====== TensorFlow ======

===== Debugging =====
  * Printing values (during training, etc).
    * Use tf.print(), instead of print().  See [[https://stackoverflow.com/questions/57469673/tf-print-vs-python-print-vs-tensor-eval|here]].

==== Profiling =====
  * [[https://www.tensorflow.org/guide/gpu_performance_analysis|Tensorflow - Optimize TensorFlow GPU Performance with the TensorFlow Profiler]]

===== Operations =====
  * Cumulative sum and max
    * Cumulative sum: [[https://www.tensorflow.org/api_docs/python/tf/math/cumsum|tf.math.cumsum]]
    * Cumulative max: [[https://stackoverflow.com/questions/49314186/tensorflow-how-to-implement-cumulative-maximum|Stack Overflow]] or [[https://github.com/balancap/SSD-Tensorflow/blob/master/tf_extended/math.py|tf_extended]]

===== Related Pages =====
  * [[Hugging Face]]
  * [[PyTorch]]
  * [[Software]]