Differences

This shows you the differences between two versions of the page.

--- ml:software [2022/08/01 01:28] – [Related Pages] jmflanig
+++ ml:software [2025/10/09 17:40] (current) – [Current, Recommended Frameworks] jmflanig
@@ Line 3: / Line 3: @@
 ===== Deep Learning =====
-  * Huggingface (pytorch)
+==== Current, Recommended Frameworks ====
+  * **Pytorch**
+    * Huggingface
+    * LLMs
+      * [[https://unsloth.ai/|Unsloth]] [[https://github.com/unslothai/unsloth|github]] Incredibly fast. As of March 2025, this is the fastest single GPU framework for LLMs
+      * [[https://github.com/ggml-org/llama.cpp|llama.cpp]]
+      * LLVM
+    * **Multi-GPU training**
+      * Note: recommendations can change frequently (every few months it seems)
+      * As of March 2025: Nilay recommends DeepSpeed, which is integrated with HuggingFace Accelerate.  See here: [[https://huggingface.co/docs/accelerate/en/usage_guides/deepspeed|HuggingFace Accelerate - DeepSpeed]]
+==== Miscellaneous, Perhaps Less Used, or Older Ones ====
   * Fairseq (pytorch)
     * Tutorial on how to add a new model to fairseq: [[https://fairseq.readthedocs.io/en/latest/tutorial_simple_lstm.html|Tutorial: Simple LSTM]] Nilay used this tutorial when adding his model to fairseq
@@ Line 37: / Line 49: @@
   * [[Hugging Face]]
   * [[nlp:Transformers#Software|Transformers - Software]]
-  * [[nlp:Software|NLP - Software]]
+  * **[[nlp:Software|NLP - Software]]**
   * [[PyTorch]]
   * [[Tensorflow]]