Differences

This shows you the differences between two versions of the page.

--- ml:software [2025/03/14 01:29] – [Current, Recommended Ones] jmflanig
+++ ml:software [2025/10/09 17:40] (current) – [Current, Recommended Frameworks] jmflanig
@@ Line 4: / Line 4: @@
 ===== Deep Learning =====
-==== Current, Recommended Ones ====
+==== Current, Recommended Frameworks ====
   * **Pytorch**
     * Huggingface
-    * [[https://unsloth.ai/|Unsloth]] [[https://github.com/unslothai/unsloth|github]] Incredibly fast. As of March 2025, this is the fastest single GPU framework for LLMs
+    * LLMs
-    * Multi-GPU training
+      * [[https://unsloth.ai/|Unsloth]] [[https://github.com/unslothai/unsloth|github]] Incredibly fast. As of March 2025, this is the fastest single GPU framework for LLMs
+      * [[https://github.com/ggml-org/llama.cpp|llama.cpp]]
+      * LLVM
+    * **Multi-GPU training**
+      * Note: recommendations can change frequently (every few months it seems)
       * As of March 2025: Nilay recommends DeepSpeed, which is integrated with HuggingFace Accelerate.  See here: [[https://huggingface.co/docs/accelerate/en/usage_guides/deepspeed|HuggingFace Accelerate - DeepSpeed]]