NLP Wiki

User Tools

Site Tools

Trace: • language_model • retrieval-augmented_methods • distributed_training • experimental_method • quantifiers • gpu_deep_learning • state-space_models • curriculum_learning
ml:knowledge_distillation

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
ml:knowledge_distillation [2023/06/15 07:36] – external edit 127.0.0.1ml:knowledge_distillation [2025/05/12 08:11] (current) – [Overviews] jmflanig
Line 4: Line 4:
 ===== Overviews ===== ===== Overviews =====
   * Section 4.2.2 of [[https://arxiv.org/pdf/2006.11316.pdf|Iandola 2020]]   * Section 4.2.2 of [[https://arxiv.org/pdf/2006.11316.pdf|Iandola 2020]]
 +  * [[https://arxiv.org/pdf/2402.13116|Xu et al 2024 - A Survey on Knowledge Distillation of Large Language Models]]
  
 ===== Papers ===== ===== Papers =====
ml/knowledge_distillation.1686814574.txt.gz · Last modified: 2023/06/15 07:36 by 127.0.0.1
Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki