nlp:post-training
This is an old revision of the document!
Table of Contents
Post-Training
Post-training refers to the things done to a LLM after pre-training to improve its performance, such as supervised fine-tuning, RLHF, instruction tuning, etc. This is a critical step before releasing the LLM. Typically, this refers to things done by the company or group before releasing the LLM, not the things done afterwards to customize to a specific application. (For an example of this usage, see the GPT-4 technical report.)
Overviews
Sub-Areas
nlp/post-training.1746093009.txt.gz · Last modified: 2025/05/01 09:50 by jmflanig