User Tools

Site Tools


nlp:post-training

This is an old revision of the document!


Table of Contents

Post-Training

Post-training refers to the things done to a LLM after pre-training to improve it's performance, such as supervised fine-tuning, RLHF, instruction tuning, etc. This is a critical step before releasing the LLM. Typically, this refers to things done by the company or group before releasing the LLM. (For an example of this usage, see the GPT-4 technical report.)

Overviews

Sub-Areas

nlp/post-training.1741341202.txt.gz · Last modified: 2025/03/07 09:53 by jmflanig

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki