Language Models are Unsupervised Multitask Learners
Language Models are Unsupervised Multitask Learners
Code:
https://github.com/openai/gpt-2
Open-source clone of the dataset:
OpenWebText
(from
https://github.com/NVIDIA/Megatron-LM
)