Table of Contents
Supertasks
Papers
Blogs, etc
Related Pages
Supertasks
I believe Richard Socher may have introduced this terminology, see this
tweet
and these
slides
.
Papers
Radford et al 2018 - Language Models are Unsupervised Multitask Learners
McCann et al 2018 - The Natural Language Decathlon: Multitask Learning as Question Answering
(
slides
, talks about supertasks)
Blogs, etc
Richard Socher's
tweet
regarding GPT-3: “There are 3 equivalent super tasks of NLP: Language models, dialogue systems and question answering. LMs have the most training data→win.”
Related Pages
Dialog
Language Model
Question Answering