Differences

This shows you the differences between two versions of the page.

--- nlp:prompting_and_task_descriptions [2021/06/25 00:16] – [Prompting Language Models] jmflanig
+++ nlp:prompting_and_task_descriptions [2022/09/16 18:19] (current) – removed jmflanig
@@ Line 1: / Line 1: @@
-====== Prompting and Task Descriptions ======
-This page is about natural language task descriptions and prompting language models.  Both these methods use natural language to describe a task which is to be performed.
-===== Prompting Language Models =====
-  * Zero-shot
-    * [[https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf|Radford et al 2019 - Language Models Are Unsupervised Multitask Learners]] GPT-2
-  * Few-shot
-    * [[https://arxiv.org/pdf/2009.07118.pdf|Schick & Schütze 2020 - It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners]]
-    * **[[https://arxiv.org/pdf/2001.07676.pdf|Schick & Schütze 2021 - Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference]]** Pre-dates GTP-3
-    * [[https://arxiv.org/pdf/2005.14165.pdf|Brown et al 2021 - Language Models are Few-Shot Learners]] GPT-3
-    * [[https://arxiv.org/pdf/2012.15723.pdf|Gao et al 2021 - Making Pre-trained Language Models Better Few-shot Learners]]
-  * Soft-Prompting
-    * [[https://arxiv.org/pdf/2104.06599.pdf|Qin & Eisner 2021 - Learning How to Ask: Querying LMs with Mixtures of Soft Prompts]]
-  * More papers
-    * [[https://arxiv.org/pdf/2103.08493.pdf|Scao & Rush 2021 - How Many Data Points is a Prompt Worth?]]
-===== Natural Language Task Descriptions =====
-    * [[https://link.springer.com/content/pdf/10.1007/s10994-013-5407-y.pdf|Goldwasser & Roth 2014 - Learning From Natural Instructions]]
-    * [[https://arxiv.org/pdf/2104.08773.pdf|Mishra et al 2021 - Natural-Instructions: Benchmarking Generalization to New Tasks from Natural Language Instructions]]
-===== Talks and Lectures =====
-  * [[https://underline.io/events/122/sessions?eventSessionId=4313|Invited Talk @ NAACL 2021: Humans Learn From Task Descriptions and So Should Our Models - Hinrich Schütze]]
-===== People =====
-  * [[https://scholar.google.com/citations?user=k8CKy5UAAAAJ&hl=en|Timo Schick]]
-===== Related Pages =====
-  * [[ml:Few-Shot Learning]]
-  * [[ml:Zero-Shot Learning]]