====== Crowdsourcing ======

===== Resources =====
  * Tutorials
    * [[https://aclanthology.org/2021.naacl-tutorials.6/|NAACL 2021 Tutorial - Crowdsourcing Natural Language Data at Scale: A Hands-On Tutorial]] [[https://aclanthology.org/2021.naacl-tutorials.6.mp4|video]] Great tutorial
    * EMNLP 2021 tutorial: [[https://nlp-crowdsourcing.github.io/emnlp2021-crowdsourcing-tutorial.pdf|slides]]
    * LLM Labeling w/ Human in the Loop tutorial proposal: [[https://arxiv.org/pdf/2411.04637|2024 - Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop]]
  * Platforms
    * Amazon Mechanical Turk
    * [[https://appen.com/|Appen]] (was called Crowdflower, then Figure-Eight, then aquired by Appen)
    * [[https://toloka.ai|Toloka]] Has a $500 academic [[https://toloka.ai/grants/|grant program]]

===== Related Pages =====
  * [[Dataset Creation]]
  * [[Gamification]]
  * [[nlp:data_augmentation#llm_prompt-based_data_augmentation_or_generation|LLM-Based Data Generation]]