Table of Contents
Crowdsourcing
Resources
Related Pages
Crowdsourcing
Resources
Tutorials
NAACL 2021 Tutorial - Crowdsourcing Natural Language Data at Scale: A Hands-On Tutorial
video
Great tutorial
EMNLP 2021 tutorial:
slides
LLM Labeling w/ Human in the Loop tutorial proposal:
2024 - Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop
Platforms
Amazon Mechanical Turk
Appen
(was called Crowdflower, then Figure-Eight, then aquired by Appen)
Toloka
Has a $500 academic
grant program
Related Pages
Dataset Creation
Gamification
LLM-Based Data Generation