• Introductions
  • S&LP - Ch 22
• PDTB
  • Prasad et al 2014 - Reflections on the Penn Discourse TreeBank, Comparable Corpora, and Complementary Annotation

• Marcu & Echihabi 2002 - An Unsupervised Approach to Recognizing Discourse Relations The first discourse parser
• Li et al 2014 - Recursive Deep Models for Discourse Parsing
• Afantenos et al 2015 - Discourse parsing for multi-party chat dialogues
• Xue et al 2015 - The CoNLL-2015 Shared Task on Shallow Discourse Parsing
• Perret et al 2016 - Integer Linear Programming for Discourse Parsing Good intro to discourse parsing
• Braud et al 2017 - Cross-lingual RST Discourse Parsing
• Stab & Gurevych 2017 - Parsing Argumentation Structures in Persuasive Essays (Contains an overview of related work in discourse parsing in sec 2.5). Another version here: here.
• Morey et al 2018 - A Dependency Perspective on RST Discourse Parsing and Evaluation
• Lin et al 2019 - A Unified Linear-Time Framework for Sentence-Level Discourse Parsing

• Moore & Paris 1993 - Planning Text for Advisory Dialogues: Capturing Intentional and Rhetorical Information Old paper, but very good. Talks about how one could use RST in a dialog system planner. Contains a mapping between desired belief states in the listener and RST relations (in table 1, p. 20).
• Stent 2000 - Rhetorical Structure in Dialog
• Ma et al 2019 - Implicit Discourse Relation Identification for Open-domain Dialogue
  • https://github.com/derekmma/dialogue-discourse-relation (annotated corpus)
  • https://github.com/jfainberg/self_dialogue_corpus (full corpus) (paper)

• Linguistics theory, see also Wikipedia - Rhetorical Structure Theory
  • Mann & Thompson 1987 - Rhetorical Structure Theory: A Theory of Text Organization
  • Mann & Thompson 1988 - Rhetorical Structure Theory: Toward a functional theory of text organization The paper that is usually cited for introducing RST

• Dataset
  • Paper: Carlson et al 2001 - Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory Created the RST Discourse Tree Bank. Annotated full RST discourse structures.
  • LDC: RST Discourse Treebank
  • Website: https://www.isi.edu/~marcu/discourse/Corpora.html
  • Guideline: RST Annotation Guideline and another guideline
  • RST Website
  • Annotation tool: rstWeb Web-based annotation tool
• Systems
  • Perret et al 2016 - Integer Linear Programming for Discourse Parsing Good intro to discourse parsing
  • Morey et al 2017 - How much progress have we made on RST discourse parsing? A replication study of recent results on the RST-DT
  • Lin et al 2019 - A Unified Linear-Time Framework for Sentence-Level Discourse Parsing github

• STAC Corpus
• SFU Review Corpus

See also PDTB Publications. PDTB is a shallow discourse representation, as opposed to RST-DT. According to Perret 2016 “the PDTB does not provide full discourse structures for texts,” but the RST-DT does.

• Dataset
  • Miltsakaki et al 2004 - The Penn Discourse Treebank
  • Webber et al 2005- A Short Introduction to the Penn Discourse TreeBank
  • Prasad et al 2008 - The Penn Discourse TreeBank 2.0
  • Prasad et al 2014 - Reflections on the Penn Discourse TreeBank, Comparable Corpora, and Complementary Annotation 30 pages, very good
  • 2019 - PDTB 3.0 Introduction
  • Webber et al 2019 - The Penn Discourse Treebank 3.0 Annotation Manual
• Systems
  • Lin et al 2009 - Recognizing Implicit Discourse Relations in the Penn Discourse Treebank
  • Lin et al 2010 - A PDTB-Styled End-to-End Discourse Parser
  • Lin et al 2012 - A PDTB-Styled End-to-End Discourse Parser (parser) The parser that Stab & Gurevych 2017 used.
  • Biran & McKeown 2015 - PDTB Discourse Parsing as a Tagging Task: The Two Taggers Approach
• Extensions
  • Liang et al 2020 - Extending Implicit Discourse Relation Recognition to the PDTB-3

PDTB sense hierarchy from Prasad 2014. There are three levels - most systems do level 2 senses but not the finer-grained level 3 senses.

• ISO 24617-2 (preview)
  • Paper: Bunt et al 2012 - ISO 24617-2: A Semantically-based Standard for Dialogue Annotation
  • Bunt 2011 - Guidelines for using ISO standard 24617-2
  • DialogBank: Bunt et al 2016 - The DialogBank

• Marcu & Echihabi 2002 - An Unsupervised Approach to Recognizing Discourse Relations The first discourse parser
• Nishida & Nakayama - Unsupervised discourse constituency parsing using Viterbi EM Rivals supervised methods. Doesn't seem to cite Marcu & Echihabi 2002!

• Mesgar & Strube 2016 - Lexical Coherence Graph Modeling Using Word Embeddings Uses a readability ranking task.
• Lai & Tetreault 2018 - Discourse Coherence in the Wild: A Dataset, Evaluation and Methods Introduces the Grammarly Corpus of Discourse Coherence of 1,000 documents with human evaluation of coherence (at the document-level).

• Gandhe & Traum 2008 - An Evaluation Understudy for Dialogue Coherence Models Evaluates measures of dialog coherence against human judgements.
• Cervone & Riccardi 2020 - Is this Dialogue Coherent? Learning from Dialogue Acts and Entities. Introduces the Switchboard Coherence (SWBD-Coh) corpus (dataset), a dataset of human-human spoken dialogues from the Switchboard corpus annotated with human coherence ratings for each turn.

• Textual cohesion (linguistics topic). There are metrics for this (ask Pranav about this)
• Centering theory. See this paper.

• Summarization
  • Chen & Yang 2021 - Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs

• Dialog
• Topic Detection