Graph Neural Networks

Best overview: Wu et al 2021 - Graph Neural Networks for Natural Language Processing: A Survey

• General surveys (not just NLP):
  • Wu et al 2019 - A Comprehensive Survey on Graph Neural Networks
  • Liu & Zhou 2020 - Introduction to Graph Neural Networks
  • Wu et al 2020 - A Comprehensive Survey on Graph Neural Networks
  • Graph Neural Networks: A Review of Methods and Applications
• NLP Surveys:
  • Wu et al 2021 - Graph Neural Networks for Natural Language Processing: A Survey
  • Yuan et al 2020 - Explainability in Graph Neural Networks: A Taxonomic Survey
  • Nice overview in related work here: Lin 2021

See also Graph4NLP Bibliography.

• Graph Convolution Networks (GCN)
• Gating GCN
• Graph Attention Networks
  • Velickovi et al 2017 - Graph Attention Networks
• Graph2Seq
  • Xu et al 2018 - Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks
• Applications
  • See also Knowledge-Enhanced Methods.
  • Li et al 2020 - Graph-to-Tree Neural Networks for Learning Structured Input-Output Translation with Applications to Semantic Parsing and Math Word Problem (Graph to tree neural network)
  • Bastings et al 2017 - Graph Convolutional Encoders for Syntax-aware Neural Machine Translation
  • Bogin et al 2019 - Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsing
  • Bogin et al 2019 - Global Reasoning over Database Structures for Text-to-SQL Parsing
  • Zhong et al 2020 - LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network
  • Cao et al 2018 - Question Answering by Reasoning Across Documents with Graph Convolutional Networks
  • Tu et al 2019 - Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs]
  • Chen et al 2019 - GraphFlow: Exploiting Conversation Flow with Graph Neural Networks for Conversational Machine Comprehension
  • Lin et al 2021 - BertGCN: Transductive Text Classification by Combining GCN and BERT
• Graph Language Models
  • 2024 - Graph Language Models

• Graph4NLP (uses DGL as the runtime library)
• DGL - Deep Graph Library
• PyTorch Geometric (not as actively maintained as DGL)

• Deep Learning on Graphs for Natural Language Processing @ NAACL 2021

• Ivan Titov
• Lingfei Wu

• Knowledge-Enhanced Methods
• Neural Network Architectures