Neural Nets for NLP 2020 - Neural Nets + Knowledge Bases

Neural Nets for NLP 2020 - Neural Nets + Knowledge Bases

Graham Neubig via YouTube Direct link

Knowledge Base Incompleteness

6 of 13

6 of 13

Knowledge Base Incompleteness

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Neural Nets for NLP 2020 - Neural Nets + Knowledge Bases

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Knowledge Bases . Structured databases of knowledge usually containing
  3. 3 WordNet (Miller 1995)
  4. 4 Decomposable Relation Model (Xie et al. 2017) • Idea: There are many relations, but each can be represented by a limited number of concepts • Method: Treat each relation map as a mixture of concepts,…
  5. 5 Multi-hop Relational Context w/ Graph Neural Networks (Schlichtbruil et al., 2017)
  6. 6 Knowledge Base Incompleteness
  7. 7 Relation Extraction w/ Neural Tensor Networks (Socher et al. 2013)
  8. 8 Distant Supervision for Relation Extraction (Mintz et al. 2009)
  9. 9 Relation Classification w/ CNNS (Zeng et al. 2014)
  10. 10 Jointly Modeling KB Relations and Text (Toutanova et al. 2015) To model textual links between words w neural net: aggregate over multiple instances of links independency tree
  11. 11 Modeling Distant Supervision Noise in Neural Models (Luo et al. 2017) • Idea: there is noise in distant Supervision labels, so we want to model it
  12. 12 Retrofitting of Embeddings to Existing Lexicons (Faruqui et al. 2015)
  13. 13 Reasoning over Text Corpus as a Knowledge Base (Dhingra et al. 2020)

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.