Building a Knowledge Graph with Spark and NLP for Novel Drug Recommendations

Building a Knowledge Graph with Spark and NLP for Novel Drug Recommendations

Databricks via YouTube Direct link

5R has had a significant impact in improving our efficiency

4 of 28

4 of 28

5R has had a significant impact in improving our efficiency

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Building a Knowledge Graph with Spark and NLP for Novel Drug Recommendations

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 Drug discovery is hard
  3. 3 AstraZeneca introduced the "5R" framework
  4. 4 5R has had a significant impact in improving our efficiency
  5. 5 We are investing in new sources of data and faster validation
  6. 6 We need tools to make sense of data & make better and faster decisions
  7. 7 Finding a drug target can be formulated as a hybrid recommendation problem • Scientists need to parse large amount of information and make a ranking prediction • Different formats, data models, locat…
  8. 8 Multiple objective optimization
  9. 9 Traditional recsys approaches
  10. 10 We assemble a large scale knowledge graph from public and AZ internal data
  11. 11 KG pipeline on
  12. 12 Pipeline - series of notebooks
  13. 13 Pipeline stages
  14. 14 Node dictionary
  15. 15 Mappings table
  16. 16 Edge assertions
  17. 17 Keep evidence & context for each assertion
  18. 18 Focus on NLP
  19. 19 Use natural language processing to extract precise information at scale
  20. 20 NLP Termite on Spark
  21. 21 Syntax parsing increases precision of entity recognition
  22. 22 Relationship from literatures reduce sparsity of biological KG
  23. 23 Language models lead to improvements in recall and precision
  24. 24 Learned sentence representation can be used for downstream tasks
  25. 25 Graph embedding pipeline
  26. 26 Approximate nearest neighbor search
  27. 27 Lessons learned
  28. 28 Acknowledgements

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.