PyTorch and the Journey in Open Source - Keynote by Soumith Chintala

Overview

Dive into a keynote address from JuliaCon 2021 featuring Soumith Chintala, co-creator of PyTorch and researcher at Facebook AI Research. Explore the journey of PyTorch, from its inception to its current status as a leading deep learning framework. Gain insights into the implementation, principles, and ecosystem of PyTorch, as well as its community and funding structure. Learn about the philosophy behind this open-source project, its user and technology-centric approach, and the challenges faced during the migration from Torch to PyTorch. Discover how PyTorch interacts with other communities, manages scope and risk, and approaches measurement and scaling. The talk concludes with a Q&A session addressing the future of TorchScript and potential front-end languages for PyTorch beyond Python.

Syllabus

Welcome!.
Introduction by the speaker.
What is PyTorch?.
Implementation of PyTorch.
Example: neural network in PyTorch.
General principles of PyTorch.
PyTorch team needs to collaborate with others.
PyTorch ecosystem.
State of PyTorch in the year 2020.
Community and funding of PyTorch.
PyTorch ecosystem.
The journey of PyTorch.
Where we come from?.
Philosophy/principles of the open-source project.
User and technology-centric projects.
Migrating from Torch to PyTorch.
Interactions with other communities.
Scope & risk.
Measurement/metric.
Scaling.
Vertical and horizontal integration.
Q&A: Do you see TorchScript becoming an independent programming language?.
Q&A: Do you imagine PyTorch first-class front-end for languages other than Python?.