Overview
Syllabus
Intro
A modern autocomplete
Google Sheets
The naturalness of code
The bimodality of code
Code has predictable properties
Rapid advances in ML
ML in Software Lifecycle
Autocomplete tools boost developer productivity
RNN as a language model learner
Transformers
Other architectures for code completion
A popular design today: Pretraining and Finetuning
Motivation
Recommendation 1
Problem Statement
Token Features
Parent Features
Sibling Features
Variable Usage Features
We've been writing code for 70 years, all without ML help
Why inevitable?
Open Questions
Taught by
Strange Loop Conference