The Design of Functional Numerical Software - Dr. Richard Mortier, University of Cambridge
Alan Turing Institute via YouTube
Overview
Syllabus
Intro
Why, What, When, Where?
Motivating Application: Databox
Owl's Architecture
Indexing & Slicing
Core Functor Stack
Advanced Uses of Algorithmic Differentiation
Laziness & Dataflow
Incremental Computation
GPGPU Programming
Expressiveness
Google Inception v3 in 150 LOC
Actor, Parallel and Distributed Processing
Owl & Actor: Neural Network Example
Actor & the Synchronous Parallel Machine
Barrier Synchronisation
Three Main Schemes: A 10,000 Foot View
Simple Analytical Model
Decomposing Synchronous Parallel Machine
Key Insights from System Decomposition
Probabilistic Synchronous Parallel
Sampling Primitive
Adding the Completeness Dimension
Reducing Sample Size
Revisit System Decomposition
Comparing Synchronisation Methods
Step Distribution
Effect of Sample Size
Tightening Bounds
Scalability
Ongoing: Integration with App Development Kit
Taught by
Alan Turing Institute