Explore the innovative world of AI-powered audio processing in this 51-minute conference talk from the Audio Developer Conference (ADC22). Learn about Neutone, a groundbreaking real-time AI audio plugin for Digital Audio Workstations (DAWs) that bridges the gap between AI research and creative audio production. Discover how this VST/AU plugin enables music and audio creators to experiment with cutting-edge deep learning technologies without the steep learning curve of programming in Python or using dedicated GPU hardware. Gain insights into timbre transfer models, deep learning-powered effects, and the plugin's ability to run in real-time on CPU. Follow along as Andrew Fyfe and Christopher Mitcheltree demonstrate the plugin, discuss its development workflow, and explore collaboration opportunities in this exciting field of AI-driven audio processing.
Overview
Syllabus
Introduction
What is Neutone
Why build Neutone
Example
Existing workflow
Big Yuki
Plugin Overview
Demo
SDK
Development workflow
Download the plugin
Upload your model
Building a universal VST
Flow of audio
Python Deep Modeling
Collab Notebook
Examples
Collaboration opportunities
Questions
Taught by
ADC - Audio Developer Conference
Related Courses
-
Real-Time Inference of Neural Networks: A Guide for DSP Engineers
-
Deep Learning in Audio for Absolute Beginners: From No Experience to a Deployed Model
-
Deep Learning in Audio for Absolute Beginners: From No Experience to a Deployed Model
-
Leveraging Pruning and Quantization for Efficient Real-Time Audio Applications
-
Deep Learning for DSP Engineers: Challenges and Tricks for Audio AI
-
Real-Time Interactive Synthesis with Machine Learning: Differentiable DSP in a Plugin - Lecture
