Explore the development of DDSP-VST, a cross-platform audio plugin for real-time neural audio synthesis, in this conference talk from ADCx SF. Dive into the technical and UX challenges of building an audio plugin powered by machine learning, making it accessible to musicians and artists. Learn about the combination of classical DSP elements with deep learning expressivity, enabling audio signal transformation into various musical instruments. Gain insights into the extraction of pitch and loudness features for synthesis, and discover the potential next steps for this innovative technology. Engage with the speakers' expertise in real-time systems, signal processing, musical interfaces, and the intersection of multimodal generative AI with creativity.
DDSP-VST: Neural Synthesis for Real-Time Audio Processing - ADCx SF
ADC - Audio Developer Conference via YouTube
Overview
Syllabus
Introduction
DDSP
Realtime
Usability
UX
Next Steps
Questions
Taught by
ADC - Audio Developer Conference