On-Device Generative AI: Deployment, Optimization, and Advanced Techniques

Watch a 25-minute technical presentation exploring the deployment of Generative AI on edge devices, delivered by Qualcomm Technologies' Senior Director Fatih PORIKLI. Dive into the transformative capabilities of Generative AI in creating diverse content forms and its impact across industries. Learn about crucial aspects of on-device AI deployment, including full-stack optimizations, advanced techniques like distillation and quantization, and practical implementations of various AI models such as LVMs, LLMs, and LMMs. Understand how speculative decoding enhances efficiency and discover Qualcomm Technologies' approach to scaling on-device generative AI solutions. Gain insights into why on-device processing becomes increasingly critical as computational demands grow with the rapid adoption of generative AI technologies.