Mastering Automotive Language Models and Edge Deployment in 2024

Learn about the transformative potential of Small Language Models (SLMs) in automotive applications through this technical talk from BOSCH experts. Explore how SLMs are revolutionizing vehicular edge systems by providing customization and performance reliability while maintaining data privacy. Gain insights into the complementary relationship between SLMs and Large Language Models (LLMs) for handling domain-specific tasks and complex cloud computations. Examine the optimization journey of the Tiny Llama 1.1 model, including its remarkable 700% throughput improvement and significant size reduction through fine-tuning. Discover practical implementations on edge devices like Pi 4B and Jetson Oren Nano, along with audio and chat functionalities that are advancing vehicular AI. Understand the future landscape of personalized vehicle interactions powered by generative AI, and how it's reshaping communication between drivers, vehicles, and their environment.