Run GenAI Projects at Scale Securely: From the Operating System to the MLOps Platform

Explore a comprehensive overview of securing GenAI projects at scale in this 21-minute conference talk by Michelle Tabirao from Canonical, presented at OpenSSF. Delve into the challenges and opportunities of implementing generative AI initiatives, focusing on the critical aspects of data security and infrastructure protection. Learn about the importance of safeguarding the entire technology stack, from operating systems to MLOps platforms, in both data centers and edge devices. Discover key security considerations, best practices, and strategies for highly regulated industries adopting GenAI. Gain insights into leveraging open-source tools for scalability and portability while maintaining robust security measures throughout the AI development and deployment lifecycle.