Learn how to effectively manage and distribute AI models using OCI standards and Harbor in this technical conference talk from VMware by Broadcom experts. Explore standardization approaches for AI model structures through OCI specifications and discover extension mechanisms like OCI Reference for linking datasets and dependencies. Dive into solutions for handling large models, including replication strategies and proxy integration with platforms like Hugging Face. Master security best practices for model distribution, including signing, vulnerability scanning, and policy-based governance. Understand how P2P acceleration mechanisms can optimize large model loading performance and examine practical workflows for AI model training, inference, and application deployment.
Managing and Distributing AI Models Using OCI Standards and Harbor
CNCF [Cloud Native Computing Foundation] via YouTube
Overview
Syllabus
Managing and Distributing AI Models Using OCI Standards and Harbor - Steven Zou & Steven Ren
Taught by
CNCF [Cloud Native Computing Foundation]