VMware Private AI Foundation with NVIDIA - Technical Overview and Demo

Watch a technical presentation that explores VMware Private AI Foundation with NVIDIA's evolution from preview to general availability, featuring a comprehensive demonstration of its capabilities. Dive into the architectural updates, including the implementation of NVIDIA Inference Microservice (NIM) and Retriever microservice for enhanced Retrieval Augmented Generation (RAG) functionality. Learn how the platform integrates private company data with large language models (LLMs) through vector databases, effectively addressing challenges like hallucinations and citation requirements. Explore how VMware Cloud Foundation (VCF) streamlines infrastructure management for data scientists, enabling rapid deployment of AI workstations and Kubernetes clusters with pre-configured environments. Understand the governance and lifecycle management features that ensure version control and compatibility across environments, while discovering how the platform handles automated scaling and regular stack updates. Follow along with a practical demonstration showcasing the day-to-day workflow of a GenAI Application Developer, from provisioning vector databases to deploying LLMs, all within a virtualized environment designed to maximize efficiency and minimize setup time.