Using Intel AMX CPUs for AI and LLMs on VMware vSphere

Watch a technical presentation from AI Field Day 4 exploring how to deploy AI models using existing data center infrastructure without GPUs. Learn about VMware Private AI with Intel, a collaboration enabling enterprises to build and deploy secure AI models on VMware Cloud Foundation while leveraging Intel's AI software suite and 4th Generation Intel® Xeon® Scalable Processors. Discover how Intel's Advanced Matrix Extensions (AMX) CPUs integrated into Sapphire Rapids and Emerald Rapids servers accelerate AI/ML workloads in virtualized environments. Explore the performance comparisons between AMX-enabled CPUs and older processors for running Large Language Models, along with practical guidance on choosing between CPU and GPU implementations based on performance needs, cost considerations, and power consumption requirements. Gain insights into the benefits of Private AI, including data privacy, intellectual property protection, and seamless integration with existing vSphere security tools.