Explore CPU-based inference using a 4-bit quantized Phi 3 4K Instruct model in ONNX format with C# in this 24-minute video tutorial. Learn how to implement and optimize large language model operations (LLMOPs) for data science and machine learning applications. Gain hands-on experience with the provided code repository, which demonstrates practical implementation techniques for efficient inference on CPU hardware. Discover the potential of leveraging quantized models to enhance performance and reduce computational requirements in natural language processing tasks.
LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#
The Machine Learning Engineer via YouTube
Overview
Syllabus
LLMOPs: Inference in CPU Phi3 4k Intruct ONNX 4bits in C# #datascience #machinelearning
Taught by
The Machine Learning Engineer
Related Courses
-
LLMOPs: Multimodal Prompting and Inference with Phi-3 Vision 128K Instruct on CPU - ONNX 4-Bit Quantization in C#
-
LLMOPs - Inferencia en CPU con Phi3 4k Instruct ONNX 4bits en C#
-
LLMOPs: Inferencia en CPU con Phi3 Vision 128k Instruct - ONNX 4bits en C#
-
Microsoft AI: Semantic Kernel C# SDK Chatting with Phi3 4k ONNX CPU - Machine Learning and Data Science
-
LLMOps: Quantization Models and Inference with ONNX Generative Runtime
-
LLMOps: Converting Video Classifier (ViViT) to ONNX and Inference on CPU
