Learn how to quantize the Microsoft Phi3 model using LLaMA.cpp in this 23-minute tutorial video. Explore the process of transforming the model into various formats including bf16, fp16, and q8_0. Follow along with practical demonstrations and access the accompanying notebooks on GitHub to enhance your understanding of model quantization techniques in machine learning and data science.
MLOPS LLMs: Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp
The Machine Learning Engineer via YouTube
Overview
Syllabus
MLOPS LLM,s: Convert Microsoft Phi3 to GGUF format with LLaMA.cpp #machinelearning #datascience
Taught by
The Machine Learning Engineer
Related Courses
-
MLOPS LLMs - Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp
-
MLOps: Logging and Loading Microsoft Phi3 Mini 128k in GGUF with MLflow
-
MLOps with MLFlow: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats
-
MLOps: Saving and Loading Microsoft Phi3 Mini 128k in GGUF Format with MLflow
-
MLOps: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats
-
Quantizing LLMs and Converting to GGUF Format for Faster and Smaller Models
