Learn how to log and load a quantized LLama.cpp model in MLflow through this 18-minute tutorial video. Create a Python class, log it in MLflow, and load it for inference using a Microsoft Phi3 mini 128k model quantized with llama.cpp into int8. Follow along with the provided notebook to gain hands-on experience in implementing MLOps practices for machine learning and data science projects.
MLOps: Logging and Loading Microsoft Phi3 Mini 128k in GGUF with MLflow
The Machine Learning Engineer via YouTube
Overview
Syllabus
MLOPS MLFlow :Log and Load in MLflow Microsoft Phi3 mini 128k in GGUF #machinelearning #datascience
Taught by
The Machine Learning Engineer
Related Courses
-
MLOps: Saving and Loading Microsoft Phi3 Mini 128k in GGUF Format with MLflow
-
MLOps with MLFlow: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats
-
MLOps: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats
-
MLOPS LLMs: Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp
-
MLOPS LLMs - Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp
-
Serving LLMs with MLflow - Phi-3-mini-4k-instruct Model
