Quantization Courses and Certifications

Quantization Fundamentals with Hugging Face

Learn to compress and optimize generative AI models through quantization techniques, making them more efficient and accessible for various devices while minimizing performance loss.

• Coursera
• 1 hour 30 minutes
• On-Demand
• Paid Course

Quantization in Depth

Build and customize linear quantization methods to compress model weights, balance performance and space tradeoffs, and implement techniques for 8-bit and 2-bit quantization in PyTorch.

• Coursera
• 1 hour 30 minutes
• On-Demand
• Paid Course

Nvidia

Inference and Quantization for AI - Session 3

Explore quantized inference, TensorRT 5, and TensorFlow integration for AI model optimization. Learn about NVIDIA's inference server and techniques to improve model efficiency and performance.

• YouTube
• 41 minutes
• On-Demand
• Free Video

TensorFlow

TensorFlow Model Optimization - Quantization and Pruning

Explore TensorFlow model optimization techniques like quantization and pruning to enhance performance, reduce resource usage, and improve efficiency in machine learning applications.

• YouTube
• 41 minutes
• On-Demand
• Free Video

tinyML

Extremely Low-Bit Quantization for Transformers - tinyML Asia 2021

Explore extremely low-bit quantization techniques for Transformers, focusing on mixed precision strategies to optimize deployment on resource-limited devices without compromising accuracy.

• YouTube
• 28 minutes
• On-Demand
• Free Video

tinyML

MicroTVM: A Tensor Compiler for Bare Metal

Explore microTVM, a tensor compiler for bare metal devices, its functionality, and future directions. Learn about deployment challenges and see a demonstration of the technology.

• YouTube
• 58 minutes
• On-Demand
• Free Video

Hausdorff Center for Mathematics

Helmut Bölcskei - Lossy Compression on General Data Structures

Explore lossy compression for data on manifolds and fractals, with bounds on rate-distortion function and quantization error. Applications in data science and image processing.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Unlocking Local LLMs with Quantization

Discover how quantization optimizes LLMs for local deployment, from pre-training techniques to fine-tuning methods and inference optimization using cutting-edge approaches and community tools.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Trelis Research

How to Quantize a Large Language Model with GGUF or AWQ

Learn to quantize large language models using GGUF and AWQ. Explore techniques, compare methods, and gain practical skills for efficient model compression and deployment.

• YouTube
• 26 minutes
• On-Demand
• Free Video

USENIX

Quant-LLM: Accelerating Large Language Model Serving via FP6-Centric Algorithm-System Co-Design

Innovative GPU kernel design enables efficient 6-bit quantization for large language models, significantly improving inference speed while maintaining quality across various applications.

• YouTube
• 19 minutes
• On-Demand
• Free Video

M-Seminar, Kansas State University

Koszul Duality on Quantizations of Bionic Symplectic Varieties

Explore Koszul duality in quantizations of bionic symplectic varieties, focusing on localization theorems, DQ-modules, and geometric category O. Gain insights into recent advancements in filtered Koszul duality.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

MIT HAN Lab

Quantization in Neural Networks - Lecture 5

Explore neural network quantization, including numeric data types, K-means-based quantization, and linear quantization for efficient deep learning on resource-constrained devices.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

MIT HAN Lab

EfficientML.ai: Quantization Part II - Lecture 6

Explore advanced quantization techniques for efficient machine learning, covering post-training and quantization-aware training methods to optimize model performance.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

MIT HAN Lab

Quantization for Efficient Machine Learning - Part II

Explore advanced quantization techniques for efficient machine learning, including post-training and quantization-aware training methods.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

MIT HAN Lab

EfficientML.ai: Quantization Part II - Lecture 6

Explore advanced quantization techniques for efficient machine learning, including Rooney quantization, scaling factors, and fine-tuning strategies.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video