Quantization Courses and Certifications

MIT HAN Lab

Quantization for Efficient Machine Learning - Part I - Lecture 5

Explore quantization techniques for efficient machine learning, covering fundamental concepts and practical applications in neural network optimization.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

MIT HAN Lab

EfficientML.ai - Quantization Part I - Lecture 5

Explore quantization techniques for efficient machine learning, focusing on part I of the topic in this MIT lecture by Prof. Song Han.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

MIT HAN Lab

Quantization in Neural Networks - Lecture 5

Explore neural network quantization, including numeric data types, K-means-based quantization, and linear quantization for efficient deep learning on resource-constrained devices.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Oxen

Understanding 1-Bit Large Language Models - From Theory to Implementation

Dive into the revolutionary concept of 1-bit Large Language Models, exploring how weights can be represented with simple integers (0, 1, -1) instead of complex floating-point numbers.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Unlocking Local LLMs with Quantization

Discover how quantization optimizes LLMs for local deployment, from pre-training techniques to fine-tuning methods and inference optimization using cutting-edge approaches and community tools.

• YouTube
• 40 minutes
• On-Demand
• Free Video

AI Bites

Simple Quantization of LLMs - A Hands-on Guide to Absolute Max and Zero Point Methods

Master practical LLM quantization techniques through hands-on implementation of Absolute Max and Zero Point methods, building foundational skills for advanced approaches like GPTQ and AWQ.

• YouTube
• 15 minutes
• On-Demand
• Free Video

AI Bites

Quantization in Deep Learning: Types, Algorithms, and Implementation

Explore quantization techniques in deep learning, from uniform to non-uniform approaches, and learn practical implementation strategies for optimizing large-scale neural networks.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Discover AI

AI Phone: From Voice Assistants to Advanced AI Integration and Reasoning

Explore the revolutionary concept of AI Phone technology, from LLM quantization to advanced reasoning systems, and discover how AI-centric devices could transform mobile computing and human interaction.

• YouTube
• 17 minutes
• On-Demand
• Free Video

UofU Data Science

Faster and Cheaper LLMs with Weight and Key-value Cache Quantization

Explore advanced techniques for optimizing Large Language Models through weight and key-value cache quantization methods to improve speed and reduce computational costs.

• YouTube
• 55 minutes
• On-Demand
• Free Video

M-Seminar, Kansas State University

Koszul Duality on Quantizations of Bionic Symplectic Varieties

Explore Koszul duality in quantizations of bionic symplectic varieties, focusing on localization theorems, DQ-modules, and geometric category O. Gain insights into recent advancements in filtered Koszul duality.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Trelis Research

How to Quantize a Large Language Model with GGUF or AWQ

Learn to quantize large language models using GGUF and AWQ. Explore techniques, compare methods, and gain practical skills for efficient model compression and deployment.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Venelin Valkov

Quantizing LLMs and Converting to GGUF Format for Faster and Smaller Models

Master the process of LLM quantization and GGUF conversion, optimizing model performance through llama.cpp and Ollama while maintaining accuracy for efficient deployment on resource-limited devices.

• YouTube
• 14 minutes
• On-Demand
• Free Video

EDGE AI FOUNDATION

Quantization Techniques for Efficient Large Language Model Inference

Discover advanced quantization methods for optimizing large language model performance on edge devices, focusing on reducing computational costs and memory requirements while maintaining efficiency.

• YouTube
• 27 minutes
• On-Demand
• Free Video

EDGE AI FOUNDATION

Advances in Quantization for Efficient On-Device Neural Network Inference

Discover advances in neural network quantization techniques for efficient edge device deployment, focusing on FP8/INT8 formats, training challenges, and optimizing transformers for mobile use.

• YouTube
• 18 minutes
• On-Demand
• Free Video

Stanford Seminar - Neural Networks on Chip Design from the User Perspective

We will briefly review our past effort on Deep learning Processing Unit (DPU) design on FPGA in Tsinghua and Deephi, and then talk about some features, i.e. interrupt and virtualization, we are trying to introduce into the accelerators from the user's pe…

• YouTube
• 58 minutes
• On-Demand
• Free Online Course