MIT HAN Lab Courses

Long-Context Large Language Models - Lecture 15

Dive into advanced techniques for handling long-context scenarios in Large Language Models, exploring efficient methods and architectural innovations for extended sequence processing.

• YouTube
• 1 hour 14 minutes
• On-Demand
• Free Video

Long-Context Large Language Models - Lecture 15

Dive into advanced techniques for handling extended context in Large Language Models, exploring efficiency strategies and implementation methods for enhanced AI processing capabilities.

• YouTube
• 1 hour 14 minutes
• On-Demand
• Free Video

Neural Architecture Search (Part II) - Lecture 8

Explore neural architecture search techniques, including hardware-aware approaches and joint optimization of hardware and neural architectures. Learn applications and advancements in efficient deep learning design.

• YouTube
• 1 hour 13 minutes
• On-Demand
• Free Video

Quantization in Neural Networks - Part II - Lecture 6

Explore advanced neural network quantization techniques, including post-training quantization, quantization-aware training, binary/ternary quantization, and mixed-precision quantization.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

Quantization in Neural Networks - Lecture 5

Explore neural network quantization, including numeric data types, K-means-based quantization, and linear quantization for efficient deep learning on resource-constrained devices.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Pruning and Sparsity in Neural Networks - Lecture 4

Explore neural network pruning techniques, including sensitivity scans, automatic pruning, and the lottery ticket hypothesis. Learn to fine-tune sparse networks and understand system support for sparsity.

• YouTube
• 1 hour 8 minutes
• On-Demand
• Free Video

Neural Architecture Search for Efficient Deep Learning - Lecture 9

Explore advanced neural architecture search techniques for efficient deep learning on resource-constrained devices. Gain insights into model optimization for mobile and IoT applications.

• YouTube
• 1 hour 7 minutes
• On-Demand
• Free Video

Neural Architecture Search (Part II) - Lecture 8

Explore neural architecture search techniques, including hardware-aware approaches and joint optimization of hardware and neural architectures. Learn applications and advancements in efficient deep learning design.

• YouTube
• 1 hour 13 minutes
• On-Demand
• Free Video

Atomique: A Quantum Compiler for Reconfigurable Neutral Atom Arrays

Explore Atomique, a novel quantum compiler for reconfigurable neutral atom arrays, enhancing scalability and efficiency in quantum computing through strategic atom movements and optimized gate scheduling.

• YouTube
• 12 minutes
• On-Demand
• Free Video

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Explore activation-aware weight quantization for compressing and accelerating large language models. Learn about AWQ's innovative approach to LLM optimization.

• YouTube
• 19 minutes
• On-Demand
• Free Video

TorchSparse++ - Efficient Training and Inference Framework for Sparse Convolution on GPUs

Explore efficient GPU-based sparse convolution with TorchSparse++, an advanced framework for training and inference in deep learning applications.

• YouTube
• 15 minutes
• On-Demand
• Free Video

StreamingLLM: Deploying Language Models for Streaming Applications with Long Text Sequences

Explore innovative techniques for deploying LLMs in streaming applications, focusing on the "attention sink" phenomenon and efficient KV cache management.

• YouTube
• 14 minutes
• On-Demand
• Free Video

TinyML and Efficient Deep Learning Computing - Lecture 24: Course Summary

Explore efficient machine learning techniques for deploying neural networks on resource-constrained devices. Gain hands-on experience with mobile AI and quantum machine learning.

• YouTube
• 13 minutes
• On-Demand
• Free Video

TinyML and Efficient Deep Learning Computing - Course Summary

Explore efficient machine learning techniques for deploying neural networks on resource-constrained devices, covering model compression, pruning, quantization, and more.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Knowledge Distillation in Efficient Machine Learning - Lecture 9

Explore knowledge distillation techniques for efficient machine learning, covering theory, applications, and practical implementation strategies.

• YouTube
• 59 minutes
• On-Demand
• Free Video