Explore the technical aspects of Long-Context Large Language Models in this recorded MIT lecture from the Fall 2024 EfficientML.ai course series. Professor Song Han from MIT HAN Lab delves into the complexities and advancements of extending context windows in LLMs, providing comprehensive insights into the latest developments in this critical area of machine learning. Learn about the architectural considerations, optimization techniques, and practical implementations that enable LLMs to process and understand longer sequences of text. Access accompanying lecture slides through the EfficientML.ai platform to enhance your understanding of the concepts presented during this 74-minute technical discussion.
Overview
Syllabus
EfficientML.ai Lecture 15 - Long-Context LLM (MIT 6.5940, Fall 2024, Zoom Recording)
Taught by
MIT HAN Lab
Related Courses
-
Transformer and Large Language Models - Part II - Lecture 13
-
TinyEngine: Transformer and Large Language Models - Lecture 12
-
Transformer and Large Language Models - Part II - Lecture 13
-
LLM Post-Training Techniques - Lecture 14
-
Vision Transformer for Efficient Machine Learning - Lecture 16
-
Transformer and Large Language Models - Part I - Lecture 12
