HOTI - Hot Interconnects Symposium Courses

Connectivity for AI Everywhere - The Role of Chiplets

Explore how chiplet technology revolutionizes AI connectivity and enables distributed computing solutions through advanced semiconductor integration and interconnect strategies.

• YouTube
• 1 hour
• On-Demand
• Free Video

A New Mechanism to Identify Congesting Packets in High-Performance Interconnection Networks

Discover innovative techniques for identifying network congestion through advanced packet tracking mechanisms in high-performance interconnection systems.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Chip-let Interconnect Test and Repair

Explore advanced techniques for testing and repairing chip-let interconnects, focusing on practical solutions and emerging methodologies in semiconductor manufacturing.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Rail-only: A Low-Cost High-Performance Network for Training LLMs with Trillion Parameters

Discover a groundbreaking network architecture designed for efficient training of large language models, optimizing performance while reducing infrastructure costs.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Characterizing Communication in Distributed Parameter-Efficient Fine-Tuning for LLMs

Explore communication patterns and optimization techniques in distributed parameter-efficient fine-tuning for Large Language Models, focusing on network performance and scalability challenges.

• YouTube
• 29 minutes
• On-Demand
• Free Video

OHIO: Improving RDMA Network Scalability in MPI_Alltoall Through Optimized Communication Design

Discover optimized RDMA network communication techniques for MPI_Alltoall operations through hierarchical design and improved overlap strategies for enhanced scalability and performance.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Demystifying the Communication Characteristics for Distributed Transformer Models

Explore communication patterns and optimization strategies for distributed transformer models, focusing on collective operations and performance characteristics in large-scale deployments.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Keeping Pace: Micro-Models, Large Language Models, and the Co-Evolution of Chip and Data Center Design in a Rapidly Shifting AI Landscape

Explore the dynamic relationship between AI models and hardware design, examining how micro-models and LLMs are reshaping chip and data center architecture in modern computing.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Powering Llama 3 - A Peek into Meta's Massive Infrastructure for Generative AI

Dive into Meta's advanced infrastructure powering Llama 3, exploring the technological backbone and innovative systems behind their next-generation generative AI development.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Can Interconnects Keep Up with AI? - A Network Performance Analysis

Explore the future of AI infrastructure as industry expert Andy Bechtolsheim examines how interconnect technologies are evolving to meet the demanding requirements of artificial intelligence systems.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Unified Collective Communication - A Library for CPU, GPU, and DPU Integration

Explore the innovative Unified Collective Communication library that seamlessly integrates CPU, GPU, and DPU communication, enhancing performance across diverse computing architectures.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Principles and Practice of Scalable and Distributed Deep Neural Networks Training and Inference

Dive into scalable and distributed deep neural networks, exploring advanced training and inference techniques for enhanced performance and efficiency in modern AI systems.

• YouTube
• 2 hours 44 minutes
• On-Demand
• Free Video

ASTRA-sim and Chakra - Co-design Exploration for Distributed Machine Learning Platforms

Explore co-design methodologies for distributed ML platforms using ASTRA-sim and Chakra frameworks, focusing on system optimization and performance analysis.

• YouTube
• 1 hour 58 minutes
• On-Demand
• Free Video

Leveraging SmartNICs for HPC and Data Center Applications - Part 2

Dive into advanced SmartNIC implementation strategies for optimizing high-performance computing and data center operations, covering deployment techniques and performance optimization.

• YouTube
• 2 hours 32 minutes
• On-Demand
• Free Video

Leveraging SmartNICs for HPC and Data Center Applications - Part 1

Discover how SmartNICs revolutionize high-performance computing and data center operations, exploring key implementation strategies and performance optimization techniques for modern infrastructure.

• YouTube
• 41 minutes
• On-Demand
• Free Video