Overview
Explore a technical conference presentation that delves into integrating S3 storage with distributed multi-protocol Hyperscale NAS systems for high-performance computing environments. Learn how pNFS v4.2 architectures can deliver exceptional performance for GPU-based AI/DL workflows using standard enterprise infrastructure, as demonstrated by Meta's AI Research SuperCluster achieving 12.5TB per second throughput. Discover an innovative architecture that seamlessly incorporates S3 storage from edge locations into multi-platform, multi-protocol, multi-site Hyperscale NAS environments without traditional gateway requirements. Master best practices for consolidating distributed data sources, leveraging commodity hardware, and utilizing existing multi-vendor storage resources to create an integrated, vendor-neutral environment optimized for high-performance computing tasks. Presented by industry experts Alan Wright and Johan Ballin from Hammerspace, gain practical insights into overcoming performance limitations of legacy storage systems while maintaining enterprise-grade capabilities.
Syllabus
SNIA SDC 2024 - Integrating S3 Into Distributed Multi-Proticol Hyperscale NAS
Taught by
SNIAVideo