Designing a Modern Object Store Server for Lustre File System

Watch a 42-minute technical conference talk exploring the modernization of Lustre file system's object storage server design for enhanced performance in supercomputing environments. Dive into the architecture of Lustre's key networking and storage components, examining current limitations in the disk-oriented object storage server designs based on Ext4 derived ldiskfs. Learn about a proposed new OSS/OST architecture that incorporates modern hardware advancements like SSDs and persistent memory, alongside software innovations including SPDK/PMDK and KV-Store. Understand how flexible Erasure Coding data protection schemes can be integrated into next-generation storage solutions. Discover the potential benefits of these architectural improvements for developer community engagement and end-user adoption. Follow along as Samsung Electronics' Yong Chen details the project's implementation progress, challenges encountered, and lessons learned while building a more efficient and scalable parallel file system for big data and machine learning applications.