Apache Ozone Distributed Object Storage with Erasure Coding Architecture

Explore a 44-minute technical conference talk that delves into Apache Ozone's distributed object storage system and its implementation of Erasure Coding (EC). Learn how EC reduces storage costs by approximately 50% compared to traditional 3-way replication while maintaining reliability. Understand the fundamental concepts of Container abstraction, where data is organized into d data Containers and p parity Containers distributed across distinct storage nodes. Master the detailed EC architecture, including data layout and decoding sections, while examining design challenges and their solutions. Gain comprehensive knowledge about object storage architecture, EC benefits in storage systems, failure models and selection criteria, and consistency scenarios. Presented by Uma Maheswara Rao Gangumalla from Cloudera Inc., the talk covers essential topics including Ozone Architecture, Replication Monitor, Coding Schemes, Cluster Level EC, Bucket Creation, Container Group, and Consensus Protocol, providing a thorough understanding of this advanced storage technology.