OpenEC - Toward Unified and Configurable Erasure Coding Management in Distributed Storage Systems

Explore a 24-minute conference talk from USENIX FAST '19 that introduces OpenEC, a unified and configurable framework for deploying erasure coding solutions in distributed storage systems. Learn how OpenEC decouples erasure coding management from storage workflows, providing erasure coding designers with configurable controls through a directed-acyclic-graph-based programming abstraction. Discover how OpenEC can be prototyped on two versions of HDFS with minimal code modifications, preserving operational performance and erasure coding properties while automatically optimizing repair performance. Gain insights into the challenges of integrating new erasure coding solutions into existing distributed storage systems and how OpenEC addresses these issues.