Optimizing Container Registry Storage: Introducing Blob De-Duplication for Accurate Sizing and Cost

Explore a new technique for accurately calculating container registry storage in this 25-minute conference talk by Brandon Caton from Red Hat. Learn about blob de-duplication, a method that eliminates duplicate blob sizes within a namespace to provide a more precise measure of actual storage usage. Discover how this approach improves cost optimization and enhances visibility into container registry usage. Delve into the implementation details and real-world deployment experiences at scale. Understand the benefits of splitting calculations into backfill and running total components to maintain accuracy while keeping latency low. Gain insights into performing specific checks that preserve the accuracy of de-duplicated blob totals without recalculating across millions of rows. Ideal for developers, DevOps engineers, and operators interested in advancements in effective storage utilization and innovative approaches to solving complex problems in container registry management.