Optikon - Saving 95% on Logging Costs by Building an Internal Platform
Platform Engineering via YouTube
Overview
Discover how to significantly reduce logging costs and streamline log management in a growing company through an internal platform solution. Learn about the challenges of merging multiple companies with different tech stacks and how to address high logging costs, disparate systems, and inadequate log coverage. Explore the development of a centralized platform that combines Kubernetes tools and cloud-managed services to minimize maintenance costs and enhance availability. Gain insights into implementing guardrails to prevent unexpected cost increases from sudden log volume spikes and creating an abstraction layer for flexible component changes. This 12-minute talk by Rafael Borrego Ropero from Platform Engineering demonstrates how to handle terabytes of daily logs efficiently while meeting the complex needs of a growing organization.
Syllabus
Optikon: how we saved 95% on our logging costs by building an internal platform
Taught by
Platform Engineering