Processing Docker Container Logs and Metrics at Scale

Explore the challenges and solutions for processing Docker container logs and metrics at scale in this 42-minute conference talk from DockerCon 2023. Dive deep into logging mechanisms for containerized applications, comparing filesystem and network-oriented events across various transports and formats. Learn to handle multiline log messages and understand the importance of in-motion log parsing and filtering for scalable environments. Discover best practices for reliably transferring information to different backends for data analysis, addressing issues like back pressure, network outages, and data loss. Gain hands-on experience with Fluent Bit, an open source telemetry agent, to demonstrate data collection and processing in containerized environments. Enhance your operational efficiency and logging layer stability by implementing the strategies and techniques shared by Eduardo Silva, Co-founder & CEO of Calyptia. Ideal for DevOps engineers, system administrators, developers, and professionals working with cloud-native environments seeking a comprehensive understanding of applied telemetry in highly scalable systems.