Explore how Docker revolutionized an Ops Team's monitoring infrastructure rebuild in this 22-minute conference talk. Discover the challenges faced and why Docker became the project's savior. Learn about fixing dependencies, implementing rolling upgrades, and building a modular, scalable, and resilient infrastructure. Understand the crucial role of CI/CD workflows, Docker tooling, and Docker Swarm in achieving success. Delve into specific issues like Python version conflicts, I/O storms, and UDP challenges. Gain insights on best practices, including configuration management, security considerations, and automation techniques. Explore future Docker-based projects and potential areas for growth, such as image size reduction, vulnerability scanning, and full-scale Docker implementation.
Overview
Syllabus
Docker to the rescue of an Ops Team Rachid Zarouali
Rebuild everything! June 2014 A monitoring system from scratch "Microservices" oriented Replaceable parts
Some rules first! Simple Efficient Extendable Python based
Test your might! Python 2.6 along with python 2.7 Different version of 'some libraries Whisper backend (I/O storm) Upstream repositories issues
This isn't over yet! Docker udp issues Tricky iptable filtering Unstable data volume Configuration management
Round 2: FIGHT! Metric proxy (Collectd) on the
Epic loots! No more dependency issues Replaceable and movable parts Greater security level Clustering ready (Swarm/K8S)
Lessons learned Caution when using udp IPv4 Config files out of the container Don't use env variables security Use (abuse) automation
What's next? Greater Docker challenges
Many rooms to grow Reduce (even more) Image size Sign Images (notary to the rescue) Vulnerability scanning Implement rolling upgrades
New docker based projects Migrate Development platform (2015) Swarm clustering (0) Full scale Docker (1) Work in Progress
Taught by
Docker
