Discover how to serve up-to-date information on a high-scale production system in this 28-minute conference talk from SREcon21. Learn about a innovative approach to in-memory caching that balances data freshness and load using Kafka and MySQL binlog. Explore the journey of creating a "fast track" system that resulted in significant performance and yield improvements across thousands of services. Gain insights into maintaining fast response times while handling massive loads of 500K HTTP requests per second. Understand the constraints of successful production systems and how to overcome them using advanced caching techniques. Delve into the benefits of using Kafka for data distribution and learn how to inject data directly into caches for blazing fast information updates.
Cache for Cash - Speeding Up Production with Kafka and MySQL binlog
Overview
Syllabus
Intro
Cache for Cash Speeding up production with Kafka and Mysql binlog
3 Constraints of a Successful Production
Fast Response time
Traditional cache layers
Fresh Data = higher yield
Lower load = Lower cost
Use Kafka for data distribution
Inject Data to Caches
Taught by
USENIX
