Kafka Monitoring: What Matters - Key Metrics and Performance Indicators

Explore the critical aspects of monitoring Apache Kafka at scale in this 37-minute conference talk from The ASF. Gain insights into the most important metrics and indicators for Kafka monitoring, with a special emphasis on lag performance. Learn how to interpret and correlate key indicators, create effective dashboards, and set up proactive alerts for potential issues. Discover the significance of trend analysis in detecting anomalies within long-running Kafka pipelines. By the end of the talk, acquire a deeper understanding of essential performance indicators for Kafka, their interpretation and visualization, and the value of trend analysis in maintaining healthy Kafka deployments. Benefit from the expertise of Amrit Sarkar, an experienced engineer with 8+ years at Apple focused on Search and Streaming.