How to Be a 10x SRE - A Deep Dive into Prometheus Operator

Overview

Dive deep into the Prometheus Operator with this conference talk by Red Hat experts Jayapriya Pai and Haoyu Sun. Explore common usage patterns, practical examples, and advanced features of this popular solution for monitoring Kubernetes workloads. Learn about securing Prometheus with TLS, enabling robust remote write, and operating AlertManager via Prometheus Operator. Gain insights into monitoring and operating aspects of the Prometheus Operator itself, drawing from first-hand experience of maintaining it in thousands of OpenShift clusters. Discover the architecture, Custom Resource Definitions (CRDs), and components like ServiceMonitors, PodMonitors, PrometheusRules, and Probes. Understand how monitoring works, alerting mechanisms, security considerations, and limitations of the Prometheus Operator. Get a glimpse into the future of this technology and walk away with valuable takeaways for implementing and optimizing your Kubernetes monitoring setup.

Syllabus

Thank you to our Session Recording Sponsor!
Takeaways
Typical Monitoring Stack
Operator = CRD + Custom Controllers
Prometheus Operator Architecture
Prometheus-Operator CRD's
Prometheus Custom Resource
Service Monitor, Pod Monitor and Probe
Probe Example: Static Target
Probe Example: Ingress
How monitoring works?
Alerting - PrometheusRule
Alerting - AlertManager CRD
Security - TLS
Remote Write
Kube-Prometheus
Limitations
Future
Summary