Overview
Syllabus
Intro
Canarying: What is that?
What we're going to talk about
What we're not going to talk about
Conflicting Incentives
Triangle of Canarying Priorities
Example: Geographical distribution
Example: High variance among replicas
Example: Bimodal distribution
Example: Two metrics, different outliers
Takeaways 2
Example: Service With Cache, restarted
Example: Memory leak canary
Example: Before/after test
Example Takeaway
Example: Compound probability
Beware Meta Analysis
Prefer Few Metrics
Canary In These 3 Simple Steps
Canary In These 3-ish Simple Steps
Taught by
USENIX