Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Troubleshooting Tiered Tragedy - A Peek Into Failure

GOTO Conferences via YouTube

Overview

Dive into a real-world failure scenario and learn the process Centro uses to uncover latent system issues in this 33-minute conference talk from GOTO Berlin 2019. Explore the importance of monitoring signals before they become catastrophic, and understand how viewing a system from multiple perspectives can provide clarity during incidents. Discover the vital role of product organizations in maintaining system uptime, and gain insights into troubleshooting tiered tragedies. Follow along as the speaker breaks down the failure model, basic architecture, deployment process, and timeline of events, ultimately revealing valuable lessons learned and potential improvements for preventing future system failures.

Syllabus

Intro
What went wrong
Subsystem
Failure Model
Basic Architecture
Deployment Process
Background Tasks
Postgres Locking
Altar Table Command
HTTP Stacking
Timeline of Events
Making Improvements
Possible Alerts
Case Closed
Human Processes
Operators
Staging
Pay Jobs
Auth Users
System Failure
Lessons Learned

Taught by

GOTO Conferences

Reviews

Start your review of Troubleshooting Tiered Tragedy - A Peek Into Failure

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.