How We Managed a Massive-scale Incident at Datadog

Explore a detailed account of Datadog's massive global outage on March 8, 2023, in this 40-minute conference talk from SREcon23 Europe/Middle East/Africa. Learn about the incident's trigger, the extensive recovery efforts, and the technical challenges faced during the crisis. Gain insights into how Datadog successfully coordinated over 500 engineers for more than two days of continuous incident response. Discover the technical lessons learned, innovative solutions implemented, and the organizational strategies that enabled such a large-scale response with minimal heroism. Understand how to build and prepare an engineering team capable of handling major incidents effectively.