Cross Atlantic - Scaling Instagram Infrastructure from US to Europe

Explore the challenges and solutions involved in scaling Instagram's infrastructure across continents in this 22-minute conference talk from LISA18. Dive into the complexities of deploying a stateful service across multiple datacenters in the US and Europe, focusing on the partitioning of Cassandra databases. Learn about the innovative use of social hash to keep user data within the same partition, improving cache miss rates. Discover the intricacies of disaster recovery planning and failover strategies for European datacenters. Gain insights into the technical hurdles faced by Facebook's engineering team and the creative solutions they implemented to ensure efficient cross-Atlantic operations for Instagram's massive user base.