Highly Available Search Platform for Data Resilience and Compliance at Shopify

Explore a 29-minute conference talk on Shopify's highly available search platform, which indexes petabytes of data for millions of merchants. Learn how Kafka messaging service enables real-time indexing of millions of documents per minute to Elasticsearch across multiple global regions, ensuring high availability. Discover strategies for handling varying write loads, implementing storage autoscaling, and using Envoy for disaster recovery and regional failover. Gain insights into building a complex infrastructure that meets key requirements such as scalability, data residency compliance, and efficient search query performance in a large-scale commerce platform.