Enhancing Elasticsearch Performance: Innovative Reindexing Strategies Using Dedicated Nodes and KEDA Autoscalers

Learn how to optimize Elasticsearch performance through innovative reindexing strategies in this 28-minute conference talk from SREcon24 Europe/Middle East/Africa. Dive into Shopify's search infrastructure optimization journey, managing over two petabytes of data for more than three million merchants. Explore advanced techniques for leveraging Kubernetes on Google Cloud Platform to maintain high availability, implement dedicated reindexing nodes within existing clusters, and utilize Kubernetes Event-Driven Autoscaling (KEDA) for dynamic resource allocation. Discover how these strategies significantly improve indexing performance, reduce infrastructure costs, minimize on-call fatigue, and ultimately contribute to increased Gross Merchandise Value and revenue through enhanced system responsiveness. Gain valuable insights applicable to managing large-scale data systems and implementing advanced Elasticsearch optimizations.