Fink on Kubernetes - Efficient Management of Massive Alert Streams for Astronomical Object Identification

Explore how Kubernetes facilitates efficient management of massive alert streams for astronomical object identification in this conference talk. Learn about the Fink broker project's role in handling real-time streams of millions of alerts produced nightly by modern astronomical facilities like the Rubin Observatory. Discover the cloud-based infrastructure of Fink, which utilizes state-of-the-art distributed computing frameworks such as Apache Spark and integrates with Kubernetes for real-time decision-making. Gain insights into Fink's complex software stack, rigorously tested in a self-hosted CI/CD environment on Kubernetes and OpenStack. Understand the modern challenges in astronomy and how Kubernetes contributes to advancing scientific frontiers through the efficient processing of large-scale astronomical data.