Managed Airflow Service Vane Development Journey

Explore a 22-minute conference talk from SK TECH SUMMIT 2023 focusing on the development journey of Vane, a Managed Airflow service. Learn about the architectural decisions, implementation challenges, and valuable insights gained during the development of this SaaS platform that allows users to create and manage Airflow instances through a simple web UI. Discover how Vane facilitates integration with various data systems and enables seamless pipeline utilization of Jupyter Notebooks. Gain deep insights into the rationale behind SaaS-ifying Airflow, the de facto platform for workflow orchestration, and understand the practical experiences of operating Airflow and data platforms in an enterprise environment. Presented by SK Telecom engineers Park Ji-won, who specializes in large-scale data processing and backend platforms, and Kim Kyung-min, whose expertise spans backend development, machine learning, and big data platforms.