Flink K8S Operator Autoscaling - Implementation and Best Practices

Explore the Flink K8S Operator and its autoscaling capabilities in this 21-minute conference talk by Chen Zhengyu, an Apache Flink/Streampark Contributor. Gain insights into the challenges of 24/7 stream processing operations and the importance of effective resource utilization in the big data field. Discover the origins and development history of the Flink K8S Operator sub-project, with a focus on its latest automatic tuning function. Learn about the implementation of FLIP-271, its working principles, and best practices. Get a glimpse of the ongoing non-stop updates (FLIP-291) and future plans for automatic tuning in the Flink community and StreamPark. Benefit from Chen's extensive experience in data development within the game industry and his expertise in Flink's public multi-cloud data solutions.