Explore efficient and frugal image data processing pipelines in this conference talk by Anna Heng Chi at Conf42 Platform Engineering 2024. Dive into various image processing use cases and learn how to tackle challenges associated with handling large image datasets. Discover techniques for selecting optimal image formats, including next-generation options, and implementing adaptive compression. Gain insights on leveraging cloud services for image processing while optimizing costs. Examine strategies for distributed processing, parallelism, containerization, and orchestration. Understand the importance of continuous optimization and cost monitoring in image processing workflows. Conclude with a look into the future of image processing and its ethical considerations, providing a comprehensive overview of efficient and cost-effective image data processing techniques.
Overview
Syllabus
intro
introduction to efficient image data processing
overview of image processing use cases
challenges in handling large image data
choosing the right image formats
next-generation image formats
adaptive compression techniques
leveraging cloud services for image processing
optimizing cloud costs
distributed processing and parallelism
containerization and orchestration
continuous optimization and cost monitoring
future of image processing and ethical considerations
conclusion and summary
Taught by
Conf42
