Data Versioning in Generative AI: A Pathway to Cost-Effective ML

Explore data versioning in the context of Generative AI through this 27-minute conference talk by Dmitry Petrov, CEO of DVC, at MLOps World: Machine Learning in Production. Discover how the evolving Generative AI workflows require an adaptation of versioning techniques to meet new challenges. Learn about the unique data management issues arising from working with vast amounts of unstructured data, including images, videos, audio, MRI scans, document scans, and text dialogues. Understand the complexities of handling billions of objects and the resource-intensive process of scoring models on expensive GPU hardware or using model APIs like ChatGPT. Gain insights into cost-effective machine learning strategies and how proper data versioning can help teams navigate the challenges of the Generative AI era.