Building File-Based Applications with Unity Catalog Volumes

Explore the capabilities of Unity Catalog Volumes for building file-based applications that handle extensive collections of non-tabular data in this 41-minute talk by Adrian Ionescu and Adriana Ispas from Databricks. Learn how to access, store, process, and share files of any format, including structured, semi-structured, and unstructured data. Discover how Volumes enable unified discovery and governance for all data and AI assets alongside tabular data and models in Unity Catalog. Gain insights into reading directories, processing files, creating and writing new ones, and working with files using specific libraries and tools. Understand how to build scalable file-based applications using Spark APIs, REST APIs, native file libraries, SQL connectors, and SDKs. See practical demonstrations of Volumes in action for AI and Ingestion use cases. Delve into the full potential of Volumes for managing non-tabular data and enhancing your data processing capabilities.