Discover the latest capabilities of Databricks Workflows in this 42-minute conference talk presented by the Databricks Workflows product team. Learn how to define, manage, and monitor multi-task workflows for ETL, analytics, and machine learning pipelines on the Data Intelligence Platform. Watch live demonstrations showcasing recent innovations, including repair runs for jobs and tasks with greater control, enhanced control flow using for-each and conditionals, improved job scheduling with file arrival and table triggers, and authoring jobs in Python using Databricks Asset Bundles. Gain valuable insights from Roland Fäustlin and Saad Ansari, Product Managers at Databricks, as they guide you through these new features. Explore additional resources like the Big Book of Data Engineering and The Data Team's Guide to the Databricks Lakehouse Platform to further enhance your knowledge.
Overview
Syllabus
What's New in Databricks Workflows - with Live Demos!
Taught by
Databricks