Learn how to leverage Databricks workflows for orchestrating and scheduling complex multi-task processes using a DAG architecture. Explore the creation, execution, and benefits of workflows, which are a significant enhancement to the Databricks Jobs service. Discover practical use cases and gain insights into this powerful feature through hands-on examples. Access accompanying slides and a notebook for a comprehensive learning experience, and explore the potential of workflows to streamline your data processing tasks in Databricks.
Overview
Syllabus
Intro
What are workflows
Creating a workflow
Running a workflow
Why use workflows
What I wish for
Why use a workflow
Wrap up
Taught by
Bryan Cafferky
