Learn how to build self-orchestrating data pipelines for Presto in this 24-minute conference talk by Roy Hasson from Upsolver. Discover an alternative to the dbt and Airflow combination that simplifies data lake operations without complex DAG management. Explore how to use SQL for writing data pipelines that automatically orchestrate themselves, maintain data awareness, and ensure consistent data contracts between pipeline stages. Gain insights into implementing data products within your organization to enhance self-service capabilities for Presto users, making data ingestion, modeling, and transformation more accessible to engineers, developers, and analysts.
Overview
Syllabus
Ending DAG Distress: Building Self-Orchestrating Pipelines for Presto - Roy Hasson, Upsolver
Taught by
Presto Foundation