Explore the intricacies of streaming ETL in this 30-minute conference talk by Alex Cristu, Senior Solution Architect at Streamkap. Delve into the process of streaming Change Data Capture (CDC) data from PostgreSQL to Snowflake, uncovering challenges and innovative solutions along the way. Learn about dynamic tables, Snowpipe streaming, and the advantages of streaming ETL for businesses seeking lower latency, cost efficiency, and improved scalability. Gain valuable insights into data ingestion pipelines and discover why companies are increasingly adopting streaming ETL techniques. Benefit from Alex's expertise as he shares lessons learned and practical solutions for overcoming common obstacles in the world of data streaming and transformation.
Overview
Syllabus
Streaming CDC data from PostgreSQL to Snowflake, challenges and solutions
Taught by
Data Council
Related Courses
-
Handling Streaming Data with Apache Pulsar
-
Streaming Data Enrichment and Analysis with Redpanda, CDC, and Python
-
Database Native Support for CDC Streaming Pipeline
-
How DLT Stretched CDC Capabilities and Kept ETL Limber at Hinge Health
-
Achieving Data Interoperability with Real-time Stream Processing Using Snowflake Cortex and Apache Iceberg
-
Empowering Real-Time Data Integration with Flink CDC
