Confluent Courses

Sustainability and Streaming Data: Merging Real-Time Insights, Green Futures and Profitability

Explore how streaming data applications enable real-time environmental insights, driving sustainable decisions and cost savings while addressing ethical considerations and maintaining profitability.

• YouTube
• 46 minutes
• On-Demand
• Free Video

From Raw Data to an Interactive Data App in an Hour - Powered by Snowpark Python

Develop a Streamlit data app to visualize advertising ROI using Snowpark Python. Learn data ingestion, transformation, ML modeling, and interactive visualization techniques.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Automatically Detect and Remediate Degraded Storage in Kafka

Discover an automated system for detecting and remediating degraded storage in Kafka, improving cluster performance and availability. Learn about monitoring, algorithm formulation, and mitigation strategies.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Dynamic Change Data Capture with Flink CDC and Consistent Hashing

Implement dynamic Change Data Capture for large databases using Flink CDC connectors and consistent hashing. Overcome challenges with incremental snapshotting and Postgres replication slots.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Debezium Snapshots Revisited - Incremental Snapshots for CDC Pipelines

Explore innovative incremental snapshot techniques for Debezium CDC connectors. Learn to pause, resume, and parallelize snapshots, and customize snapshot contents for efficient data pipeline management.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Beyond Monoliths: Thrivent's Lessons in Building a Modern Integration Architecture

Explore strategies for modernizing data architecture, from technical aspects like JSON Schema and OpenTelemetry to human factors like building trust and adopting a product-focused mindset.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Flink SQL: The Challenges to Build a Streaming SQL Engine

Explore challenges in building a streaming SQL engine like Flink SQL. Learn about late data handling, change data processing, event ordering, nondeterminism, and state storage in stream processing.

• YouTube
• 45 minutes
• On-Demand
• Free Video

General Coordinates Network: Harnessing Kafka for Real-Time Open Astronomy at NASA

Explore NASA's use of Kafka for real-time astronomy data sharing, including architectural choices and OAuth2 implementation for public access in the General Coordinates Network.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Put Events to Work and Respond in Real Time

Unlock real-time event streams to detect trends, issues, and threats. Learn how IBM Event Automation empowers teams to process events, define scenarios, and automate decisions.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Restate: Stream Processing for Microservices

Explore a novel system for microservices that handles state, communication, and consistency. Learn how it complements event-processing systems for complex control flow and coordination in distributed applications.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Evolution of Streaming Pipeline at Lyft - Real-Time Optimization Platform

Explore Lyft's real-time optimization platform evolution, focusing on streaming infrastructure for marketplace balance, scalability, and decision-making using Kafka and data science tools.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Serverless Realtime Lakehouse Architecture - Standing on the Shoulders of Open-Source Giants

Explore the serverless lakehouse architecture for real-time data streaming. Learn its benefits, implementation, and cost-saving potential through an interactive demo using live events from mobile devices.

• YouTube
• 49 minutes
• On-Demand
• Free Video

Efficiently Streaming Data into Medallion Architecture with Apache Hudi

Efficiently stream data into medallion architecture using Apache Hudi. Learn about record index, incremental updates, and CDC features to overcome challenges and build low-latency data processing systems.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB - A Comprehensive Guide

Learn to create powerful data pipelines by combining Apache Kafka and InfluxDB for real-time processing, analysis, and visualization of large-scale data, especially in IoT applications.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Configuring Kafka Connect for Scalability - Best Practices

Optimize Kafka Connect clusters for scalability. Learn best practices to configure and manage Kafka Connect effectively, ensuring successful integration of external systems with Apache Kafka at scale.

• YouTube
• 35 minutes
• On-Demand
• Free Video