Apache NiFi, Kafka, RisingWave, and Iceberg for Stock Data Processing with LLM - Conf42 Python 2024

Overview

Explore stream processing and its applications in this conference talk from Conf42 Python 2024. Dive into the fundamentals of stream processing and gain insights into RisingWave, a cloud-native streaming database. Learn about various use cases including streaming ETL, real-time analytics, and event-driven applications. Discover the architecture behind these technologies and follow a practical demonstration using Apache NiFi, Apache Kafka, RisingWave, and Apache Iceberg to process stock data with LLM integration. Gain valuable knowledge on implementing stream processing solutions in your projects through this comprehensive overview and hands-on example.

Syllabus

intro
preamble
about karin
what is stream processing?
understanding stream processes
what is risingwave
data stream processes in risingwave
- streaming etl
- real-time analytics
- event-driven applications
- the architecture
using apache nifi, apache kafka, risingwave, and apache iceberg with stock data and llm
thank you