Real-time Data Ingestion and Analysis Using Open Source Tools - Apache Kafka, QuestDB, and Grafana

Learn to build a high-performance real-time analytics system in this 31-minute conference talk from OSACon that demonstrates a project template using Apache Kafka, QuestDB, Grafana OSS, and Jupyter Notebook. Explore data ingestion techniques using Python, JavaScript, and Go to send messages into Kafka, followed by implementing QuestDB as a time-series database for millisecond-level data querying. Create real-time updating charts with Grafana OSS and perform interactive data exploration and time-series forecasting using Jupyter Notebook. Follow along with this demo-driven presentation using the open-source code available on GitHub to kickstart your own streaming data projects capable of processing millions of events per second.