Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Dyalog and Apache Kafka Integration - True?

Dyalog User Meetings via YouTube

Overview

Explore the potential integration of Dyalog APL with Apache Kafka in this 26-minute conference talk from Dyalog '23. Delve into the fundamentals of Apache Kafka, a distributed event streaming platform used for building real-time data pipelines and streaming applications. Learn about Kafka's key concepts including messages, topics, producers, consumers, partitions, and message retention. Discover how Kafka ensures message ordering and various ways to run it. Examine Stefan Kruger's experimental Dyalog interface to Apache Kafka, focusing on DKaf.NET and its use of C# generics. Follow along with practical examples, including reading a London bike rental stream and implementing a string producer. Gain insights into the possibilities of combining Dyalog's powerful array programming capabilities with Kafka's robust distributed streaming architecture.

Syllabus

About Stefan
Apache Kafka distributed streaming platform
Messages
Topics
Producers and consumers
Partition
Message retention
Kafka guarantees message ordering
How to run Kafka
A Dyalog Kafka interface
DKaf.NET
C# generics
Example reading London bike rental stream
String producer example
Summary

Taught by

Dyalog User Meetings

Reviews

Start your review of Dyalog and Apache Kafka Integration - True?

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.