Watch a 26-minute conference talk exploring software monitoring through telemetry data collection and Protocol Buffers implementation in Dyalog APL. Learn how to leverage OpenTelemetry for standardized monitoring, with Gilgamesh Athoraya demonstrating a sample application that emits telemetry data. Discover Sandra Persson's APL implementation of Protocol Buffers (Protobuf) and code generation from schema files. Explore key concepts including logging, metrics tracking, request tracing, and system health monitoring. Follow practical demonstrations using the Microsoft Aspire dashboard and see how to serialize data between Python and APL using Protobuf. Gain insights into the advantages and disadvantages of different data serialization methods, comparing Protobuf with JSON, and understand how to effectively monitor distributed systems' performance and behavior.
Overview
Syllabus
Collecting and transmitting data about performance, usage and health of a distributed system
Logs
Metrics such as resource usage
Tracing a request throughout the system
Telemetry setup
OpenTelemetry
A prototype for Dyalog APL
Demo using the Microsoft Aspire dashboard
Protobuf format for serialising data
Protobuf vs. JSON
Usage overview
Advantages and disadvantages
Languages that support protobuf
Demo serialise data from python and read in APL
Taught by
Dyalog User Meetings
