Explore a detailed technical discussion between Altinity's Dev Advocate Josh Lee and MongoDB's Justin Mason in this 32-minute video that delves into the OpenTelemetry ClickHouse exporter implementation. Learn how to optimize time-series data in ClickHouse with impressive 158x compression ratios, configure the OpenTelemetry collector, and efficiently query data using Grafana and PromQL. Master essential concepts including database schemas, pipeline setup, metric grouping, performance optimization, window functions, materialized views, and data interval management. Gain practical insights into integrating Prometheus data, leveraging ClickHouse for long-term metrics storage, and customizing the OpenTelemetry collector. Access comprehensive resources including the exporter's GitHub repository, client libraries for SQL exporters, and detailed configuration tutorials while understanding the future roadmap of OpenTelemetry and ClickHouse exporter development.
OpenTelemetry ClickHouse Exporter with Prometheus and Grafana for Time Series Data
Overview
Syllabus
– Introduction
– OpenTelemetry Collector and ClickHouse Exporter
– OpenTelemetry Collector and Contributions
– ClickHouse Exporter Overview and Database Schemas
– Setting Up the OpenTelemetry Pipeline
– Prometheus Data and ClickHouse Integration
– Compression Benefits of ClickHouse
– Why Use ClickHouse for Long-Term Metrics Storage
– Data Querying in ClickHouse: Grafana and PromQL
– Handling Metric Grouping and Performance Optimization
– Querying ClickHouse with Grafana Plugins
– Window Functions and Efficient Querying
– Working with Materialized Views in ClickHouse
– OpenTelemetry Collector Customization
– PR Contributions and Exporter Enhancements
– Managing Data Intervals and Aggregations
– Future of OpenTelemetry and ClickHouse Exporter
– Closing Remarks and Next Steps
Taught by
Altinity
