Overview
Learn how to build an advanced log analytics solution using ClickHouse and Kafka in this 17-minute conference talk from OSA Con 2023. Explore how to overcome common challenges with log analysis, including verbosity, lack of structure, and search difficulties, while avoiding the high costs and complexity of traditional tools like OpenSearch. Discover ClickHouse's powerful analytical capabilities and data compression features as a cost-effective alternative for handling billions of log events. Through a comprehensive end-to-end example, master the implementation of key ClickHouse components including JSON data type, Kafka table engine, and materialized views, while learning how to leverage Kafka for efficient log ingestion into ClickHouse.
Syllabus
Unlocking Advanced Log Analytics With ClickHouse and Kafka
Taught by
OSACon