Overview
Explore the challenges and solutions of Hybrid Transactional/Analytical Processing (HTAP) in this 18-minute conference talk by Xiaoyu Ma from PingCAP. Learn about TiFlash, a columnar engine for TiKV that addresses design conflicts such as workload interference and storage format. Discover how TiFlash provides consistent, latest, and isolated columnar replicas, significantly improving performance in analytical workloads. Understand the multi-raft approach used to achieve consistent and scalable heterogeneous replication in distributed systems like TiKV. Gain insights into why HTAP is challenging, the system design principles, and the resulting performance improvements. Examine real-world use cases and user feedback demonstrating TiFlash's impact on TiDB and TiKV in real-time analytics and HTAP scenarios.
Syllabus
Intro
Why Separated - Storage Format
Why Separated - Workload Interference
How to make TIKV HTAP-able?
Real-time updatable columnar storage
Raft based HTAP
Consistent read
Performance - Wide Table
Performance - User Feedback
Use Case
Taught by
CNCF [Cloud Native Computing Foundation]