Explore the evolution of Whatnot's modern data stack in this 14-minute conference talk from Data Council. Discover how a small team manages to process tens of millions of events across hundreds of different event types daily after rapid growth. Learn about the implementation of data contracts using Interface Definition Language (Protobuf) as a source of truth for event definitions, event construction governance in production, and automatic DBT model generation in the data warehouse. Gain insights into maintaining data quality and key learnings from Zack Klein, a software engineer at Whatnot, as he shares his experience building data products and navigating challenges in a fast-growing environment.
Overview
Syllabus
Whatnot
Data Stack
Problems
What we did
Architecture
Three Steps
Maintaining Quality
Learnings
Taught by
Data Council
