Explore the journey of Zappi's data history and learn how Ruby, graph databases, and bitmap stores are utilized to build a unique data engine. Discover the evolution from disconnected data sets and serialized data frames to an efficient in-memory index solution. Delve into the use of RedisGraph for modeling data relationships and connecting semantically equal nodes. Examine the implementation of a query layer for indexing a bitmap store, resulting in significantly faster dataset interrogation. Gain insights into cross-market analysis, harmonization, and the architecture behind this innovative approach to data indexing.
Overview
Syllabus
Intro
Data Indexing with RGB
The world before the MeasureStore
Context
Storage
Introducing MeasureStore
Cross market analysis
Cross comparison
Harmonisation
The bitmap store
The graph
Architecture
Performance
Next steps
Taught by
Ruby Central