Temporal Databases for Streaming Architectures

Explore the concept of temporal databases in streaming architectures through this conference talk from Strange Loop. Dive into the development of Crux, an open-source document database with bitemporal graph queries. Learn how Crux was conceived from real-world consulting experiences in global system integrations and financial services projects. Discover the overarching goals of Crux as an "unbundled," pluggable, and layered database with bitemporal ACID transactions. Understand the importance of bitemporality in separating transaction time from valid time, and its role in maintaining consistent temporal views of data in streaming architectures. Examine the design choices made to support a Datalog query engine on top of Key/Value stores, the use of semi-immutable log storage, clustering with Kafka, and the implementation of Clojure for creating a layered and extensible system. Gain insights into future directions and plans for collaboration with the open-source community. Presented by Jeremy Taylor and Jon Pither from JUXT LTD, this 35-minute talk covers topics such as streaming architectures, Kafka, logs, temporality, transaction time, valid time, temporal modeling, stream processing tools, and various database operations.