Learn how DuckDB efficiently processes and analyzes JSON data in this 21-minute conference talk from the Dutch Seminar on Data Systems Design. Explore the implementation of reading JSON files directly as tables with automatic schema detection, introduced in DuckDB 0.7.0. Discover how semi-structured JSON data, including nested OBJECTs and ARRAYs, is transformed into efficient columnar STRUCT and LIST types for analytical processing. Presented by Laurens Kuiper, a PhD Student at CWI Amsterdam and Software Developer at DuckDB Labs, who specializes in OLAP systems and memory-efficient database performance.
Shredding Deeply Nested JSON for Efficient Analytics in DuckDB
DSDSD - Dutch Seminar on Data Systems Design via YouTube
Overview
Syllabus
"description": "DSDSD - THE DUTCH SEMINAR ON DATA SYSTEMS DESIGN: We hold bi-weekly talks on Fridays from PM to 5 PM CET for and by researchers and practitioners designing and implementing data systems. The objective is to establish a new forum for the Dutch Data Systems community to come together, foster collaborations between its members, and bring in high-quality international speakers. We would like to invite all researchers, especially also Ph.D. students, who are working on related topics to join the events. It is an excellent opportunity to receive feedback early on from researchers in your field.",
Taught by
DSDSD - Dutch Seminar on Data Systems Design
Related Courses
-
Lambda Functions and List Operations in DuckDB SQL
-
Efficient CSV Parsing - On the Complexity of Simple Things
-
LingoDB: An Open Compilation and Optimization Framework for Sustainable Data Processing
-
Database Schemas in the Wild - Learning from a Large Corpus of Relational Database Schemas
-
Decoupling Compute and Storage for Stream Processing Systems
-
Efficient Detection of Multivariate Correlations in Static and Streaming Data
