Explore efficient LIST-type operations and Python-style list comprehension in SQL databases through this 25-minute technical talk from the Dutch Seminar on Data Systems Design. Discover how DuckDB, a high-performance relational database system for analytics, implements internal design choices to support LIST values efficiently, particularly when working with nested input formats like JSON. Learn about the challenges and solutions in leveraging SQL engines' potential while maintaining ease of use, without requiring additional unnesting steps or normalized data loading. Presented by Tania Bogatsch, a software engineer at DuckDB Labs with experience in adaptive expression reordering, this talk offers valuable insights for researchers and practitioners working on data systems design and implementation.
Lambda Functions and List Operations in DuckDB SQL
DSDSD - Dutch Seminar on Data Systems Design via YouTube
Overview
Syllabus
We hold bi-weekly talks on Fridays from PM to 5 PM CET for and by researchers and practitioners designing and implementing data systems. The objective is to establish a new forum for the Dutch Data Systems community to unite, foster collaborations between its members, and bring in high-quality international speakers. We would like to invite all researchers, especially PhD students, who are working on related topics to join the events. It is an excellent opportunity to receive feedback early on from researchers in your field.
Taught by
DSDSD - Dutch Seminar on Data Systems Design
Related Courses
-
Shredding Deeply Nested JSON for Efficient Analytics in DuckDB
-
Efficient CSV Parsing - On the Complexity of Simple Things
-
Towards LLM-augmented Database Systems
-
C3: Compressing Correlated Columns - A Framework for Multi-Column Data Compression
-
Provenance Research in Data Management Systems at Microsoft
-
LingoDB: An Open Compilation and Optimization Framework for Sustainable Data Processing
