Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Anatomy of Reading Apache Parquet Files in Apache Impala

The ASF via YouTube

Overview

Explore the intricacies of reading Apache Parquet files from the perspective of Apache Impala in this 26-minute conference talk. Delve into the crucial early stages of query execution in Apache Impala, focusing on the process from reading bytes of Parquet files on the filesystem to applying predicates and runtime filters on individual rows. Learn about Apache Impala's distributed massively parallel analytic query engine, optimized for both object stores and on-premises distributed file systems. Discover why Impala uses its own C++ Parquet scanner instead of existing libraries, enabling features like data caching, execution within memory bounds, and efficient parallelism. Gain insights into how these features give Impala an edge in the world of Big Data query engines. Presented by Csaba Ringhofer and Daniel Becker, experienced software engineers from Cloudera and members of the Apache Impala PMC, this talk offers valuable knowledge for those working with big data systems and file formats.

Syllabus

Anatomy of reading Apache Parquet files (from the Apache Impala perspective)

Taught by

The ASF

Reviews

Start your review of Anatomy of Reading Apache Parquet Files in Apache Impala

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.