Learn how to optimize data engineering workflows in this 16-minute conference talk from PyBay that explores the powerful combination of Pandas, Polars, and Apache Arrow. Dive deep into the technical distinctions between Pandas and Polars, discover their latest features, and master techniques for seamlessly integrating these tools to achieve maximum performance. Explore practical strategies for building faster, more efficient data pipelines that can scale effectively, delivered by Chris Brousseau at the SF Python regional conference. Gain insights into leveraging Apache Arrow's in-memory technology while understanding how these complementary tools can work together to enhance your data processing capabilities.
Better Together - Unleashing the Synergy of Pandas, Polars, and Apache Arrow
Overview
Syllabus
Sun Oct 8 2023 at Bungalo West
Taught by
SF Python
Related Courses
-
Rust Data Engineering
-
Scale Data Science Using Pandas API on Spark
-
Processing and Storing Time Series Instrument Data with Pandas and PySpark
-
Pandas 2, Dask or Polars? Quickly Tackling Larger Data on a Single Machine
-
Design Patterns for Data Pipelines Beyond ETL
-
Solving Wordle with Python's Concurrency Tools - Exploring Forks, Pools, and Async
