Discover techniques to optimize Pandas for larger datasets in this 30-minute EuroPython 2020 conference talk. Learn how to compress data to fit more rows into RAM, explore methods to accelerate common DataFrame operations using numpy and Numba, and investigate multi-core processing. Examine solutions for handling datasets that exceed memory limitations, including Dask on Pandas and the Vaex alternative. Gain valuable insights to reduce DataFrame size and boost data processing speed, applicable to Pandas users of all levels. Based on the speaker's work updating the O'Reilly book "High Performance Python," this talk equips you with strategies to enhance your data analysis capabilities and improve job effectiveness.
Overview
Syllabus
Ian Ozsvald - Making Pandas Fly
Taught by
EuroPython Conference
Related Courses
-
Scaling Python Data Applications with Dask
-
Do These Pandas Alternatives Actually Work?
-
Pandas 2, Dask or Polars? Quickly Tackling Larger Data on a Single Machine
-
How to Speed Up Your Pandas Code and Save Time and Resources
-
Using Pandas and Dask to Work with Large Columnar Datasets in Apache Parquet
-
All You Need is Pandas - Unexpected Success Stories
