Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Java Parsing Optimization: Processing 1 Billion Rows of Weather Data

GOTO Conferences via YouTube

Overview

Explore an in-depth presentation on optimizing Java performance for parsing 1 billion rows of weather data. Dive into advanced techniques including parallelism, memory-mapped files, SWAR (SIMD Within A Register), bit twiddling, branchless code, mechanical sympathy, and Graal native compilation. Learn how to dramatically improve processing speed from over 4 minutes to under 2 seconds using various optimization strategies. Discover the power of Java's performance capabilities through practical examples and code changes, including unconventional approaches like using sun.misc.Unsafe. Gain insights into JVM selection, Graal native image compilation, and their impact on execution speed. Follow the speaker's journey of experimentation and optimization, uncovering valuable lessons in high-performance Java programming along the way.

Syllabus

Intro
The challenge
Watch, learn, adopt, experiment
Mechanical sympathy
Temperature as integer
Memory mapped files
Getting unsafe
SWAR
Stringless
Branchless programming
Parse the temperature
Keeping track
Which JVM?
Graal native-image
Summary
Results
Outro

Taught by

GOTO Conferences

Reviews

Start your review of Java Parsing Optimization: Processing 1 Billion Rows of Weather Data

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.