Parallel Computing Courses and Certifications

Strange Loop Conference

Systems That Run Forever - Self-Heal and Scale

Explore architectural principles for building scalable, fault-tolerant systems using isolated parallel components, error detection, and live code upgrades, with insights from Erlang's design.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Conference Talk

Strange Loop Conference

Concurrency and Parallel Computing in JavaScript

Explore concurrency and parallel computing in JavaScript, covering actors, futures, and throughput computing in browsers. Learn techniques for leveraging modern parallel hardware in web development.

• YouTube
• 41 minutes
• On-Demand
• Conference Talk

TED

How Do I Compute the Body Electric?

Explore computational physics and supercomputing to revolutionize personalized medicine through advanced simulations of the human body.

• YouTube
• 16 minutes
• On-Demand
• Conference Talk

IEEE

Near Optimal Massively Parallel Graph Connectivity

Explore efficient parallel algorithms for graph connectivity, focusing on near-optimal solutions and innovative techniques for large-scale graph processing.

• YouTube
• 22 minutes
• On-Demand
• Conference Talk

IEEE

Parallel Reachability in Almost Linear Work and Square Root Depth

Explore efficient parallel algorithms for graph reachability, focusing on distributed computing and improved runtime complexity in large-scale networks.

• YouTube
• 22 minutes
• On-Demand
• Conference Talk

Databricks

Architecture Analysis for ETL Processing - CPU vs GPU

Explore GPU acceleration for ETL operations, comparing CPU and GPU architectures. Learn about performance gains in database operations and SQL query acceleration using GPUs.

• YouTube
• 19 minutes
• On-Demand
• Free Video

Paul G. Allen School

GraphLab - Machine Learning for Big Data in the Cloud

Explore GraphLab, a framework for efficient parallel machine learning algorithms handling Big Data. Learn about its advantages over existing tools and its impact on large-scale tasks.

• YouTube
• 33 minutes
• On-Demand
• Free Video

USENIX

Fast Inference for Probabilistic Graphical Models

Innovative system for efficient probabilistic graphical model inference, offering significant speedup through optimized memory management, parallelization, and flexible integration with sampling algorithms.

• YouTube
• 18 minutes
• On-Demand
• Free Video

USENIX

PUZZLE: Efficiently Aligning Large Language Models through Light-Weight Context Switching

Efficient system for aligning large language models, optimizing model orchestration and workload switching to minimize overhead and improve performance in AI alignment tasks.

• YouTube
• 15 minutes
• On-Demand
• Free Video

USENIX

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Innovative framework for efficient deep learning training parallelization, using primitives and constraints to generate optimized execution plans, outperforming existing solutions for popular DNN models.

• YouTube
• 14 minutes
• On-Demand
• Free Video

USENIX

DistServe: Disaggregating Prefill and Decoding for Goodput-Optimized Large Language Model Serving

Innovative approach to optimize large language model serving by separating prefill and decoding phases, improving performance and meeting latency requirements for various applications.

• YouTube
• 15 minutes
• On-Demand
• Free Video

USENIX

DRust - Language-Guided Distributed Shared Memory with Fine Granularity and Full Transparency

Explores DRust, a Rust-based distributed shared memory system that leverages language ownership semantics for improved efficiency and scalability in distributed computing environments.

• YouTube
• 16 minutes
• On-Demand
• Free Video

USENIX

Massively Parallel Multi-Versioned Transaction Processing

Explore Epic, a groundbreaking GPU-based database system that revolutionizes multi-versioned transaction processing, offering enhanced performance and efficiency for high-contention OLTP workloads.

• YouTube
• 15 minutes
• On-Demand
• Free Video

The Julia Programming Language

A Fast and Flexible CFD Solver with Heterogeneous Execution - JuliaCon 2024

Explore WaterLily.jl: a fast, flexible CFD solver for CPUs and GPUs. Learn about its meta-programming approach, performance, and potential for ML integration and differentiability.

• YouTube
• 22 minutes
• On-Demand
• Free Video

The Julia Programming Language

Julia Community Reshapes Computation in Geosciences

Explore Julia's impact on geosciences: ecosystem tools, hardware acceleration, and collaborative initiatives revolutionizing Earth observation and software development in the field.

• YouTube
• 11 minutes
• On-Demand
• Free Video