Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Building Blocks of Distributed Systems - Parts 1 & 2

USENIX via YouTube

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Dive into a comprehensive two-part conference talk from SREcon19 Asia/Pacific that explores the essential building blocks of distributed systems. Learn about orchestration, load balancing, databases, and storage services through the lens of designing a large data processing pipeline. Engage in an interactive session where John Looney from Facebook discusses crucial concepts, including pipeline and batch systems, failover, lockservers, consensus algorithms, queues, data storage, and database types. Participate in a collaborative design review of a theoretical pipeline system to solidify your understanding of these complex topics. Gain valuable insights into the challenges and solutions in distributed systems architecture, from CAP theorem to cluster filesystems, in this comprehensive 1 hour and 23 minutes presentation.

Syllabus

Intro
Pipeline & Batch Systems (Part 1)
Orchestration: Finding, Ordering, Sharding
Making Reliability Worse: Failover
Lockservers, discovery
Clients, self-resolution
So, what lockserver ?
Let's talk about Consensus
Consensus Challenges
Consensus; Requirements
Consensus; Raft
Spot the Difference!
Ordered Queues: Pain And Suffering
Queues: PubSub & SQS
Queues: Kafka, Log Device, Kinesis
Data Storage: CAP Theorem
Data Storage; B-Trees vs. LSM
Data Storage: Weak vs Strong Isolation
Data Storage: Database Types
Datacenter / Cluster Filesystems
Useful Distributed DB/Cluster patterns

Taught by

USENIX

Reviews

Start your review of Building Blocks of Distributed Systems - Parts 1 & 2

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.