Explore how Twitter maximizes performance with BigQuery in this 16-minute video from Google Cloud Tech. Discover the process of a tweet reaching hundreds of millions of people and the rapid data processing behind it. Join Priyanka as she interviews Gary and Saurabh from Twitter, delving into how data from over 200 million users flows through Twitter's data center and Google Cloud. Learn about Twitter's data migration architecture, use cases for BigQuery, data storage management, organization, and security. Gain insights into the challenges of handling data at scale and how Twitter leverages BigQuery to process millions of queries each month across tens of thousands of tables in Google Cloud.
How Twitter Maximizes Performance with BigQuery
Overview
Syllabus
- Intro
- How does Twitter process data?
- How does Twitter’s data get to Google Cloud?
- Twitter’s data migration architecture
- Use cases for BigQuery at Twitter
- How does Twitter manage storage?
- How does Twitter organize data?
- Data storage hierarchy & provisioning
- How does Twitter secure & monitor data?
- Twitter’s challenges for data at scale
- BigQuery at Twitter
- Wrap up
Taught by
Google Cloud Tech
