Explore how Microsoft manages over a million databases in SQL Azure through this conference talk from PASS Data Community Summit. Dive into big data techniques for cloud troubleshooting, telemetry scaling, and data collection strategies. Learn about building batch pipelines, utilizing table and blob storage, and creating dashboard systems. Discover cloud service fundamentals and approaches to petabyte-scale telemetry. Gain insights on near real-time alerting and the potential of machine learning in database management. Understand the challenges and solutions in managing massive-scale database operations in the cloud.
Managing 1 Million+ DBs - How Big Data is Used to Run SQL Azure
PASS Data Community Summit via YouTube
Overview
Syllabus
Intro
Talk Motivation
Troubleshooting Models
Cloud Troubleshooting Model
Telemetry Scenarios
Disclosures
Telemetry Scaling - Lessons Learned
What Data To Collect?
Building Batch Pipelines
Table Storage
Blob Storage + SQL Database
Example Dashboard/Report System
Cloud Service Fundamentals
Approach 3 - Petabyte Scale Telemetry
Approach 3 - Details/Limitations
(Near Real-Time) Alerting
Using Machine Learning Option 1: Go get R-it is free
Taught by
PASS Data Community Summit
