Big Data Visualization in Public Health - Optimizing Respiratory Illness Dashboard with Databricks

Explore a 35-minute presentation on optimizing big data visualization for public health monitoring. Learn how the CDC enhanced its data processing methodology using Databricks to create responsive and timely visualizations for COVID-19, RSV, and influenza tracking. Discover the implementation of medallion architecture, smart SQL parameterization, and reusable software engineering templates to manage data in a common model and accelerate standard visualization delivery for datasets up to petabyte scale. Understand how self-service variable management improved maintenance, reduced costs, and increased scalability, resulting in up to tenfold efficiency gains in analysis and visualization processes. Gain insights from John Bowyer, Data Architect at CDC, on streamlining the journey from data acquisition to actionable insights in public health surveillance.