Modern Industrial Data Platform - Technical Deep Dive

Explore a technical conference presentation from SK TECH SUMMIT 2023 that delves into two smart approaches for Data Scientists, Engineers, and Platform operators in SKT's Modern Industrial Data Platform. Learn about On Demand Data Mesh, which enables easy deployment and management of distributed Federated Query Engine (Trino Cluster) on kubernetes with blue-green deployment support, and Active Meta, an innovative solution that automatically generates fresh metadata through active data pipeline monitoring and column-level lineage tracking. Presented by Han-eul Jang and Hyung-eun Kim from SK Telecom's AI Data Platform team, discover how these technologies enhance data platform observability, enable proactive issue detection, and support root cause analysis while reducing dependency on traditional catalog services and manual metadata maintenance.