Ensuring GDPR Compliance for Real-Time Data Pipelines

Explore strategies for implementing GDPR compliance in real-time data pipelines through this informative conference talk. Discover how Conde Nast leverages Databricks tools to address privacy regulations in their customer subscription data pipeline. Learn about short-term solutions using Delta Lake's Change Data Feed (CDF) for efficient data modification tracking and real-time GDPR compliance, including the 'right to be forgotten'. Gain insights into long-term plans for separating Personally Identifiable Information (PII) and implementing a secure data vault to minimize GDPR risks and enhance security. Ideal for data engineers, architects, and compliance officers, this session provides practical solutions for aligning data practices with privacy regulations using advanced technology. Presented by Emma Stein, Sr. Solutions Architect at Databricks, and Sarah Uludag, Data Engineer at Condé Nast, the talk offers valuable insights for organizations seeking to ensure privacy compliance in their data processing workflows.