Data Mesh and Compliance in Multi-Regional Data Lakes - Atlassian's Journey

Explore the implementation of Data Mesh at Atlassian in this 45-minute conference talk. Delve into the differences between logical and physical replication, understanding their implications and trade-offs. Learn about a product-agnostic replication protocol for logical replication and the application of schema enforcement using Data Contracts. Examine the challenges and solutions in deploying a multi-region data lake to accommodate cloud customers' AWS Region preferences for data storage. Discover strategies for regulatory compliance, including GDPR and FedRAMP, as well as advanced enterprise features like BYOK (Bring Your Own Key). See how the data lake supports various use cases, including Atlassian Analytics, in-product data experiences, ML training, and data exports using Delta Sharing, ultimately enhancing team potential. Presented by Mike Dias, Principal Data Platform Engineer, and Paul Ashley, Principal Software Engineer at Atlassian, this talk offers valuable insights into modern data architecture and compliance in a multi-regional context.