Architecting Well-Rounded and Evolvable Data Platforms

Explore a comprehensive conference talk on architecting robust and adaptable data platforms. Delve into the challenges organizations face when building data lakes and learn about crucial cross-cutting concerns often overlooked in the initial stages. Discover the importance of metadata management, lineage tracking, reconciliation, retention, security, and data formats in creating accessible and valuable data lakes. Gain insights from Arun Manivannan, an experienced data engineer at ThoughtWorks and author of data science books, as he shares his expertise on building unified stores for structured, unstructured, and semi-structured data. Understand how to avoid common pitfalls and ensure your data platform is well-rounded and evolvable to meet the growing needs of your organization.