Building a Business-Critical Data Platform to Process Over £34 Billion in Card Transactions

Explore the journey of building a PCI DSS compliant data platform on Kubernetes to process over £34 billion in card transactions in this 37-minute conference talk by Sandeep Mehta and Richard Oastler from Paymentsense/Dojo. Discover how cloud-native technologies are used to abstract the complexity of ingesting and processing data in the UK's largely unchanged payments infrastructure. Learn about the challenges of working with legacy and proprietary file formats in a highly regulated industry, and gain insights into security measures, auto-scaling techniques, data observability practices, data transformation methods, schema evolution strategies, and data governance considerations implemented in this business-critical platform.