Explore how a major bank governs open source data technologies in the fast-paced world of real-time analytics. Learn about ING's approach to embracing and contributing to open source projects, addressing the need for control in a landscape dominated by technologies like Kafka, Flink, Storm, Beam, and Nifi. Discover the bank's strategy for building missing components, implementing data governance, and managing metadata in a real-time environment. Gain insights into becoming a "sheriff" in the open source "wild west," making governance simple and effective, and developing tools like the OpenIP API editor and specification. Understand the importance of standardized metadata, federated open metadata landscapes, and the integration of open source in the financial sector. Examine the relationship between data and metadata, data types, and the current landscape of data governance in banking.
A Sheriff in the Wild West - How to Govern Open Source Data Technology
Overview
Syllabus
Introduction
History
Governance at ING
Data governance
Metadata
Real time data
Kafka
ETL
Becoming a sheriff
Nice sheriff
Governance is easy
Selling the story
Making governance simple
OpenIP API editor
OpenIP API specification
API specification editor
API data definition
API endpoint definition
Consistency
Esperanto
Open Metadata
What do we do
federated open metadata landscape
standardized metadata
open metadata landscape
Open source integration
Linux Foundation
Market understanding of open source
I know it before lunch
Bringing data and metadata together
Data types
Onetoone relationship
Data is governed
Current landscape
Taught by
Devoxx
