Logging Modernization and Cybersecurity at Scale with MiNiFi, Kafka and Flink

Explore an architecture for efficient log collection and cybersecurity monitoring at scale in this conference talk from ApacheCon 2022. Learn how to leverage Apache MiNiFi agents, Apache NiFi, Apache Kafka, and Apache Flink to collect logs from heterogeneous devices across globally distributed networks. Discover techniques for processing and normalizing diverse log patterns, performing streaming analytics, and generating alerts for effective network monitoring. Gain insights into applying this architecture to both on-premises and cloud-based deployments through a practical demonstration. Delve into topics such as the MiNiFi ecosystem, data flow functions, geolocation, data enrichments, and scaling strategies for comprehensive logging modernization and cybersecurity implementation.