Log Processing with Apache NiFi and Apache Kafka

Explore real-time log processing using open source tools Apache NiFi and Apache Kafka in this 46-minute technical workshop presented by Sophia Izokun from IBM at a Linux Foundation event. Learn how to leverage these powerful tools for log analytics, focusing on the NASA Kennedy Space Center web server logs as a practical example. Set up the environment, perform data transformation, create a Kafka Topic and NiFi Flow, establish a dataflow from NiFi to Kafka Topic, and load data from Kafka into OpenSearch for advanced log analytics. Gain hands-on experience in ingesting, indexing, and assessing information from computing system events, equipping yourself with valuable skills for efficient log processing and analysis.