Explore the fundamentals of Apache NiFi for Internet of Things (IoT) applications in this comprehensive 53-minute conference talk presented by Timothy J Spann from Cloudera. Delve into edge data ingestion, Apache Flink, and data visualization techniques. Gain insights into NiFi's history, key features, and concepts such as provenance, structured data, and stateless engine. Learn about configuration files, cluster parameters, retry flows, and back pressure. Discover how to work with readers, writers, and reporting tools. Explore practical applications including IoT flows, database ingestion, and data flow management. Watch a live demo showcasing Knife Flow, data flows, and integration with Slack and Kafka. Understand minify SQL queries, data storage solutions, and the importance of full provenance in IoT data processing.
Overview
Syllabus
Introduction
Agenda
Edge Data Ingest
Apache Flink
Data Visualization
History of NiFi
Features of NiFi
Provenance
Structured Data
Stateless Engine
Configuration File
Cluster Parameters
Retry Flow
Back Pressure
Reader and Writer
Reporting
Lookup Records
ingesting databases
IoT flows
NiFi hurdles
Demo
Knife Flow
Data Flow
Warm Data
Send to Slack
Score
Thermal Data
Kafka
minify
SQL queries
Data flows
Data Storage
Conclusion
Full Provenance
Taught by
Linux Foundation
