Explore the world of Apache NiFi 2.0 Python Processors in this conference talk from Conf42 Python 2024. Dive into the latest features of NiFi 2.0.0, focusing on Python processors and their applications in data processing and generative AI. Learn about extracting company names, handling GTFS data, working with web VTT files, and integrating with WatsonX SDK. Discover how to monitor systems, generate synthetic data using Faker, and download Wikipedia pages in various formats. Watch a live demo showcasing these capabilities and gain insights into the future of data processing with Apache NiFi and its integration with generative AI technologies.
Building Apache NiFi 2.0 Python Processors - Conf42 Python 2024
Overview
Syllabus
intro
preamble
about tim
flank stack weekly by tim spann
future of data - nyc + nj + philly + virtual
generative ai
rapid innovation in the llm space
cloudera generative ai stack
apache nifi and real-time genai
readyflow gallery
cloudera + llms
nifi 2.0.0 features
python processors
extract company names
get compound gtfs data
extract text from web vtt
watsonx sdk to foundation
system / process monitoring
generate synthetic records w/ faker
download a wiki page as html or wikiformat text
get gtfs data
other python processors
demo
thank you
Taught by
Conf42
Related Courses
-
Adding Generative AI to Real-Time Streaming Pipelines - Conf42 LLMs 2024
-
Enriching Generative AI Events in Real-Time Streaming Pipelines
-
FLiPN Stack for Edge AI - Flink, NiFi, Pulsar
-
Apache NiFi, Kafka, RisingWave, and Iceberg for Stock Data Processing with LLM - Conf42 Python 2024
-
ChatGPT Masterclass: From Basics to Advanced Applications
