Andy: NiFi, MiNiFi fundamentals (technical intro) – Intelligently Collecting Data from Edge to Core with Apache NiFi and MiNiFi
Discover Apache NiFi and MiNiFi from a core contributor. Whether you are new to the concept of data flow, or want details about how to route, transform, and process millions of events per second, this session will bring new information in an understandable format. Become familiar with the concepts and tools available to simplify, strengthen, and secure your flow. Learn about the new NiFi Registry to ease flow versioning, deployment, and promotion between environments. And get a first look at future enhancements and feature roadmaps for upcoming releases.
Tim: Ingesting Real-time Camera Images and Sensor Data with MiniFi and Apache NiFi.
I will run through a live example of using MiniFi to orchestrate, control and capture sensor data from a Raspberry Pi device. We will also ingest live webcam images. This device has a neural compute stick for enhanced VPU to run multiple deep learning algorithms on live captured webcam images. The MiniFi agent will then stream the data securely to an HDF 3.1 cluster running Apache NiFi 1.5. We will use Apache NiFi to parse, filter, join, transform, fork, analyze, query, sort, dissect and enrich the data using open source tools including Apache OpenNLP, Apache Tika and Apache MXNet.
Andy LoPresto is a Sr. Member of Technical Staff at Hortonworks working on the Hortonworks DataFlow team. In this role he serves as both a Committer and Project Management Committee Member for Apache NiFi, an open source, robust, secure data routing and delivery system. Andy focuses on security concerns within NiFi including identity management, TLS negotiation, data protection, access control, encryption and hashing. Andy is also involved with the sub-project, Apache MiNiFi, which drives edge data collection, including secure command and control and immediate data provenance and governance. He has presented about NiFi at DataWorks Summit Sydney 2017, Hadoop Summit San Jose 2016, FOSDEM ’17 in Brussels, and the OpenIoT Summit 2017.
Tim Spann is an avid blogger and the Big Data Zone Leader for Dzone (https://dzone.com/users/297029/bunkertor.html). He runs the the successful Future of Data Princeton meetup with over 830 members at http://www.meetup.com/futureofdata-princeton/. He is currently a Solutions Engineer at Hortonworks in the Princeton New Jersey area. You can find all the source and material behind his talks at his Github and Community blog: