Our next meetup has been scheduled covering application/integration of NiFi with Solr and Lucene. Agenda below:
Networking and Food
NiFi & Docker 💧+🐳
Presented by Aldrin Piri – Hortonworks
No technology is complete without a showcasing of how it can be used within the Docker ecosystem! This talk will cover how Docker can help your development and integration of NiFi. We will cover some of the fundamentals of why Docker has risen to prominence, its ecosystem, and how we can take advantage of these tools working with NiFi for development, testing, clustering, and more.
Aldrin is a developer for Hortonworks where he works on Apache NiFi as part of Hortonworks Data Flow (HDF). Aldrin likes automation, Docker, and championing do-while loops. You can find him on Twitter, @aldrinpiri.
Building Data Pipelines for Solr with Apache NiFi
Presented by Bryan Bende – Hortonworks
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It supports highly configurable directed graphs of data routing, transformation, and system mediation logic. Some of NiFi’s key features include a web-based user interface for monitoring and controlling data flows, guaranteed delivery, data provenance, and easy extensibility through custom processor development.
These features make NiFi a perfect candidate for building production quality data pipelines that interact with Apache Solr. This talk will demonstrate how to use a NiFi processor that delivers data to a Solr update handler, as well as a processor for extracting data from Solr on regular intervals for delivery to down-stream systems. In addition we will show how these processors can be combined with other built-in NiFi processors to solve a variety of use cases, including log aggregation, and indexing messages received from Kafka.
Bryan Bende is a Software Engineer at Hortonworks where he develops dataflow capabilities around the core framework of Apache NiFi. He has over ten years of experience developing enterprise software solutions with Java and supporting technologies. Bryan received a B.S. in Computer Science from the University of Maryland at College Park, and a M.S. in Computer Science from John Hopkins University.