It has been another exciting week on Hortonworks Community Connection HCC. We continue to see great activity and recommend the following assets from last week.
Nifi 1.0.0 Beta UI Introduction by:hsowell
The Apache Nifi community recently released the beta version of Apache Nifi 1.0.0. This version comes with significant updates, which include a UI refresh, transition to zero master clustering, added multi-tenant authorization, and templates that are now deterministically ordered allowing for version controlled templates!
Five Infrequently Known Commands To Debug Your HDFS Issues by:mliu
When you do “hdfs dfs -cat file1” from the command line, you get the exception saying that it “Cannot obtain block length for LocatedBlock”. Usually this means the file is still in being-written state. Read the article for tips and techniques in debugging.
Dynamic List Filtering with NiFi by:cstanca
This article is not meant to show how to install or create a “Hello World” Nifi data flow, but how to resolve a data filtering problem with NiFi providing two approaches, using a filter list as a file on the disk, which could be static or dynamic, and a list stored in a distributed cache populated from the same file.
Using Pig to convert uncompressed data to compressed data in HDFS by:myoung
ORC provides many benefits, including support for compression. However, there are times when you need to store “raw” data in HDFS, but want to take advantage of compression. One such use case is with Hive external tables.
Simple Kafka Producer using Java in a Kerberozied cluster by:sgowda
Kafka from 0.9 onwards started support SASL_PLAINTEXT ( authentication and non-encrypted) for communication b/w brokers and consumer/produce r with broker.
Come over to HCC and participate.