cta

Get Started

cloud

Ready to Get Started?

Download sandbox

How can we help you?

closeClose button
April 26, 2016
prev slideNext slide

Inaugural Apache Kafka Summit 2016 Kickoff

HDF 1.2 Kerboros Support

Introduction

Confluent is pleased to announce the inaugural Kafka Summit 2016 to be held in San Francisco on April 26. The inaugural Kafka Summit is a full day conference that brings together the Apache Kafka community. At Hortonworks, since we are committed to delivering data-in-motion and data-at-rest completely in the open, we continue to introduce enterprise feature requirements and drive that innovation into the public domain. In addition, Hortonworks DataFlow (HDF) 1.2, a data-in-motion platform for real-time streaming data was just released in the first quarter of this year. HDF improves support for streaming analytics, Apache Storm and Apache Kafka. Hortonworks Community Connection’s (HCC) Future of Data: San Francisco will be hosting a Storm/Kafka Meetup, “Securing Kafka Clusters” with Parth Brahmbhatt, Sr. Software Engineer at Neltflix and Apache Storm Committer & PMC and Sriharsha Chintalapani, Storm/Kafka Tech Lead at Hortonworks, Apache Kafka Committer, Apache Storm Committer & PMC on May 25 6:00 to 9:00 PM .

Highlights

The Kafka Summit is packed with useful content from a diverse group of developers, experts, core committers and leading production end users. Here are some of my personal key highlights:

  1. Chris Fregly from IBM will discuss Generating Real-time Recommendations with NiFi, Kafka, and Spark.
  2. Julian Hyde, Data Architect at Hortonworks will discuss Streaming SQL and how Apache Calcite’s planner optimizes queries for throughput and latency.
  3. Jun Rao, co-founder at Confluent will discuss Securing Kafka and the threats that Kafka Security mitigates, the changes made to Kafka to enable security, and the steps required to secure an existing Kafka cluster.
  4. Danny Yuan, Staff Software Engineer at Uber will discuss Stream Processing with Kafka at Uber with use cases not limited to real time aggregation of geospatial time series, pattern detection across event streams and forecasting of marketplace dynamics.

Hortonworks and Kafka

At Hortonworks we continue to see strong enterprise adoption of Kafka across large, real time data integration and stream processing projects. Hortonworks has contributed extensively to Apache Kafka 0.9 and earlier releases. Some of the highlights of that recent work include –

  1. Client (producers, consumers, connect workers etc.) authentication to Kafka brokers using either Kerberos/SASL or TLS including support for Kerberos authentication between the broker and Zookeeper components
  2. Defining Kafka ACLs to allow authorizations for both client requests as well as inter broker operations in a secure cluster
  3. Support for encryption of network traffic via TLS for both client/broker and inter broker communication
  4. Adding a new partitioner interface for Kafka producers with the goal of allowing producers to specify and implement a new partitioning strategy that isn’t supported out of the box

To learn more click here

Leave a Reply

Your email address will not be published. Required fields are marked *