Apache Storm 0.9.2 Released with New Features

Apache Storm overhauls transport in Netty and adds REST API for monitoring and visualization

The Apache Storm community recently announced the release of Apache Storm 0.9.2, which includes improvements to Storm’s user interface and an overhaul of its netty-based transport.

We thank all who have contributed to Storm – whether through direct code contributions, documentation, bug reports, or helping other users on the mailing lists. Together, we resolved 112 JIRA issues.

Here are summaries of this version’s important fixes and improvements.

New Feature Highlights

Netty Transport Overhaul

Storm’s Netty-based transport has been overhauled to significantly improve performance through better utilization of thread, CPU, and network resources, particularly in cases where message sizes are small.

UI Improvements with a New REST API

This release also includes a number of improvements to the Storm UI service. A new REST API exposes metrics and operations in JSON format, which the UI now uses.

The new REST API will make it considerably easier for other services to consume available cluster and topology metrics for monitoring and visualization applications. The Storm UI service now includes a powerful tool for visualizing the state of running topologies that is built on top of this API.

storm

Kafka Spout

This is the first Storm release to include official support for consuming data from Kafka 0.8.x. In the past, development of Kafka spouts for Storm had become somewhat fragmented and finding an implementation that worked with certain versions of Storm and Kafka proved burdensome.

This is no longer the case. The storm-kafka module is now part of the Storm project and associated artifacts are released to official channels (Maven Central) along with Storm’s other components.

Storm Starter & Examples

Similar to the external section of the codebase, we have also added an examples directory and pulled in the storm-starter project to ensure it will be maintained in lock-step with Storm’s main codebase.

Plugable Serialization for Multilang

In previous versions of Storm, serialization of data to and from multilang components was limited to JSON, which came with somewhat of a performance penalty. The serialization mechanism is now plugable and enables the use of more performant serialization frameworks like protocol buffers in addition to JSON.

Download and Learn More

Categorized by :
Administrator CIO & ITDM Data Analyst & Scientist Data Management Developer New Features Operations & Management Storm Stream Data

Comments

adolfo
|
June 30, 2014 at 12:38 pm
|

an article about how to use the new Plugable Serialization for Multilang feature could be a nice post for this blog!

Leave a Reply

Your email address will not be published. Required fields are marked *

If you have specific technical questions, please post them in the Forums

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Join the Webinar!

Big Data Virtual Meetup Chennai
Wednesday, October 29, 2014
9:00 pm India Time / 8:30 am Pacific Time / 4:30 pm Europe Time (Paris)

More Webinars »

HDP 2.1 Webinar Series
Join us for a series of talks on some of the new enterprise functionality available in HDP 2.1 including data governance, security, operations and data access :
Contact Us
Hortonworks provides enterprise-grade support, services and training. Discuss how to leverage Hadoop in your business with our sales team.
Integrate with existing systems
Hortonworks maintains and works with an extensive partner ecosystem from broad enterprise platform vendors to specialized solutions and systems integrators.