newsletter

Get fresh updates from Hortonworks by email

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.

AVAILABLE NEWSLETTERS:

Sign up for the Developers Newsletter

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.

cta

Get Started

cloud

Ready to Get Started?

Download sandbox

How can we help you?

* I understand I can unsubscribe at any time. I also acknowledge the additional information found in Hortonworks Privacy Policy.
closeClose button
HDF > Develop Data Flow & Streaming Applications > Hello World

Storm in Trucking IoT on HDF

Deploying the Topology

cloud Ready to Get Started?

DOWNLOAD SANDBOX

Deploying the Topology

Introduction

Now that we know how to develop a Storm topology, let’s go over how to package it up into a JAR file and deploy it onto a cluster.

Outline

Packaging a JAR

In a terminal, navigate to the trucking-iot-demo-storm-on-scala directory and run:

scripts/rebuild-and-deploy-topology.sh

After installing some dependencies, this script runs the command sbt assembly under the hood in order to produce an uber jar, housing your topology and all of the dependencies. The jar is saved to target/scala-2.12/trucking-iot-demo-storm-on-scala-assembly-1.1.0.jar.

Deploying to Storm

If you ran the command in the previous section, then the topology was build and then also deployed.

scripts/rebuild-and-deploy-topology.sh

Feel free to open that script to see what it is doing. Notice that under the hood, it runs a command that looks like the following.

storm jar trucking-iot-demo-storm-on-scala/target/scala-2.12/trucking-iot-demo-storm-on-scala-assembly-1.1.0.jar com.orendainx.trucking.storm.topologies.KafkaToKafka

storm will submit the jar to the cluster. After uploading the jar, storm calls the main function of the class we specified (com.orendainx.trucking.storm.topologies.KafkaToKafka), which deploys the topology by way of the StormSubmitter class.

Summary

Congratulations! You now know about the role that Storm plays in a real-time data pipeline and how to create and deploy a topology from scratch.

User Reviews

User Rating
0 No Reviews
5 Star 0%
4 Star 0%
3 Star 0%
2 Star 0%
1 Star 0%
Tutorial Name
Storm in Trucking IoT on HDF

To ask a question, or find an answer, please visit the Hortonworks Community Connection.

No Reviews
Write Review

Register

Please register to write a review

Share Your Experience

Example: Best Tutorial Ever

You must write at least 50 characters for this field.

Success

Thank you for sharing your review!