Apache Storm

Introduction to Real Time
Analytics using Apache Storm
www.edureka.in/apache-storm
Buy Complete Course at : www.edureka.in/apache-storm
Batch Starts On: 17th May 07:00 AM , IST / 16th May 06:30 PM, PDT
Course Fee: USD 329 / INR (17795 + 12.36% Service tax)**
Introductory (15% OFF) Price : USD 280 / INR 15126
For Existing edureka Customers (25% OFF) Price : USD 247/ INR 13346
* Offer expires on 11th May
Post your Questions on Twitter on @edurekaIN: #askEdureka

Objectives of this Session
• Un
• The need for Real Time Analytics - Usecases
• How does Storm come to rescue?
• Where does Storm fit in Hadoop Framework?
• Storm Architecture – Components of Storm
• Quiz to reinforce your learning
For Queries during the session and class recording:
Post on Twitter @edurekaIN: #askEdureka
Post on Facebook /edurekaIN

Need of Real Time Analytics
Ret
• Banking - Fraud Transaction Detection
• Telecommunication – Silent Roamers Detection
• Retail- Inventory Dynamic Pricing
• Social Networking- Trending Topics
*Covered in module 5 and 6 in the course
www.edureka.in/apache-stormTwitter @edurekaIN, Facebook /edurekaIN, use #askEdureka for Questions

Growing Interest in Apache Storm

Storm Usecases – Need for Real Time Analytics
Twitter Trends
Responsive Logs
Source: https://github.com/nathanmarz/storm/wiki/Powered-By
Custom Magazine Feeds
Real Time Video Analytics
Enable Clinicians to Make
Medical Decisions
Compare and Display
Real Time Prices

What is Storm ?
 Apache Storm is a free and open source distributed real-time computation system.
 Storm makes it easy to reliably process unbounded streams of data.
 Storm does for real-time processing what Hadoop did for batch processing.
 Simple, can be used with any programming language.

Understanding the Storm Architecture
Nimbus
Zookeeper
Supervisor
Zookeeper
Zookeeper
Supervisor
Supervisor
Supervisor
Supervisor
*Covered in module 2 in the course
Twitter @edurekaIN, Facebook /edurekaIN, use #askEdureka for Questions

ZooKeeper
Nimbus ZooKeeper
ZooKeeper
Supervisor
Supervisor
Supervisor
Supervisor
Supervisor
Nimbus node (master node, similar to the Hadoop
JobTracker):
» Uploads computations for execution
» Distributes code across the cluster
» Launches workers across the cluster
» Monitors computation and reallocates
workers as needed
ZooKeeper nodes:
» Coordinates the Storm cluster
Supervisor nodes :
» Communicates with Nimbus through
Zookeeper, starts and stops workers
according to signals from Nimbus
Storm Components
A Storm cluster has 3 sets of nodes
1. Nimbus node
2. Zookeeper nodes
3. Supervisor nodes

The work is delegated to different types of components that are each responsible for a simple specific processing task.
The input stream of a Storm cluster is handled by a component called a spout.
The spout passes the data to a component called a bolt, which transforms it in some way.
A bolt either persists the data in some sort of storage, or passes it to some other bolt.
Storm Topology
spout
spout
bolt
bolt
bolt
bolt
passes data
passes data
transforms data
data storage
Input Data
Source

Why Storm is ideal for Real Time Processing
Fast – benchmarked as processing one million, 100 byte messages, per second per node.
Scalable – with parallel calculations that run across a cluster of machines.
Fault-tolerant – when workers die, Storm will automatically restart them. If a node dies, the
worker will be restarted on another node.
Reliable – Storm guarantees that each unit of data (tuple) will be processed at least once or
exactly once. Messages are only replayed when there are failures.
Easy to operate – standard configurations are suitable for production on day one. Once
deployed, Storm is easy to operate.
http://hortonworks.com/hadoop/storm/

MapReduce
(Batch)
INTERACTIVE
(Text)
ONLINE
(HBase)
STORM
(Streaming)
GRAPH
(Giraph)
IN-MEMORY
(Spark)
HPC MPI
(OpenMPI)
OTHER
(Search)
(Weave..)
http://hadoop.apache.org/docs/stable2/hadoop-yarn/hadoop-yarn-site/YARN.html
Storm in the Hadoop Framework

Upcoming Batch for Storm
Start Date:
17th May (07:00 AM – 10:00 AM, India Time) / 16th May (06:30 PM – 09:30 PM, Pacific Time)
Curriculum:
Module 1: Introduction of Big Data and Storm
Module 2: Getting Started with Storm
Module 3: Spouts and Bolts
Module 4: Trident Topologies
Module 5: Real Life Storm Project – 1
Module 6: Real Life Storm Project – 2
Price:
Introductory Discount : 15%
Discount for Existing Edureka Customers: 25%

Annie’s Question
Storm can be used in:
- Real-time Processing
- Batch Processing
- Both

Annie’s Answer
Real-time Processing

Annie’s Question
Which of them can be a source of Stream?
- Spout
- Bolt
- Both

Annie’s Answer
Both

Annie’s Question
It is not possible to run Storm process along with MapReduce jobs inside a
Hadoop Cluster.
- True
- False

Annie’s Answer
False. With Hadoop 2.0, it is possible.

Annie’s Question
A Nimbus Node is similar to TaskTracker Node in Hadoop Cluster.
- True
- False

Annie’s Answer
No. A Nimbus Node is more like a JobTracker Node in Hadoop

Annie’s Question
A Storm topology is defined in terms of
- Nimbus, Zookeeper, Supervisor nodes
- Spout, Bolt
- Spout, Bolt, Nimbus, Zookeeper, Supervisor nodes
- Spout, Bolt, Zookeeper node

Annie’s Answer
Spout and Bolt

Questions?
Buy Complete Course at : www.edureka.in/apache-storm
Batch Starts On: 17th May 07:00 AM , IST / 16th May 06:30 PM, PDT
Introductory (15% OFF) Price : USD 280 / INR 15126
For Existing edureka Customers (25% OFF) Price : USD 247/ INR 13346
* Offer expires on 11th May

Apache Storm

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (20)

Semelhante a Apache Storm

Semelhante a Apache Storm (20)

Mais de Edureka!

Mais de Edureka! (20)

Último

Último (20)

Apache Storm