Skip to main content
Make Data Work
Oct 15–17, 2014 • New York, NY

Scaling Storm: Cluster Sizing and Performance Optimization

P. Taylor Goetz (Hortonworks )
4:15pm–4:55pm Thursday, 10/16/2014
Hadoop Platform
Location: Hall A 23/24
Average rating: ****.
(4.33, 6 ratings)

Scaling Storm: Cluster Sizing and Performance Optimization

One of the most commonly asked questions about Storm is how to properly size and scale a cluster for a given use case. While there is no magic bullet when it comes to capacity planning for a Storm cluster, there are many operational and development techniques that can be applied to eek out the maximum throughput for a given application. In this session we’ll cover capacity planning, performance tuning and optimization from both an operational and development perspective. We will discuss the basics of scaling, common mistakes and misconceptions, how different technology decisions affect performance, and how to identify and scale around the bottlenecks in a Storm deployment.

P. Taylor Goetz


P. Taylor Goetz is an Apache Storm committer and release manager and has been involved with the usage and development of Storm since it was first released as open source in October of 2011. As an active contributor to the Storm user community, Taylor is lead on a number of open-source projects related to Storm. Specifically, he has developed numerous technologies that enable integration of Storm into the enterprise. He has also authored a number of open source storm projects which enable enterprises to integrate Storm into heterogeneous infrastructure.

Comments on this page are now closed.


Colin Wilson
11/11/2014 1:52pm EST

Slides look like they were posted on Taylor’s slide share for people looking:

Andy Welch
10/22/2014 8:54pm EDT

Might you post the deck?