Scaling Storm: Cluster Sizing and Performance Optimization
One of the most commonly asked questions about Storm is how to properly size and scale a cluster for a given use case. While there is no magic bullet when it comes to capacity planning for a Storm cluster, there are many operational and development techniques that can be applied to eek out the maximum throughput for a given application. In this session we’ll cover capacity planning, performance tuning and optimization from both an operational and development perspective. We will discuss the basics of scaling, common mistakes and misconceptions, how different technology decisions affect performance, and how to identify and scale around the bottlenecks in a Storm deployment.
P. Taylor Goetz is an Apache Storm committer and release manager and has been involved with the usage and development of Storm since it was first released as open source in October of 2011. As an active contributor to the Storm user community, Taylor is lead on a number of open-source projects related to Storm. Specifically, he has developed numerous technologies that enable integration of Storm into the enterprise. He has also authored a number of open source storm projects which enable enterprises to integrate Storm into heterogeneous infrastructure.
Comments on this page are now closed.