Get the free Ebook:
Private and Open Data in Asia: A Regional Guide.
Today’s big data streaming frameworks are in high demand to process immense amounts of data from a rapidly growing set of disparate data sources. Beyond the requirements of fault tolerance, persistence, and scalability, streaming engines need to provide a programming model where computations can be easily expressed and deployed in a distributed manner. GearPump meets this objective while differentiating itself from other streaming engines by elevating and promoting the actor model as the primary entity permeating the framework. What we set out to build is a simple and powerful streaming framework. The Scala language and Akka offer a higher level of abstraction allowing frameworks to focus more on the application and make the engine more lightweight. Main points:
Sean Zhong was a cloud architect in Intel’s Big Data engineering group. Sean’s expertise is in streaming, and he is the creator of Apache Gearpump as well as a PMC member of Apache Storm. Besides streaming, Sean participates in many other Apache projects, including Hadoop NativeTask and HBase media object storage.
©2015, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com
Apache Hadoop, Hadoop, Apache Spark, Spark, and Apache are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries, and are used with permission. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event, which is managed by O'Reilly Media and/or Cloudera.