Presented By O'Reilly and Cloudera
Make Data Work
31 May–1 June 2016: Training
1 June–3 June 2016: Conference
London, UK

The IoT with Apache NiFi and Hadoop: Better together

Emil Andreas Siemes (Hortonworks), Stephan Anne (Hortonworks)
14:55–15:35 Friday, 3/06/2016
IoT & real-time
Location: Capital Suite 2/3 Level: Intermediate
Tags: real-time, iot
Average rating: **...
(2.00, 7 ratings)

Prerequisite knowledge

Attendees should have coding experience.


Ever wondered how to get started with the IoT? How to get all the data from your sensors into your Hadoop cluster? How to link all the fancy Apache projects like Hadoop, Spark, R, HBase, and others together?

Basically you wonder how to create an Application on Hadoop for IoT.

Through hands-on investigations of two different applications using data from heart-rate sensors, mobile phones, and Raspberry Pis, Emil Andreas Siemes and Stephan Anné demonstrate how to use Apache NiFi to ingest, transform, and route sensor data into Hadoop and how to do further predictive analytics. Emil and Stephan also talk about and build generic code for other use cases (maybe yours?) as they walk you through code and share best practices around streaming, HBase, Spark, Solr, Zeppelin, R, and many more.

All code will be available on GitHub for direct application in real business applications.

Photo of Emil Andreas Siemes

Emil Andreas Siemes


Emil A. Siemes is a long-term Java veteran interested in building, running, and managing the next generation of data-driven web and mobile applications. After several years with Sun, Aplix, Wily, and SpringSource (VMware), Emil joined Hortonworks, where he helps customers modernize their data architectures with Hadoop.

Photo of Stephan Anne

Stephan Anne


Stephan Anné is a solution engineer at Hortonworks with a rich experience in presales. Previously, Stephan worked as a solutions consultant on a global base for NetApp and VMware, covering enterprise customers like Siemens and VW. He was the last employee with Sulzer GmbH, where he was a project leader for a strategical development project in the automobile industry. Stephan has also run his own company developing Java-based applications for sports monitoring. He is an ultramarathon runner and a three-time Marathon des Sables finisher. He has two boys, 8 and 11 years old.