Presented By O'Reilly and Cloudera
Make Data Work
Dec 4–5, 2017: Training
Dec 5–7, 2017: Tutorials & Conference

Smart agriculture: Blending IoT sensor data with visual analytics on Apache Hive and Spark

Mike Prorock (, Hugo Sheng (Qlik)
10:00am10:30am Tuesday, December 5, 2017
Average rating: ***..
(3.00, 2 ratings)

Mike Prorock and Hugo Sheng offer an overview of, a game-changing climate awareness solution that utilizes Apache Hive, Spark, ESRI, and Qlik. combines smart sensor technology, data transmission, and state-of-the-art visual analytics to transform the agricultural and turf management market. Utilizing real-time, in-place measurements, with advanced big data analytics and relevant external data, enables growers to monitor areas of concern, from water usage to feed storage conditions and beyond, providing immediate benefits to crop yield, supply costs, farm labor overhead, and water consumption.

The hardware sensor component, the “io Bulb,” measures temperature, moisture level, relative humidity, light levels, and conductivity. Each io Bulb sensor is configurable but typically sends eight data points per reporting cycle. These numbers are for the base configuration bulbs only. Obviously, as more sensors are attached (e.g., CO2 measurements or additional temp points), the numbers grow.’s platform uses AWS cloud solutions to focus resources on the devices and on the user experience of the platform rather than on infrastructure and traditional systems and operations management. Hive simplifies the storage of IoT data for analysis via Apache Spark, particularly when combining that data with other key datasets that inform regular analysis (water usage trends, problem alerting, etc.). Hive can also simplify access to the data with rapid data development platforms such as Qlik Sense, which enables to effectively merge the results of big data analytics from Apache Spark and external sources with historical in-memory analysis of sensor data and real-time feeds of data from devices.

Photo of Mike Prorock

Mike Prorock

Michael Prorock is founder and CTO at Michael is an expert in systems and analytics, as well as in building teams that deliver results. Previously, he was director of emerging technologies for the Bardess Group, where he defined and implemented a technology strategy that enabled Bardess to scale its business to new verticals across a variety of clients, and worked in analytics for Raytheon, Cisco, and IBM, among others. He has filed multiple patents related to heuristics, media analysis, and speech recognition. In his spare time, Michael applies his findings and environmentally conscious methods on his small farm.

Photo of Hugo Sheng

Hugo Sheng


Hugo Sheng leads Qlik’s partner engineering organization, which is responsible for both developer relations and the integration of global technology partner solutions with the Qlik platform. Hugo has spent over 20 years in data management and analytics, specializing in highly scalable big data solutions. Over his career, he has held senior roles at Torrent Systems, Ascential Software, and IBM and led sales engineering and services at Expressor Software (acquired by Qlik in 2012). Hugo also spent several years in software development in the medical device industry. Hugo holds a BS in electrical engineering from the University of Houston and an MBA from the Jones Graduate School of Business at Rice University.