Presented By O'Reilly and Cloudera
Make Data Work
September 26–27, 2016: Training
September 27–29, 2016: Tutorials & Conference
New York, NY

Kentucky Transportation Cabinet: Monitoring road activities with a real-time snow and ice information management system using Spark and Hadoop

Vinee Kumar (Dept of Transportation)
9:30am–10:00am Tuesday, 09/27/2016
DCS
Location: 1 E 12/ 1 E 13 Level: Intermediate
Average rating: ***..
(3.67, 3 ratings)

In Kentucky, managing and monitoring snow and ice removal is necessary from October to March. This requirement is critical for the safety of the traveling public as well as the economy of Kentucky. It is further driven by federal requirements that define real-time systems mandating information accuracy and notification of construction and road closures within 20 minutes. However, Maintenance had previously been unable to apply predictive analytics to move to a proactive management stance to prepare for and manage snow events prior to and when happening.

As a result, the Kentucky Transportation Cabinet (KYTC) invested significant time and energy into building a new real-time system that utilizes a combination of commercial and open source software as well as crowdsourced data. The most significant factor for a new system, however, had more to do with the weather. Kentucky suffered a significant increase in snow and ice expenses during the unforgiving 2013–2014 and 2014–2015 seasons. While average winters cost somewhere in the range of $40–$50 million, the storms of 2013–2014 and 2014–2015 each exceeded $75 million. Beyond cost, each season brought with it very unique challenges. Those two winter seasons emphasized the need for more detailed management and optimization of our material usage and responsiveness to weather events.

Last year marked the beginning of major changes within KYTC’s Intelligent Transportation Systems program, as the KYTC began integrating streaming data—crowdsourced from Waze, Twitter, weather reports, sensors, and snow truck status—to improve public safety, reduce congestion, and enhance operations. Vineet Kumar offers an overview of the system and shares how the data is processed using GeoEvent Processor, ArcServer, SDE, and Hadoop.

Photo of Vinee Kumar

Vinee Kumar

Dept of Transportation

Vineet Kumar works as the Kentucky Transportation Cabinet’s data architect. Vineet has 14 years of IT experience, has worked with many database product vendors like Oracle, Microsoft, and IBM, and has played many key roles including developer, database designer, and data warehouse architect. In his free time, he writes technical blogs. Vineet is passionate about open source products. His goal is to provide business data in real time to business users for analytics.