Presented By O'Reilly and Cloudera
Make Data Work
31 May–1 June 2016: Training
1 June–3 June 2016: Conference
London, UK

Reactive Streams: Linking reactive applications to Spark Streaming

Luc Bourlier (Lightbend)
12:05–12:45 Friday, 3/06/2016
Spark & beyond
Location: Capital Suite 13 Level: Intermediate
Average rating: **...
(2.00, 1 rating)

Prerequisite knowledge

Attendees should have a basic knowledge of Java, Scala, and Spark.

Description

The Reactive Manifesto describes the four characteristics defining a reactive application: responsive, resilient, elastic, and message driven. Reactive Streams, one of the tools used to create reactive applications, is a small API for the JVM that defines the interfaces needed to connect a stream of data, with back-pressure, to the parts of a reactive application. And with the addition of back-pressure support in Spark Streaming in Spark 1.5, it is simpler than ever before to use these three technologies together.

Luc Bourlier explores communication with back-pressure, describes its implementation in Reactive Streams, and shows how it can be used to integrate Spark Streaming in reactive applications.

Photo of Luc Bourlier

Luc Bourlier

Lightbend

Luc Bourlier has been working on the JVM since 2002, first for IBM on the Debugger team of the Eclipse project, where he wrote the expression evaluation engine. After a few other Eclipse projects, Luc went to TomTom to recreate their data distribution platform for over-the-air services. He then joined Lightbend to work on the Eclipse plugin for Scala before switching to the Fast Data team to focus on deployment and interaction of streaming systems.