Presented By O'Reilly and Cloudera
Make Data Work
September 26–27, 2016: Training
September 27–29, 2016: Tutorials & Conference
New York, NY

Spark and Java: Yes, they work together

Jesse Anderson (Big Data Institute)
4:35pm–5:15pm Thursday, 09/29/2016
Spark & beyond
Location: Hall 1B Level: Intermediate
Tags: real-time
Average rating: *****
(5.00, 2 ratings)

Prerequisite knowledge

  • Intermediate-level Java knowledge
  • A beginner-level understanding of how Spark works (No knowledge of the Spark API is required.)
  • What you'll learn

  • Understand how to leverage your Java knowledge with Spark to get the best of both worlds without having to learn Scala
  • Description

    Most people are surprised to know that Spark works with Java. Maybe they saw the initial Java code that used anonymous classes and dismissed it as an ungainly mess. They were right—plain Java and Spark are ugly together. Then Java 8’s lambdas came along. Now, instead of an ungainly mess, we get the tight syntax of lambda expressions offering code that is readable and testable. Best of all, it uses Java.

    Jesse Anderson demonstrates how to create Java lambdas and integrate them with Spark to process data. Then Jesse explains how to find Java resources about Spark and outlines the pros and cons for a Java developer to learn Scala.

    Learning two big concepts at once is often a nonstarter. People learning Spark are often learning Scala at the same time. If we can remove one big concept (learning Scala), people will be more successful at learning Spark.

    Photo of Jesse Anderson

    Jesse Anderson

    Big Data Institute

    Jesse Anderson is a data engineer, creative engineer, and managing director of the Big Data Institute. Jesse trains employees on big data—including cutting-edge technology like Apache Kafka, Apache Hadoop, and Apache Spark. He’s taught thousands of students at companies ranging from startups to Fortune 100 companies the skills to become data engineers. He’s widely regarded as an expert in the field and recognized for his novel teaching practices. Jesse is published by O’Reilly and Pragmatic Programmers and has been covered in such prestigious media outlets as the Wall Street Journal, CNN, BBC, NPR, Engadget, and Wired. You can learn more about Jesse at