Build Systems that Drive Business
June 11–12, 2018: Training
June 12–14, 2018: Tutorials & Conference
San Jose, CA

Improving performance with Tesser

Kyle Kingsbury (Jepsen)
3:40pm–4:20pm Thursday, June 14, 2018
Distributed Systems
Location: LL21 A/B Level: Intermediate
Secondary topics: Resilient, Performant & Secure Distributed Systems
Average rating: *****
(5.00, 3 ratings)

Prerequisite knowledge

  • Familiarity with functional collection techniques like map, filter, and reduce
  • Lisp experience (useful but not required)

What you'll learn

  • Explore Tesser, a Clojure library

Description

Many computational problems involve combining information from many elements in a collection: summing and counting, parsing, filtering, limiting and faceting, finding distributions and covariance matrices, and so on. Where the collection can be divided into chunks, we can dramatically improve performance through parallelization.

Kyle Kingsbury offers an overview of Tesser, a Clojure library for writing commutative, parallel folds that can be chained and composed into complex single-pass reductions that are dramatically faster on multicore systems and can be transparently distributed over Hadoop.

Photo of Kyle Kingsbury

Kyle Kingsbury

Jepsen

Kyle Kingsbury, aka Aphyr, is a computer safety researcher and independent consultant. He’s the author of the Riemann monitoring system, the Clojure from the Ground Up introduction to programming, and the Jepsen series on distributed systems correctness. He grills databases in the American Midwest.