Skip to main content

Mesos: An SDK for Distributed Systems Developers

Connor Doyle (Mesosphere.io), Niklas Nielsen (Mesosphere, Inc.), Adam Bordelon (Mesosphere)
1:30pm–5:00pm Sunday, 07/20/2014
Cloud | Tools & Techniques
D136
Tutorial Please note: to attend, your registration must include Tutorials.
Average rating: ***..
(3.38, 8 ratings)
Slides:   external link,   external link

THIS TUTORIAL HAS REQUIREMENTS AND INSTRUCTIONS LISTED BELOW

In this tutorial, the experts from Mesosphere will explain the core concepts behind writing frameworks for Apache Mesos, including a detailed description of the low-level tools at your disposal as a framework author. Attendees are encouraged to follow along on their own computers as we demonstrate how to write elastic services using several popular programming languages (without a single line of networking code). Participants will leave with the skills to build the future of distributed systems!

Agenda:

  • Introduction to Apache Mesos
  • When to write a Framework
  • Environment Setup
  • Hands-On Implementation
  • Q & A

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications. It can run Apache Hadoop, Apache Spark, MPI, Hypertable, Storm, Chronos, Marathon, and other applications on a dynamically shared pool of nodes. The biggest user of Mesos is Twitter, where it runs on tens of thousands of cores. Airbnb runs all of their data infrastructure on it, processing petabytes of data.

TUTORIAL REQUIREMENTS AND INSTRUCTIONS FOR ATTENDEES

* No prior knowledge of Apache Mesos or distributed systems is required.
* Familiarity with at least one of the target languages (Python, Scala, or Go) will be helpful.
* All attendees should bring a laptop with Vagrant and VirtualBox pre-installed.

QUESTIONS for the speaker?: Use the “Leave a Comment or Question” section at the bottom to address them.

Photo of Connor Doyle

Connor Doyle

Mesosphere.io

Connor Doyle is a software engineer at Mesosphere, focused on developing tools around Apache Mesos. Before joining Mesosphere, Connor worked at the design firm Gensler where he worked on process improvement, internal libraries and distributed architecture in Scala. He completed his Master’s degree at the University of Wisconsin – La Crosse, where his capstone project was a distributed simulator for doing multi-agent learning research.

Photo of Niklas Nielsen

Niklas Nielsen

Mesosphere, Inc.

Engineer at Mesosphere working at Apache Mesos. Prior to Mesosphere, I worked at Adobe on the Flash VM and Google V8, as well as a secret next-generation VM. Did my Master’s at Lawrence Livermore National Lab, working on debugging tools for future exascale systems.

Adam Bordelon

Mesosphere

Adam is a distributed systems engineer at Mesosphere and works on Apache Mesos.
Before joining Mesosphere, Adam was lead developer on the Hadoop core team at MapR Technologies; he developed distributed systems for personalized recommendations at Amazon; and he rearchitected the LabVIEW compiler at National Instruments. He completed his Master’s degree at Rice University, building a tool to analyze supercomputer performance data for bottlenecks and anomalies.