July 20–24, 2015
Portland, OR

Mesos: The operating system for your datacenter

David Greenberg (Two Sigma)
5:00pm–5:40pm Thursday, 07/23/2015
Scale Portland 251
Average rating: ****.
(4.36, 11 ratings)

Prerequisite Knowledge

Some exposure to the pains of operating groups of machines, either as a developer or sysadmin.

Description

The talk will be structured in three parts:
1) What is Mesos?
2) How can I leverage existing open source on Mesos?
3) Why should I build my next application on Mesos?

In the first part of the talk, I’ll describe what Mesos is—a kernel for your datacenter. When computers were first used, only one program ran on them at a time, and it had to be loaded arduously by punchcards. Later on, the operating system was invented, which allowed for many programs to run on one machine, seamlessly sharing resources and providing common infrastructure, like the filesystem, network, and display.

Mesos serves this role for distributed systems: it provides isolation (like processes); common APIs (like sys calls); and basic services (like messaging/filesystems). I’ll also explain the terminology used by Mesos (e.g. what are Masters, Slaves, Frameworks, Executors, and Tasks).

In the second part of the talk, I’ll review the applications that run out-of-the box on Mesos. We’ll briefly look at Marathon (a PaaS on Mesos, similar to the init process in Unix), Chronos (a time-based scheduler like cron), Spark (an exciting big data analysis platform), and several other applications.

In the final part of the talk, I’ll explain why you should build your next application on Mesos. We’ll learn about Mesos’s internal architecture and design, so that the API will make sense to you. We’ll also go over a few approaches to deciding when and how to build your application on Mesos, and the benefits you’ll derive from that.

Photo of David Greenberg

David Greenberg

Two Sigma

David Greenberg loves learning. He currently works at Two Sigma, where he leads several efforts to build reliable, distributed, cluster computing environments. He also enjoys writing Clojure.