Build Systems that Drive Business
Sep 30–Oct 1, 2018: Training
Oct 1–3, 2018: Tutorials & Conference
New York, NY

Migrating Spotify's runtime to Kubernetes

James Wen (Spotify)
9:35am–10:05am Monday, October 1, 2018
Location: Sutton Center Level: Intermediate

Who is this presentation for?

  • Tech leads, architects, migration road managers, infrastructure engineers, and site reliability engineers

Prerequisite knowledge

  • A basic understanding of Kubernetes, containerization, and application development

What you'll learn

  • Learn how Spotify migrated all of its runtime to Kubernetes
  • Understand common pitfalls to avoid in the migration process as well as useful tips and technical approaches and integrations

Description

Spotify’s infrastructure is undergoing a drastic transformation from data centers running a large amount of proprietary services to public cloud-hosted, cloud-native services. Two years ago, all of Spotify’s services ran on its own hardware. Today, they are running in hosts on the cloud in Google Cloud Platform, and Spotify is in the process of replacing many of its proprietary systems with open source, cloud-native solutions like Kubernetes.

James Wen discusses the specific migration process Spotify followed for moving services and all of runtime to Kubernetes, covering the tightly scoped migration stages that were utilized and the lessons learned at each step. Join in to learn how one company successfully underwent a drastic transition.

Photo of James Wen

James Wen

Spotify

James Wen is a site reliability engineer at Spotify, where he’s currently focused on revamping Spotify’s infrastructure and adopting Kubernetes. Previously, James was the team lead (anchor) of the Cloud Foundry buildpacks team at Pivotal and a core contributor and maintainer of Bundler. James has spoken about buildpacks at Cloud Foundry Summit Europe and Spotify’s infrastructure journey and migrations at QCon New York, KubeCon Europe, and DevfestDC. He loves climbing, whether it’s on gorgeous Fontainebleau slopers or nasty plastic crimps.