Put open source to work
July 16–17, 2018: Training & Tutorials
July 18–19, 2018: Conference
Portland, OR

The SMACK stack on Mesosphere DC/OS using cloud infrastructure

John Dohoney (Mesosphere), Kaitlin Carter (Mesosphere)
9:00am–12:30pm Tuesday, July 17, 2018
SMACK stack
 Location: D137/138
Level: Intermediate
Average rating: *****
(5.00, 1 rating)
Download slides (PDF)

Who is this presentation for?

  • Architects, DevOps engineers, developers, and system administrators

Prerequisite knowledge

  • A working knowledge of a text editor (e.g., making minor changes to files, copy/paste, and saving files), command-line curl, JSON and YAML syntax (e.g., indention rules and how to properly create JSON objects with proper syntax), installing software using curl, wget, and package managers, and command-line SSH and SCP (e.g., ssh –I ~/.ssh/mykey.pem foo@52.23.13.14)

Materials or downloads needed in advance

  • A WiFi-enabled laptop (Windows, Linux, or macOS) that does not use a corporate proxy (It's best to bring your personal laptop to avoid issues.)
  • The following software installed:
    • curl (test: curl –version)
    • wget (test: wget –version)
    • Python 3 (for Ansible) (test: python3 –version)
    • The text editor of your choice
    • An SSH/SCP tool (Windows users only)
    • OpenSSH (test: ssh-add ~/.ssh/somekey.pem; ssh-add –L)
    • The non-proxy-ed browser of your choice with unrestricted access on Port 22, Port 443, and Port 80 from both the browser and the command line (If you are not sure, bring your personal laptop to be safe. Corporate proxies block ipv4-style IP address and many reserved ports we will be using in this class.)
  • Bookmark the following pages: YAML Lint and JSON Lint (If you are new to either of these, take a quick tutorial online to become familiar with the syntax, particularly the error messages.)

What you'll learn

  • Understand the rationale for cloud-based infrastructure and the DC/OS Catalog
  • Learn how to deploy the SMACK stack from both the DC/OS Catalog and command-line interface (CLI) and deploy a demo application that uses a streaming architecture on the SMACK stack

Description

Economic growth is currently dominated by companies transforming how we live our lives with highly personalized, data-informed, real-time interactions. For the first time in recent history, 7 of the 10 most valuable companies in the world are internet giants. Their success comes partly from being able to develop globally scalable application infrastructure to provide individualized experiences that support and fulfill, surprise and delight, and inform and entertain. To regain a competitive edge, most traditional enterprises need to emulate these capabilities using the same tools that power the internet giants. However, due to obsolete skills and fear of change, they find the requirements needed to support those solutions, such as unfamiliar cloud-native infrastructure, tools, and techniques, difficult.

Many of the patterns and tools developed and used by technology companies have been democratized through open source and cloud tools. Google designed Kubernetes, drawing on its decade-long experience with container orchestration; Facebook built the Cassandra distributed database to provide massive backend scale; and LinkedIn created Kafka to handle the massive scale for distributed message-based applications, while on the management side, Twitter showed the world how to improve user experience using Apache Mesos to pool and automate running containerized data intensive applications. As a result, all of the once-closed capabilities of the Silicon Valley elite are now widely available and supported. Given the know-how, anyone can leverage these tools to tap into the near limitless capacity of cloud-native applications.

John Dohoney and Kaitlin Carter walk you through deploying the SMACK stack on DC/OS. This architecture enables you to create modern streaming applications that make use of NoSQL databases with Cassandra and highly reliable message streaming with Apache Kafka using analytics streaming with Apache Spark, all running under Apache Mesos implemented with Akka streaming and asynchronous Java libraries under DC/OS. The tutorial will be conducted on cloud instances using AWS.

Photo of John Dohoney

John Dohoney

Mesosphere

John Dohoney is a certified solution architect at Mesosphere.

Photo of Kaitlin Carter

Kaitlin Carter

Mesosphere

Kait Carter is a foundational courseware developer at Mesosphere. Kait has six years’ experience in the technology industry, with special interests in infrastructure, automation, and teaching. All of her technology roles have revolved around helping system administrators.

Comments on this page are now closed.

Comments

Picture of Kaitlin Carter
Kaitlin Carter | FOUNDATIONAL COURSEWARE DEVELOPER
07/17/2018 7:25am PDT

Hi Chris, you should be able to download the pdf version of our slides at the top of this page, under “Rate This Session”.

Chris Thorman | VP, ENTERPRISE ARCHITECTURE
07/17/2018 2:44am PDT

Couldn’t find the uploaded slides on the class or speaker pages, but would love to get them. Can you post the URL?