All Software Architecture, All the Time
June 10-13, 2019
San Jose, CA

Rearchitecting for cloud native; Or, All we changed was everything

J.R. Jasperson (Twilio SendGrid)
4:50pm–5:35pm Wednesday, June 12, 2019
Cloud native, Distributed systems, Scale
Location: 210 C/G
Secondary topics:  Best Practice
Average rating: ***..
(3.43, 7 ratings)

Who is this presentation for?

  • Architects, engineers, and DevOps practitioners

Level

Intermediate

Prerequisite knowledge

  • Basic knowledge of the disposition and capabilities of public clouds

What you'll learn

  • Reimage all facets of your legacy architecture from the ground up to simultaneously solve scaling concerns and fully leverage the capabilities of the modern public cloud

Description

Twilio SendGrid, a business unit of Twilio, processes more than 50 billion marketing and transactional emails per month for companies like Airbnb, Pandora, Uber, and Spotify. Since its founding in 2009, the company has run the majority of its operations on-premises in a private cloud, dependent on public clouds only for ancillary workloads. In 2016, the company began a multiyear journey to rearchitect its most critical systems as a precursor to an anticipated migration to the public cloud (now underway).

The protocols, software, and systems that collectively drive email predate modern notions of the cloud by several decades. Classic email software architecture typically follows the assumptions of legacy infrastructure—its monolithic, stateful, scale-up posture is ill-suited to run in the cloud. Like pulling a thread on a knitted sweater, it quickly became apparent that sweeping changes would be required. Some systems were completely rebuilt from the ground up. Others were significantly redesigned. Systems, software, and data architecture; networking infrastructure and routing methodologies; messaging and eventing topologies; statefulness and persistence—virtually nothing remains as it was.

J.R. Jasperson covers some of the challenges SendGrid faced and their technical outcomes, including obviating legacy scale-up networking to eliminate choke points and route traffic through the most efficient path; eradicating state from CPU-bound components to take advantage of ephemeral compute; decoupling discrete components in the system to allow for independent scaling events; solving for nonlinear messaging and eventing complexity to accommodate hypergrowth on a higher-latency, jittery network; and developing solutions for distributed complex queuing and deduplication capabilities by building atop public cloud primitives and capabilities.

Photo of J.R. Jasperson

J.R. Jasperson

Twilio SendGrid

J.R. Jasperson is the CTO at Twilio SendGrid. A senior technology leader and strategist with a focus on architecture and engineering, he has over 20 years of experience working at internet services and SaaS companies as well as experience leading, designing, developing, and supporting enterprise-level, mission-critical infrastructure, OLTP, data warehouse/DSS, finance/reporting, marketing, CRM, and human resources systems at Fortune 50 companies.