Build Systems that Drive Business
June 11–12, 2018: Training
June 12–14, 2018: Tutorials & Conference
San Jose, CA

Distributed State

Manage distributed state in your applications

Explore the technical challenges and lessons learned in managing distributed state in large-scale applications that reliably process millions of events per second. Experts will share their experiences with data streams, events, and the storage systems that work best for them. Discover best practices, use cases, and tools for handling real-time data in streams and events.

We'll help you solve your toughest challenges with real-world advice from leaders in the field who have grappled with the same problems you're facing today. Like how to:

  • Handle issues with data consistency and serialization
  • Manage the need for and limitations of data snapshots
  • Pick the right database and indexes
  • Understand the tradeoffs between different types of storage
  • Scale out your data and plan its growth
  • Achieve distributed state, multi-tenancy, scalability, and resilience in a complex cloud-native distributed systems environment
11:25am–12:05pm Wednesday, June 13, 2018
Location: 230 B Level: Beginner
Secondary topics: Distributed State
John Mumm (Wallaroo Labs)
Average rating: *****
(5.00, 1 rating)
Coordination is a common source of performance problems when dealing with distributed state. John Mumm shares strategies for avoiding coordination and relying on local knowledge wherever possible along with pros and cons and tips for using in-memory state instead of the typical approach of using external data stores. Read more.
4:35pm–5:15pm Wednesday, June 13, 2018
Location: 230 B Level: Advanced
Secondary topics: Distributed State
Jon Tirsen (Square)
Average rating: *****
(5.00, 3 ratings)
Jon Tirsen explains how Square scaled out the backend for its Cash app using Vitess, a database middleware for MySQL built at YouTube. Read more.
4:35pm–5:15pm Wednesday, June 13, 2018
Location: LL21 E/F Level: Advanced
Secondary topics: Distributed State
John Miller (Fauna)
Average rating: *....
(1.33, 3 ratings)
The complexity of distributed databases makes building tools for their declarative automation a daunting engineering challenge. Drawing from his experience of developing multiple configuration automation systems for databases, John Miller explores patterns that generally apply to building declarative management tooling for distributed stateful systems. Read more.
11:25am–12:05pm Thursday, June 14, 2018
Location: LL21 A/B Level: Beginner
Secondary topics: Distributed State
Sean Allen (Wallaroo Labs)
Average rating: *****
(5.00, 3 ratings)
In 2007, Pat Helland published "Life Beyond Distributed Transactions: An Apostate’s Opinion," in which he conducts a thought experiment on how to design a distributed database that can scale almost infinitely. While the paper explicitly addresses distributed database design, Sean Allen shows that the ideas are far more widely applicable, particularly in scaling stateful applications. Read more.