Engineer for the future of Cloud
June 10-13, 2019
San Jose, CA

Everything is a little bit broken; or, The illusion of control

Heidi Waterhouse (LaunchDarkly)
4:45pm5:25pm Wednesday, June 12, 2019
Building Resilient Systems
Location: LL21 C/D

Who is this presentation for?

  • Architects, SREs, and people who are operating at the edges of system tolerance



What you'll learn

  • Gain some concrete ideas about how to add resiliency to your system


We never change the amount of work or technical debt; we just shift it, and with it, we change how it emerges and appears. Our systems don’t have to be perfect to be operational—planes, networks, and elite athletes all function at extremely high levels even though they are not operating at 100%. As an industry, we have moved the locus of control from hardware to operating system to virtual machine to container to orchestration, and now we’re approaching serverless.

None of that has reduced the amount of work you have to do; it just makes it so you can reuse and conceptually compress the work of others. Since we’re making the work in our tools less visible, we also have less control over how they work. We assume the promises that have been true will continue to be true, but that isn’t in our control.

Heidi Waterhouse asks, How do we handle this level of uncertainty? You’ll learn to add in error budgets, layered access, and other accommodations for failure and to design your systems for function over form or purity. You’ll leave with some concrete ideas about how to add resiliency to your system by learning to trust but mitigate your reliance on perfect performance of your underlying tools.

Photo of Heidi Waterhouse

Heidi Waterhouse


Heidi Waterhouse is a developer advocate with LaunchDarkly. She delights in working at the intersection of usability, risk reduction, and cutting-edge technology. One of her favorite hobbies is talking to developers about things they already knew but had never thought of that way before. She sews all her conference dresses so that she’s sure there is a pocket for the mic.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)