Fueling innovative software
July 15-18, 2019
Portland, OR

Quota exceeded: Success and failure building an observability pipeline at The Home Depot

David Narayan (The Home Depot)
4:15pm–4:55pm Wednesday, July 17, 2019
OSCON Business Summit - Open Source in Enterprise Case Studies
 Location: C120-122
Secondary topics:  Customer Centered
Average rating: ****.
(4.67, 9 ratings)

Who is this presentation for?

  • Systems and software engineers

Level

Intermediate

Description

Technology is at the very center of delivering a great customer experience at The Home Depot—the world’s largest home improvement retailer, with a presence across 2,300 stores in North America. The applications and infrastructure that help power the operations of the company must maintain a high level of reliability to ensure that customer needs are being met. A little-known fact is that the company develops 90% of the software for its retail operations in-house.

David Narayan discusses the issues encountered while building an observability pipeline to collect logs, metrics, and traces from applications and infrastructure systems. You’ll learn how the company combined open source applications (Kafka and Envoy), homegrown applications (its streaming engine Siphon), and cloud products (Google BigQuery) to build a great experience for thousands of technology associates.

Prerequisite knowledge

  • Familiarity with the basic concepts of distributed systems and reliability engineering

What you'll learn

  • Learn the issues The Home Depot encountered while building a scalable, distributed system for logs, metrics, and traces (and how to overcome them)
  • Identify good patterns and practices to apply when designing large-scale distributed systems
Photo of David Narayan

David Narayan

The Home Depot

David Narayan is a distinguished engineer on the infrastructure team at The Home Depot, where he spends most of his time working on monitoring, performance engineering, and distributed systems.