With the explosion of open source tooling for logging (e.g., Fluentd), monitoring (e.g., Prometheus), and tracing (e.g., OpenTracing, Zipkin, and Jaeger), there have never been more ways to observe and introspect application behavior. Often, quickly identifying and resolving application pathologies requires several of these tools to be used in concert. But in a world where software can be deployed in many different ways (such as clusters, VMs, containers, and functions), understanding which metrics correlate to behavior in different applications can be difficult.
In an ideal world, we would have a standardized way to identify running software systems that our monitoring tools could easily lean on, even when spread over multiple teams, geographies, and platforms. But real-world deployments are rarely so simple. Priyanka Sharma and Sabree Blackmon explain how application identity can be used as the basis for correlating metrics from multiple sources (with the help of OpenTracing) and detail some of the challenges inherent in defining application identity in different contexts (such as virtual machines, functions, and different Kubernetes primitives). They then offer an overview of open source projects like SPIFFE and SPIRE, which have modernized identity authentication across microservices, and demonstrate how SPIRE, Fluentd, Prometheus, and Zipkin can be used together to precisely correlate logs, metrics, and traces to improve and diagnose real-world production issues.
Priyanka Sharma is the director of cloud native alliances at GitLab, which automates the software development lifecycle with AutoDevOps. She is also a contributor to the OpenTracing project and a member of the Cloud Native Computing Foundation. A former entrepreneur with a passion for building developer products and growing them through open source communities, Priyanka advises startups at HeavyBit Industries, an accelerator for developer products. Priyanka holds a BA in political science from Stanford University.
Sabree is a Technologist and Developer Advocate at Scytale. He helps organize the SPIFFE and SPIRE open-source communities, while also mentoring engineers on application identity and security.
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org