This tutorial is for you because:
You are working with ELK and need to understand and scale your system.
Etsy migrated to ELK for log ingestion and searching in 2014 after a year of planning and testing. Since then, it’s grown from tens of millions of log lines to over five billion per day. During this time, Etsy has learned many lessons around choosing hardware, measuring the impact of change, and working around the limitations of Elasticsearch and Logstash and developed tooling to help monitor and continue scaling the system up.
Deploying and scaling ELK is often a trial by fire. Avleen Vig covers sizing your cluster, monitoring and extracting metrics from it, and patterns for effectively scaling it up as your logs grow and teaches you to design and grow your own ELK cluster with large log volumes. You’ll leave knowing how to correctly design and deploy your Elasticsearch cluster, how to monitor and observe changes to ELK, and how to scale your system.
The talk will be delivered in three parts:
Avleen Vig is a staff operations engineer at Etsy, where he spends much of his time growing the infrastructure for selling knitted gloves and cross-stitch periodic tables. Before joining Etsy, Avleen worked at several large tech companies, including EarthLink and Google, as well as a number of small successful startups.
©2016, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org