Monitoring data from tools like OpenTSDB is typically used for dashboards and alerts, but applying techniques used in the data science, financial, and scientific computing fields to real-time monitoring data can drive deeper understanding about infrastructure. Rob Claire introduces the monitoring tools Pinterest uses and offers real-world examples of problem solving with data monitoring.
Rob walks attendees through practical examples of importing and shaping time series data with Python data tools, including pandas and StatsModels, and graphing libraries like Matplotlib. Using Jupyter Notebook examples, Rob then discusses the types of problems that can be solved with this approach, including automatically detecting site performance and availability issues, building a real-time network graph with the NetworkX library, and predicting the rate of disk utilization for an HBase cluster.
Rob Claire is an engineer on the visibility team at Pinterest, where he focuses on extracting insight from real-time operational data. Rob has more than 17 years of experience in the fields of data engineering, DevOps, and performance tuning. His career has included stints at One King’s Lane, Slide, Ning, and eBay.
©2016, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com