Build Systems that Drive Business
Sep 30–Oct 1, 2018: Training
Oct 1–3, 2018: Tutorials & Conference
New York, NY

Performance anomaly detection at scale (sponsored by Salesforce)

Tuli Nivas (Salesforce)
1:30pm–2:10pm Tuesday, October 2, 2018
Location: Sutton Center Level: Intermediate
Average rating: *****
(5.00, 3 ratings)

Prerequisite knowledge

  • A basic understanding of performance engineering, data analysis, statistics, and linear regression

What you'll learn

  • Learn how to apply simple statistics to change how performance data is viewed and how to easily and effectively identify issues in production


As performance engineers, we understand the importance of software testing during and after development in order to identify any and all performance bottlenecks. Due to various constraints—whether a scaled-down test environment, data volume, or code integration limitations—it’s not always possible to catch all bugs in test. If performance bottlenecks are not identified and resolved in a timely manner, there’s a chance customers may be impacted. As a result, anomaly detection in production takes on an even bigger significance.

The scale at which this kind of anomaly detection needs to be done is noteworthy—few servers in test versus thousands of servers in production, with time being of the utmost essence. That’s why anomaly detection at scale is one the biggest challenges for a performance engineer. One of the most widely used techniques to identify performance bugs is to look at time series data for the various metrics, which can then be used to find potential problems. However, this approach doesn’t scale well in production, even if time series data can be consolidated into a few charts. Tuli Nivas shares techniques that address how time consuming this kind of analysis can be and demonstrates how applying simple statistics and basic linear regression principles can improve productivity of a performance engineer tenfold or more.

This session is sponsored by Salesforce.

Photo of Tuli Nivas

Tuli Nivas


Tuli Nivas is a principal performance engineer at Salesforce with extensive experience in design and implementation of test automation and monitoring frameworks. Her interests lie in software testing, cloud computing, big data analytics, systems engineering, and architecture. Tuli holds a PhD in computer science with a focus on building processes to set up robust and fault-tolerant performance engineering systems.

Comments on this page are now closed.


Picture of Tuli Nivas
10/04/2018 1:01pm EDT

Hi Jim, I did upload the presentation to the Velocity website. Are you on able to see/download it?

10/04/2018 12:14pm EDT

Wondering if the presentation will be posted here?