It would be wildly irresponsible to deploy a release without extensive functional testing. Finding out you broke the checkout process after you released would be terrible. Ideally, you’d want to automatically test the entire app, and fail a build if certain critical use cases don’t function properly. At a minimum, you’d want transparency into what functional bugs and regression exist so you can make a cost-benefit analysis as to whether you still want to ship.
Since performance metrics can directly impact business goals like conversion rate as much as functionality can, why on earth would you ship a build without transparency about whether performance metrics are better or worse or performance issues were introduced or regressed? The answer is you shouldn’t. And if functional testing has taught us anything, it’s that integrating and automating testing as part of a build or CI system is critical to ensuring that consistent and repeatable insight.
Billy Hoffman explains how to integrate open source performance testing tools into your workflow, exploring practical tips and step-by-step examples. Along the way, Billy shares the lessons he’s learned helping organizations get these tools into CI and success stories about how this can reduce regressions and accelerate development while remaining confident about performance.
Billy Hoffman is the director of product at Rigor, where he focuses on delivering best-in-class performance software. From hacking into sites as a penetration tester to optimizing performance for the Fortune 500, Billy has over a decade of deep technical experience into the inner workings of complex web applications. Billy was the lead researcher at the web security software company SPI Dynamics, where he developed and automated new techniques to exploit web vulnerabilities and spoke extensively at conferences such as Black Hat and RSA about his findings. Following SPI’s acquisition by Hewlett-Packard, Billy managed HP’s web security research group. Billy founded the web performance company Zoompf, where he developed the industry’s first site-wide performance analysis product that tells you the root cause of your performance issues. He has spoken at industry conferences such as Velocity and was a contributing author for O’Reilly’s Web Performance Daybook. Billy holds a BS in computer science from the Georgia Institute of Technology. Outside of work, Billy enjoys refinishing rooms in his house and spending time with his wife, Jill, and their two daughters.
Comments on this page are now closed.
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org