Presented By O’Reilly and Cloudera
Make Data Work
March 5–6, 2018: Training
March 6–8, 2018: Tutorials & Conference
San Jose, CA

When tests cry wolf (sponsored by Pure Storage)

Ivan Jibaja (Pure Storage)
2:40pm–3:20pm Thursday, March 8, 2018
Sponsored
 Location: LL20 B

What you'll learn

  • Explore Pure Storage's streaming big data analytics pipeline for QA testing

Description

Pure Storage’s engineering runs a lean team, with only 5% dedicated to QA. As a result, the company has invested heavily in automated testing for a continuous integration and release cycle. Using open source technologies like Spark and Kafka, the company deployed a streaming big data analytics pipeline that processes over 70 billion events per day to prioritize, classify, deduplicate, and understand test failures. Ivan Jibaja discusses use cases for big data analytics technologies, the underlying elastic infrastructure that provides flexibility of scaling, agility, and simplicity across multiple application clusters, and lessons learned implementing the project.

This session is sponsored by Pure Storage.

Photo of Ivan Jibaja

Ivan Jibaja

Pure Storage

Ivan Jibaja is a software engineer at Pure Storage, where he leads the team that built a big data analytics pipeline for streaming telemetry data from Pure Storage’s testing infrastructure to classify, prioritize, and understand the root causes of bugs in the software development cycle. Ivan was a part of the core development team that built FlashBlade from the ground up. He holds a PhD in computer science from the University of Texas at Austin with a concentration in compilers and programming languages.