Presented By O’Reilly and Cloudera
Make Data Work
September 11, 2018: Training & Tutorials
September 12–13, 2018: Keynotes & Sessions
New York, NY
Arpan Agrawal

Arpan Agrawal
Software Engineer, LinkedIn

Arpan Agrawal is software engineer on the analytics platforms and applications team at LinkedIn. He holds a graduate degree in computer science and engineering from IIT Kanpur.

Sessions

4:20pm–5:00pm Thursday, 09/13/2018
Location: 1E 09 Level: Intermediate
Manoj Kumar (LinkedIn), Pralabh Kumar (LinkedIn), Arpan Agrawal (LinkedIn)
Average rating: *****
(5.00, 1 rating)
Have you ever tuned a Spark or MR job? If the answer is yes, you already know how difficult it is to tune more than hundred parameters to optimize the resources used. Manoj Kumar, Pralabh Kumar, and Arpan Agrawal offer an overview of TuneIn, an auto-tuning tool developed to minimize the resource usage of jobs. Experiments have shown up to a 50% reduction in resource usage. Read more.