Presented By O'Reilly and Cloudera
Make Data Work
March 13–14, 2017: Training
March 14–16, 2017: Tutorials & Conference
San Jose, CA
Kaarthik Sivashanmugam

Kaarthik Sivashanmugam
Principal Sofware Engineer, Microsoft

Website | @kaarthikss

Kaarthik is a Principal Software Engineer in the AI Tools and Infrastructure group at Microsoft with expertise in building data and machine learning platforms. In his current role, he is building a scale-out deep learning platform to unlock the full potential of GPU Cloud + Data + Machine Learning techniques in addressing complex AI challenges and enabling magical end-user experiences in various Microsoft services. Kaarthik is also involved in enhancing Azure Machine Learning service to make it the best cloud-platform for data scientists and ML engineers.


4:20pm5:00pm Wednesday, March 15, 2017
Spark & beyond
Location: LL21 C/D Level: Beginner
Secondary topics:  Architecture, Data Platform, Media
Average rating: ***..
(3.00, 3 ratings)
Spark powers various services in Bing, but the Bing team had to customize and extend Spark to cover its use cases and scale the implementation of Spark-based data pipelines to handle internet-scale data volume. Kaarthik Sivashanmugam explores these use cases, covering the architecture of Spark-based data platforms, challenges faced, and the customization done to Spark to address the challenges. Read more.