Presented By O'Reilly and Cloudera
Make Data Work
Dec 4–5, 2017: Training
Dec 5–7, 2017: Tutorials & Conference
Singapore

Engineering cloud-native machine learning applications

11:15am11:55am Wednesday, December 6, 2017
Data engineering and architecture, Machine Learning
Location: Summit 1 Level: Beginner

Who is this presentation for?

  • Software developers, data scientists, data engineers, and product managers

What you'll learn

  • Learn how to design and build cloud-native machine learning applications

Description

In the current Agile business environment, where developers are required to experiment multiple ideas and also react to various situations, doing cloud-native development is the way to go. However, being cloud native means autoprovisioning, autoscaling, and autoredundancy. The benefits are huge, but writing cloud-native applications requires a major shift in the developer mindset from modules to services and from object-oriented to functional code.

Harjinder Mistry and Bargava Subramanian explain how to design and build a microservices-based cloud-native machine learning application, drawing on their own application, written and deployed entirely in Python. The application consists of multiple microservices that collaborate with each other to ingest data and generate real-time machine learning-driven recommendations for end users and customers. The microservices are deployed on OpenShift; the data is stored in cloud storage; and the application leverages Amazon Web Services and Google Cloud Platform for cloud compute and machine learning. You’ll learn to visualize the different layers involved in cloud computing and leave able to write your own cloud-native applications with ease.

Topics include:

  • How to divide the application into a set of microservices
  • How to debug and unit test program
  • How to set up the required environment in the cloud
  • How to write program in a cluster-native way
  • How to handle different data sources
  • How to write deployment scripts
Photo of Harjindersingh Mistry

Harjindersingh Mistry

Ola

Harjinder Mistry is a Principal Research Engineer at Ola, where he is building a cloud-native data-science platform to solve challenging problems of fleet management. Previously, he engineered data platforms for a couple of interesting data-science projects: OpenShift.io at RedHat and Watson ML Platform at IBM. Earlier, he spent several years in the DB2 SQL Query Optimizer team, building and fixing the mathematical model that decides query execution plan. Harjinder holds an MTech from IIIT, Bangalore, India.

Photo of Bargava Subramanian

Bargava Subramanian

Independent

Bargava Subramanian is a machine learning engineer based in Bangalore, India. Bargava has 14 years’ experience delivering business analytics solutions to investment banks, entertainment studios, and high-tech companies. He has given talks and conducted numerous workshops on data science, machine learning, deep learning, and optimization in Python and R around the world. He mentors early-stage startups in their data science journey. Bargava holds a master’s degree in statistics from the University of Maryland at College Park. He is an ardent NBA fan.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)