June 15–18, 2020

Serverless architecture for AI applications

Rustem Feyzkhanov (Instrumental)
4:50pm5:35pm, Thursday, 18 June, 2020
Location: Great America Meeting Room 3

Who is this presentation for?

  • Architects and DevOps engineers

Level

Intermediate

Description

ML and DL are becoming more and more essential for businesses in internal and external use; one of the main issues with deployment is finding the right way to train and operationalize the model. Rustem Feyzkhanov digs into how use AWS infrastructure to use a serverless approach for deep learning, providing cheap, simple, scalable, and reliable architecture.

Serverless architecture changes the rules of the game—instead of thinking about cluster management, scalability, and query processing, you can focus completely on training the model. The downside of this approach is that you have to keep in mind certain limitations and how to correctly organize the training and deployment of your model.

You’ll learn how to train and deploy TensorFlow and PyTorch models on AWS infrastructure and how you can easily use pretrained models for your tasks. The AWS function-as-a-service solution—Lambda—can achieve very significant results, such as 20K–30K runs per one dollar (completely pay-as-you-go model), 10K functions can be run in parallel, and it easily integrates with other AWS services. It allows you to easily connect it to an API, chatbot, database, or stream of events.

Prerequisite knowledge

  • General knowledge of AWS
  • A basic understanding of DL

What you'll learn

  • Learn how to architect serverless ML and DL in your cloud pipeline and if ML and DL serverless is right for you and your company
  • Identify hidden problems and tricks when using serverless DL and ML
Photo of Rustem Feyzkhanov

Rustem Feyzkhanov

Instrumental

Rustem Feyzkhanov is a machine learning engineer at Instrumental, where he creates analytical models for the manufacturing industry. Rustem is passionate about serverless infrastructure (and AI deployments on it) and is the author of the course and book Serverless Deep Learning with TensorFlow and AWS Lambda.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

pr@oreilly.com

For media/analyst press inquires