Serverless architecture for AI applications
Who is this presentation for?
- Architects and DevOps engineers
ML and DL are becoming more and more essential for businesses in internal and external use; one of the main issues with deployment is finding the right way to train and operationalize the model. Rustem Feyzkhanov digs into how use AWS infrastructure to use a serverless approach for deep learning, providing cheap, simple, scalable, and reliable architecture.
Serverless architecture changes the rules of the game—instead of thinking about cluster management, scalability, and query processing, you can focus completely on training the model. The downside of this approach is that you have to keep in mind certain limitations and how to correctly organize the training and deployment of your model.
You’ll learn how to train and deploy TensorFlow and PyTorch models on AWS infrastructure and how you can easily use pretrained models for your tasks. The AWS function-as-a-service solution—Lambda—can achieve very significant results, such as 20K–30K runs per one dollar (completely pay-as-you-go model), 10K functions can be run in parallel, and it easily integrates with other AWS services. It allows you to easily connect it to an API, chatbot, database, or stream of events.
- General knowledge of AWS
- A basic understanding of DL
What you'll learn
- Learn how to architect serverless ML and DL in your cloud pipeline and if ML and DL serverless is right for you and your company
- Identify hidden problems and tricks when using serverless DL and ML
Rustem Feyzkhanov is a machine learning engineer at Instrumental, where he creates analytical models for the manufacturing industry. Rustem is passionate about serverless infrastructure (and AI deployments on it) and is the author of the course and book Serverless Deep Learning with TensorFlow and AWS Lambda.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
For media/analyst press inquires