Creating smaller, faster, production-worthy mobile machine learning models
Who is this presentation for?
- Developers, data scientists, AI enthusiasts, mobile developers, product designers, and product managers
Getting ML models ready for use on device is a major challenge. Drag-and-drop training tools can get you started, but the models they produce aren’t small enough or fast enough to ship. Jameson Toole explains optimization, pruning, and compression techniques that keep app sizes small and inference speeds high.
There are flexible model architectures that meet performance and accuracy requirements across devices and platforms. You’ll discover pruning and distillation techniques to optimize model performance and use quantization tools to compress models to a fraction of their original size. Along the way, you’ll see a practical example of this process as you create an artistic style transfer model that’s just 17 KB. All of these techniques are applied to mobile ML frameworks like Core ML and TensorFlow Lite.
- Experience with mobile ML frameworks like Core ML or TensorFlow Lite
- A basic understanding of how neural networks are designed and trained
What you'll learn
- Learn techniques for optimizing mobile ML models for production, both in terms of size and inference speeds
Jameson Toole is the cofounder and CEO of Fritz AI, a company building tools to help developers optimize, deploy, and manage machine learning models on mobile devices. Previously, he built analytics pipelines for Google X’s Project Wing and ran the data science team at Boston technology startup Jana Mobile. He holds undergraduate degrees in physics, economics, and applied mathematics from the University of Michigan and both an MS and PhD in engineering systems from MIT, where he worked on applications of big data and machine learning to urban and transportation planning at the Human Mobility and Networks Lab.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
Premier Diamond Sponsors
Premier Exhibitor Plus
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
For media/analyst press inquires