Artificial intelligence is already helping many businesses become more responsive and competitive, but how do you move machine learning models efficiently from research to deployment at enterprise scale? It’s imperative to plan for deployment from day one, both in tool selection and in the feedback and development process.
As recently as a few years ago, data scientists were the people who played in a sandbox—when they came up with a useful model, it was thrown over the wall to another team that would reimplement it to put it into production. Those days are over now: there’s only one Git repo in the entire company, and everything you commit is essentially in production. But teams are still run as if data science is mainly about experimentation.
Sourav Day and Alex Ng share best practices for working in this new reality. Data scientists can still play in a sandbox but must do so in a way such that offers a turnkey solution to take models into production. Just as in DevOps, where people work at the intersection of development and operations, today people are working at the intersection of data science and software engineering and need to be integrated into the team with tools and support. Manifold developed the Lean AI process and the open source Orbyter package for Docker-first data science to help do just that.
Sourav and Alex explain how to streamline a machine learning project and help your engineers work as an an integrated part of your development and production teams.
Sourav Dey is CTO at Manifold, an artificial intelligence engineering services firm with offices in Boston and Silicon Valley. Previously, Sourav led teams building data products across the technology stack, from smart thermostats and security cams at Google Nest to power grid forecasting at AutoGrid to wireless communication chips at Qualcomm. He holds patents for his work, has been published in several IEEE journals, and has won numerous awards. He holds PhD, MS, and BS degrees in electrical engineering and computer science from MIT.
Alexander Ng is a senior data engineer at Manifold. His previous work includes a stint as engineer and technical lead doing DevOps at Kryuus as well as engineering work for the Navy. He holds a BS in electrical engineering from Boston University.
Comments on this page are now closed.
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org