Usually data scientists find it challenging to create a clean REST API; likewise, web developers find it almost impossible to understand machine learning internals. And big data engineers tend to use clunky Hadoop distributions with dozens of tightly coupled tools and then continue to follow this design, developing data processing scripts that communicate through unmanageable state and shared flags. Hydrosphere.io helps data scientists and big data engineers plug into modern reactive and microservices architectures that have already been adopted by traditional web and enterprise teams.
Hadoop-based data platforms that power ETL jobs and machine learning pipelines are great examples of monolithic architectures that could be redesigned with microservices. Stepan Pushkarev walks you through building and deploying data processing, reporting services, training, and prediction pipelines as decoupled microservices connected with the rest of the enterprise architecture.
Topics include:
Stepan Pushkarev is CTO at hydrosphere.io, where he is responsible for product vision, sales strategy, and architecture and is still heavily involved in development. A technology entrepreneur, Stepan has cofounded two product startups so far. Previously, he spent 13 years in the software industry as a consulting engineer, architect, and CTO.
Comments on this page are now closed.
For exhibition and sponsorship opportunities, email SAconf@oreilly.com
For information on trade opportunities with O'Reilly conferences, email partners@oreilly.com
View a complete list of O'Reilly Software Architecture contacts
©2017, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • confreg@oreilly.com
Comments
Preview blog post for ML FaaS concept to be presented during the talk!
Please check out background information for the 1st part of the talk Statesafe Data Pipelines
Looking forward to receive a feedback and questions before or after the talk.