Enterprises and public sector organizations are drowning in real-time data from equipment, assets, suppliers, employees, customers, and city and utility data sources. Hidden insights have the potential to optimize production, transform efficiency, and streamline flows of goods and services, but finding insights cost effectively remains a challenge. Complex, big-data focused, cloud-hosted ML solutions are expensive, slow, and unsuited to real-time data. It’s important to cost-effectively learn on data at the “edge” as it is produced.
Simon Crosby details an architecture for learning on time series data using edge devices, based on the distributed actor model. This approach flies in the face of the traditional wisdom of cloud-based, big-data solutions to ML problems. You’ll see that there are more than enough resources at “the edge” to cost-effectively analyze, learn from, and predict from streaming data on the fly.
The solution relies on two fundamental innovations:
Edge learning delivers new insights fast, specific to the local context, enabling the infrastructure to adapt to changing conditions. Learning at the edge on “high def” data—with many parameters per entity—enables us to avoid overfitting and to gain greater fidelity. The efficient solution of an edge learning model also is maximally efficient in terms of communication, making the edge environment into a parallel machine learning network, distributed across edge nodes.
Simon Crosby is the CTO of SWIM Inc. Simon brings an established record of technology industry success, most recently as cofounder and CTO of security technology company Bromium, where he built a highly secure virtualized system to protect applications. Previously, he was the CTO of the Virtualization and Management Division at Citrix, the cofounder and CTO of XenSource (acquired by Citrix), a principal engineer at Intel, and the founder of CPlane, a network-optimization software vendor. Simon has been a tenured faculty member at the University of Cambridge and was named one of InfoWorld’s top 25 CTOs in 2007.
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org