The field of artificial intelligence has made great strides over the past 10 years, benefiting greatly from the adoption of GPU technology and a rising flood of training data. Old algorithms can finally show their full power, and practitioners are able to be more creative and innovative when developing new architectures to solve AI problems. However, these gains do not transfer well to smaller systems that lack the computational resources of large, monolithic models, such as typical IoT devices, smartphones, and other highly portable technologies. Bringing AI to these devices necessitates compromises in terms of responsiveness, connectivity, and model fidelity. New approaches such as federated learning and other distributed frameworks show promise, but building these systems requires us to make very real trade-offs in where and how data is collected, stored, transferred, and ultimately incorporated into the model and in how the model is deployed and adapted to fit within the constraints of edge computing devices.
Noah Schwartz explores the most recent advances in distributed and cooperative learning systems, including federated learning systems for real-world, edge-based AI. Along the way, Noah discusses topics and methods such as asynchronous learning of distributed representations, multi-agent federation in both centralized and peer-to-peer topologies, and online learning algorithms that enable true learning in edge-based systems—demonstrating concepts and solutions live using the Quorum AI Framework.
Noah Schwartz is cofounder and CEO of Quorum AI, a San Francisco-based AI SaaS company that specializes in lightweight, distributed AI architectures. Previously, Noah spent 12 years in academic research, most recently at Northwestern University as the assistant chair of Neurobiology, where his work focused on information processing in the brain. He has translated his research into products in augmented reality, sensor fusion, brain-computer interfaces, computer vision, and embedded robotics control systems. Noah was also senior data scientist at Lumos Labs, creators of the popular Lumosity brain training app.
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • email@example.com