How do you turn any product into a smart product? Have it engage with the user, understand the environment, be instantly responsive, and have exceptional reliability.
Breakthroughs in deep learning and new analog-domain computation methods to deploy trained neural networks will deliver exciting new capabilities to consumer and industrial hardware products. Michael B. Henry explains why the combination of human-like levels of recognition and massive computation capabilities in a tiny package will enable products with true awareness and understanding of the user and environment.
First key: Local AI—Cloud processing is unreliable, has poor latency, and imparts onerous data transmission requirements. Intelligence should be at the edge: in the device and as close to the user and environment as possible.
Second key: Pick the best algorithms—Deep neural networks (DNNs) are the best at interpreting data pulled from the real world (audio, video, sensors), and breakthroughs promise to broadly expand their scope. Generative/adversarial networks now give developers a tool to train networks using loss functions inspired by human perception. WaveNets allow us to separate noise and recreate rich data like voice with a stunningly low number of parameters. It’s not just about voice assistants and self-driving cars. Any device that requires user interaction or perception of the environment will reap huge benefits from the ongoing advances in deep learning.
Third key: Big improvements on every metric that matters (low cost, low power, low latency, high throughput)—To run ensembles of 1M–100M parameter networks that are instantly available yet disappear when not needed, a new method of running already-trained DNNs is required. Computation is done in the analog domain and inside of flash memory arrays. Each transistor in the array stores a DNN parameter and performs the computation. These techniques offer a 100x improvement over conventional digital computation, while the nonvolatile nature of the compute + storage lets you turn on intelligence as needed and save power when not.
Mike Henry is cofounder and CEO at Mythic, an AI hardware startup based in Redwood City, CA, and Austin, TX. Under his leadership, Mythic has raised $56M in investment from top-tier VCs and developed novel chip technology that is up to 100 times better than incumbents. Mike holds both a BS and a PhD in computer engineering from Virginia Tech.
©2017, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org