Put AI to work
June 26-27, 2017: Training
June 27-29, 2017: Tutorials & Conference
New York, NY

AI for smartphones: Running neural networks locally on phones for real-time use of the camera as a sensor

Alberto Rizzoli (Aipoly)
11:05am11:45am Thursday, June 29, 2017
Implementing AI
Location: Beekman Level: Beginner
Average rating: *****
(5.00, 1 rating)

Prerequisite Knowledge

  • A basic understanding of deep learning concepts and techniques.

What you'll learn

  • How running vision AI locally on smartphones and embedded devices opens up a large amount of use cases in consumer and enterprise fields, what are its advantages and limits.
  • How cameras can be used as universal sensors using inexpensive hardware.


For the past two years, Aipoly has been developing deep learning resources to run convolutional neural networks locally on smartphones in real-time to aid the visually impaired. Today, Aipoly’s vision AI is being used in smartphone apps, appliances, security cameras and more.

Alberto Rizzoli explains how running vision AI locally can bring forth many advantages, from faster speeds to a reduced reliance on the Internet. Alberto shares the challenges faced in running the networks on real-time on smartphones and those encountered while obtaining data that is fit for accessibility use cases and relatively small deep learning models that need to fit on computationally limited hardware.

This talk gives an overview of what vision AI can do today on smartphones, what it will be able to do in the near future, and what problem spaces can benefit from this shift to faster locally run AI.

Photo of Alberto Rizzoli

Alberto Rizzoli


Alberto Rizzoli is an Italian entrepreneur and the cofounder of Aipoly, a startup bringing artificial intelligence to embedded devices to help the visually impaired identify objects and give machines a sense of sight. Born in Rome, Italy, Alberto discovered a passion for technology at a young age. Alberto started building companies at age 20, with 3D printing ed-tech, and was featured on Maker Faire’s 20 under 20 list. He coauthored The Future of Business, a series of insights on the future of 60 industries, in collaboration with fellow futurists from London. In March 2016, Alberto was recognized by Italian President Sergio Mattarella for his efforts in advancing artificial intelligence for a good cause, and in October 2016, he received the National Gentile Award for innovation. He occasionally holds talks and lectures on advanced technologies or futurology topics, such as job automation and AI. He attended Singularity University’s Global Solutions program under a scholarship from Google.