Presented By O’Reilly and Intel AI
Put AI to Work
April 29-30, 2018: Training
April 30-May 2, 2018: Tutorials & Conference
New York, NY

High-throughput single-shot multibox object detection on edge devices using FPGAs

11:05am–11:45am Tuesday, May 1, 2018
Implementing AI, Models and Methods
Location: Grand Ballroom West

Who is this presentation for?

  • AI developers

Prerequisite knowledge

  • Basic knowledge of AI and computer vision

What you'll learn

  • Explore an approach for high-throughput single-shot multibox object detection (SSD) on edge devices using FPGAs

Description

Deep learning is becoming increasingly popular for visual understanding use cases on edge devices, such as image classification and object detection, and there has been an increasing demand for running basic computer vision and deep learning models on edge devices due to concerns about privacy and security.

There are several implementations of SSD with deep neural nets, such as GoogLeNet and VGG, which provide low-throughput object-detection solutions on edge devices. Srinivasa Karlapalem demonstrates a new SSD network with SqueezeNet for high-throughput single-shot multibox object detection (SSD) on edge devices using FPGAs, specifically for surveillance. This network is used for multiclass object detection on IoT platforms such as Apollo Lake and SkyLake, accelerated with Arria 10 FPGAs.

The solution uses live and prerecorded video streams or the Pascal VOC dataset as input. Frames are extracted and resized to be fed into the Squeezenet SSD network. The SSD network uses pretrained models and input frames to determine bounding boxes of objects and their classes. Srinivasa details the detection throughput (images/sec) and other metrics such as CPU and FPGA utilization.

Photo of Srinivasa Karlapalem

Srinivasa Karlapalem

Intel

Srinivasa Manohar Karlapalem is a software engineer at Intel, where he develops and optimizes novel deep learning-based applications on compute and memory-constrained edge and IoT hardware architectures. He has extensive experience optimizing programming language VM runtimes and OS stacks on modern, high-performance Intel architectures. He holds an MS in computer science from the Georgia Institute of Technology.