Over the past several decades, the industry has invested heavily in traditional vision algorithms. However, in the past few years, there’s been a major shift from traditional vision algorithms to deep neural network algorithms. While many companies expect to move to deep learning for some or all of their algorithms, they may already have a significant investment in classical vision and likely want to continue to use classical vision algorithms for specific tasks. After all, they don’t want to lose their investment.
When specifying silicon for next-generation products, companies must consider whether to prioritize the hardware needed to support the traditional vision algorithms that they have today or that needed for deep neural network algorithms in the future. There is an increased cost to optimize for both. However, if some of the traditional algorithms can run on deep learning optimized hardware, more area could be allocated for the deep learning hardware.
Paul Brasnett discusses how a company can maximize its existing investment in traditional algorithms while building toward deep learning algorithms. Paul examines the similarities between classical and deep vision and explains how to express and adapt a classical vision algorithm to become a trainable DNN. Along the way, Paul demonstrates how traditional computer vision algorithms (e.g., histograms and morphological operators) can be mapped on to deep learning primitives and explores a case study on mapping a feature point descriptor called Brisk. This enables traditional vision on specialized deep learning hardware, ultimately providing a low-risk path for developers transitioning from traditional vision algorithms to DNN-based approaches and enabling them to maximize their investments.
Paul Brasnett is a principal research engineer leading a team responsible for imaging, image processing, and computer vision algorithms within the PowerVR Division of Imagination Technologies. Previously, he was a senior research engineer at Mitsubishi Electric, where he was involved in image and video processing and participated in MPEG standardization work. Paul holds a PhD and MEng from the University of Bristol, UK.
©2018, O’Reilly UK Ltd • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org