Productionalizing deep learning for computer vision

Description

Jumio has processed more than 100 million IDs over the last few years. The company uses this massive dataset to recognize important patterns—patterns often indistinguishable by the human eye. Labhesh Patel explains how deep learning is informing Jumio’s computer vision through smarter data extraction, fraud detection, and risk scoring.

Topics include:

Data extraction: Jumio has created JADE (Jumio Automated Data Extraction), a tool that leverages deep learning to “dewarp” or rectify an image, exploit multiline OCR for reading lines of text, and field finding (e.g., where we should expect to find a person’s first name on a UK driver’s license). Because Jumio processes hundreds of thousands of IDs every day, it can feed its deep learning algorithms with lots of data to improve their ability to recognize specific ID documents and know how to extract the data and make sense of it.

Fraud detection: Deep learning helps identify potentially fraudulent IDs in several important ways. DL helps determine if an ID has been manipulated in any way (e.g., if a digit has been added). For instance, since Jumio has seen hundreds of thousands of Nepalese driver’s licenses, it knows which fonts are used, where the picture should be placed, how many digits are in the DL number, where the security features are placed, etc. If anything has been manipulated or changed, it is flagged for closer review.

Risk scoring: Because of the volume of global verifications Jumio has performed and the fact that every verification is confirmed or denied by a human agent (the company’s verification experts), it can leverage deep learning to identify patterns and probability of fraud based on a combination of high-risk variables. Without giving away too much of its secret sauce, Jumio knows through its deep learning algorithms the countries, the ID types, the methods of ID capture, and a handful of other variables that result in the highest incidences of fraud. In fact, the company knows from its analysis that 1% of IDs account for about 15% of known fraud. Jumio uses this scoring to alert its verification experts to pay special attention to these high-risk IDs.