US 12,462,604 B2
Method and system for verifying uploaded customer photographs
Prajwal Paudyal, Peoria, AZ (US); Sameer Dongare, Phoenix, AZ (US); and Artie Tonan, Phoenix, AZ (US)
Assigned to U-HAUL INTERNATIONAL, INC., Phoenix, AZ (US)
Filed by U-Haul International, Inc., Phoenix, AZ (US)
Filed on Jun. 3, 2022, as Appl. No. 17/805,440.
Claims priority of provisional application 63/196,483, filed on Jun. 3, 2021.
Prior Publication US 2022/0392258 A1, Dec. 8, 2022
Int. Cl. G06K 9/00 (2022.01); G06T 7/11 (2017.01); G06V 40/16 (2022.01)
CPC G06V 40/172 (2022.01) [G06T 7/11 (2017.01); G06T 2207/30201 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for automatically verifying an image uploaded to a computer system by a customer, the method comprising:
generating an upload prompt to request a customer to upload an image of a requested type to a computer system, wherein the requested type of image comprises one of a headshot of the customer, a front of an identification card of the customer, or a back of an identification card of the customer;
receiving with the computer system an image uploaded in response to the upload prompt;
automatically processing the uploaded image with a computer-implemented classification model operative to attempt to classify the uploaded image as one of a headshot, a front of an identification card, or a back of an identification card;
if the classification model classifies the uploaded image as a headshot, automatically processing the uploaded image with a face detection model operative to return a headshot return result that includes a face bounding box for the uploaded image;
if the classification model classifies the uploaded image as a front of an identification card:
automatically processing the uploaded image with an identification card detection model operative to return an identification card front return result that includes an identification card front bounding box for the uploaded image; and
using the identification card front bounding box to process the uploaded image with the face detection model to return an identification card headshot return result that includes an identification card face bounding box for the uploaded image; and
if the classification model classifies the uploaded image as a back of an identification card, processing the uploaded image with the identification card detection model to return an identification card back return result that includes an identification card back bounding box for the uploaded image;
wherein the classification model is implemented via a convolutional neural network having an architecture that comprises a modification of an Inception v3 architecture, wherein the modification of the Inception v3 architecture includes a global max pool layer, a fully connected layer and an output max layer in place of a fully connected layer of the Inception v3 architecture.