US 11,893,836 B1
Augmented reality system for remote product inspection
Michal Knas, Monson, MA (US); Jiby John, Suffield, CT (US); Damon DePaolo, Barkhamsted, CT (US); and Payton Shubrick, Springfield, MA (US)
Assigned to Massachusetts Mutual Life Insurance Company, Springfield, MA (US)
Filed by Massachusetts Mutual Life Insurance Company, Springfield, MA (US)
Filed on Jan. 13, 2023, as Appl. No. 18/097,059.
Application 18/097,059 is a continuation of application No. 16/895,684, filed on Jun. 8, 2020, granted, now 11,557,156.
Claims priority of provisional application 62/858,038, filed on Jun. 6, 2019.
This patent is subject to a terminal disclaimer.
Int. Cl. G07C 5/00 (2006.01); G06T 7/00 (2017.01); G06F 3/16 (2006.01); G06F 3/01 (2006.01); G06T 17/20 (2006.01); G06T 19/20 (2011.01)
CPC G07C 5/008 (2013.01) [G06F 3/017 (2013.01); G06F 3/167 (2013.01); G06T 7/001 (2013.01); G06T 17/20 (2013.01); G06T 19/20 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
determining, by a server, a position and a direction of an electronic device in relation to a vehicle using a direction sensor of the electronic device when a user operating the electronic device scans the vehicle using a camera of the electronic device;
displaying, by the server on the electronic device, a layout of a first element of the vehicle, wherein the server prompts the user to align the first element displayed on the electronic device with a corresponding first element of the vehicle by adjusting the position and direction of the electronic device relative to the vehicle;
when the corresponding first element of the vehicle is aligned with the first element displayed on the electronic device, causing, by the server, the camera to capture a video comprising a set of images of the vehicle;
retrieving, by the server, a set of reference images associated with the vehicle;
responsive to the first element in at least one image within the set of images matching the corresponding first element in the set of reference images, displaying, by the server on the electronic device, a composite image overlaid on the first at least one image comprising a first graphical component corresponding to a status of an inspection of the first element; and
displaying, by the server, a second graphical component corresponding to a successful completion of the inspection when a predetermined number of elements within a set of captured images of the vehicle matches a corresponding element within the set of reference images.