US 12,423,972 B2
Insurance inventory and claim generation
Rebecca A. Little, Mesa, AZ (US); and Christopher Robert Galante, Mesa, AZ (US)
Assigned to State Farm Mutual Automobile Insurance Company, Bloomington, IL (US)
Filed by State Farm Mutual Automobile Insurance Company, Bloomington, IL (US)
Filed on Jul. 27, 2022, as Appl. No. 17/815,481.
Application 17/815,481 is a continuation of application No. 16/890,865, filed on Jun. 2, 2020, granted, now 11,436,828.
Prior Publication US 2022/0366689 A1, Nov. 17, 2022
Int. Cl. G06V 20/20 (2022.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06Q 40/08 (2012.01)
CPC G06V 20/20 (2022.01) [G02B 27/0093 (2013.01); G02B 27/0172 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06Q 40/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, by a mobile computing device comprising one or more processors, live video data representing a physical environment;
receiving, by the mobile computing device, previous image data representing the physical environment at a previous time;
identifying, by the mobile computing device and based on the live video data, a first physical object associated with a homeowners or property insurance policy;
based on identifying the first physical object associated with the homeowners or property insurance policy, retrieving, from a database, metadata associated with the first physical object;
determining, by the mobile computing device and based on the live video data, the previous image data, the homeowners or property insurance policy, and the retrieved metadata, a requested action to be performed on the first physical object;
providing, by the mobile computing device, a real-time augmented or mixed reality representation of the physical environment, including:
a virtual assistant identifying the first physical object in the physical environment; and
rendering instructions for a user to perform the requested action within the representation at a location proximate to the first physical object or the virtual assistant;
determining, based on the live video data, that the user has performed the requested action on the first physical object;
based on determining that the user has performed the requested action, capturing new image data of a surface of the first physical object exposed by the performing of the requested action; and
generating or updating, by the mobile computing device and based on the new image data, an insurance claim of the homeowners or property insurance policy pertaining to the first physical object.