US 11,983,817 B2
Systems and methods for labeling 3D models using virtual reality and augmented reality
Bryan Nussbaum, Hershey, PA (US); Jeremy Carnahan, Normal, IL (US); and Ryan Knuffman, Danvers, IL (US)
Assigned to State Farm Mutual Automobile Insurance Company, Bloomington, IL (US)
Filed by State Farm Mutual Automobile Insurance Company, Bloomington, IL (US)
Filed on Dec. 6, 2021, as Appl. No. 17/543,105.
Application 17/543,105 is a continuation of application No. 16/543,127, filed on Aug. 16, 2019, granted, now 11,210,851.
Claims priority of provisional application 62/861,779, filed on Jun. 14, 2019.
Prior Publication US 2022/0092854 A1, Mar. 24, 2022
Int. Cl. G06T 17/20 (2006.01); G06F 16/58 (2019.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); H04W 4/021 (2018.01)
CPC G06T 17/205 (2013.01) [G06F 16/5866 (2019.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); H04W 4/021 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for labeling a three-dimensional (3D) model using virtual reality (VR) techniques, the method implemented by a computer system including at least one processor, the method comprising:
receiving, by the processor, a 3D model including at least one environmental feature that is unlabeled;
displaying, through a VR device in communication with the processor, a VR environment to a user representing the 3D model, the VR environment modifiable by the user;
displaying, in the VR environment, a prompt requesting the user to input labeling data for the at least one environmental feature displayed within the VR environment and one or more rules associated with the at least one environmental feature, the labeling data inputted by selecting the at least one environmental feature through gesture icons interacting with the VR environment displayed on the VR device, the labeling data identifying the at least one environmental feature, the one or more rules indicating one or more predicted outcomes associated with the at least one environmental feature; and
generating, by the processor, a labeled 3D model by embedding the labeling data associated with the selected at least one environmental feature into the 3D model along with the one or more rules inputted for the selected at least one environmental feature.