US 11,710,280 B1
Local physical environment modeling in extended reality environments
Ravi Durairaj, San Antonio, TX (US); Marta Argumedo, Helotes, TX (US); Sean C. Mitchem, San Antonio, TX (US); Ruthie Lyle, Durham, NC (US); Nolan Serrao, Plano, TX (US); Bharat Prasad, San Antonio, TX (US); and Nathan L. Post, Rockport, TX (US)
Assigned to United Services Automobile Association (USAA), San Antonio, TX (US)
Filed by UIPCO, LLC, San Antonio, TX (US)
Filed on Aug. 13, 2021, as Appl. No. 17/402,408.
Claims priority of provisional application 63/066,032, filed on Aug. 14, 2020.
Int. Cl. G06T 19/00 (2011.01); G06T 17/00 (2006.01); G06F 3/01 (2006.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/017 (2013.01); G06T 17/00 (2013.01); G06V 20/20 (2022.01); G06V 40/28 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
capturing a local physical environment of a first user, via external facing environment cameras of a first head mounted extended reality device (“XR device”);
generating a digital model of the local physical environment of the first user;
rendering to a display of the first XR device of the first user, a digital avatar of a second user positioned within the local physical environment;
receiving instructions from the second user;
providing, via the first XR device and based on the instructions from the second user, directions for the first user to aim external facing environment cameras of the first XR device at a physical object within the local physical environment of the first user, wherein multiple images captured by one or more of the cameras are each a depth map frame including a digital representation of the physical object;
generating, by combining the depth map frame and a corresponding visible light frame, the digital representation of the physical object within the local physical environment of the first user, the visible light frame being combined with its corresponding depth map frame so as to provide color to a portion of the digital model of the local environment corresponding to the digital representation of the physical object; and
transmitting the digital representation of the physical object to a device associated with the second user for display.