US 11,776,166 B2
Discrimination between virtual objects and real objects in a mixed reality scene
Yiwei Yang, San Mateo, CA (US); and Warren Benedetto, Foothill Ranch, CA (US)
Assigned to Sony Interactive Entertainment LLC, San Mateo, CA (US)
Filed by Sony Interactive Entertainment LLC, San Mateo, CA (US)
Filed on Oct. 8, 2021, as Appl. No. 17/497,783.
Prior Publication US 2023/0114080 A1, Apr. 13, 2023
Int. Cl. G06T 11/00 (2006.01); G06F 3/01 (2006.01); G06T 7/20 (2017.01); G06V 20/20 (2022.01)
CPC G06T 11/00 (2013.01) [G06F 3/011 (2013.01); G06F 3/016 (2013.01); G06T 7/20 (2013.01); G06V 20/20 (2022.01); G06T 2207/30241 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for providing a mixed reality (MR) experience, comprising:
rendering a mixed reality view for a user on an MR headset, wherein the mixed reality view includes virtual elements;
tracking a gaze of the user during the rendering of the mixed reality view;
during the rendering of the mixed reality view, capturing sensor data by the MR headset, and analyzing the sensor data to detect real-world objects in a local environment in which the MR headset is disposed;
determining a risk to the user posed by one or more of the identified real-world objects;
responsive to determining the risk, then adjusting an appearance of at least one virtual element; and,
following the adjusting of the appearance, responsive to detecting the gaze of the user looking at the one or more of the identified real-world objects posing the risk, including detecting the gaze directed toward the one or more of the identified real-world objects for at least a predefined duration, then stopping the adjusting of the appearance of the at least one virtual element.