US 12,125,126 B1
Managing visual clutter in artificial reality environments
Naveen Sendhilnathan, Seattle, WA (US); Ting Zhang, Santa Clara, CA (US); Sebastian Freitag, Seattle, WA (US); Tanya Renee Jonker, Seattle, WA (US); and Peiqi Tang, Redmond, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 23, 2023, as Appl. No. 18/492,413.
Int. Cl. G06T 11/00 (2006.01); G06F 3/01 (2006.01); G06V 20/20 (2022.01)
CPC G06T 11/00 (2013.01) [G06F 3/013 (2013.01); G06V 20/20 (2022.01); G06T 2200/24 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by a computing system:
receiving an image comprising one or more virtual elements associated with a virtual environment and one or more real-world elements associated with a real-world environment;
determining, using one or more image analysis techniques, a first metric indicative of a measure of clutter in the virtual environment based on the one or more virtual elements and a second metric indicative of the measure of clutter in the real-world environment based on the one or more real-world elements;
determining a plurality of gaze features associated with a user based on a user activity with respect to the image comprising the one or more virtual elements and the one or more real-world elements;
predicting, using a machine learning model, a reaction time of the user in performing the user activity based on the plurality of gaze features;
determining a third metric indicative of the measure of clutter in the image based on predicted reaction time;
computing an overall clutter metric based on the first metric determined based on the one or more virtual elements, the second metric determined based on the one or more real-world elements, and the third metric determined based on the predicted reaction time; and
performing one or more actions to manage the clutter in the image based on the overall clutter metric.