US 12,444,144 B2
Designing and optimizing adaptive shortcuts for extended reality
Tanya Renee Jonker, Seattle, WA (US); Kashyap Todi, Seattle, WA (US); Joao Marcelo Evangelista Belo, Redmond, WA (US); and Felix Izarra, Redmond, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 30, 2023, as Appl. No. 18/497,241.
Claims priority of provisional application 63/381,441, filed on Oct. 28, 2022.
Prior Publication US 2024/0144618 A1, May 2, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06T 2200/24 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An extended reality system comprising:
an extended reality device designed to be worn by a user and having a display to display content to the user in one or more extended reality environments;
one or more sensors to capture input data including images of a visual field of the user;
one or more processors; and
one or more memories accessible to the one or more processors, the one or more memories storing a plurality of instructions that are executable by the one or more processors to cause the one or more processors to perform processing comprising:
collecting a first set of personalized usage data of the user in the one or more extended reality environments over a period of time;
based on the first set of personalized usage data, estimating, by a predictive model, a plurality of interaction times for the user in the one or more extended reality environments, wherein each interaction time is associated with a corresponding functionality that has been used by the user over the period of time;
generating, by the predictive model, graphical user interface in the one or more extended reality environments, the graphical user interface including shortcuts based on the plurality of interaction times for the user; and
rendering the graphical user interface in the one or more extended reality environments to the user.