US 12,265,680 B1
Mapped direct touch virtual trackpad and invisible mouse
Samuel Matthew Levatich, Seattle, WA (US); and Etienne Pinchon, Pasadena, CA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by META PLATFORMS TECHNOLOGIES, LLC, Menlo Park, CA (US)
Filed on Aug. 7, 2023, as Appl. No. 18/366,578.
Int. Cl. G06F 3/048 (2013.01); G06F 3/01 (2006.01); G06F 3/042 (2006.01)
CPC G06F 3/0426 (2013.01) [G06F 3/011 (2013.01); G06F 3/017 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
obtaining, in an extended reality (XR) environment, a virtual model corresponding to a hand of a user in a physical environment and used to represent a location of a virtual representation of the hand of the user within the XR environment;
identifying a virtual trackpad in the XR environment, wherein:
a surface of the virtual trackpad is configured to control a focus selector mapped to a surface of a distant virtual object in the XR environment,
the virtual trackpad is presented at a first location distinct from the location of the virtual representation of the hand of the user, and
the virtual trackpad is displayed in the XR environment generated within a near-eye display (NED) system;
in accordance with a determination that the virtual representation of the hand of the user is within a proximity threshold to the first location of the virtual trackpad, activating the virtual trackpad;
responsive to a determination that the virtual trackpad is activated, tracking a movement of the virtual representation of the hand and at least one finger associated with the virtual representation of the hand of the user, such that a sensitivity using to track the at least one finger is distinct from a different sensitivity used to track the virtual representation of the hand of the user;
responsive to a determination that the virtual trackpad is activated, tracking a movement of the virtual representation of the hand and at least one finger associated with the virtual representation of the hand of the user using the sensitivity;
determining an action to be performed in relation to the distant virtual object that corresponds to the movement; and
performing the action.