US 12,067,171 B1
Systems and methods for operating artificial reality devices using gestures
Priyanka Sharma, Cupertino, CA (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on May 5, 2022, as Appl. No. 17/737,483.
Claims priority of provisional application 63/231,908, filed on Aug. 11, 2021.
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01); G09B 21/00 (2006.01)
CPC G06F 3/017 (2013.01) [G02B 27/0172 (2013.01); G06F 3/011 (2013.01); G06T 19/006 (2013.01); G09B 21/00 (2013.01); G09B 21/001 (2013.01); G09B 21/009 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An artificial reality device comprising at least one processor and a non-transitory memory including computer-executable instructions which, when executed by the processor, cause the artificial reality device to:
determine, based on a first user interaction with the artificial reality device, a type of impairment comprising at least one of a visual impairment or an auditory impairment;
initiate a gesture recognition mode, based on the type of impairment, to evaluate a second user interaction with the artificial reality device;
cause a camera associated with the artificial reality device to operate in the gesture recognition mode;
receive at least one image of a gesture captured by the camera;
identify and evaluate the gesture, wherein the gesture is indicative of a user command;
execute the user command in response to the evaluated gesture; and
generate feedback confirming execution of the user command.