US 12,242,672 B1
Triggering actions based on detected motions on an artificial reality device
Shaik Shabnam Nizamudeen Basha, Mountain View, CA (US); Peter Ju, San Mateo, CA (US); Eric Leung, San Francisco, CA (US); Pierluigi Taddei, Zürich (CH); and Jianhan Xu, Vancouver (CA)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Dec. 19, 2022, as Appl. No. 18/068,048.
Claims priority of provisional application 63/380,410, filed on Oct. 21, 2022.
Int. Cl. G06F 3/01 (2006.01); G06T 11/00 (2006.01)
CPC G06F 3/017 (2013.01) [G06F 3/012 (2013.01); G06T 11/00 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for triggering an action based on a particular motion detected by an artificial reality device, the method comprising:
displaying an artificial reality experience to a user on the artificial reality device;
detecting, by one or more sensors, including at least an inertial measurement unit (IMU), integral with the artificial reality device, a physical interaction with the artificial reality device comprising one or more hand taps on the artificial reality device, the physical interaction generating a movement profile of the one or more hand taps on the artificial reality device;
identifying the physical interaction as the particular motion by applying a machine learning model to the movement profile, the machine learning model being trained on existing movement profiles associated with known motions of hand taps on artificial reality devices; and
in response to identifying the physical interaction as the particular motion, triggering the action on the artificial reality device based on a mapping of detected motions to actions which includes a mapping of one or more hand taps to the action.