US 11,983,329 B1
Detecting head gestures using inertial measurement unit signals
Shervin Ghasemlou, Redmond, WA (US); Devashish Prasad Joshi, New York, NY (US); Rongzhou Shen, Kirkland, WA (US); and Riza Kazemi, Vancouver (CA)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Dec. 5, 2022, as Appl. No. 18/061,838.
Int. Cl. G06F 3/01 (2006.01); G06F 3/0346 (2013.01)
CPC G06F 3/017 (2013.01) [G06F 3/012 (2013.01); G06F 3/0346 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method comprising, by one or more processors of a head-mounted device:
presenting, by the head-mounted device via an assistant xbot, a suggestion to a user of the head-mounted device during a dialog session between the user and the assistant xbot, wherein the suggestion is associated with a plurality of actions to be performed by an assistant system associated with the assistant xbot;
accessing, by the head-mounted device, one or more signals from one or more inertial measurement unit (IMU) sensors of the head-mounted device during the dialog session;
determining, by an on-device head-gesture detection model trained only on IMU training data and based only on the one or more signals from the IMU sensors, a head gesture performed by the user during the dialog session; and
executing, by the assistant system executing on the head-mounted device, a first action from the plurality of actions, wherein the first action is selected based on the determined head gesture during the dialog session.