US 11,699,104 B2
Machine-learning based gesture recognition using multiple sensors
Charles Maalouf, Seattle, WA (US); Shawn R. Scully, Seattle, WA (US); Christopher B. Fleizach, Gilroy, CA (US); Tu K. Nguyen, San Jose, CA (US); Lilian H. Liang, Kenmore, WA (US); Warren J. Seto, Sunnyvale, CA (US); Julian Quintana, San Jose, CA (US); Michael J. Beyhs, San Francisco, CA (US); Hojjat Seyed Mousavi, Santa Clara, CA (US); and Behrooz Shahsavari, Hayward, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jul. 20, 2022, as Appl. No. 17/869,740.
Application 17/869,740 is a division of application No. 16/937,481, filed on Jul. 23, 2020, granted, now 11,449,802.
Claims priority of provisional application 62/933,232, filed on Nov. 8, 2019.
Prior Publication US 2022/0351086 A1, Nov. 3, 2022
Int. Cl. G06V 10/00 (2022.01); G06N 20/00 (2019.01); G06F 3/01 (2006.01); G06F 3/04883 (2022.01); G06F 18/214 (2023.01); G06N 3/08 (2023.01)
CPC G06N 20/00 (2019.01) [G06F 3/015 (2013.01); G06F 3/017 (2013.01); G06F 3/04883 (2013.01); G06F 18/2155 (2023.01); G06N 3/08 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, from a first sensor of a device, first sensor output of a first type;
receiving, from a second sensor of the device, second sensor output of a second type that differs from the first type;
providing the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type;
determining the predicted gesture based on an output from the machine learning model; and
performing, in response to determining the predicted gesture, a predetermined action on the device.