US 11,934,586 B2
Gesture detection via image capture of subdermal tissue from a wrist-pointing camera system
Dongeek Shin, San Jose, CA (US); Andrea Colaco, Los Altos, CA (US); Stiven Guillaume Francois Morvan, New York, NY (US); Adam James Banfield, Troy, NY (US); and Shahram Izadi, Tiburon, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Jun. 29, 2022, as Appl. No. 17/809,772.
Prior Publication US 2024/0004476 A1, Jan. 4, 2024
Int. Cl. G06V 40/10 (2022.01); G06F 1/16 (2006.01); G06F 3/01 (2006.01); G06V 10/82 (2022.01); G06V 20/20 (2022.01); G06V 40/13 (2022.01); G06V 40/20 (2022.01)
CPC G06F 3/017 (2013.01) [G06F 1/163 (2013.01); G06V 10/82 (2022.01); G06V 20/20 (2022.01); G06V 40/1318 (2022.01); G06V 40/15 (2022.01); G06V 40/28 (2022.01)] 22 Claims
OG exemplary drawing
 
1. A method comprising:
capturing a sequence of images through skin of a wrist of a user;
determining a biological fluid flow metric based on the sequence of images, including applying a first model that maps the sequence of images to the biological fluid flow metric;
determining a gesture formed by the user based on the biological fluid flow metric; and
triggering execution of a command related to an object being displayed in an augmented reality (AR) system based on the gesture.