US 12,354,199 B1
Remote gesture control
Graeme Lambourne Geddes, Aliso Viejo, CA (US); and Shawn Michael Rolin, San Jose, CA (US)
Assigned to Zoom Communications, Inc., San Jose, CA (US)
Filed by Zoom Communications, Inc., San Jose, CA (US)
Filed on Jul. 12, 2023, as Appl. No. 18/351,126.
Application 18/351,126 is a continuation of application No. 17/942,801, filed on Sep. 12, 2022, abandoned.
Int. Cl. G06T 13/40 (2011.01); G06F 3/01 (2006.01); G06T 17/20 (2006.01)
CPC G06T 13/40 (2013.01) [G06F 3/012 (2013.01); G06F 3/017 (2013.01); G06T 17/20 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
triggering transmission of an instance of a three-dimensional (3D) mesh model to a target computer device associated with a first user account;
detecting one or more changes in a video stream captured at a source computer device associated with a second user account, the second user account represented by a digital rendering at the target computer device according to the instance of the 3D mesh model received by the target computer device;
identifying at least one command based on the one or more detected changes in the video stream captured at the source computer device, the at least one command corresponding to at least a portion of one or more blendshapes;
identifying one or more portions of an audio stream associated with one or more image frames that portray the one or more detected changes in the video stream;
generating a command timestamp for the at least one identified command based on the one or more identified portions of the audio stream; and
triggering transmission of the identified command to the target computer device associated with the first user account, the target computer device generating a local instantiation of the digital rendering according to the 3D mesh model and the one or more blendshapes.