US 11,755,122 B2
Hand gesture-based emojis
Julia Schwarz, Bellevue, WA (US); Michael Harley Notter, Woodinville, WA (US); Jenny Kam, Seattle, WA (US); Sheng Kai Tang, Redmond, WA (US); Kenneth Mitchell Jakubzak, Lynnwood, WA (US); Adam Edwin Behringer, Seattle, WA (US); Amy Mun Hong, Redmond, WA (US); Joshua Kyle Neff, Renton, WA (US); Sophie Stellmach, Kirkland, WA (US); Mathew J. Lamb, Seattle, WA (US); and Nicholas Ferianc Kamuda, Seattle, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on May 23, 2022, as Appl. No. 17/664,520.
Application 17/664,520 is a continuation of application No. 16/888,562, filed on May 29, 2020, granted, now 11,340,707.
Prior Publication US 2022/0283646 A1, Sep. 8, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/00 (2006.01); G06F 3/01 (2006.01); G06F 3/16 (2006.01); G06T 13/40 (2011.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01); G06V 40/10 (2022.01)
CPC G06F 3/017 (2013.01) [G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06F 3/167 (2013.01); G06T 13/40 (2013.01); G06V 20/20 (2022.01); G06V 40/107 (2022.01); G06V 40/28 (2022.01)] 20 Claims
OG exemplary drawing
 
1. On a computing device, a method comprising:
receiving user input data targeting an object in an environment with which to associate an emoji, the object being located at a location in a coordinate system of the environment;
receiving hand tracking data representing a pose of a hand in the coordinate system, the hand tracking data comprising data regarding a spatial position in the coordinate system of each joint of a plurality of joints of a hand model;
based on the hand tracking data, recognizing a hand gesture;
identifying an emoji corresponding to the hand gesture;
outputting the emoji for display as associated with the object; and
sending an instruction to one or more other computing devices to present the emoji as associated with the object.