US 12,266,217 B2
Extended reality gesture recognition proximate tracked object
Erik A. Hill, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on May 11, 2022, as Appl. No. 17/741,979.
Application 17/741,979 is a continuation of application No. 16/797,333, filed on Feb. 21, 2020, granted, now 11,348,373.
Prior Publication US 2022/0415088 A1, Dec. 29, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 40/20 (2022.01); G06F 3/01 (2006.01); G06T 7/73 (2017.01); G06V 20/20 (2022.01)
CPC G06V 40/20 (2022.01) [G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06T 7/74 (2017.01); G06V 20/20 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A wearable device comprising:
a camera;
processing circuitry configured to receive image data from the camera; and
a memory device coupled to the processing circuitry and having a program stored thereon for execution by the processing circuitry to perform operations comprising:
recognizing and tracking one or more real objects and separate from a user, in the image data from the camera;
analyzing the image data to determine whether a real object of the real objects in the image data is at least partially occluded by a gesture by the user by:
projecting bounds of the real object to a depth of a gesture object resulting in projected bounds; and
in response to determining the projected bounds overlap bounds of the gesture object, performing, based on the gesture, an augmentation of the real object in the image data.