US 12,223,117 B1
Spatiotemporal smoothing for improved hand tracking
Emmanuel Piuze-Phaneuf, Los Gatos, CA (US); Ali Ercan, San Jose, CA (US); Julian K. Shutzberg, San Francisco, CA (US); and Paul A. Lacey, Davie, FL (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 21, 2023, as Appl. No. 18/371,111.
Claims priority of provisional application 63/409,318, filed on Sep. 23, 2022.
Int. Cl. G06F 3/01 (2006.01); G06T 5/70 (2024.01); G06T 7/73 (2017.01)
CPC G06F 3/017 (2013.01) [G06F 3/011 (2013.01); G06T 5/70 (2024.01); G06T 7/73 (2017.01); G06T 2207/10028 (2013.01); G06T 2207/30196 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices via a communication interface:
obtaining uncorrected hand tracking data;
obtaining a depth map associated with a physical environment;
identifying a position of a portion of the finger within the physical environment based on the depth map and the uncorrected hand tracking data;
performing spatial depth smoothing on a region of the depth map adjacent to the position of the portion of the finger; and
generating corrected hand tracking data by performing point of view (POV) correction on the uncorrected hand tracking data based on the spatially depth smoothed region of the depth map adjacent to the portion of the finger.