US 12,461,615 B2
Hand gesture tracking device, method, and non-transitory computer readable storage medium thereof
Chang Hua Wei, Taoyuan (TW); and Yu-Ling Huang, Taoyuan (TW)
Assigned to HTC Corporation, Taoyuan (TW)
Filed by HTC Corporation, Taoyuan (TW)
Filed on Mar. 26, 2024, as Appl. No. 18/617,629.
Prior Publication US 2025/0306694 A1, Oct. 2, 2025
Int. Cl. G06F 3/038 (2013.01); G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06V 40/20 (2022.01)
CPC G06F 3/038 (2013.01) [G06F 3/013 (2013.01); G06F 3/016 (2013.01); G06F 3/017 (2013.01); G06F 3/0346 (2013.01); G06V 40/28 (2022.01); G06F 3/014 (2013.01); G06F 2203/0331 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A hand gesture tracking device, comprising:
a transceiver interface, being communicatively connected to a wearable device, wherein the wearable device is configured to generate an inertial sensing data corresponding to a user, and the wearable device comprises a haptic feedback device; and
a processor, being electrically connected to the transceiver interface, and being configured to perform the following operations:
performing a hand gesture tracking corresponding to the user based on a plurality of real-time images and the inertial sensing data, wherein the real-time images include a user hand or the wearable device used by the user;
determining whether a virtual object associated with a haptic feedback interaction is contacted based on the hand gesture tracking and a plurality of eyeball trajectories;
in response to determining that the virtual object associated with the haptic feedback interaction is contacted, triggering the haptic feedback device of the wearable device to execute the haptic feedback interaction corresponding to a time interval; and
inactivating the inertial sensing data corresponding to the wearable device to perform the hand gesture tracking corresponding to the time interval,
wherein the operation of determining whether the virtual object associated with the haptic feedback interaction is contacted comprises the following operations;
generating a gaze position corresponding to the user based on the plurality of eyeball trajectories;
determining whether the gaze position is located on the virtual object; and
in response to determining that the gaze position is located on the virtual object, determining that the virtual object associated with the haptic feedback interaction is contacted.