US 12,243,247 B2
Method and apparatus for tracking hand joints
Paul Oh, Seongnam-si (KR)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on May 7, 2021, as Appl. No. 17/314,082.
Claims priority of application No. 10-2020-0177251 (KR), filed on Dec. 17, 2020.
Prior Publication US 2022/0198682 A1, Jun. 23, 2022
Int. Cl. G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06V 40/20 (2022.01)
CPC G06T 7/251 (2017.01) [G06T 7/75 (2017.01); G06V 40/28 (2022.01); G06T 2200/04 (2013.01); G06T 2207/30196 (2013.01)] 27 Claims
OG exemplary drawing
 
1. A method, the method comprising:
performing respective rotation conversions of initial positions of hand joints based on a set three-dimensional (3D) coordinate system, wherein the initial positions are obtained from an image of a hand and reflect a current pose of the hand;
estimating angle information, of the current pose, of finger joints resulting from the respective rotation conversions of the initial positions of the hand joints, with at least some of the respective rotation conversions corresponding to different rotations;
generating a kinematic model of the hand joints based on the initial positions of the hand joints and the angle information of the finger joints; and
tracking the hand joints by generating at least one of updated positions or angles of the hand joints in the current pose based on the initial positions of the hand joints and the kinematic model,
wherein the estimating of the angle information further includes performing the estimating of the angle information of the finger based on a selected, based on the determination of whether the finger joint is bent, one among a consideration of a geometry among multiple finger joints in the image and a consideration of a calculated finger joint angle in a previous image.