US 12,394,067 B2
Device and method for capturing and analyzing a motion of a user
Kin Sun Chan, Pok Fu Lam (HK); Yan Nei Law, Pok Fu Lam (HK); and Ka Lun Fan, Pok Fu Lam (HK)
Assigned to Logistics and Supply Chain MultiTech R&D Centre Limited, Pok Fu Lam (HK)
Filed by Logistics and Supply Chain MultiTech R&D Centre Limited, Pok Fu Lam (HK)
Filed on Mar. 25, 2022, as Appl. No. 17/704,568.
Prior Publication US 2023/0306616 A1, Sep. 28, 2023
Int. Cl. G06T 7/246 (2017.01); A63B 24/00 (2006.01); G06T 7/215 (2017.01); G06T 7/579 (2017.01); G06T 7/70 (2017.01)
CPC G06T 7/248 (2017.01) [A63B 24/0062 (2013.01); G06T 7/215 (2017.01); G06T 7/579 (2017.01); G06T 7/70 (2017.01); A63B 2220/05 (2013.01); A63B 2220/806 (2013.01); G06T 2207/10021 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20021 (2013.01); G06T 2207/20092 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30241 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method for capturing and analyzing a motion of a user, comprising the following steps:
A. capturing a motion of a first user represented by an RGB moving image and depth data;
B. obtaining 2D skeletal data based on the RGB moving image for each frame;
C. converting the 2D skeletal data to 3D skeletal data by mapping the 2D skeletal data with corresponding depth data for each frame;
D. determining one or more key poses of the motion of the first user based on a preset condition for each of the key poses;
E. obtaining the one or more key poses of the motion of the first user and segmenting a motion sequence by the key poses into segments;
F. sampling each segment and aligning each segment with a corresponding segment of a set of standard key poses; and
G. comparing trajectories obtained based on the aligned segments between the one or more key poses of the motion of the first user and the set of standard key poses,
wherein the set of standard key poses comprises one or more key poses of a motion sequence of a captured motion of a second user,
wherein the step of comparing trajectories includes calculating, for each segment, a difference between the 3D skeletal data of the one or more key poses by the first user and 3D skeletal data of the set of standard key poses.