US 12,456,204 B1
Computer vision-driven interactive full-body motion tracking
Luís António Correia de Oliveira, Oporto (PT); Pedro Henrique Oliveira Santos, Oporto (PT); Gustavo Seixas De Sá Burmester, Oporto (PT); Ricardo Miguel Pontes Leonardo, Oporto (PT); and Pedro Fillipe da Silva Rodrigues, Oporto (PT)
Assigned to SWORD HEALTH, S.A., Oporto (PT)
Filed by Sword Health, S.A., Oporto (PT)
Filed on Apr. 1, 2025, as Appl. No. 19/097,799.
Int. Cl. G06K 9/00 (2022.01); G06T 5/90 (2024.01); G06T 7/20 (2017.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01)
CPC G06T 7/20 (2013.01) [G06T 5/90 (2024.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06T 2207/20208 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. One or more non-transitory machine-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
accessing images of a full body of a user captured by a first image sensor and a second image sensor of a portable computing device, the images captured while the portable computing device is positioned in a substantially vertical orientation and while the user is performing one or more exercises;
processing the images of the first image sensor and the second image sensor to:
generate high dynamic range (HDR) image data, and
determine depth information associated with the user; and
generating, in real time and while the user is performing the one or more exercises, motion tracking data based on the HDR image data and the depth information,
wherein generating the motion tracking data comprises generating pose estimation data by analyzing body landmarks of the user while the user performs the one or more exercises, the pose estimation data obtained by processing first input comprising the HDR image data generated from the images of the first image sensor and the second image sensor and second input comprising the depth information determined from the images of the first image sensor and the second image sensor.