US 12,236,616 B2
Method and system for automatic extraction of virtual on-body inertial measurement units
Hyeokhyen Kwon, Atlanta, GA (US); Gregory D. Abowd, Atlanta, GA (US); Harish Kashyap Haresamudram, Atlanta, GA (US); Thomas Ploetz, Atlanta, GA (US); Eu Gen Catherine Tong, London (GB); Yan Gao, Oxford (GB); and Nicholas Lane, Cambridge (GB)
Assigned to Georgia Tech Research Corporation, Atlanta, GA (US)
Filed by Georgia Tech Research Corporation, Atlanta, GA (US)
Filed on Sep. 1, 2021, as Appl. No. 17/464,488.
Claims priority of provisional application 63/073,009, filed on Sep. 1, 2020.
Prior Publication US 2022/0066544 A1, Mar. 3, 2022
Int. Cl. G06T 7/246 (2017.01); G06T 7/20 (2017.01); G06V 40/20 (2022.01)
CPC G06T 7/251 (2017.01) [G06T 7/20 (2013.01); G06V 40/23 (2022.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
at least one processor configured to execute an automated processing pipeline comprising:
a two-dimensional skeletal estimator configured to determine skeletal-associated points of a body of a person in a plurality of frames of a video data set;
a three-dimensional skeletal estimator configured to generate 3D motion estimation of 3D joints of the skeletal-associated points;
an inertial measurement unit (IMU) extractor configured to determine motion values at one or more 3D joints of the skeletal-associated points; and
a sensor emulator configured to modify the determined motion values at one or more 3D joints of the skeletal-associated points according to an IMU sensor profile to generate virtual IMU sensor values including at least acceleration data and gyroscope data,
wherein the virtual IMU sensor values are outputted for the one or more 3D joints of the skeletal-associated points.