US 12,456,332 B2
Motion visualization system and the motion visualization method
Takeshi Tanaka, Tokyo (JP); Daisuke Fukui, Tokyo (JP); Hiromitsu Nakagawa, Tokyo (JP); and Takashi Toyomura, Tokyo (JP)
Assigned to Hitachi High-Tech Corporation, Tokyo (JP)
Appl. No. 18/031,263
Filed by Hitachi High-Tech Corporation, Tokyo (JP)
PCT Filed Oct. 4, 2021, PCT No. PCT/JP2021/036602
§ 371(c)(1), (2) Date Apr. 11, 2023,
PCT Pub. No. WO2022/080165, PCT Pub. Date Apr. 21, 2022.
Claims priority of application No. 2020-173653 (JP), filed on Oct. 15, 2020.
Prior Publication US 2023/0377375 A1, Nov. 23, 2023
Int. Cl. G06V 40/20 (2022.01); A61B 5/11 (2006.01); G06T 3/60 (2024.01)
CPC G06V 40/25 (2022.01) [A61B 5/112 (2013.01); G06T 3/60 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A motion visualization system comprising:
a camera having a z-axis, which is a direction along an optical axis of a lens of the camera;
a controller coupled to the camera; and
a memory storing instructions that when executed by the controller, configures the controller to:
obtain skeleton coordinate information of a target person for each of a plurality of frames captured by the camera,
extract a walk cycle in a traveling direction of the target person based on the skeleton coordinate information,
determine information a predetermined portion of the target person based on the skeleton coordinate information of one of the plurality frames,
transform the skeleton coordinate information in a reference coordinate system where a direction in which the predetermined portion of the target person moves is set as an axis of the traveling direction in one walk cycle extracted by the cycle extraction unit, the traveling direction being different than the z-axis of the camera, and
transform the skeleton coordinate information based on the information of the predetermined portion of the target person, as reference data, so that the z-axis and the traveling direction overlap with one another.