US 12,260,612 B2
Impact motion recognition system for screen-based multi-sport coaching
Jong Sung Kim, Daejeon (KR); Seong Il Yang, Daejeon (KR); Min Sung Yoon, Daejeon (KR); and Si Hwan Jang, Daejeon (KR)
Assigned to ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, Daejeon (KR)
Filed by ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, Daejeon (KR)
Filed on Oct. 25, 2021, as Appl. No. 17/509,615.
Claims priority of application No. 10-2021-0041993 (KR), filed on Mar. 31, 2021.
Prior Publication US 2022/0319151 A1, Oct. 6, 2022
Int. Cl. G06V 10/764 (2022.01); G06V 10/28 (2022.01); G06V 20/40 (2022.01)
CPC G06V 10/764 (2022.01) [G06V 10/28 (2022.01); G06V 20/42 (2022.01)] 20 Claims
OG exemplary drawing
 
1. An impact motion recognition system for a screen-based multi-sport coaching system, the impact motion recognition system comprising:
a high-speed stereo camera device positioned to observe a target object including a hitting body and a moving body, and configured to acquire a stereo image sequence from a moment of impact between the hitting body and the moving body;
an object detection unit configured to detect objects in motion in the acquired stereo image sequence;
a moving body recognition unit configured to identify that an impact motion has occurred between the objects in motion and to recognize, in response to the identification of the impact motion of the impact, the moving body from among the objects in motion;
a hitting body detection unit configured to, in response to the identification of the impact motion of the impact and based on the moving body being recognized through the moving body recognition unit, detect the hitting body from among the objects in motion excluding the moving body;
a target object tracking unit configured to continuously detect a center point of the moving body and a feature point of the hitting body in a subsequent stereo image sequence using characteristics of the moving body and the hitting body that are detected, and to continuously track the center point of the moving body and the feature point of the hitting body until the center point of the moving body and the feature point of the hitting body are not detected; and
a motion analysis unit configured to analyze three-dimensional (3D) motion information of the target object using the center point of the moving body and the feature point of the hitting body, which are detected through the target object tracking unit, and high-speed stereo camera correction data and to output, based on the analyzation, sport-specific information about the impact from among coachable sports of the multi-sport coaching system.