US 12,073,570 B2
Video generation device
Hideki Shimizu, Saitama (JP)
Assigned to CITIZEN WATCH CO., LTD., Tokyo (JP)
Appl. No. 17/638,697
Filed by CITIZEN WATCH CO., LTD., Tokyo (JP)
PCT Filed Aug. 26, 2020, PCT No. PCT/JP2020/032226
§ 371(c)(1), (2) Date Feb. 25, 2022,
PCT Pub. No. WO2021/039857, PCT Pub. Date Mar. 4, 2021.
Claims priority of application No. 2019-156804 (JP), filed on Aug. 29, 2019.
Prior Publication US 2022/0335625 A1, Oct. 20, 2022
Int. Cl. G06T 7/246 (2017.01); G06T 7/215 (2017.01); H04N 5/262 (2006.01)
CPC G06T 7/251 (2017.01) [G06T 7/215 (2017.01); H04N 5/2621 (2013.01); G06T 2207/10016 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A video generation device comprising:
storage that contains ideal skeletal pose information representing, for each of predetermined rhythms, a series of skeletal poses corresponding to ideal movements performed at predetermined timings to the predetermined rhythm;
a recorder that records an actual video of movements performed by a subject at predetermined timings to a predetermined rhythm played back;
a skeletal-pose analysis unit that extracts skeletal pose information representing a series of skeletal poses corresponding to the movements performed by the subject at predetermined timings from a group of still images constituting the actual video;
a model generation unit that generates a trained model of images of the subject corresponding to skeletal poses, based on the group of still images and the skeletal pose information; and
a video generation unit that generates and outputs a virtual ideal video, based on the trained model and the ideal skeletal pose information, wherein the virtual ideal video is a video of the subject performing movements matching the ideal skeletal pose information at predetermined timings.