US 11,948,555 B2
Method and system for content internationalization and localization
Mark Christie, Auckley (GB); and Gerald Chao, Los Angeles, CA (US)
Assigned to NEP SUPERSHOOTERS L.P., Pittsburgh, PA (US)
Appl. No. 17/441,220
Filed by Piksel, Inc., Atlanta, GA (US)
PCT Filed Mar. 20, 2020, PCT No. PCT/EP2020/057843
§ 371(c)(1), (2) Date Sep. 20, 2021,
PCT Pub. No. WO2020/188101, PCT Pub. Date Sep. 24, 2020.
Claims priority of provisional application 62/821,274, filed on Mar. 20, 2019.
Prior Publication US 2022/0172709 A1, Jun. 2, 2022
Int. Cl. G10L 15/00 (2013.01); G10L 15/06 (2013.01); G10L 15/07 (2013.01); G10L 15/08 (2006.01); G10L 17/00 (2013.01); H04N 21/233 (2011.01); H04N 21/234 (2011.01); H04N 21/2343 (2011.01); H04N 21/81 (2011.01)
CPC G10L 15/07 (2013.01) [G10L 15/005 (2013.01); G10L 15/063 (2013.01); G10L 15/083 (2013.01); H04N 21/2335 (2013.01); H04N 21/23418 (2013.01); H04N 21/234345 (2013.01); H04N 21/8106 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of processing an original video file to generate a modified video file, the modified video file including a translated audio content of the original video file, the method comprising:
receiving the original video file for processing;
receiving a second video file of a different speaker than the speaker in the original video file, wherein the second video file is a video of a different speaker stating speech expressions;
accessing a model associating facial characteristics of the speaker in the original video file with portions of speech for those portions of replaced audio content; and
replacing facial expressions of the speaker in the original video file with facial expressions according to the video of the different speaker, on determination of a facial expression of the speaker matching a facial expression in the model.