US 12,315,063 B2
Subtitle processing method and apparatus
Xuehang Huang, Beijing (CN); Zhanpeng Huang, Beijing (CN); and Zhiyun Yu, Beijing (CN)
Assigned to Beijing Zitiao Network Technology Co., Ltd., Beijing (CN)
Filed by Beijing Zitiao Network Technology Co., Ltd., Beijing (CN)
Filed on Dec. 18, 2023, as Appl. No. 18/543,836.
Application 18/543,836 is a continuation of application No. PCT/CN2023/118772, filed on Sep. 14, 2023.
Claims priority of application No. 202211117721.1 (CN), filed on Sep. 14, 2022.
Prior Publication US 2024/0119654 A1, Apr. 11, 2024
Int. Cl. G06F 3/048 (2013.01); G06T 11/20 (2006.01); G06T 13/80 (2011.01)
CPC G06T 13/80 (2013.01) [G06T 11/203 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A subtitle processing method, comprising:
performing, in a process of editing multimedia material, speech recognition on an audio corresponding to the multimedia material, to obtain a subtitle text corresponding to the audio and timestamp information of audio fragments respectively corresponding to respective text elements included in the subtitle text, wherein each of the text elements is a word;
matching with respective material units in the multimedia material according to the timestamp information of the audio fragments respectively corresponding to the respective text elements, and determining material fragments in the multimedia material respectively matching with the respective text elements; wherein a time in an editing timeline of a material fragment matching with a text element is consistent with a time in the editing timeline of an audio fragment corresponding to the text element; and
synthesizing the respective text elements respectively with material fragments in a matching time period to obtain a target multimedia material with an animation effect in which the subtitle text jumps out word by word,
wherein the synthesizing the respective text elements respectively with the material fragments in the matching time period to obtain the target multimedia material with the animation effect in which the subtitle text jumps out word by word comprises:
applying a specified first subtitle animation style to the respective text elements in batches, and synthesizing the text elements with the first subtitle animation style and the material fragments in the matching time period, to obtain the target multimedia material with the animation effect in which the subtitle text jumps out word by word in the first subtitle animation style.