US 12,447,412 B2
Commentary video generation method and apparatus, server, and storage medium
Shaobin Lin, Shenzhen (CN)
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed by Tencent Technology (Shenzhen) Company Limited, Guangdong (CN)
Filed on Sep. 14, 2022, as Appl. No. 17/944,589.
Application 17/944,589 is a continuation of application No. PCT/CN2021/130893, filed on Nov. 16, 2021.
Claims priority of application No. 202011560174.5 (CN), filed on Dec. 25, 2020.
Prior Publication US 2023/0018621 A1, Jan. 19, 2023
Int. Cl. A63F 13/86 (2014.01); A63F 13/537 (2014.01); A63F 13/58 (2014.01); A63F 13/85 (2014.01); H04N 21/44 (2011.01)
CPC A63F 13/85 (2014.09) [A63F 13/537 (2014.09); A63F 13/58 (2014.09); A63F 13/86 (2014.09); H04N 21/44008 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A commentary video generation method performed by a commentary server, the commentary video generation method comprising:
obtaining a game instruction frame, the game instruction frame comprising at least one game operation instruction, and the game operation instruction being used for controlling a virtual object to perform an in-game behavior in a game;
generating a commentary data stream based on the game instruction frame, the commentary data stream comprising at least one piece of commentary audio describing a game event, and the game event being triggered during the virtual object performing the in-game behavior;
rendering a game screen based on the game instruction frame and a global game screen to generate a game video stream, the game video stream corresponding to a target game viewing angle of the global game scene based on a target game screen; and
generating a commentary video stream corresponding to the target game viewing angle based on combining the commentary data stream and the game video stream, the game video frame and the commentary audio corresponding to the same game event in the commentary video stream being aligned in time.