US 12,277,689 B2
Video processing method, electronic device, and storage medium
Jingcong Zhang, Los Angeles, CA (US); Nathanael Schager, Los Angeles, CA (US); Xiaocheng Tang, Los Angeles, CA (US); James Gualtieri, Los Angeles, CA (US); Yang Lv, Beijing (CN); Zhe Huang, Los Angeles, CA (US); Zeyong Cai, Los Angeles, CA (US); Jing Wang, Beijing (CN); Xiaoyu Liu, Los Angeles, CA (US); Nite Luo, Los Angeles, CA (US); Julia Meng, Culver City, CA (US); Haiying Cheng, Culver City, CA (US); and Qinzi Tan, Beijing (CN)
Assigned to LEMON INC., Grand Cayman (KY)
Filed by Lemon Inc., Grand Cayman (KY)
Filed on Nov. 16, 2022, as Appl. No. 18/056,155.
Claims priority of application No. 202210077967.4 (CN), filed on Jan. 24, 2022.
Prior Publication US 2023/0237625 A1, Jul. 27, 2023
Int. Cl. G06T 5/77 (2024.01); G06T 7/40 (2017.01)
CPC G06T 5/77 (2024.01) [G06T 7/40 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30201 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A video processing method, comprising:
acquiring a first video, and recognizing at least one first face key point of a first target object in the first video, wherein the at least one first face key point corresponds to at least one mask key point in a three-dimensional human face mask effect; and
adding the three-dimensional human face mask effect to video frames of the first video to obtain a second video, wherein the at least one mask key point in the three-dimensional human face mask effect moves with a corresponding first face key point;
wherein adding the three-dimensional human face mask effect to the video frames of the first video comprises:
determining first position data of the at least one first face key point in a current first video frame in the first video, and acquiring a first three-dimensional human face model corresponding to the current first video frame;
updating a position of each patch vertex in the first three-dimensional human face model according to the first position data to obtain a second three-dimensional human face model corresponding to the current first video frame;
performing mapping rendering on the second three-dimensional human face model to obtain a current three-dimensional human face mask effect; and
adding the current three-dimensional human face mask effect to the current first video frame to obtain a current second video frame; and
acquiring to-be-rendered texture information of the second three-dimensional human face model, comprising:
determining a to-be-rendered material corresponding to the current first video frame, and acquiring texture information of the to-be-rendered material as the to-be-rendered texture information of the second three-dimensional human face model.