US 12,236,712 B2
Facial expression recognition method and apparatus, electronic device and storage medium
Yanbo Fan, Guangdong (CN); Yong Zhang, Guangdong (CN); Le Li, Guangdong (CN); Baoyuan Wu, Guangdong (CN); Zhifeng Li, Guangdong (CN); and Wei Liu, Guangdong (CN)
Assigned to Tencent Technology (Shenzhen) Company Limited, Shenzhen (CN)
Filed by Tencent Technology (Shenzhen) Company Limited, Guangdong (CN)
Filed on Sep. 13, 2021, as Appl. No. 17/473,887.
Application 17/473,887 is a continuation of application No. PCT/CN2020/092593, filed on May 27, 2020.
Claims priority of application No. 201910478195.3 (CN), filed on Jun. 3, 2019.
Prior Publication US 2021/0406525 A1, Dec. 30, 2021
Int. Cl. G06V 40/16 (2022.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06F 18/25 (2023.01); G06N 3/045 (2023.01); G06V 10/20 (2022.01); G06V 10/44 (2022.01); G06V 10/56 (2022.01)
CPC G06V 40/174 (2022.01) [G06F 18/214 (2023.01); G06F 18/2193 (2023.01); G06F 18/253 (2023.01); G06N 3/045 (2023.01); G06V 10/255 (2022.01); G06V 10/44 (2022.01); G06V 10/56 (2022.01); G06V 40/171 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A facial expression recognition method comprising:
extracting a first feature of a facial texture from color information of pixels in a first image;
extracting a second feature of facial key points from the first image;
combining the first feature and the second feature, to obtain a fused feature; and
determining, by processing circuitry of an electronic device, a first expression type of a face in the first image that corresponds to the fused feature, the first expression type being determined from a plurality of facial expression types according to a correlation between the facial texture of the first feature and the second feature of the facial key points indicated by the fused feature, each of the plurality of facial expression types being indicated by a different correlation between the facial texture of the first feature and the second feature of the facial key points.