US 12,488,625 B2
Liveness detection method and apparatus, electronic device, and storage medium
Jia Meng, Shenzhen (CN); Dongheng Zhang, Shenzhen (CN); Jian Zhang, Shenzhen (CN); Mingwei Bi, Shenzhen (CN); Xinzhe Deng, Shenzhen (CN); Shouhong Ding, Shenzhen (CN); and Jilin Li, Shenzhen (CN)
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed by TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed on May 17, 2023, as Appl. No. 18/319,114.
Application 18/319,114 is a continuation of application No. PCT/CN2022/097110, filed on Jun. 6, 2022.
Claims priority of application No. 202110661492.9 (CN), filed on Jun. 15, 2021.
Prior Publication US 2023/0290187 A1, Sep. 14, 2023
Int. Cl. G06V 40/40 (2022.01); G01S 15/58 (2006.01); G01S 15/86 (2020.01); G06T 7/246 (2017.01); G06V 10/776 (2022.01); G06V 10/80 (2022.01); G06V 40/16 (2022.01)
CPC G06V 40/45 (2022.01) [G01S 15/58 (2013.01); G01S 15/86 (2020.01); G06T 7/246 (2017.01); G06V 10/776 (2022.01); G06V 10/806 (2022.01); G06V 40/171 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30241 (2013.01); G06V 40/172 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A liveness detection method, performed by an electronic device, the method comprising:
obtaining a reflected audio signal and video data of an object to be detected in response to receiving a liveness detection request;
performing signal processing on the reflected audio signal to obtain a processed audio signal, and performing time-frequency analysis on the processed audio signal to obtain time-frequency information of the processed audio signal;
extracting motion trajectory information of the object from the video data;
extracting features respectively from the time-frequency information and the motion trajectory information to obtain an audio feature and a motion feature of the object;
calculating first global attention information of the object according to the audio feature, and calculating second global attention information of the object according to the motion feature, the first global attention information indicating a global correlation of the audio feature, and the second global attention information indicating a global correlation of the motion feature; and
fusing the first global attention information with the second global attention information to obtain fused global information, and determining a liveness detection result of the object based on the fused global information.