| CPC G06F 21/32 (2013.01) [G06F 18/22 (2023.01); G06F 18/24137 (2023.01); G06Q 20/108 (2013.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/771 (2022.01); G06V 10/82 (2022.01); G06V 40/165 (2022.01); G06V 40/171 (2022.01); G06V 40/20 (2022.01); G10L 15/25 (2013.01)] | 20 Claims |

|
1. A computer system for conducting a dynamic passphrase challenge to control access to a secure electronic resource, the computer system comprising a non-transitory computer readable storage device, computer memory, and a processor configured to:
extract, from a script-reading video data set, a data structure representing one or more facial or lip features of an individual corresponding to at least one phoneme or phoneme transition corresponding to a sequence of pre-identified phonemes or phoneme transitions, the data structure of the script-reading video data set having the sequence of pre-identified phonemes or phoneme transitions, the pre-identified phonemes or phoneme transitions including at least one overlapping phoneme or phoneme transition required to be spoken when speaking words of a response string;
train, one or more baseline machine learning data model architectures, each baseline machine learning data model architecture of the one or more baseline machine learning data model architectures corresponding to a corresponding pre-identified phoneme or phoneme transition of the data structure such that parameters of the baseline machine learning data model architectures are tuned based on the corresponding one or more facial or lip features;
receive an answer-reading video data set capturing a portion of or an entirety of an individual's face while the individual is speaking the words corresponding to the response string; and
process, the answer-reading video data set, using the one or more baseline machine learning data model architectures corresponding to the at least one overlapping phoneme or phoneme transition to determine an overall classification similarity score;
wherein a provisioning of access to the secure electronic resource occurs based on a comparison of the overall classification similarity score against a pre-defined threshold similarity score.
|