US 12,482,164 B2
Method for protecting anonymity from media-based interactions
Camille Eddy, Boise, ID (US); Jennifer Halweil, New York, NY (US); and Mohammad Mahee, Brooklyn, NY (US)
Assigned to GoBeyond, New York, NY (US)
Filed by GoBeyond, New York, NY (US)
Filed on Apr. 27, 2023, as Appl. No. 18/308,432.
Claims priority of provisional application 63/363,652, filed on Apr. 27, 2022.
Prior Publication US 2023/0351664 A1, Nov. 2, 2023
Int. Cl. G06T 13/40 (2011.01); G10L 15/05 (2013.01); G10L 21/003 (2013.01); G10L 21/013 (2013.01); G10L 21/043 (2013.01)
CPC G06T 13/40 (2013.01) [G10L 15/05 (2013.01); G10L 21/003 (2013.01); G10L 21/043 (2013.01); G10L 2021/0135 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for anonymizing a user during a media-based interaction, wherein the media-based interaction comprises video data and audio data, the method comprising:
receiving the video data, wherein the video data comprises facial information of the user;
receiving the audio data, wherein the audio data comprises speech data associated with the video data;
accessing one or more identifiers, wherein each of the one or more identifiers is associated with one or more bias categories, the one or more identifiers comprising a mapping, wherein each of the one or more identifiers is mapped to a set of one or more synonyms that are neutral with respect to at least one of the one or more bias categories;
applying a natural language filter to the audio data to generate altered speech of the user based on the one or more identifiers, wherein the natural language filter is configured to:
detect a set of one or more words in the audio data;
match a word in the set of one or more words with an identifier in the one or more identifiers; and
replace, in the audio data, the word with a mapped synonym in the set of one or more synonyms;
identifying one or more facial expressions from the facial information of the user;
generating, based on the one or more facial expressions, a neutral facial representation of the user, wherein the neutral facial representation of the user anonymizes the user;
generating a virtual representation of the user, wherein the virtual representation comprises:
a visual component that includes the neutral facial representation of the user; and
an audio component comprising the altered speech of the user; and
transmitting, during the media-based interaction, the virtual representation to one or more computing devices over an electronic network.