US 12,148,445 B2
Emotion detection and moderation based on voice inputs, errors in gameplay, physiological indicators of heart rate or skin tone of users of a communication session
Victoria Dorn, San Mateo, CA (US); Celeste Bean, San Mateo, CA (US); Olga Rudi, San Mateo, CA (US); Courtney Yingling, San Mateo, CA (US); and Hsin-Yi Chien, San Mateo, CA (US)
Assigned to Sony Interactive Entertainment Inc., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Sep. 30, 2021, as Appl. No. 17/491,269.
Prior Publication US 2023/0096357 A1, Mar. 30, 2023
Int. Cl. G10L 25/63 (2013.01); A61B 5/16 (2006.01); G10L 15/22 (2006.01); H04L 67/306 (2022.01); H04N 7/15 (2006.01); H04W 76/45 (2018.01)
CPC G10L 25/63 (2013.01) [G10L 15/22 (2013.01); H04L 67/306 (2013.01); H04N 7/152 (2013.01); H04W 76/45 (2018.02); A61B 5/16 (2013.01); G10L 15/222 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for emotion-based moderation, the method comprising:
storing a user emotion profile in memory for a user, wherein the user emotion profile includes one or more moderation rules that specify a moderation action responsive to one or more emotional states of other users;
monitoring a current communication session associated with a user device of the user based on the user emotion profile, wherein the current communication session includes messages from one or more other user devices of the other users;
identifying an emotional state of one of the other users based on analyzing a subset of the messages from the other user using an emotion learning model that correlates emotion to one or more emotional indicators including at least one of error in gameplay, character behavior, or player physiological indicator that includes at least one of a heart rate or a skin tone;
detecting that the emotional state identified for the other user triggers at least one of the moderation rules, wherein the detected emotional state corresponds to at least one of the emotional states specified by the user emotion profile; and
modifying a presentation of at least one of the messages in the subset being provided to the user device in accordance with the at least one triggered moderation rule, wherein at least a part of the at least one message is filtered out of the modified presentation in accordance with the moderation action specified by the at least one triggered moderation rule from the user emotion profile of the user, and wherein the modified presentation is different from a version provided to each of the other users of the current communication session.