US 12,483,436 B2
Recommendation based on video-based audience sentiment
Vi Dinh Chau, Seattle, WA (US)
Assigned to Zoom Communications, Inc., San Jose, CA (US)
Filed by Zoom Communications, Inc., San Jose, CA (US)
Filed on Feb. 14, 2024, as Appl. No. 18/441,698.
Application 18/441,698 is a continuation of application No. 17/514,918, filed on Oct. 29, 2021, granted, now 11,943,074.
Prior Publication US 2024/0187269 A1, Jun. 6, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04L 12/18 (2006.01); G06V 10/50 (2022.01); G06V 40/20 (2022.01)
CPC H04L 12/1827 (2013.01) [G06V 10/507 (2022.01); G06V 40/20 (2022.01); H04L 12/1831 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method, comprising:
aggregating, by a server during multiple previous video conference sessions, previous conference session information including previous speaker participant behaviors, previous engagement levels, previous recommendations output by the server and effectiveness indications for the previous recommendations, wherein the effectiveness indications identify at least some of the previous recommendations as previously effective recommendations;
determining, by the server during a video conference, sentiment types based on reactions of one or more audience participants to speaker participant behaviors of a speaker participant;
determining, by the server during the video conference, a most frequently counted one of the sentiment types based on a count of the sentiment types for the one or more audience participants;
determining, by the server during the video conference, an engagement level based on the most frequently counted one of the sentiment types;
determining, by the server during the video conference using a machine learning system based in part on the previously effective recommendations from the previous conference session information, a real-time recommendation based on the engagement level and the speaker participant behaviors;
providing, by the server during the video conference, an outputting of the real-time recommendation at a device associated with the speaker participant to allow the speaker participant to change the speaker participant behaviors during the video conference;
maintaining, by the server during the video conference, engagement trends based on an engagement level before an output of the real-time recommendation, an engagement level after the output of the real-time recommendation, and associated timestamps; and
determining, by the server, an impact of the real-time recommendation on the engagement trends during the video conference.