US 11,954,778 B2
Avatar rendering of presentations
Zachary A. Silverstein, Georgetown, TX (US); Nadiya Kochura, Bolton, MA (US); Tiberiu Suto, Franklin, NY (US); and Hemant Kumar Sivaswamy, Pune (IN)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Jan. 4, 2022, as Appl. No. 17/567,937.
Prior Publication US 2023/0215067 A1, Jul. 6, 2023
Int. Cl. G06T 13/20 (2011.01); G06F 3/01 (2006.01); G06T 13/40 (2011.01); G06T 13/80 (2011.01)
CPC G06T 13/205 (2013.01) [G06F 3/013 (2013.01); G06T 13/40 (2013.01); G06T 13/80 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for avatar rendering of virtual presentations, the computer-implemented method comprising:
extracting visual content from a presentation;
generating a first timestamp for the visual content;
extracting audio content from the presentation;
generating a second timestamp for the audio content;
converting the extracted audio content into textual data using natural language processing to determine audio content being played;
determining a context of the visual content and the audio content of the presentation;
based on visual content data of the visual content associated with the first timestamp matching audio content data of the audio content associated with the second timestamp, correlating the visual content with the audio content as the audio content is played;
generating a virtual avatar to dynamically render a virtual presentation to a viewer, based at least in part, on the correlated visual content and audio content, wherein the virtual avatar emulates eye contact with the viewer and exhibits a body language consistent with the context, the visual content, and the audio content of the presentation; and
highlighting the correlated visual content of the presentation as the correlated audio content is played.