US 12,032,922 B2
Automated script generation and audio-visual presentations
Ji Li, San Jose, CA (US); Konstantin Seleskerov, Palo Alto, CA (US); Huey-Ru Tsai, Los Altos, CA (US); Muin Barkatali Momin, Santa Clara, CA (US); Ramya Tridandapani, Sunnyvale, CA (US); Sindhu Vigasini Jambunathan, San Jose, CA (US); Amit Srivastava, San Jose, CA (US); Derek Martin Johnson, Sunnyvale, CA (US); Gencheng Wu, Campbell, CA (US); Sheng Zhao, Beijing (CN); Xinfeng Chen, Beijing (CN); and Bohan Li, Beijing (CN)
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on May 12, 2021, as Appl. No. 17/318,170.
Prior Publication US 2022/0366153 A1, Nov. 17, 2022
Int. Cl. G06F 40/58 (2020.01); G06F 3/0481 (2022.01); G06F 16/2457 (2019.01); G06F 40/205 (2020.01); G10L 13/02 (2013.01)
CPC G06F 40/58 (2020.01) [G06F 3/0481 (2013.01); G06F 16/24578 (2019.01); G06F 40/205 (2020.01); G10L 13/02 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A computer-implemented method for automatically generating a presentation script, the method comprising:
receiving a presentation slide deck comprising a visual presentation;
determining a topic of the presentation slide deck;
generating a natural language generation model prompt for a first natural language generation model of a plurality of natural language generation models using an input design model, the generating comprising:
providing the presentation slide deck, the topic, and user information as first inputs to the input design model trained to:
select the first natural language generation model from the plurality of natural language generation models based on the first inputs, and
generate the natural language generation model prompt for the first natural language generation model based on the first inputs, wherein the natural language generation model prompt is designed to request a candidate presentation script for a speech on the topic, and
receiving the natural language generation model prompt as output from the input design model in response to the first inputs;
providing the natural language generation model prompt as an input prompt to the first natural language generation model trained to generate a natural language response to the input prompt;
receiving, in response to the input prompt, the candidate presentation script for the speech on the topic from the first natural language generation model;
generating an audio presentation by inputting the candidate presentation script into a text-to-speech model;
generating a final presentation comprising a visual display of the presentation slide deck synchronized with the audio presentation; and
outputting the final presentation to an audience.