US 12,118,296 B2
Collaborative coauthoring with artificial intelligence
Benjamin Gustav Wilde, Quincy, MA (US); Ransom Lloyd Richardson, Acton, MA (US); Jenna Hong, Acton, MA (US); Theo Lorrain-Hale, Boston, MA (US); Christina Rose Long, Cambridge, MA (US); Omar Basim Tuffaha, Saugus, MA (US); Yang Wang, Middleton, MA (US); Paul Anthony Scudieri, Columbus, OH (US); Susanne Duswald, Vancouver (CA); Ryan Michael Lawrence, Redmond, WA (US); Michael Adam Scarpati, Wellesley, MA (US); Courtney Sarah Cochrane, Cambridge, MA (US); Alexey Romanov, Cambridge, MA (US); Katie Nicole Rotella, Highland Park, NJ (US); Moiz Shabbir Ghadiyali, Cypress, TX (US); and Emili Koui-Miclette, Seattle, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Apr. 28, 2023, as Appl. No. 18/309,338.
Claims priority of provisional application 63/489,298, filed on Mar. 9, 2023.
Prior Publication US 2024/0303415 A1, Sep. 12, 2024
Int. Cl. G06F 40/166 (2020.01); G06F 16/176 (2019.01); G06F 40/56 (2020.01); H04L 65/401 (2022.01)
CPC G06F 40/166 (2020.01) [G06F 16/176 (2019.01); G06F 40/56 (2020.01); H04L 65/4015 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A data processing system comprising:
a processor; and
a machine-readable medium storing executable instructions that, when executed, cause the processor to perform operations comprising:
receiving, during a coauthoring session between a first user and a first generative model, a first textual prompt from the first user via a user interface of a first client device, the first textual prompt comprising a first textual description;
providing the first textual description as a first input to the first generative model to output a first collaborative content including textual and non-textual collaborative content;
applying on the non-textual collaborative content of the first collaborative content at least one of an image analysis to identify a subject matter depicted therein, or an optical character recognition to extract textual components depicted therein;
monitoring the textual collaborative content and at least one of the subject matter or the textual components for objectionable content;
causing the first client device to present the first collaborative content for editing during the coauthoring session, after determining that the textual collaborative content and the at least one of the subject matter or the textual components do not contain objectionable content;
receiving during the coauthoring session an edited version of the first collaborative content from the first client device, the edited version of the first collaborative content including edits to the first collaborative content provided by the first user via the user interface;
providing the edited version of the first collaborative content as a second input to the first generative model to output a second collaborative content;
causing the first client device to present the second collaborative content on the user interface during the coauthoring session;
maintaining a history of textual prompts, a plurality of collaborative content, and edits to the plurality of collaborative content generated by the first generative model during the coauthoring session, wherein the history includes controls that, when activated, present a view of a state of content generated by the first generative model for each state, the textual prompts include the first textual prompt, and the plurality of collaborative content include the first collaborative content; and
causing the first client device to present the textual prompts and the plurality of collaborative content in a chronological list in conjunction with a current version of the collaborative content in one screen on the user interface during the coauthoring session.