US 12,223,015 B2
Human-augmented artificial intelligence configuration and optimization insights
Emmanouil Koukoumidis, Mountain View, CA (US); Nikolaos Kofinas, Mountain View, CA (US); Evan Huang, Mountain View, CA (US); Kiran Bellare, Mountain View, CA (US); Xiao Liu, San Francisco, CA (US); Michael Lanning, Mountain View, CA (US); and Lukas Rutishauser, Mountain View, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Feb. 16, 2022, as Appl. No. 17/651,414.
Claims priority of provisional application 63/290,332, filed on Dec. 16, 2021.
Prior Publication US 2023/0195847 A1, Jun. 22, 2023
Int. Cl. G06F 40/295 (2020.01); G06F 18/20 (2023.01); G06F 18/21 (2023.01)
CPC G06F 18/2193 (2023.01) [G06F 18/285 (2023.01); G06F 40/295 (2020.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform operations comprising:
receiving a document insight request requesting document insights for a corpus of documents from a user device associated with a user, the document insight request comprising:
the corpus of documents;
a set of entities contained within each document of the corpus of documents; and
a document insight request parameter comprising a confidence value target;
obtaining a machine learning model based on the corpus of documents, the machine learning model trained on a training corpus of documents containing the set of entities;
generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, the document insights for the corpus of documents comprising an accuracy target indicating a ratio of correctly identified entities from the corpus of documents and a user review rate target corresponding to the accuracy target; and
transmitting the document insights to the user device, the document insights, when received by the user device, causing a graphical user interface (GUI) executing on the user device to display the document insights on a display screen of the user device.