	US 12,014,135 B2
	Methods, apparatus and systems for annotation of text documents
Christopher Potts, Palo Alto, CA (US); Evan Lin, San Francisco, CA (US); Andrew Maas, Redwood City, CA (US); Abhilash Itharaju, Fremont, CA (US); Kevin Reschke, San Mateo, CA (US); and Jordan Vincent, San Francisco, CA (US)
Assigned to PAREXEL International, LLC, Waltham, MA (US)
Filed by PAREXEL International, LLC, Waltham, MA (US)
Filed on Jan. 18, 2022, as Appl. No. 17/578,390.
Application 17/578,390 is a continuation of application No. 16/815,873, filed on Mar. 11, 2020, granted, now 11,263,391.
Claims priority of provisional application 62/816,596, filed on Mar. 11, 2019.
Prior Publication US 2022/0253594 A1, Aug. 11, 2022
Int. Cl. G06F 40/169 (2020.01); G06F 3/04842 (2022.01); G16H 10/60 (2018.01)

CPC G06F 40/169 (2020.01) [G06F 3/04842 (2013.01); G16H 10/60 (2018.01)]

26 Claims

1. A system for annotating documents with a plurality of labels according to an annotation scheme, the system comprising:

a non-transitory computer-readable medium configured to store:

the annotation scheme comprising a plurality of annotation labels for annotating a document; and

a database comprising:

a plurality of documents; and

a plurality of annotations made by one or more users, each of the plurality of annotations being associated with a document of the plurality of documents and including:

an annotation label selected from the plurality of annotation labels in the annotation scheme, and

an association indicating a correspondence between the annotation label and a span of text in the associated document or a relationship represented by the annotation label between a first span of text and a second span of text in the associated document; and

at least one processor configured to:

cause a first user device to display:

a first document of the plurality of documents in the database; and

the annotation scheme;

receive from the first user device one or more annotations to the first document made by a first user;

receive from the first user device an indication of user interaction indicating a change of an annotation label of the plurality of annotation labels in the annotation scheme;

update the annotation scheme according to the change of the annotation label;

propagate the change of the annotation label in the annotation scheme to at least a subset of the plurality of annotations;

cause the first user device to display one or more prior annotations to the first document that were previously made by a second user different from the first user;

receive from the first user device an indication of a user interaction indicating one or more corrections to a subset of the one or more prior annotations to the first document; and

store the subset of the one or more prior annotations to the first document with the one or more corrections applied.