	US 12,013,841 B2
	Apparatus and methods for annotation management
Mani Shankar, Princeton, NJ (US); and Sweetee Manchanda, Princeton Junction, NJ (US)
Assigned to Bank of America Corporation, Charlotte, NC (US)
Filed by Bank of America Corporation, Charlotte, NC (US)
Filed on May 4, 2021, as Appl. No. 17/307,628.
Prior Publication US 2022/0358117 A1, Nov. 10, 2022
Int. Cl. G06F 16/23 (2019.01); G06F 21/31 (2013.01); G06F 21/60 (2013.01); G06N 20/00 (2019.01)

CPC G06F 16/2379 (2019.01) [G06F 16/2343 (2019.01); G06F 21/31 (2013.01); G06F 21/602 (2013.01); G06N 20/00 (2019.01)]

12 Claims

1. A method for managing concurrent annotation of a body of data comprising a plurality of data files, the method comprising:

(a) storing, at a centralized server, the body of data;

(b) receiving, at an annotation management engine, a user login from an annotator, said user login enabling the annotator to select an available data file from the plurality of data files;

(d) displaying, on a monitor proximate to the annotator, the selected available data file and a graphical user interface;

(e) receiving, at the annotation management engine, one or more saved labels applied by the annotator to the available data file;

(f) locking, at the annotation management engine, the available data file, said locking transforming the available data file to an annotated data file and preventing a different annotator from applying one or more saved labels;

(g) updating the body of data with the annotated data file;

(h) generating, at the annotation management engine, a history of the annotated data file;

(i) receiving, at an annotation management engine, a user login from a checker while the annotator is labeling the available data file, said user login enabling the checker to select the annotated data file and the available data file from the plurality of data files;

(j) authenticating the checker;

(k) unlocking, at the annotation management engine, the available data file, said unlocking allowing the checker to check and apply one or more labels to the available data file;

(l) displaying, on a monitor proximate to the checker, the annotated data file, the available data file, the history, and a graphical user interface;

(m) receiving confirmation from the checker that the labels are accurate;

(n) storing the confirmation and the annotated data file as a checked data file;

(o) updating the body of data with the checked data file; and

(p) generating, at the annotation management engine, a history of the checked data file;

wherein the history includes the available data file, the annotated data file, the one or more saved labels, an identity of the one or more annotators, and any changes made by the one or more annotators to the available data file, and

wherein the annotation management engine, through an artificial intelligence/machine learning (“AI/ML”) algorithm automatically determines available data files of the plurality of data files.