US 12,147,876 B1
Methods and systems for facilitating stratified elusion and recall
Jesse Allan Winkler, Cincinnati, OH (US); Elise Tropiano, Evanston, IL (US); William Webber, Victoria (AU); Robert Jenson Price, Leesburg, VA (US); Brandon Gauthier, Centreville, VA (US); Dennis Chau, Chicago, IL (US); and Patricia Ann Gleason, Chicago, IL (US)
Assigned to RELATIVITY ODA LLC, Chicago, IL (US)
Filed by RELATIVITY ODA LLC, Chicago, IL (US)
Filed on Oct. 22, 2020, as Appl. No. 17/077,723.
Claims priority of provisional application 62/925,046, filed on Oct. 23, 2019.
Int. Cl. G06N 20/00 (2019.01); G06Q 50/18 (2012.01)
CPC G06N 20/00 (2019.01) [G06Q 50/18 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method of facilitating validation of an analysis of a set of documents in an active learning process, comprising:
selecting, in response to detecting a stopping point of the active learning process, an initial set of hypothetical cutoff ranks;
calculating, for each hypothetical cutoff rank, a respective recall value, a respective elusion value, and a respective number of documents left to review; and
displaying, in a display device, for each hypothetical cutoff rank, the hypothetical cutoff rank, the respective recall value, the respective elusion value, and the respective number of documents left to review.