CPC G06F 11/3096 (2013.01) [G06F 16/907 (2019.01); G06F 16/9017 (2019.01); G06F 16/9038 (2019.01); G06F 16/93 (2019.01)] | 20 Claims |
1. A system, comprising:
hardware processing circuitry;
one or more memories storing instructions that when executed configure the hardware processing circuitry to perform operations comprising:
storing a plurality of documents in a data store resulting in stored documents;
receiving a read request for the stored documents from a labeling system;
responsive to the read request, retrieving the plurality of documents from the data store;
providing, based on the retrieving, the plurality of documents to the labeling system;
receiving from the labeling system, a first message;
decoding, from the first message,
a first watermark indicating a first data item in a delivery queue that is to be retrieved next and
an indication that a label that indicates a sensitivity level for at least one of the plurality of documents is available;
determining a label storage space available in one or more memories;
determining, based on the determined label storage space available, a data limit on an amount of response data;
generating a data request that includes the determined limit and the first watermark;
transmitting the data request to the labeling system;
receiving from the labeling system, a second message,
responsive to receiving the second message, attempting to decode, from the second message,
first labels including the first data item and
a second watermark indicating a second data item in the delivery queue after the first labels;
providing a retry request for the first labels;
adjusting the delivery queue to indicate the first labels are pending for delivery based on a time in the retry request; and
associating each label in the first labels with its respective document in the data store.
|