| CPC H04L 9/3234 (2013.01) [G06F 40/284 (2020.01); H04L 63/101 (2013.01)] | 20 Claims |
|
1. A method for providing inputs to a language model and recoverability of source data associated with outputs of the language model, as a process resulting in at least one reversible token as a reversible representation of the source data, using at least a first control circuit configured as a first tokenization processor, a second control circuit configured as a second tokenization processor that is different than the first tokenization processor, and a first requesting network element acting as a first requestor, wherein the first tokenization processor and the second tokenization processor communicate with the first requestor, the method comprising:
incorporating by the first tokenization processor and the second tokenization processor of a first set of tokenization processor secrets into a first reversible token of the at least one reversible token, wherein the first reversible token remains invariant notwithstanding updating of the first set of tokenization processor secrets across the first tokenization processor and the second tokenization processor;
generating by the first requestor of a first input of the inputs to the language model, comprising, at least in part, substituting, for output fidelity retention, of the first reversible token by a first short label token comprising at least a first metadata and a first short token; and
associating by the first requestor with the first reversible token, a first output of the outputs of the language model that is attributable to the first input.
|