| CPC H04L 9/3213 (2013.01) [G06F 21/60 (2013.01); H04L 9/0618 (2013.01); H04L 9/3236 (2013.01); H04L 67/1097 (2013.01)] | 20 Claims |

|
1. A method comprising:
receiving, at a local computing system, a string of characters comprising a date portion of characters, a time portion of characters, and a microseconds portion of characters, the string of characters representative of a date and time at a microsecond granularity;
querying, by the local computing system, a token server using the date portion of characters to access a first set of token tables, using the time portion of characters to access a second set of token tables, and using the microseconds portion of characters to access a third set of token tables;
instantiating, by the local computing system, a first tokenization pipeline, a second tokenization pipeline, and a third tokenization pipeline configured to operate in parallel to tokenize the string of characters, wherein:
the first tokenization pipeline is configured to perform one or more sequential tokenization operations on the date portion of characters using the first set of token tables to produce a tokenized date portion of characters,
the second tokenization pipeline is configured to perform one or more sequential tokenization operations on the time portion of characters using the second set of token tables to produce a tokenized time portion of characters,
the third tokenization pipe is configured to perform one or more sequential tokenization operations on the microseconds portion of characters using the third set of token tables to produce a tokenized microseconds portion of characters, and
each tokenization pipeline is configured to receive as input a first output of a tokenization operation from a different tokenization pipeline such that the first output of the tokenization operation from the different tokenization pipeline is used by both the tokenization pipeline and the different tokenization pipeline to perform different sequential tokenization operations associated with the tokenization pipeline and the different tokenization pipeline, and to provide a second output of at least one sequential tokenization operation associated with the tokenization pipeline to at least one additional tokenization pipeline such that the second output of the tokenization pipeline is used by both the tokenization pipeline and the additional tokenization pipeline to perform different sequential tokenization operations associated with the tokenization pipeline and the additional tokenization pipeline; and
combining the tokenized date portion of characters, the tokenized time portion of characters, and the tokenized microseconds portion of characters to produce a combined tokenized output and providing, by the local computing system, the combined tokenized output to a remote computing system.
|