CPC G06F 16/1752 (2019.01) [G06F 3/0608 (2013.01); G06F 3/0641 (2013.01); G06F 3/067 (2013.01)] | 10 Claims |
1. A system for error-resilient data reduction, comprising:
a computing device comprising a memory, a processor, and a non-volatile data storage device;
a data deconstruction engine comprising a first plurality of programming instructions stored in the memory of, and operating on a processor of, the computing device, wherein the first plurality of programming instructions, when operating on the processor, cause the computing device to:
train an encoding algorithm on sourceblocks at multiple phases, wherein each phase comprises a distinct starting bit offset of a respective sourceblock;
deconstruct incoming data into a plurality of sourceblocks;
encode the sourceblocks into codewords using the encoding algorithm and a reference codebook; and
send the codewords to a data reconstruction engine; and
a data reconstruction engine comprising a second plurality of programming instructions stored in the memory of, and operating on a processor of, the computing device, wherein the second plurality of programming instructions, when operating on the processor, cause the computing device to:
decode received codewords into decoded sourceblocks using the key-value pairs stored within the reference codebook; and
for each decoded sourceblock, determine if the decoded sourceblock has exceeded a predetermined threshold probability that the decoded sourceblock was properly encoded, wherein the decoded sourceblock is in-phase if the threshold is exceeded and the decoded sourceblock is out-of-phase if the threshold is not exceeded.
|