| CPC H03M 7/3059 (2013.01) [G06N 20/00 (2019.01); H03M 7/6005 (2013.01)] | 8 Claims |

|
1. A system for storing, retrieving, and transmitting data in a highly compact format, comprising:
a computing device comprising a processor, a memory, and a first plurality of programming instructions;
a monitor database stored in the memory of the computing device, wherein the monitor database comprises a previous training dataset, a first measured probability distribution associated with the previous training dataset, performance metrics, and model predictions; and
a codebook training module comprising a second plurality of programming instructions stored in the memory and operable on the processor, wherein the second plurality of programming instructions, when operating on the processor, cause the processor to:
receive data;
format the received data into a test dataset;
retrieve the first measured probability distribution associated with the previous training dataset from the monitor database;
use one or more algorithms to measure a second probability distribution of the test dataset;
use the test dataset to retrain encoding and decoding algorithms;
utilize the retrained algorithms to create new data chunklets;
create new codeword for each new data chunklet; and
store each new data chunklet and its associated new codeword in an updated codebook.
|