| CPC G06F 16/1744 (2019.01) [G06F 16/116 (2019.01); G06F 16/13 (2019.01); G06F 16/221 (2019.01)] | 14 Claims |

|
1. A hardware-implemented file reader, comprising:
an interface, configured to access a file comprising multiple records, wherein the records store values in accordance with a structure that supports optional values and repeated values, and wherein the file is stored in a columnar format having multiple columns, each column storing (i) compressed values and (ii) corresponding compressed structure information that associates the values in the column to the nested structure of the records;
multiple hardware-implemented column readers, each column reader configured to be assigned to a respective selected column, and to read and decompress both the values and the structure information from at least a portion of the selected column, wherein at least a given column reader among the column readers comprises a hardware-implemented pipeline configured to incrementally decrypt, decompress and decode portions of the values or the structure information; and
a hardware-implemented record reconstructor, configured to reconstruct one or more of the records from at least portions of the columns that are read by the column readers, and to output the reconstructed records.
|