US 12,093,232 B2
Method for storing time series data
Hongze Cheng, Beijing (CN); Haojun Liao, Beijing (CN); and Jianhui Tao, Beijing (CN)
Assigned to TAOS DATA, Chaoyang District Beijing (CN)
Appl. No. 18/027,716
Filed by TAOS DATA, Beijing (CN)
PCT Filed Dec. 17, 2020, PCT No. PCT/CN2020/137378
§ 371(c)(1), (2) Date Mar. 22, 2023,
PCT Pub. No. WO2022/126551, PCT Pub. Date Jun. 23, 2022.
Prior Publication US 2023/0385254 A1, Nov. 30, 2023
Int. Cl. G06F 16/22 (2019.01); G06F 16/2458 (2019.01)
CPC G06F 16/22 (2019.01) [G06F 16/2474 (2019.01)] 9 Claims
OG exemplary drawing
 
1. A method for storing time series data, comprising:
caching, by a processor, the time series data containing at least one record from a network to a memory in a row-based storage manner;
determining, by the processor, whether the time series data cached in the memory needs to be written to the disk, and when the time series data cached in the memory needs to be written to a disk, determining a sum of number of records according to number of records of to-be-written-to-disk time series data and number of records of the time series data in a LAST file of the disk, wherein the determining whether the time series data cached in the memory needs to be written to the disk comprises: checking the memory and an offset list of the time series data in the memory to determine if the memory is insufficient or the offset list of the time series data in the memory is full; and
in response to the determining that the time series data cached in the memory needs to be written to the disk:
when the sum of number of the records is less than a pre-set number N, writing, by the processor, the to-be-written-to-disk time series data to the LAST file of the disk, wherein the pre-set number N is a minimum number of records; and
when the sum of number of the records is greater than or equal to the pre-set number N, merging, by the processor, the to-be-written-to-disk time series data and the time series data in the LAST file of the disk to obtain a merged time series data, and writing the merged time series data to a new or existing DATA file for permanently saving data of the disk in a column-based storage manner.