	US 12,105,717 B2
	Method and device for processing information by batch-stream fusion, and storage medium
Lu Cao, Shanghai (CN); Hongbin Ma, Shanghai (CN); Yifan Zhang, Shanghai (CN); Zhixiong Chen, Shanghai (CN); Yang Li, Shanghai (CN); and Qing Han, Shanghai (CN)
Assigned to SHANGHAI KYLIGENCE INFORMATION TECHNOLOGY CO., LTD., Shanghai (CN)
Filed by SHANGHAI KYLIGENCE INFORMATION TECHNOLOGY CO., LTD., Shanghai (CN)
Filed on Jan. 1, 2023, as Appl. No. 18/092,326.
Application 18/092,326 is a continuation of application No. PCT/CN2021/123288, filed on Oct. 12, 2021.
Claims priority of application No. 202111049808.5 (CN), filed on Sep. 8, 2021.
Prior Publication US 2023/0153308 A1, May 18, 2023
Int. Cl. G06F 16/00 (2019.01); G06F 16/22 (2019.01); G06F 16/23 (2019.01); G06F 16/2455 (2019.01)

CPC G06F 16/24568 (2019.01) [G06F 16/22 (2019.01); G06F 16/2386 (2019.01); G06F 16/2456 (2019.01)]

7 Claims

1. A method for processing information by batch-stream fusion, comprising:

obtaining an index based on an input query statement by a client;

extracting a pre-computed index data segment based on the index as a query result by a query engine; and

extracting a re-computed index data segment to update the query result by an updating device, wherein the step of extracting the pre-computed index data segment based on the index as the query result specifically includes:

acquiring statistical information of the index by the query engine;

retrieving a pre-created index with the statistical information in an internal memory by the query engine;

positioning the pre-computed index data segment in a storage medium based on the pre-created index by the query engine;

taking the positioned pre-computed index data segment as the query result by the query engine, wherein the step of extracting the pre-computed index data segment specifically includes:

defining a pre-created index based on a predefined unified model by a pre-created index definition device;

performing pre-computation based on the pre-created index to obtain the index data segment by a pre-computation device; and

storing the statistical information of the pre-created index in an internal memory, and storing the pre-computed index data segment in the storage medium by an information storage device, wherein the step of extracting the re-computed index data segment to update the query result specifically includes:

performing re-computation in a data source based on the index, the index being divided into a batch index, a stream index and a fusion index, and the data source including a batch data source and a stream data source by the updating device;

performing re-computation through the computation engine to obtain a re-computed index data segment, the computation engine comprising the batch processing computation engine and the stream processing computation engine, and the re-computed index data segment being divided into a batch index data segment and a stream index data segment by the updating device;

storing the re-computed index data segment in the storage medium by the updating device; and extracting the re-computed index data segment in the storage medium to update the query result by the updating device.