US 12,235,875 B2
Low latency ingestion into a data system
Dhiraj Gupta, San Mateo, CA (US); and Subramanian Muralidhar, Mercer Island, WA (US)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on Aug. 28, 2023, as Appl. No. 18/456,675.
Application 18/456,675 is a continuation of application No. 17/809,931, filed on Jun. 30, 2022, granted, now 11,775,563.
Application 17/809,931 is a continuation of application No. 17/648,228, filed on Jan. 18, 2022, granted, now 11,487,788.
Prior Publication US 2023/0401235 A1, Dec. 14, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/00 (2019.01); G06F 16/18 (2019.01); G06F 16/2453 (2019.01); G06F 16/25 (2019.01); G06F 16/27 (2019.01)
CPC G06F 16/278 (2019.01) [G06F 16/1815 (2019.01); G06F 16/24532 (2019.01); G06F 16/258 (2019.01)] 27 Claims
OG exemplary drawing
 
1. A method comprising:
receiving data into a metadata database;
generating a version stamp for the received data;
generating a partition identifier for the received data, the partition identifier being based on one or more attribute values of the received data;
writing, by one or more writer computing resources, the received data into the metadata database with the version stamp and partition identifier;
scanning, by a plurality of reader computing resources, the metadata database;
exporting the received data to a storage location based on the version stamp and partition identifier, the plurality of readers being assigned based on partition identifiers;
ingesting the exported data into a journal table in the database; and
providing the exported data in the journal table accessible for query processing before the exported data is merged with a snapshot table.