US 12,216,654 B2
Materialized table refresh using multiple processing pipelines
Tyler Arthur Akidau, Seattle, WA (US); Fabian Hueske, Berlin (DE); Tyler Jones, Redwood City, CA (US); Daniel Mills, Seattle, WA (US); Leon Papke, Berlin (DE); Prasanna Rajaperumal, Bangalore (IN); and Daniel E. Sotolongo, Seattle, WA (US)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on Jul. 31, 2023, as Appl. No. 18/362,898.
Application 18/362,898 is a continuation of application No. 17/931,590, filed on Sep. 13, 2022, granted, now 11,762,855.
Claims priority of provisional application 63/366,197, filed on Jun. 10, 2022.
Prior Publication US 2023/0409574 A1, Dec. 21, 2023
Int. Cl. G06F 16/2453 (2019.01); G06F 7/14 (2006.01)
CPC G06F 16/24539 (2019.01) [G06F 7/14 (2013.01); G06F 16/24542 (2019.01)] 30 Claims
OG exemplary drawing
 
1. A system comprising:
at least one hardware processor; and
at least one memory storing instructions that cause the at least one hardware processor to perform operations comprising:
determining dependencies among a plurality of intermediate materialized tables (MTs) generated from a source materialized table (MT), the source MT using a table definition with a query on one or more base tables and a lag duration value;
generating a graph snapshot of dependencies among the plurality of intermediate MTs based on an application of a graph rendering process to a log of the dependencies;
configuring processing pipelines, each processing pipeline of the processing pipelines corresponding to a subset of the plurality of intermediate MTs indicated by the graph snapshot; and
responsive to detecting an instruction for a refresh operation on the source MT, performing refreshes on corresponding intermediate MTs of the plurality of intermediate MTs in each processing pipeline of the processing pipelines to complete the refresh operation on the source MT.