US 11,748,327 B2
Streams using persistent tables
Tyler Arthur Akidau, Seattle, WA (US); Istvan Cseri, Seattle, WA (US); Tyler Jones, Redwood City, CA (US); and Daniel E. Sotolongo, Seattle, WA (US)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on Jan. 21, 2022, as Appl. No. 17/648,622.
Claims priority of provisional application 63/143,184, filed on Jan. 29, 2021.
Prior Publication US 2022/0245117 A1, Aug. 4, 2022
Int. Cl. G06F 16/22 (2019.01); G06F 16/23 (2019.01); G06F 16/2455 (2019.01)
CPC G06F 16/2282 (2019.01) [G06F 16/2358 (2019.01); G06F 16/24568 (2019.01)] 12 Claims
OG exemplary drawing
 
1. A method comprising:
providing a primary table storing a set of data in a plurality of partitions;
executing modifications to the primary table to delete a first partition of the plurality of partitions and to add a new partition representing a change to the first partition based on the modifications;
generating a system table storing delta information related to the modifications to the primary table in a different format than the primary table;
defining a retention boundary for the set of data stored in the primary table;
deleting data past the retention boundary in the primary table;
storing, in the system table, delta information related to modifications executed past the retention boundary; and
generating change data capture information including a virtual table with one or more pointers to the system table for delta information related to modifications past the retention boundary and one or more pointers to the primary table for data before the retention boundary.