US 11,748,338 B1
Auto refresh of directory tables for stages
Polita Paulus, Kirkland, WA (US); Aravind Ramarathinam, Sammamish, WA (US); and Saurin Shah, Kirkland, WA (US)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on Aug. 25, 2022, as Appl. No. 17/822,381.
Claims priority of provisional application 63/366,192, filed on Jun. 10, 2022.
Int. Cl. G06F 16/23 (2019.01); G06F 16/22 (2019.01)
CPC G06F 16/2379 (2019.01) [G06F 16/2282 (2019.01); G06F 16/2358 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
storing unstructured data in an external stage of a database platform and in an internal stage of the database platform;
generating, at a database platform, a file stage of the internal stage in a user account on the database platform based on file stage properties attributes indicating an auto-refresh setting enabled, the user account being associated with a client device;
in response to the auto-refresh setting enabled in the file stage properties attributes, generating, at the database platform, a hidden stage directory table and a data pipeline for the file stage;
binding the data pipeline to the file stage of the internal stage;
receiving a notification of an event for the file stage of the internal stage;
identifying the data pipeline corresponding to the file stage of the internal stage; and
updating, without receiving an internal stage directory refresh command from a user account, the hidden stage directory table of the data pipeline with metadata extracted from files stored at an internal storage location that is internal to the database platform.