CPC G06F 16/2379 (2019.01) [G06F 16/2282 (2019.01); G06F 16/2358 (2019.01)] | 20 Claims |
1. A method comprising:
storing unstructured data in an external stage of a database platform and in an internal stage of the database platform;
generating, at a database platform, a file stage of the internal stage in a user account on the database platform based on file stage properties attributes indicating an auto-refresh setting enabled, the user account being associated with a client device;
in response to the auto-refresh setting enabled in the file stage properties attributes, generating, at the database platform, a hidden stage directory table and a data pipeline for the file stage;
binding the data pipeline to the file stage of the internal stage;
receiving a notification of an event for the file stage of the internal stage;
identifying the data pipeline corresponding to the file stage of the internal stage; and
updating, without receiving an internal stage directory refresh command from a user account, the hidden stage directory table of the data pipeline with metadata extracted from files stored at an internal storage location that is internal to the database platform.
|