US 12,450,028 B1
File existence checks using list API
Nemanja Matkovic, Seattle, WA (US); Polita Paulus, Kirkland, WA (US); Gaurav Saxena, Bellevue, WA (US); and Kedar Nitin Shah, Sammamish, WA (US)
Assigned to Snowflake Inc., Bozeman, MT (US)
Filed by Snowflake Inc., Bozeman, MT (US)
Filed on Aug. 15, 2024, as Appl. No. 18/806,187.
Int. Cl. G06F 7/08 (2006.01); G06F 16/174 (2019.01)
CPC G06F 7/08 (2013.01) [G06F 16/1748 (2019.01)] 27 Claims
OG exemplary drawing
 
1. A machine-implemented method comprising:
creating a bounded page in a memory of a machine; and
performing operations comprising:
selecting, from a set of metadata files, a set of selected metadata files, each selected metadata file including a set of data file metadata files, each member of the set of data file metadata files including a file name of a respective data file;
storing, in a first sorted list in the bounded page, the set of data file metadata files of each selected metadata file;
retrieving, from a data storage system, a second sorted list of file names of a set of data files stored on the data storage system;
determining an existence of each respective data file of each member of the set of data file metadata files on the data storage system by comparing the first sorted list to the second sorted list;
creating a plurality of bounded pages; and
creating a plurality of first sorted lists, each first sorted list stored in a respective bounded page of the plurality of bounded pages, the determining an existence of each respective data file of each member of the set of data file metadata files on the data storage system further comprising comparing the plurality of first sorted lists to the second sorted list in parallel processes.