US 12,079,167 B1
Scaling delta table optimize command
Rahul Shivu Mahadev, San Francisco, CA (US); Burak Yavuz, San Francisco, CA (US); and Tathagata Das, New Haven, CT (US)
Assigned to Databricks, Inc., San Francisco, CA (US)
Filed by Databricks, Inc., San Francisco, CA (US)
Filed on Jan. 6, 2023, as Appl. No. 18/093,916.
Application 18/093,916 is a continuation of application No. 17/384,486, filed on Jul. 23, 2021, granted, now 11,567,900.
Int. Cl. G06F 16/172 (2019.01); G06F 16/22 (2019.01)
CPC G06F 16/172 (2019.01) [G06F 16/2282 (2019.01)] 17 Claims
OG exemplary drawing
 
1. A system comprising:
one or more computer processors; and
one or more computer-readable mediums comprising stored instructions that when executed by the one or more computer processors cause the one or more processors to:
receive an indication to execute an optimize command;
receive a set of files; and
perform the optimize command by determining if addition of a file from the set of files to a current bin causes the current bin to exceed a bin threshold and further comprising instructions that when executed causes the one or more processors to:
add the file to a next bin,
add the current bin to a batch of bins for subsequent processing,
if all the files from the set of files have been assigned to bins, indicate that the current bin is closed, and
provide the batch of bins for processing.