a server comprising one or more processors; and

non-transitory memory comprising instructions that, when executed by the one or more processors of the server, cause the one or more processors to:

receive a query comprising key values to search on and one or both of: a filter selecting a subset of files to be searched and an aggregation of data from all of the files or from all of the files that are filtered, wherein the files are stored in a storage that exclusively receives the files during a predetermined window of time;

generate an index for a fixed window of time corresponding to a subset of the files;

dynamically generate a script based on contents of the query, optimizing the script from a template to include only features necessary to satisfy the query and to omit at least one feature unnecessary to satisfy the query; and

distribute the generated script and the index to at least one computing device that will execute the query by calling the generated script on each of the files to be searched; and

organize the subset of the files using the index.