Identifying buckets for query execution using a catalog of buckets
Alexandros Batsakis, San Francisco, CA (US); Ashish Mathew, San Mateo, CA (US); Christopher Madden Pride, Oakland, CA (US); Bharath Kishore Reddy Aleti, San Ramon, CA (US); Sourav Pal, Foster City, CA (US); Arindam Bhattacharjee, Fremont, CA (US); and James Monschke, San Francisco, CA (US)
Assigned to Splunk Inc., San Francisco, CA (US)
Filed by Splunk Inc., San Francisco, CA (US)
Filed on Apr. 16, 2021, as Appl. No. 17/233,193.
Application 17/233,193 is a continuation of application No. 15/967,590, filed on Apr. 30, 2018, granted, now 11,003,714.
Application 15/967,590 is a continuation in part of application No. 15/665,159, filed on Jul. 31, 2017, granted, now 11,281,706.
Application 15/665,159 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,148, filed on Jul. 31, 2017, granted, now 10,726,009, issued on Jul. 28, 2020.
Application 15/665,148 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,187, filed on Jul. 31, 2017, granted, now 11,232,100.
Application 15/665,187 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/976,590 is a continuation in part of application No. 15/665,248, filed on Jul. 31, 2017, granted, now 1,163,758.
Application 15/665,248 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,197, filed on Jul. 31, 2017, granted, now 11,461,334.
Application 15/665,197 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,279, filed on Jul. 31, 2017, granted, now 11,416,528.
Application 15/665,279 is a continuation in part of application No. 15/267,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,302, filed on Jul. 31, 2017, granted, now 10,795,884, issued on Oct. 6, 2020.
Application 15/665,302 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
Application 15/967,590 is a continuation in part of application No. 15/665,339, filed on Jul. 31, 2017.
Application 15/665,339 is a continuation in part of application No. 15/276,717, filed on Sep. 26, 2016, granted, now 10,353,965, issued on Jul. 16, 2019.
receiving, by a data intake and query system that includes one or more processors, a query, wherein the query identifies a set of data to be processed for the query and a manner of processing the set of data identified by the query;
based at least in part on the query, identifying, by the one or more processors, a set of bucket identifiers stored in a bucket data catalog, wherein the bucket data catalog indicates the set of data identified by the query is stored by a set of buckets of a plurality of buckets stored in a remote shared storage system, wherein the set of bucket identifiers correspond to the set of buckets;
based at least in part on identifying the set of bucket identifiers, generating, by the one or more processors, a bucket-search assignment for a worker node, wherein generating the bucket-search assignment comprises assigning a subset of the set of bucket identifiers to a worker node identifier corresponding to the worker node; and
instructing, based on the bucket-search assignment, by the one or more processors, the worker node to search a subset of the set of buckets corresponding to the subset of the set of bucket identifiers.
