US 12,333,340 B1
Data processing pipeline horizontal scaling
Prakul Agarwal, San Francisco, CA (US); Khwaja Mustafa Sidiqi, San Diego, CA (US); Stefanie Diem Anh Tonnu, San Jose, CA (US); and Christian Yang, Sunnyvale, CA (US)
Assigned to Zoox, Inc., Foster City, CA (US)
Filed by Zoox, Inc., Foster City, CA (US)
Filed on Oct. 29, 2021, as Appl. No. 17/515,117.
Int. Cl. G06F 9/46 (2006.01); G06F 9/48 (2006.01); G06F 9/50 (2006.01)
CPC G06F 9/5027 (2013.01) [G06F 9/4887 (2013.01); G06F 9/5088 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
one or more processors; and
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform operations comprising:
receiving, at an execution queue, a processing job associated with an operation of an autonomous vehicle;
determining that a scheduling component associated with a first distributed processing environment is associated with an overload attribute;
determining, by a controller, an overload state associated with the overload attribute;
generating, based at least in part on the overload state, a second distributed processing environment;
allocating, by the controller, the processing job to the second distributed processing environment;
determining, by the controller, that an actual completion time for the processing job is longer than an estimated completion time for the processing job; and
generating, by the controller, a third distributed processing environment.