CPC G06F 16/254 (2019.01) [G06F 21/6218 (2013.01)] | 20 Claims |
1. A system, comprising:
a plurality of computing devices, respectively comprising at least one processor and a memory, wherein the plurality of a computing devices implement a job execution service for an Extract Transform and Load (ETL) service offered by a provider network, wherein the job execution service comprises:
a request router;
a plurality of cells as part of a cell-based architecture for the job execution service to execute runs of ETL jobs at the job execution service, wherein the plurality of cells respectively comprise computing resources that implement independent replicas of the job execution service to perform tasks sent by the request router, wherein individual ones of the plurality of cells are isolated from communicating with other ones of the plurality of cells;
wherein the request router is configured to:
receive a request to perform a child task of an ETL job, wherein the ETL job comprises a parent task and one or more child tasks to complete a run of the ETL job;
parse the request to extract a cell identifier for the run of the ETL job included in the request, wherein the cell identifier was previously provided as part performing of the parent task by a cell of the plurality of cells of the job execution service assigned the run of the computational job;
perform a lookup in mapping information between the individual ones of the plurality of cells are to different cell identifiers to identify the cell of the plurality of cells according to the extracted cell identifier; and
send the request to the identified cell to perform the child task of the run of the ETL job.
|