US 12,124,874 B2
Pipeline task verification for a data processing platform
Kaan Tekelioglu, London (GB)
Assigned to Palantir Technologies Inc., Denver, CO (US)
Filed by Palantir Technologies Inc., Denver, CO (US)
Filed on Nov. 9, 2023, as Appl. No. 18/505,626.
Application 18/505,626 is a continuation of application No. 17/937,097, filed on Sep. 30, 2022, granted, now 11,853,794.
Application 17/937,097 is a continuation of application No. 17/106,748, filed on Nov. 30, 2020, granted, now 11,467,871, issued on Oct. 11, 2022.
Application 17/106,748 is a continuation of application No. 16/218,872, filed on Dec. 13, 2018, granted, now 10,884,798, issued on Jan. 5, 2021.
Claims priority of application No. 1720823 (GB), filed on Dec. 14, 2017.
Prior Publication US 2024/0069967 A1, Feb. 29, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 9/46 (2006.01); G05B 15/02 (2006.01); G06F 8/41 (2018.01); G06F 9/38 (2018.01); G06F 9/448 (2018.01); G06F 9/451 (2018.01); G06F 9/48 (2006.01); G06F 9/50 (2006.01)
CPC G06F 9/4881 (2013.01) [G05B 15/02 (2013.01); G06F 8/433 (2013.01); G06F 9/3838 (2013.01); G06F 9/4494 (2018.02); G06F 9/451 (2018.02); G06F 9/5072 (2013.01); G06F 2209/486 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:
accessing a data processing pipeline specification, wherein the data processing pipeline specification defines a plurality of data elements of a data processing pipeline;
identifying from the data processing pipeline specification a task indicating a defined relationship between a first data element and a second data element, wherein the task is associated with metadata indicating an expected language or transformation, an expected dependency, or an expected row and/or column name;
determining, for the task, one or more data processing elements intended to receive the first data element and to produce the second data element; and
verifying that the one or more data processing elements receive the first data element and produce the second data element according to the defined relationship.