US 12,353,378 B2
Serverless data ingestion for transforming and delivering data in system endpoints
Joshua Liburdi, Santa Rosa, CA (US)
Assigned to Brex Inc., Draper, UT (US)
Filed by Brex Inc., Draper, UT (US)
Filed on Apr. 18, 2023, as Appl. No. 18/302,239.
Prior Publication US 2024/0354293 A1, Oct. 24, 2024
Int. Cl. G06F 16/21 (2019.01); G06F 18/10 (2023.01)
CPC G06F 16/217 (2019.01) [G06F 18/10 (2023.01)] 22 Claims
OG exemplary drawing
 
1. A system comprising:
a non-transitory memory; and
one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause the system to perform operations comprising:
upon startup of an application executing in a serverless computing environment, loading data processing configurations for a data processing pipeline via which data is processed and delivered to system endpoints of the system;
creating a plurality of processing threads for the application, wherein the plurality of processing threads includes:
(i) at least one data ingestion thread for performing an ingestion operation,
(ii) at least one data transformation thread for performing a transformation operation, and
(iii) at least one data loading thread for performing a loading operation,
wherein the plurality of processing threads are created in reverse order such that (a) the at least one data loading thread is created before the at least one data transformation thread and (b) the at least one data transformation thread is created before the at least one data ingestion thread;
ingesting data received from a first one of the system endpoints using the at least one data ingestion thread of the plurality of processing threads;
transforming the data ingested by the at least one data ingestion thread using the at least one data transformation thread of the plurality of processing threads,
wherein the at least one data transformation thread transforms the data into a data format utilized by a second one of the system endpoints designated to receive the data; and
loading the transformed data from the at least one data transformation thread to the second one of the system endpoints using the at least one data loading thread of the plurality of processing threads.