| CPC G06F 11/0757 (2013.01) | 20 Claims |

|
1. A system for data reconciliation in a streaming architecture, the system comprising:
a processing device;
a non-transitory storage device containing instructions when executed by the processing device, causes the processing device to:
access a data partition within a data table, wherein the data table is configured to consume data from a stream-processing log and store the consumed data for access by an application server;
read one or more input parameters from the stream-processing log;
determine a first transformation scheme based on the one or more input parameters;
read a message from the stream-processing log, wherein the message comprises a plurality of payloads;
identify, for each payload of the plurality of payloads, an offset number;
determine, based on the identified offset numbers, that the message is incomplete;
automatically initiate a request to read data from the stream-processing log, wherein the data comprises at least one missing payload;
verify that the message is complete;
apply the first transformation scheme to the complete message; and
store the transformed message in the data partition.
|