US 11,886,451 B2
Quantization of data streams of instrumented software and handling of delayed data by adjustment of a maximum delay
Sunil Kittinakere Nagesh Koundinya, Newark, CA (US); Ramakrishnan Hariharan Chandrasekharapuram, San Jose, CA (US); Paul Ingram, Menlo Park, CA (US); and Joseph Ari Ross, Redwood City, CA (US)
Assigned to SPLUNK Inc., San Francisco, CA (US)
Filed by SPLUNK Inc., San Francisco, CA (US)
Filed on Oct. 29, 2021, as Appl. No. 17/515,140.
Prior Publication US 2023/0136216 A1, May 4, 2023
Int. Cl. G06F 16/2458 (2019.01)
CPC G06F 16/2462 (2019.01) [G06F 16/2474 (2019.01); G06F 16/2477 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method performed by a data quantizer system for dynamically adjusting a maximum delay in publishing data points of a time series of data points, the method comprising:
receiving a first data point of a time series of data points, the first data point comprising a first data point raw time indicating a time of creation of the first data point and a first receipt time indicating a time for which the first data point is obtained at the data quantizer system;
deriving a first receipt delay time for the first data point, the first receipt delay time comprising a delay between the first receipt time and a first time associated with a first applicable window;
responsive to determining that the first receipt delay time is greater than any of a set of maximum delay values for the time series of data points:
deriving a first time to live value specifying a time for the first receipt delay time to be included in the set of maximum delay values, where a greater deviance between the first receipt delay time and a weighted moving average delay for the time series of data points reduces the first time to live value; and
updating the set of maximum delay values to include the first receipt delay time and the first time to live value;
publishing, at a time after an end of the first applicable window, the first data point to a streaming analytics engine;
receiving a second data point, the second data point comprising a second data point raw time indicating a time of creation of the second data point and a second receipt time indicating a time for which the second data point is obtained at the data quantizer system;
deriving a second receipt delay time for the second data point, the second receipt delay time comprising a delay between the second receipt time and a second time associated with a second applicable window;
responsive to determining that the first time to live value associated with the first receipt delay time has expired:
deriving a second time to live value based on the second receipt delay time; and
updating the set of maximum delay values to add the second receipt delay time and the second time to live value to the set of maximum delay values and remove the first receipt delay time included in the set of maximum delay values; and
publishing, at a time after an end of the second applicable window, the second data point to the streaming analytics engine.