CPC G06F 16/278 (2019.01) [G06F 16/22 (2019.01); G06F 16/2386 (2019.01)] | 17 Claims |
1. A non-transitory computer readable medium comprising instructions which, when executed by one or more hardware processors, causes performance of operations comprising:
receiving data over a period of time;
subsequent to receiving a first subset of the data during the period of time:
determining that the first subset of the data is to be transmitted to or stored at a first system component,
determining that a first stream partition is mapped to the first system component, and
assigning the first subset of the data to the first stream partition;
subsequent to assignment of the first subset of the data to the first stream partition: delaying transmission of the first stream partition until occurrence of: (a) an expiration of a maximum delay, or (b) an amount of data assigned for transmission in the first stream partition exceeds a transmission threshold;
subsequent to receiving a second subset of the data during the period of time:
determining that the second subset of the data is to be transmitted to or stored at a second system component,
determining that a second stream partition is mapped to the second system component, and
assigning the second subset of the data to the second stream partition;
subsequent to receiving a third subset of the data during the period of time:
determining that the third subset of the data is to be transmitted to or stored at the first system component, and
assigning the third subset of the data to the first stream partition; and
transmitting a stream comprising the first stream partition and the second stream partition,
wherein the first and third subsets of the data are transmitted in the first stream partition,
and wherein the second subset of the data is transmitted in the second stream partition.
|