CPC G06F 16/24568 (2019.01) [G06F 12/10 (2013.01); G06F 16/2379 (2019.01); G06F 2212/657 (2013.01)] | 24 Claims |
1. A method comprising:
receiving, by a computer system, a first request to write a first set of one or more messages in a first message batch associated with a message stream;
identifying, by the computer system, based at least in part on the first request, a first logical partition associated with the first message batch, the first request including at least one message key that identifies the first logical partition;
identifying, by the computer system, a physical partition that is mapped to the first logical partition, the physical partition being associated with a physical node in a physical cluster of nodes in a distributed message streaming system;
identifying, by the computer system, a first partition chunk in the physical partition on which to write the first set of one or more messages in the first message batch, wherein the first partition chunk comprises a plurality of logical partitions that include the first logical partition; and
writing, by the computer system, the first set of one or more messages in the first message batch to the first partition chunk in the physical partition.
|