US 12,348,593 B2
Data streaming service with virtualized broker clusters
Sayantan Chakravorty, Sammamish, WA (US); Nagarjuna Koduru, Snohomish, WA (US); Nabanita Maji, Kenmore, WA (US); Vijaya Rama Reddy Kistampalli, Bothell, WA (US); Sankalp Bhatia, Santa Clara, CA (US); and Sahil Dorwat, Mountain View, CA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Mar. 19, 2024, as Appl. No. 18/609,987.
Application 18/609,987 is a continuation of application No. 17/810,299, filed on Jun. 30, 2022, granted, now 11,968,279.
Prior Publication US 2024/0223674 A1, Jul. 4, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04L 67/562 (2022.01); H04L 9/40 (2022.01); H04L 41/50 (2022.01); H04L 65/60 (2022.01)
CPC H04L 67/562 (2022.05) [H04L 41/509 (2013.01); H04L 63/08 (2013.01); H04L 65/60 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving a request to create a broker cluster in a distributed message service;
deploying a broker instance to the distributed message service, wherein the broker instance corresponds to the broker cluster comprising a plurality of broker nodes of the distributed message service;
assigning a client facing broker instance ID to the broker instance, wherein the client facing broker instance ID is provided to one or more message producing clients and/or one or more message consuming clients;
determining, using a cluster manager of the distributed message service, respective message traffic status for topic partitions assigned to respective broker nodes of the broker cluster corresponding to the broker instance; and
rebalancing, by the cluster manager, the topic partitions assigned to the respective broker nodes based on the determined message traffic status for the topic partitions.