US 12,423,025 B1
Shuffle-based request buffer for managing large request volumes
Connor William McMonigle, Portland, OR (US); Stephen Abel, Portland, OR (US); Nandan Bharatkumar Badheka, Santa Barbara, CA (US); Adam Ross, Louisville, CO (US); Lucas Langdon Bengtson, Portland, OR (US); Jonathan Rand Hall, Portland, OR (US); Gary Hertel, Portland, OR (US); Jared James Stewart, Portland, OR (US); Jocelyn Danae Spayd, Vancouver, WA (US); Michael Kale, Portland, OR (US); Liyuan Liu, Seattle, WA (US); Marisol Curtis, Portland, OR (US); Alexander Scott Mastrangelo, Seattle, WA (US); Nicolas Weil, Portland, OR (US); Nina Jeong Lane, Portland, OR (US); Arden Rasmussen, Portland, OR (US); Ruochen Han, Chandler, AZ (US); Shruti Prakash Singh, Portland, OR (US); Kyle Sletmoe, Portland, OR (US); Saurav Sengupta, Beaverton, OR (US); Vinay Kumar Calastry Ramesh, Hillsboro, OR (US); and Yufei Gao, Portland, OR (US)
Assigned to Amazon Technologies, Inc., Reno, NV (US)
Filed by Amazon Technologies, Inc., Reno, NV (US)
Filed on May 24, 2024, as Appl. No. 18/674,735.
Int. Cl. G06F 3/06 (2006.01); G06F 7/58 (2006.01)
CPC G06F 3/0656 (2013.01) [G06F 3/0613 (2013.01); G06F 3/067 (2013.01); G06F 7/588 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
storing a plurality of video segments to a plurality of storage devices in a multi-tenant environment;
determining that a rate of requests being received with respect to the plurality of storage requests satisfies at least one buffering criterion;
receiving a request to perform an operation with respect to a specified segment stored to a respective device of the plurality of storage devices;
generating a random number within a range of a number of elements of a request queue;
causing, if it is determined that a previously-received request is stored to the element of the request queue corresponding to the random number, the previously-received request to be transmitted to a corresponding device of the plurality of storage devices storing a segment corresponding to the previously-received request; and
storing the received request to the element of the request queue corresponding to the random number.