US 12,487,933 B2
Cache grouping for increasing performance and fairness in shared caches
John Kelley, Fort Collins, CO (US)
Assigned to Advanced Micro Devices, Inc., Santa Clara, CA (US)
Filed by Advanced Micro Devices, Inc., Santa Clara, CA (US)
Filed on May 17, 2023, as Appl. No. 18/319,016.
Application 18/319,016 is a continuation of application No. 17/118,612, filed on Dec. 11, 2020, granted, now 11,693,778.
Prior Publication US 2023/0289290 A1, Sep. 14, 2023
Int. Cl. G06F 12/08 (2016.01); G06F 11/30 (2006.01); G06F 12/084 (2016.01); G06F 12/126 (2016.01); G06F 12/128 (2016.01)
CPC G06F 12/084 (2013.01) [G06F 11/3037 (2013.01); G06F 12/126 (2013.01); G06F 12/128 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
operating a cache according to a first policy for a first group of similar a cache users and according to a second policy for a second group of cache users, wherein the first group of the similar cache users are assigned to the first group based on a degree of similarity of performance metrics between the cache users;
for one or more cache users of the first group of the similar cache users, operating the cache according to a test policy for a subset of cache entries associated with the one or more cache users;
replacing the first policy with the test policy based on the test policy resulting in an improvement in the performance metrics for the first group of the similar cache users as compared to the first policy; and
after the replacing, operating the cache according to the test policy for the first group of the similar cache users.