US 11,947,821 B2
Methods and systems for managing an accelerator's primary storage unit
Yongbin Gu, San Mateo, CA (US); Pengcheng Li, San Mateo, CA (US); Tao Zhang, San Mateo, CA (US); and Yuan Xie, San Mateo, CA (US)
Assigned to Alibaba Group Holding Limited, Grand Cayman (KY)
Filed by ALIBABA GROUP HOLDING LIMITED, Grand Cayman (KY)
Filed on Jun. 15, 2020, as Appl. No. 16/901,436.
Claims priority of provisional application 62/939,997, filed on Nov. 25, 2019.
Prior Publication US 2021/0157500 A1, May 27, 2021
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/0644 (2013.01) [G06F 3/0613 (2013.01); G06F 3/0673 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for managing a primary storage unit of an accelerator, the method comprising:
assessing activity of the accelerator;
assigning, based on the assessed activity of the accelerator, a lease having a predetermined span of time as a lease duration to a group of one or more pages of data on the primary storage unit, wherein the predetermined span of time is determined, before assigning the lease, based on assessment of activity of the accelerator including usage of primary storage unit and of kernels being executed by the accelerator; and
marking, in response to expiration of the lease duration indicated by the lease, the group of one or more pages of data as an eviction candidate.