US 12,277,440 B2
Scheduler, method of operating the same, and accelerator apparatus including the same
Seung Wook Lee, Suwon-si (KR); Jae Wook Lee, Seoul (KR); Young Hwan Oh, Seoul (KR); Seng Hak Kim, Seoul (KR); and Tae Jun Ham, Seoul (KR)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR); and Seoul National University R&DB Foundation, Seoul (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR); and Seoul National University R&DB Foundation, Seoul (KR)
Filed on Feb. 8, 2021, as Appl. No. 17/170,109.
Claims priority of application No. 10-2020-0065626 (KR), filed on Jun. 1, 2020.
Prior Publication US 2021/0373944 A1, Dec. 2, 2021
Int. Cl. G06F 9/46 (2006.01); G06F 9/48 (2006.01); G06F 9/50 (2006.01)
CPC G06F 9/4881 (2013.01) [G06F 9/5016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of scheduling an accelerator, the method comprising:
receiving at least one execution request for a first model and a second model that are executed independently from each other in the accelerator; and
performing layer-unit scheduling on the first model and the second model based on workload characteristics of the first model and the second model, such that layers of the first model and layers of the second model are alternately executed by the accelerator,
receiving at least one execution request for a first model and a second model that are executed independently from each other in the accelerator; and
determining an optimal scheduling result to find a path indicating an execution order from an input layer included in each of the first model and the second model to an output layer included in each of the first model and the second model, the determining being based on. for a current step. employing a current simulation of adding a layer of the input layer in a direction from a previous simulation from a previous step to the current step.