US 11,989,125 B2
Storage device and operating method of memory controller
Sungmin Jang, Hwaseong-si (KR); and Kibeen Jung, Incheon (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Oct. 1, 2020, as Appl. No. 17/060,737.
Claims priority of application No. 10-2020-0016633 (KR), filed on Feb. 11, 2020.
Prior Publication US 2021/0248069 A1, Aug. 12, 2021
Int. Cl. G06F 12/02 (2006.01); G06F 3/06 (2006.01); G06N 20/00 (2019.01)
CPC G06F 12/0253 (2013.01) [G06F 3/0604 (2013.01); G06F 3/064 (2013.01); G06F 3/0655 (2013.01); G06N 20/00 (2019.01); G06F 2212/7205 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A storage device comprising:
a memory device comprising a plurality of memory blocks; and
a memory controller configured to
control a garbage collection operation of the memory device,
select a victim block and a target block for performing the garbage collection operation among the plurality of memory blocks, according to state information of each of the plurality of memory blocks and feature information of data written in each of the plurality of memory blocks, by using a reinforcement learning model that includes selecting one action that maximizes a reward based on a write amplification factor (WAF), wherein the WAF is calculated based on a ratio of data requested by a host to data written to the memory device, and
provide an address, a command, and a control signal to the memory device based on the selected victim block and the selected target block,
wherein data stored in the plurality of memory blocks are rearranged based on the provided address, the command, and the control signal, and
wherein the memory controller includes
a garbage collection (GC) manager configured to determine whether to perform the garbage collection operation, and
a GC policy generator that selects the victim block and the target block by using the reinforcement learning model and outputs the control signal to the selected victim block and the selected target block to the GC manager.