US 11,836,971 B2
Method and device with convolution neural network processing
Mostafa Mahmoud, Toronto (CA); and Andreas Moshovos, Toronto (CA)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Aug. 23, 2019, as Appl. No. 16/549,002.
Claims priority of provisional application 62/721,918, filed on Aug. 23, 2018.
Claims priority of application No. 10-2018-0158379 (KR), filed on Dec. 10, 2018.
Prior Publication US 2020/0065646 A1, Feb. 27, 2020
Int. Cl. G06N 3/04 (2023.01); G06F 7/533 (2006.01); G06K 9/54 (2006.01); G06K 9/46 (2006.01); G06K 9/62 (2022.01); G06V 10/94 (2022.01); G06F 18/21 (2023.01); G06V 10/82 (2022.01); G06V 10/44 (2022.01)
CPC G06V 10/955 (2022.01) [G06F 7/533 (2013.01); G06F 18/2163 (2023.01); G06N 3/04 (2013.01); G06V 10/454 (2022.01); G06V 10/82 (2022.01)] 22 Claims
OG exemplary drawing
 
1. A processor-implemented method implementing a convolution neural network, the method comprising:
generating a plurality of differential groups by grouping a plurality of raw windows of an input feature map into the plurality of differential groups, the plurality of raw windows are sub-feature maps of the input feature map;
generating differential windows by performing, for each respective differential group of the differential groups, a differential operation between raw windows of the respective differential group, the differential operation being an element-wise differential operation between two raw windows of each respective differential group;
determining a reference element of an output feature map corresponding to a reference raw window among the raw windows by performing a convolution operation between a kernel and the reference raw window; and
determining remaining elements of the output feature map by performing a reference element summation operation based on the reference element and each of a plurality of convolution operation results determined by performing respective convolution operations between the kernel and each of the differential windows.