US 12,111,878 B2
Efficient processing of convolutional neural network layers using analog-memory-based hardware
Geoffrey Burr, Cupertino, CA (US); and Benjamin Killeen, St. Louis, MO (US)
Assigned to International Business Machines Corporation, Armonk, NY (US); and The University of Chicago, Chicago, IL (US)
Filed by INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US); and THE UNIVERSITY OF CHICAGO, Chicago, IL (US)
Filed on Mar. 25, 2019, as Appl. No. 16/363,463.
Claims priority of provisional application 62/745,132, filed on Oct. 12, 2018.
Prior Publication US 2020/0117986 A1, Apr. 16, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 17/16 (2006.01); G06F 7/544 (2006.01); G06F 17/15 (2006.01); G06G 7/16 (2006.01); G06N 3/065 (2023.01)
CPC G06F 17/16 (2013.01) [G06F 7/5443 (2013.01); G06F 17/15 (2013.01); G06G 7/16 (2013.01); G06N 3/065 (2023.01)] 19 Claims
OG exemplary drawing
 
1. A computer implemented method for implementing a convolutional neural network (CNN) using a crosspoint array, the method comprising:
configuring the crosspoint array, the crosspoint array corresponding to a convolution layer in the CNN, by storing one or more convolution kernels of the convolution layer in a plurality crosspoint devices of the crosspoint array; and
performing computations for the CNN via the crosspoint array by:
transmitting voltage pulses corresponding to a vector of input data of the convolution layer to the crosspoint array;
outputting an electric current representative of performing a multiplication operation at each crosspoint device in the crosspoint array, the electric current based on a weight value stored by each crosspoint device and the voltage pulses from the input data; and
passing the output electric current from crosspoint devices from at least three columns of the crosspoint array to corresponding integrators selected from a set of integrators where each integrator in the set of integrators corresponds to multiple columns of the at least three columns and is electrically switchable between the multiple columns of the at least three columns so as to aggregate current from one of the multiple columns of the at least three columns during a single time step, wherein the corresponding integrators are selected by an output controller that maps the output electric current from the at least three columns to selected integrators and that switches which column of the multiple columns of the at least three columns each integrator in the set of integrators is connected to between time steps, wherein the selected integrators are capacitors, and wherein the output electric current from crosspoint devices from each of the at least three columns of the crosspoint array is passed to the corresponding integrators within a common time step.