US 12,254,405 B2
Processing data in pixel-to-pixel neural networks
David Hansen, Calgary (CA); Alireza Shoa Hassani Lashdan, Burlington (CA); Sivakumar Chidambaram, Markham (CA); Haoping Xu, North York (CA); Jeffrey Kar Fai Wong, Mississauga (CA); Stone Yun, Markham (CA); and Darren Gnanapragasam, Aurora (CA)
Assigned to QUALCOMM INCORPORATED, San Diego, CA (US)
Filed by QUALCOMM Incorporated, San Diego, CA (US)
Filed on Mar. 12, 2021, as Appl. No. 17/200,090.
Prior Publication US 2022/0292344 A1, Sep. 15, 2022
Int. Cl. G06N 3/08 (2023.01); G06F 18/21 (2023.01); G06V 10/82 (2022.01)
CPC G06N 3/08 (2013.01) [G06F 18/2163 (2023.01); G06V 10/82 (2022.01)] 30 Claims
OG exemplary drawing
 
1. An apparatus comprising:
memory; and
one or more processors coupled to the memory, the one or more processors being configured to:
obtain input data comprising stripes that logically segment the input data, each stripe of the input data including at least one row of data;
process, by each layer of a neural network, a row of data in a first stripe of the input data, wherein the row of data is processed sequentially in a horizontal direction and according to a layer-by-layer sequence where each preceding layer of the neural network processes a particular row of data before each subsequent layer of the neural network, wherein an input is generated for a particular layer of the neural network based on a combination of a stored output generated by a previous layer of the neural network for one or more blocks in the row of data in the first stripe and one or more stored lines of data from the one or more blocks in the row of data in the first stripe, and wherein an additional output is generated by the particular layer of the neural network based on the output generated by the previous layer for processing by a subsequent layer of the neural network;
after processing the row of data in the first stripe, process, by each layer of the neural network, subsequent rows of data in the first stripe on a row-by-row basis, wherein each subsequent row of data is processed sequentially in the horizontal direction and according to the layer-by-layer sequence;
generate, by the neural network, a first output stripe based on the processing of the row of data and the subsequent rows of data;
after processing the first stripe, process, by each layer of the neural network, rows of data in a second stripe of the input data on a row-by-row basis, wherein each row of data in the second stripe is processed in the horizontal direction and according to the layer-by-layer sequence; and
generate a second output stripe based on the processing of the second stripe.