US 12,346,799 B2
Optical artificial neural network intelligent chip, preparation method thereof and intelligent processing apparatus
Kaiyu Cui, Beijing (CN); Jiawei Yang, Beijing (CN); Jian Xiong, Beijing (CN); Yidong Huang, Beijing (CN); Fang Liu, Beijing (CN); Xue Feng, Beijing (CN); and Wei Zhang, Beijing (CN)
Assigned to Tsinghua University, Beijing (CN)
Filed by Tsinghua University, Beijing (CN)
Filed on Jul. 15, 2021, as Appl. No. 17/377,217.
Claims priority of application No. 202110172841.0 (CN), filed on Feb. 8, 2021.
Prior Publication US 2022/0253686 A1, Aug. 11, 2022
Int. Cl. G06N 3/00 (2023.01); G06N 3/048 (2023.01); G06N 3/063 (2023.01); G06N 3/067 (2006.01); G06N 3/08 (2023.01)
CPC G06N 3/0675 (2013.01) [G06N 3/048 (2023.01); G06N 3/063 (2013.01); G06N 3/08 (2013.01)] 25 Claims
OG exemplary drawing
 
1. An optical artificial neural network intelligent chip, comprising:
an optical filter layer,
an image sensor, and
a processor;
wherein the optical filter layer corresponds to an input layer and a connection weight from the input layer to a linear layer of an artificial neural network; the image sensor corresponds to the linear layer of the artificial neural network; and the processor corresponds to a nonlinear layer and an output layer of the artificial neural network;
the optical filter layer is disposed on the surface of a photosensitive area of the image sensor, the optical filter layer comprises an optical modulation structure, and is configured to modulate, with different spectra, incident light which is incident to different location points of the optical modulation structure respectively by the optical modulation structure, to obtain information carried in the incident light corresponding to different location points on the surface of the photosensitive area; the information carried in the incident light comprises light intensity distribution information, spectral information, angle information of the incident light and phase information of the incident light;
the image sensor is configured to convert information carried in the incident light corresponding to different location points after being modulated by the optical filter layer into electric signals corresponding to the different location points, and send the electric signals corresponding to the different location points to the processor, wherein the electrical signals are image signals modulated by the optical filter layer; and
the processor is configured to perform fully connected processing and nonlinear activation processing on the electrical signals corresponding to the different location points to obtain output signals of the artificial neural network.