US 12,260,517 B2
Optical system and optical image processing method using image restoration
Chen Han Huang, Taoyuan (TW); Chun San Tai, Taoyuan (TW); and Ting Yi Lin, Taoyuan (TW)
Assigned to NATIONAL CENTRAL UNIVERSITY, Taoyuan (TW)
Filed by NATIONAL CENTRAL UNIVERSITY, Taoyuan (TW)
Filed on Dec. 7, 2021, as Appl. No. 17/543,730.
Claims priority of provisional application 63/124,220, filed on Dec. 11, 2020.
Prior Publication US 2022/0188981 A1, Jun. 16, 2022
Int. Cl. G06T 5/00 (2024.01); G01R 33/56 (2006.01); G06T 3/40 (2024.01); G06T 5/50 (2006.01); G06V 10/40 (2022.01); G06V 10/80 (2022.01); G06V 10/82 (2022.01); G06V 20/69 (2022.01); G16H 10/40 (2018.01); G16H 30/40 (2018.01); H04N 23/56 (2023.01)
CPC G06T 5/00 (2013.01) [G01R 33/56 (2013.01); G06T 3/40 (2013.01); G06T 5/50 (2013.01); G06V 10/40 (2022.01); G06V 10/806 (2022.01); G06V 10/82 (2022.01); G06V 20/693 (2022.01); G06V 20/695 (2022.01); G16H 10/40 (2018.01); G16H 30/40 (2018.01); H04N 23/56 (2023.01); G06T 2207/10056 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30024 (2013.01); G06V 2201/03 (2022.01)] 7 Claims
OG exemplary drawing
 
1. An optical system using image restoration, comprising:
a light source;
a pinhole, disposed on a light transmission path of the light source;
a testing platform, disposed on the light transmission path of the light source, the pinhole being located between the light source and the testing platform, and the testing platform being used to place a testing sample;
an image sensor, disposed below the testing platform, and used to sense the testing sample so as to output an optical diffraction signal; and
an image processing device, electrically connected to the image sensor and used to perform signal processing and optical signal recognition on the optical diffraction signal of the testing sample so as to obtain a clear image of the testing sample;
wherein the light source is a point light source composed of light emitting diodes, and the pinhole is composed of micron-sized optical pinholes or optical fibers;
wherein the testing sample is a biopsy or a blood smear;
wherein the image processing device further comprises:
an image feature extraction module, used to extract a plurality of initial features of the optical diffraction signal of the testing sample, when an optical diffraction signal is input, a downsampling is first performed twice, and the initial features are extracted through three parallel operation sub-networks using a convolution operation of step 2 to replace a traditional pooling layer;
a residual network module, connected to the image feature extraction module and used to extract a plurality of image features of the optical diffraction signal of the testing sample according to the plurality of initial features, and a parallel feature extraction is performed using a residual network as a backbone, and a dimension reduction is applied to extract advantageous features at a plurality of different scales;
an image reconstruction module, connected to the residual network module, and used to perform upsampling according to an image feature of an image extracted by the residual network module so as to restore an original resolution of the optical diffraction signal of the testing sample, and a transposed convolution is used for upsampling to progressively restore the original resolution; and
a concatenation module, connected to the image reconstruction module, and used to fuse the plurality of image features of the testing sample and preserve more dimensional information for improved image clarity so as to obtain the clear image.