US 12,452,503 B2
Imaging device
Tetsu Ogawa, Tokyo (JP); Hiroshi Mori, Tokyo (JP); and Atsushi Ito, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 18/251,527
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Oct. 7, 2021, PCT No. PCT/JP2021/037145
§ 371(c)(1), (2) Date May 2, 2023,
PCT Pub. No. WO2022/102295, PCT Pub. Date May 19, 2022.
Claims priority of application No. 2020-187386 (JP), filed on Nov. 10, 2020.
Prior Publication US 2024/0015375 A1, Jan. 11, 2024
Int. Cl. H04N 23/12 (2023.01); G01N 21/25 (2006.01); G01N 21/84 (2006.01); G06T 7/00 (2017.01); G06T 7/80 (2017.01); H04N 23/11 (2023.01); H04N 23/71 (2023.01); B64U 101/30 (2023.01); B64U 101/40 (2023.01)
CPC H04N 23/12 (2023.01) [G01N 21/25 (2013.01); G01N 21/84 (2013.01); G06T 7/0012 (2013.01); G06T 7/80 (2017.01); H04N 23/11 (2023.01); H04N 23/71 (2023.01); B64U 2101/30 (2023.01); B64U 2101/40 (2023.01); G01N 2021/258 (2013.01); G01N 2021/8466 (2013.01); G06T 2207/10036 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30188 (2013.01)] 10 Claims
OG exemplary drawing
 
1. An imaging device, comprising:
a light source spectral sensor that includes a plurality of band-pass filters and a plurality of photodiodes, wherein
a photodiode of the plurality of photodiodes is on a corresponding band-pass filter of the plurality of band-pass filters, and
the light source spectral sensor is configured to obtain a wavelength spectrum, for light from a light source for illumination of a measurement target, to detect light for each wavelength;
a multispectral camera that includes a plurality of on-chip filters and a plurality of image sensors, wherein
an on-chip filter of the plurality of on-chip filters is in a corresponding image sensor of the plurality of image sensors,
the multispectral camera is configured to perform a wavelength spectral imaging operation of the measurement target, and
the wavelength spectrum has more wavelengths than a spectrum of the multispectral camera; and
a central processing unit (CPU) configured to:
calculate spectral reflectance of the measurement target, based on a spectrum detection result and a wavelength spectral image, wherein
the spectrum detection result is associated with the light source,
the light source spectral sensor is further configured to obtain the spectrum detection result, and
the multispectral camera is further configured to capture the wavelength spectral image;
identify an incidence angle, of the light from the light source for each of portions of the wavelength spectral image, based on information indicating a direction where the light source is located,
identify a reflection angle of each of the portions of the wavelength spectral image, based on the wavelength spectral image; and
correct the spectral reflectance, for each of the portions of the wavelength spectral image, based on
direction dependence reflection mode information associated with the measurement target,
the incidence angle identified for each of the portions of the wavelength spectral image, and
the reflection angle identified for each of the portions of the wavelength spectral image.