US 11,982,899 B2
Image processing device, imaging device, image processing method, and image processing program
Kazuyoshi Okada, Saitama (JP); Yasunobu Kishine, Saitama (JP); Atsushi Kawanago, Saitama (JP); and Yuya Hirakawa, Saitama (JP)
Assigned to FUJIFILM Corporation, Tokyo (JP)
Filed by FUJIFILM Corporation, Tokyo (JP)
Filed on Jul. 12, 2022, as Appl. No. 17/862,407.
Application 17/862,407 is a continuation of application No. PCT/JP2021/002355, filed on Jan. 25, 2021.
Claims priority of application No. 2020-015550 (JP), filed on Jan. 31, 2020.
Prior Publication US 2022/0365391 A1, Nov. 17, 2022
Int. Cl. G02F 1/1335 (2006.01); G02B 5/30 (2006.01); H04N 23/55 (2023.01)
CPC G02F 1/133538 (2021.01) [G02B 5/3025 (2013.01); H04N 23/55 (2023.01)] 12 Claims
OG exemplary drawing
 
1. An image processing device comprising:
a processor; and
a memory that stores a relationship between polarization directions,
wherein the processor performs image processing, and
performs
an acquisition process of acquiring first image data from an imaging element in which n first-polarizers having different polarization directions are regularly provided in a plurality of pixels consisting of photoelectric conversion elements arranged in a two-dimensional manner, assuming that n is an integer of 4 or more,
a first polarized image data generation process of performing a demosaicing process on the first image data to generate n pieces of first polarized image data according to the different polarization directions, and
a second polarized image data generation process of generating n or less pieces of second polarized image data by using the n pieces of first polarized image data and the relationship between the polarization directions stored in the memory,
wherein in a case where the n is 4,
assuming that four pieces of polarized image data separated from the first image data for each polarization direction are I1, I2, I3, and I4, respectively, the processor performs calculation of the following equation

OG Complex Work Unit Math
where a is a parameter,
to generate four pieces of first polarized image data subjected to the demosaicing process.