US 11,748,852 B2
Pixel interpolation device and pixel interpolation method, and image processing device, and program and recording medium
Toru Aoki, Tokyo (JP); Miki Sugano, Tokyo (JP); Masako Asamura, Tokyo (JP); Yoshitaka Toyoda, Tokyo (JP); Kohei Kurihara, Tokyo (JP); and Daisuke Suzuki, Tokyo (JP)
Assigned to MITSUBISHI ELECTRIC CORPORATION, Tokyo (JP)
Appl. No. 16/973,041
Filed by Mitsubishi Electric Corporation, Tokyo (JP)
PCT Filed Jun. 27, 2018, PCT No. PCT/JP2018/024444
§ 371(c)(1), (2) Date Dec. 8, 2020,
PCT Pub. No. WO2020/003422, PCT Pub. Date Jan. 2, 2020.
Prior Publication US 2021/0272241 A1, Sep. 2, 2021
Int. Cl. G06T 5/00 (2006.01); G06T 3/40 (2006.01); H04N 23/84 (2023.01)
CPC G06T 5/002 (2013.01) [G06T 3/4007 (2013.01); H04N 23/843 (2023.01); H04N 2209/046 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A pixel interpolation device comprising processing circuitry configured as:
a plurality of interpolation calculators each interpolating a pixel value of a missing pixel in an input image, based on pixel values of pixels constituting said input image;
a decider; and
an outputter, wherein
each of said plurality of interpolation calculators interpolates the pixel value of said missing pixel, and outputs the interpolated pixel value as an interpolation candidate value, treats a plurality of non-missing pixels in a vicinity of said missing pixel as test pixels, interpolates a pixel value of each of said test pixels, and outputs the interpolated pixel value as a test interpolated value of the test pixel,
the interpolation of said test pixels is performed in a same interpolation method as the interpolation of said missing pixel,
said plurality of interpolation calculators include a first group of interpolation calculators, and a second group of interpolation calculators,
said first group of interpolation calculators perform the interpolation by mean preserving interpolation calculation,
said first group of interpolation calculators differ from each other in a number of pixels referenced,
said second group of interpolation calculators perform the interpolation by interpolation calculation different from said mean preserving interpolation calculation,
said second group of interpolation calculators differ from each other in at least one of an interpolation calculation method and a number of pixels referenced,
said decider calculates error index values pertaining to respective interpolation calculators, based on absolute difference values between said test interpolated values pertaining to the respective test pixels in the vicinity of each missing pixel, and the pixel values of the test pixels, and selects one of the plurality of interpolation calculators based on the calculated error index values, and
said outputter selects, for each missing pixel, the interpolation candidate value outputted from the interpolation calculator selected by said decider, among the interpolation candidate values outputted from the plurality of interpolation calculators, and outputs the selected interpolation candidate value.