US 10,891,715 B2
Deep neural network for image enhancement
Dalong Li, Rochester Hills, MI (US)
Assigned to Continental Automotive Systems, Inc., Auburn Hills, MI (US)
Filed by Continental Automotive Systems, Inc., Auburn Hills, MI (US)
Filed on Sep. 21, 2018, as Appl. No. 16/138,496.
Claims priority of provisional application 62/562,004, filed on Sep. 22, 2017.
Prior Publication US 2019/0096032 A1, Mar. 28, 2019
Int. Cl. G06T 3/40 (2006.01); H04N 5/232 (2006.01); G06T 5/50 (2006.01); H04N 7/18 (2006.01)
CPC G06T 3/4007 (2013.01) [G06T 3/4046 (2013.01); G06T 3/4053 (2013.01); G06T 5/50 (2013.01); H04N 5/23232 (2013.01); H04N 7/18 (2013.01); G06T 2207/20084 (2013.01); H04N 7/181 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A method for generating a super-resolved high-resolution image based on a low-resolution image, the method comprising:
during a training phase:
receiving, at data processing hardware, one or more high-resolution test images;
downsizing, at the data processing hardware, the one or more high-resolution test images into a low-resolution test image having a low-resolution image size that is less than an image size of the one or more test high-resolution images;
interpolating, at the data processing hardware, the one or more low-resolution images into one or more interpolated images having an interpolated image size that is equal to the image size of the one or more high-resolution test images;
mapping, at the data processing hardware, an interpolated sub-image of the interpolated image having a number of pixels to a pixel of a test sub-image of the high-resolution test image;
generating, at the data processing hardware, a model data comprising mapped data of the interpolated sub-image to the pixel of the test sub-image; and
storing, at memory hardware in communication with the data processing hardware, the model data; and
during an execution phase:
receiving, at data processing hardware, a low-resolution image having a first image size from a camera in communication with the data processing hardware;
determining, at the data processing hardware, an interpolated image of the low-resolution image, the interpolated image having a second image size being greater than the first image size;
determining, at the data processing hardware, a high-resolution super-resolved image based on the interpolated image and the stored model data; and
displaying, on a user interface in communication with the data processing hardware, the high-resolution super-resolved image.