US 12,277,673 B2
Image processing system and related image processing method for image enhancement based on region control and multiple processing branch
Chon Hou Sio, HsinChu (TW); and Chia-Wei Yu, HsinChu (TW)
Assigned to Realtek Semiconductor Corp., HsinChu (TW)
Filed by Realtek Semiconductor Corp., HsinChu (TW)
Filed on Mar. 17, 2022, as Appl. No. 17/697,904.
Claims priority of application No. 110139501 (TW), filed on Oct. 25, 2021.
Prior Publication US 2023/0127608 A1, Apr. 27, 2023
Int. Cl. G06T 3/4046 (2024.01); G06T 5/20 (2006.01); G06T 5/73 (2024.01)
CPC G06T 3/4046 (2013.01) [G06T 5/20 (2013.01); G06T 5/73 (2024.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 12 Claims
OG exemplary drawing
 
1. An image processing system, comprising:
a first image processing device, having a first deep learning network, configured to perform a first image enhancement processing on a source image to generate a first enhanced image;
one or more second images processing devices, each of which having a second deep learning network, configured to perform a second image enhancement processing on a reduced size image that is generated based on the source image, and accordingly to output one or more second enhanced images whose size is identical to that of the source image; wherein a reduction ratio of the reduced size image relative to the source image is determined based on a type of the second image enhancement processing; and
an output controller, configured to analyze regional frequency characteristics of the source image to generate an analysis result, determine one or more region weights according to the analysis result, and synthesize the first enhanced image with the one or more second enhanced images according to the one or more region weights, thereby to generate an output image, wherein the one or more weights are determined based on the regional frequency characteristics of the source image and the type of the second image enhancement processing;
wherein the first image enhancement processing is different from the second image enhancement processing, and the first and second image enhancement processing respectively include at least one of super resolution, de-noise, de-blur and sharpening processing.