US 11,741,570 B2
Image processing device and image processing method of same
Hyungjun Lim, Suwon-si (KR); Suk Ju Kang, Seoul (KR); Sung In Cho, Gyeongsan-si (KR); Youngsu Moon, Suwon-si (KR); Seung Joon Lee, Seoul (KR); and Siyeong Lee, Seoul (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and SOGANG UNIVERSITY RESEARCH & BUSINESS DEVELOPMENT FOUNDATION, Seoul (KR)
Appl. No. 17/279,182
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR); and SOGANG UNIVERSITY RESEARCH & BUSINESS DEVELOPMENT FOUNDATION, Seoul (KR)
PCT Filed Feb. 14, 2019, PCT No. PCT/KR2019/001798
§ 371(c)(1), (2) Date Mar. 24, 2021,
PCT Pub. No. WO2020/111387, PCT Pub. Date Jun. 4, 2020.
Claims priority of application No. 10-2018-0151429 (KR), filed on Nov. 29, 2018.
Prior Publication US 2022/0005153 A1, Jan. 6, 2022
Int. Cl. G06T 3/40 (2006.01); H04N 19/176 (2014.01); H04N 19/59 (2014.01)
CPC G06T 3/40 (2013.01) [H04N 19/176 (2014.11); H04N 19/59 (2014.11)] 15 Claims
OG exemplary drawing
 
8. An image processing method of retargeting an input image frame to acquire an output image frame, the method comprising:
identifying an area, in which pixel values are to be padded, based on the input image frame and information on the output image frame, identify a first pixel block based on a target pixel area included in the identified area;
identifying a second pixel block based on pixel values included in the first pixel block; and
acquiring the output image frame by padding the target pixel area based on pixel values included in the second pixel block,
wherein the identifying the second pixel comprises:
identifying the second pixel block by searching pixel values included in the first pixel block and a pixel block having similarity greater than or equal to a threshold value, and
identifying a foreground area in the input image frame, and perform re-research based on the second pixel block being searched in at least one of the foreground area or an adjacent area, and
wherein the acquiring the output image comprises:
summing pixel values of some pixels among pixels included in the first pixel block and pixel values of corresponding pixel among the second pixel block and dividing a value of the sum by a number of sums to obtain a calculated pixel value, and
replacing the some pixels with the calculated pixel value.