US 11,915,513 B2
Apparatus for leveling person image and operating method thereof
Seoungyoon Kang, Incheon (KR); Min Jae Kim, Seongnam-si (KR); Moo Kyung Song, Seongnam-si (KR); Hyunjung Shim, Incheon (KR); and Gun Hee Lee, Seongnam-si (KR)
Assigned to NCSOFT CORPORATION, Seongnam-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed by NCSOFT CORPORATION, Seongnam-si (KR); and INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, Seoul (KR)
Filed on Apr. 22, 2022, as Appl. No. 17/726,780.
Claims priority of application No. 10-2021-0052661 (KR), filed on Apr. 22, 2021.
Prior Publication US 2022/0375254 A1, Nov. 24, 2022
Int. Cl. G06K 9/00 (2022.01); G06V 40/16 (2022.01); G06T 11/60 (2006.01)
CPC G06V 40/161 (2022.01) [G06T 11/60 (2013.01); G06T 2207/30201 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method of performing leveling of a person image, the method comprising:
receiving an original person image;
selecting an arbitrary latent vector in a latent space;
generating a virtual person image based on the latent vector;
activating an original person region and deactivating an original background region from among the original person region and the original background region included in the original person image;
activating a virtual person region and deactivating a virtual background region from among the virtual person region and the virtual background region included in the virtual person image;
optimizing the latent vector such that identity similarity between an image of the original person region and an image of the virtual person region increases;
manipulating the optimized latent vector; and
generating a levelled person image, in which a person stares forward and shows a neutral emotion, and in which an illumination is illuminating a front of the person's face, corresponding to the original person image, by using the manipulated latent vector.