	US 12,229,880 B2
	Method for rendering relighted 3D portrait of person and computing device for the same
Artem Mikhailovich Sevastopolskiy, Moscow (RU); and Victor Sergeevich Lempitsky, Moscow (RU)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Nov. 20, 2023, as Appl. No. 18/513,716.
Application 18/513,716 is a continuation of application No. 17/457,078, filed on Dec. 1, 2021, granted, now 11,823,327.
Application 17/457,078 is a continuation of application No. PCT/KR2021/012284, filed on Sep. 9, 2021.
Claims priority of application No. 2020137990 (RU), filed on Nov. 19, 2020; and application No. 2021104328 (RU), filed on Feb. 19, 2021.
Prior Publication US 2024/0096011 A1, Mar. 21, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 15/60 (2006.01); G06F 18/214 (2023.01); G06N 3/084 (2023.01); G06T 7/194 (2017.01); G06T 15/04 (2011.01); G06T 15/10 (2011.01); G06T 17/20 (2006.01)

CPC G06T 15/60 (2013.01) [G06F 18/2148 (2023.01); G06N 3/084 (2013.01); G06T 7/194 (2017.01); G06T 15/04 (2013.01); G06T 15/10 (2013.01); G06T 17/20 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10152 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30244 (2013.01); G06T 2215/12 (2013.01)]

20 Claims

1. A method for rendering a relighted 3D portrait, the method comprising:

capturing a sequence of frames by a camera with a blinking flash while moving the camera around a person;

generating a 3D point cloud based on the sequence of frames;

receiving an input defining a camera viewpoint and lighting conditions;

obtaining feature information regarding the 3D point cloud for the camera viewpoint;

obtaining, via a neural network, at least one 2D image for the camera viewpoint based on the feature information; and

fusing the at least one 2D image into the relighted 3D portrait according to the lighting conditions.