US 12,361,639 B2
Electronic device and control method thereof
Min Hyuk Kim, Daejeon (KR); Joo Ho Lee, Daejeon (KR); Hyun Jin Ku, Daejeon (KR); Dahyun Kang, Daejeon (KR); and Hyunho Ha, Daejeon (KR)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR); and KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, Daejeon (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR); and KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY, Daejeon (KR)
Filed on Feb. 22, 2023, as Appl. No. 18/172,716.
Application 18/172,716 is a continuation of application No. PCT/KR2021/012283, filed on Sep. 9, 2021.
Claims priority of application No. 10-2020-0130867 (KR), filed on Oct. 12, 2020.
Prior Publication US 2023/0206551 A1, Jun. 29, 2023
Int. Cl. G06T 17/00 (2006.01); G06T 3/40 (2024.01); G06T 7/00 (2017.01); G06T 7/586 (2017.01); G06T 15/50 (2011.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 10/74 (2022.01); G06V 10/762 (2022.01); H04N 13/271 (2018.01); H04N 23/56 (2023.01)
CPC G06T 17/00 (2013.01) [G06T 3/40 (2013.01); G06T 7/586 (2017.01); G06T 7/97 (2017.01); G06T 15/50 (2013.01); G06V 10/141 (2022.01); G06V 10/60 (2022.01); G06V 10/761 (2022.01); G06V 10/762 (2022.01); H04N 13/271 (2018.05); H04N 23/56 (2023.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/10152 (2013.01); G06T 2207/20016 (2013.01)] 15 Claims
OG exemplary drawing
 
1. An electronic device comprising:
a camera;
a camera flash; and
at least one processor configured to:
control the camera to capture a natural light image and a depth image of an object,
control the camera and the camera flash to capture an artificial light image of the object comprising an artificial lighting,
obtain distance information from the depth image and generate a depth mask image,
generate a cluster mask image from the natural light image,
obtain a flash image in which illuminance of the natural light image has been removed from the illuminance of the artificial light image,
obtain an optimization parameter based on the distance information, the depth mask image, the cluster mask image, and the flash image, and
obtain three-dimensional (3D) geometry and surface reflection information about the object based on the obtained optimization parameter.