US 12,333,646 B2
Shadow-based estimation of 3D lighting parameters from reference object and reference virtual viewpoint
Philippe Robert, Rennes (FR); Anthony Laurent, Vignoc (FR); Pierrick Jouet, Rennes (FR); and Tao Luo, Cesson-Sevigne (FR)
Assigned to InterDigital CE Patent Holdings, SAS, Paris (FR)
Appl. No. 18/012,500
Filed by InterDigital CE Patent Holdings, SAS, Paris (FR)
PCT Filed Jun. 23, 2021, PCT No. PCT/EP2021/067137
§ 371(c)(1), (2) Date Dec. 22, 2022,
PCT Pub. No. WO2022/002716, PCT Pub. Date Jan. 6, 2022.
Claims priority of application No. 20305725 (EP), filed on Jun. 30, 2020.
Prior Publication US 2023/0260207 A1, Aug. 17, 2023
Int. Cl. G06T 15/60 (2006.01); G06T 15/50 (2011.01); G06V 10/25 (2022.01); G06V 20/20 (2022.01)
CPC G06T 15/60 (2013.01) [G06T 15/506 (2013.01); G06V 10/25 (2022.01); G06V 20/20 (2022.01); G06T 2215/16 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A method implemented by a device, the method comprising:
determining a real object in an augmented reality scene observed through the device, for which a set of candidate shadow maps and associated lighting models are stored in a memory associated with the device;
selecting, from the set of candidate shadow maps, a candidate shadow map that matches with a shadow map determined from a shadow mask of the real object in the augmented reality scene as observed through the device; and
adding virtual shadows to virtual objects in the augmented reality scene according to a lighting model associated with the selected candidate shadow map; and
wherein the shadow mask of the real object in the augmented reality scene is based on shadows cast by the real object on a non-planar surface on which the real object is placed, a geometry of the non-planar surface being included in a geometric model used to obtain the set of candidate shadow maps.