US 12,243,152 B2
Hybrid differentiable rendering for light transport simulation systems and applications
Wenzheng Chen, Toronto (CA); Joey Litalien, Montreal (CA); Jun Gao, North York (CA); Zian Wang, Toronto (CA); Clement Tse Tsian Christophe Louis Fuji Tsang, Toronto (CA); Sameh Khamis, Oakland, CA (US); Or Litany, Sunnyvale, CA (US); and Sanja Fidler, Toronto (CA)
Assigned to NVIDIA Corporation, Santa Clara, CA (US)
Filed by NVIDIA Corporation, Santa Clara, CA (US)
Filed on Feb. 14, 2024, as Appl. No. 18/441,486.
Application 18/441,486 is a continuation of application No. 17/826,611, filed on May 27, 2022, granted, now 11,922,558.
Claims priority of provisional application 63/194,729, filed on May 28, 2021.
Prior Publication US 2024/0185506 A1, Jun. 6, 2024
Int. Cl. G06T 15/06 (2011.01); G06T 15/50 (2011.01); G06T 19/20 (2011.01)
CPC G06T 15/06 (2013.01) [G06T 15/506 (2013.01); G06T 19/20 (2013.01); G06T 2219/2012 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
determining lighting information for a scene that includes a first 3D object model;
replacing the first 3D object model in the scene with a second 3D object model that is a different object model than the first 3D object model;
based at least on the replacing, using three-dimensional (3D) geometry information corresponding to the second 3D object model to determine one or more portions of the second 3D object model that correspond to one or more pixels of a virtual frame of the scene depicting at least a portion of the second 3D object model;
computing, based at least on the lighting information, one or more radiance values corresponding to the one or more portions of the second 3D object model using specular light transport simulation; and
determining, based at least on the one or more radiance values, one or more pixel values for the one or more pixels of the virtual frame of the scene.