US 11,922,558 B2
Hybrid differentiable rendering for light transport simulation systems and applications
Wenzheng Chen, Toronto (CA); Joey Litalien, Montreal (CA); Jun Gao, North York (CA); Zian Wang, Toronto (CA); Clement Tse Tsian Christophe Louis Fuji Tsang, Toronto (CA); Sameh Khamis, Oakland, CA (US); Or Litany, Sunnyvale, CA (US); and Sanja Fidler, Toronto (CA)
Assigned to NVIDIA Corporation, Santa Clara, CA (US)
Filed by NVIDIA Corporation, Santa Clara, CA (US)
Filed on May 27, 2022, as Appl. No. 17/826,611.
Claims priority of provisional application 63/194,729, filed on May 28, 2021.
Prior Publication US 2022/0383582 A1, Dec. 1, 2022
Int. Cl. G06T 15/06 (2011.01); G06T 15/50 (2011.01); G06T 19/20 (2011.01)
CPC G06T 15/06 (2013.01) [G06T 15/506 (2013.01); G06T 19/20 (2013.01); G06T 2219/2012 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
rasterizing a virtual frame depicting one or more 3D models, the rasterizing comprising using three-dimensional (3D) geometry information corresponding to the one or more 3D models to determine one or more portions of the one or more 3D models that correspond to one or more pixels of the virtual frame;
computing one or more radiance values corresponding to the one or more portions of the one or more 3D models using specular light transport simulation with respect to the one or more portions; and
determining, based at least on the one or more radiance values, one or more pixel values for the one or more pixels based at least on the determination that the one or more portions correspond to the one or more pixels.