US 12,307,573 B2
Neural shading of reflective surfaces
Vladislav Shakhrai, London (GB); Sergey Demyanov, Santa Monica, CA (US); Aleksei Stoliar, Marina del Rey, CA (US); and Istvan Marton, Encino, CA (US)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Mar. 10, 2023, as Appl. No. 18/182,117.
Prior Publication US 2024/0303902 A1, Sep. 12, 2024
Int. Cl. G06T 15/04 (2011.01); G06T 15/00 (2011.01)
CPC G06T 15/04 (2013.01) [G06T 15/005 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving an object mesh, information related to a viewpoint for rendering an image of an object having a reflective surface, and a set of maps, wherein the viewpoint comprises a vector from a point of a surface of the object mesh, and the set of maps comprises a set of textures that were modified from training a neural network model, the set of textures comprising a BRDF (Bidirectional Reflectance Distribution Function) texture, a roughness texture, an irradiance map texture, and a set of specular textures;
generating a rasterized RGB (Red Green Blue) image based on the object mesh, the viewpoint, and the set of maps;
generating, using the neural network model, an output image of the object with the reflective surface based at least in part on the rasterized RGB image and the viewpoint; and
providing for display the output image of the object with the reflective surface on a display of a computer client device.