CPC G06T 19/006 (2013.01) [G01C 21/26 (2013.01); G01C 21/365 (2013.01); G02B 27/017 (2013.01); G06T 15/205 (2013.01); G06T 17/00 (2013.01); G06T 19/20 (2013.01); G02B 2027/0141 (2013.01); G05D 2201/0213 (2013.01); G06T 2210/56 (2013.01)] | 20 Claims |
1. A system, comprising:
a display device; and
a controller comprising:
one or more processors; and
a memory storing instructions that, when executed on or across the one or more processors, cause the one or more processors to:
obtain sensor data for an environment of a real-world scene captured by one or more sensors;
generate virtual content for the environment based at least on the sensor data and three-dimensional (3D) mesh data for the environment;
determine lighting information for a region of the environment on which the virtual content is to be projected, the lighting information indicating a location or orientation of a light source relative to one or more surfaces of the region of the environment;
modify an appearance of the virtual content based at least on the determined lighting information of the region by moving a portion of the virtual content that is to be projected on or near the surface to another location; and
provide the virtual content to the display device.
|