US 11,935,197 B2
Adaptive vehicle augmented reality display using stereographic imagery
Patrick S. Piemonte, San Francisco, CA (US); Daniel De Rocha Rosario, San Francisco, CA (US); Jason D Gosnell, San Jose, CA (US); and Peter Meier, Los Gatos, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 12, 2021, as Appl. No. 17/175,456.
Application 17/175,456 is a continuation of application No. 15/713,274, filed on Sep. 22, 2017, granted, now 10,922,886.
Claims priority of provisional application 62/398,927, filed on Sep. 23, 2016.
Prior Publication US 2021/0166490 A1, Jun. 3, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G01C 21/26 (2006.01); G01C 21/36 (2006.01); G02B 27/01 (2006.01); G06T 15/20 (2011.01); G06T 17/00 (2006.01); G06T 19/20 (2011.01)
CPC G06T 19/006 (2013.01) [G01C 21/26 (2013.01); G01C 21/365 (2013.01); G02B 27/017 (2013.01); G06T 15/205 (2013.01); G06T 17/00 (2013.01); G06T 19/20 (2013.01); G02B 2027/0141 (2013.01); G05D 2201/0213 (2013.01); G06T 2210/56 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
a display device; and
a controller comprising:
one or more processors; and
a memory storing instructions that, when executed on or across the one or more processors, cause the one or more processors to:
obtain sensor data for an environment of a real-world scene captured by one or more sensors;
generate virtual content for the environment based at least on the sensor data and three-dimensional (3D) mesh data for the environment;
determine lighting information for a region of the environment on which the virtual content is to be projected, the lighting information indicating a location or orientation of a light source relative to one or more surfaces of the region of the environment;
modify an appearance of the virtual content based at least on the determined lighting information of the region by moving a portion of the virtual content that is to be projected on or near the surface to another location; and
provide the virtual content to the display device.