US 11,748,918 B1
Synthesized camera arrays for rendering novel viewpoints
Felipe Bacim De Araujo E Silva, San Jose, CA (US); Dan C Lelescu, Morgan Hill, CA (US); Sebastien Eric Gilles Leprince, San Mateo, CA (US); and Gary L Vondran, Jr., San Carlos, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 23, 2021, as Appl. No. 17/483,703.
Claims priority of provisional application 63/083,789, filed on Sep. 25, 2020.
Int. Cl. G06T 11/00 (2006.01); G06T 7/55 (2017.01); G06T 3/00 (2006.01)
CPC G06T 11/00 (2013.01) [G06T 3/00 (2013.01); G06T 7/55 (2017.01); G06T 2207/20212 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus, comprising:
one or more display devices;
a controller; and
a memory, storing program instructions that when executed by the controller, cause the controller to:
obtain an array of images of a scene comprising a plurality of synthetic viewpoints generated from a plurality of captured viewpoints of the scene and added to the array of images to complete the array of images of the scene, wherein the synthetic viewpoints are generated using lightfield rendering to preserve view dependent lighting;
receive a request to generate a novel viewpoint of the scene;
render the novel viewpoint according to weighted averages generated from neighboring images identified in the array of images according to the novel viewpoint and mapped to corresponding portions of a frame for displaying the novel viewpoint; and
display the rendered, novel viewpoint via the one or more display devices.