US 12,267,477 B2
Viewpoint synthesis with enhanced 3D perception
Seppo Valli, Espoo (FI); and Pekka Siltanen, Helsinki (FI)
Assigned to Adeia Guides Inc., San Jose, CA (US)
Filed by Adeia Guides Inc., San Jose, CA (US)
Filed on Jun. 26, 2023, as Appl. No. 18/214,272.
Prior Publication US 2024/0430395 A1, Dec. 26, 2024
Int. Cl. H04N 13/117 (2018.01); H04N 13/128 (2018.01); H04N 13/156 (2018.01); H04N 13/161 (2018.01); H04N 13/00 (2018.01); H04N 13/194 (2018.01)
CPC H04N 13/117 (2018.05) [H04N 13/128 (2018.05); H04N 13/156 (2018.05); H04N 13/161 (2018.05); H04N 2013/0077 (2013.01); H04N 2013/0081 (2013.01); H04N 2013/0092 (2013.01); H04N 13/194 (2018.05)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
accessing first image data comprising texture data and depth data from a first viewpoint;
segmenting the texture data and the depth data into a plurality of layers;
generating respective multiple focal planes (MFPs) for each respective layer based on the segmented texture data and the segmented depth data;
blanking out pixels on the respective MFPs for each respective layer that are occluded by pixels on layers that are closer to the first viewpoint;
identifying a second viewpoint; and
generating second image data for the second viewpoint to enable display of the second image data by:
shifting and scaling the respective MFPs for each respective layer corresponding to the second viewpoint, wherein layers closer to an origin of the second viewpoint are shifted and scaled more than layers farther from the origin of the second viewpoint; and
blanking out pixels on the shifted and scaled respective MFPs for each respective layer that are occluded by pixels on layers that are closer to the second viewpoint.