US 12,341,941 B2
Methods, systems, and media for rendering immersive video content with foveated meshes
Wanmin Wu, Foster City, CA (US); Samuel Kvaalen, San Francisco, CA (US); Ivan Janatra, Santa Clara, CA (US); and Changchang Wu, Mountain View, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Jun. 24, 2022, as Appl. No. 17/848,861.
Application 17/848,861 is a continuation of application No. 16/940,717, filed on Jul. 28, 2020, granted, now 11,375,170.
Claims priority of provisional application 62/879,529, filed on Jul. 28, 2019.
Prior Publication US 2022/0321858 A1, Oct. 6, 2022
Int. Cl. H04N 13/122 (2018.01); G06T 15/00 (2011.01); H04N 13/178 (2018.01); H04N 13/00 (2018.01)
CPC H04N 13/122 (2018.05) [G06T 15/005 (2013.01); H04N 13/178 (2018.05); H04N 2013/0088 (2013.01)] 20 Claims
OG exemplary drawing
 
16. A system for generating immersive video content, the system comprising:
a memory; and
a processor that, when executing computer-executable instructions stored in the memory, is configured to:
receive a video content item;
determine whether the video content item includes stereoscopic content; in response to determining that the video content item includes stereoscopic content, determine that a foveated mesh is to be generated for transcoding the stereoscopic content of the video content that is currently associated with an equirectangular mesh;
generate the foveated mesh for association with the video content item, wherein the foveated mesh is generated by deforming, using a polynomial fitting function, a two-dimensional UV map of the equirectangular mesh;
determining whether an improvement ratio satisfies a predefined criterion, wherein the improvement ratio reflects a ratio of a number of pixels in a video content item rendered using the foveated mesh to a number of pixels in the video content item rendered using the equirectangular mesh; and
responsive to determining that the improvement ratio satisfies a predefined criterion, render the immersive video content by applying the video content item as a texture to the generated foveated mesh.