US 11,863,731 B2
Selective packing of patches for immersive video
Eyal Ruhm, Tel Aviv (IL); Jill Boyce, Portland, OR (US); and Asaf J. Shenberg, Tel Aviv (IL)
Assigned to INTEL CORPORATION, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Dec. 31, 2020, as Appl. No. 17/139,738.
Application 17/139,738 is a continuation of application No. 16/050,277, filed on Jul. 31, 2018, granted, now 10,887,574.
Prior Publication US 2021/0266515 A1, Aug. 26, 2021
Int. Cl. H04N 13/161 (2018.01)
CPC H04N 13/161 (2018.05) 18 Claims
OG exemplary drawing
 
1. A apparatus comprising:
one or more processor cores; and
a memory to store data for immersive video, the data including a plurality of patches that are stored for generation of immersive video images, the plurality of patches being packed and encoded into at least a first coded picture, the plurality of patches comprising patches associated with a plurality of projection directions, wherein each patch represents a selected portion of video content captured by a real or virtual camera, the patch being visible from an associated projection direction and position for the camera;
wherein the plurality of patches includes a first set of patches representing selected portions of captured video content visible from a first projection direction and a second set of patches representing selected portions of captured video content visible from a second, different projection direction;
wherein the first coded picture includes a plurality of tiles, each tile of the plurality of tiles of the first coded picture containing patches that are associated with a set of one or more projection directions of the plurality of projection directions; and
wherein the apparatus is to generate an immersive video image for a current or anticipated viewpoint at a particular position and orientation, including the apparatus to:
identify a projection direction for the immersive video image based on the current or anticipated viewpoint at the particular position and orientation,
identify a tile of the first coded picture based at least in part on the identified projection direction for the immersive video image and the set of projection directions that are associated with each of the plurality of tiles,
decode the identified tile and unpack the patches from the identified tile, and
generate the immersive video image, including inserting one or more decoded and unpacked patches from the identified tile into the immersive video image.