CPC H04N 19/137 (2014.11) [G06T 7/254 (2017.01); G06T 7/70 (2017.01); G06T 9/00 (2013.01); G06T 9/001 (2013.01); G06T 15/04 (2013.01); G06T 15/405 (2013.01); G06T 19/006 (2013.01); H04N 19/46 (2014.11); H04N 19/503 (2014.11); H04N 19/597 (2014.11); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/30244 (2013.01)] | 20 Claims |
1. A computer system comprising one or more processors and memory, the computer system being configured to perform operations comprising:
generating, using a previous camera pose and a 3D representation of a shape of a user's environment, a previous frame image as viewed from the previous camera pose;
receiving compressed video data and camera pose data that defines a current camera pose different than the previous camera pose;
generating, using the current camera pose and the 3D representation of the shape of the user's environment, a reprojection of the previous frame image as if viewed from the current camera pose instead of the previous camera pose, the reprojection of the previous frame image being usable to predict a current frame image as viewed from the current camera pose;
decompressing the compressed video data, the compressed video data defining differences relative to the reprojection of the previous frame image; and
applying the differences to the reprojection of the previous frame image to generate the current frame image.
|