US 11,838,518 B2
Reprojecting holographic video to enhance streaming bandwidth/quality
Forrest Power Trepte, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Nov. 18, 2022, as Appl. No. 17/990,457.
Application 17/990,457 is a continuation of application No. 16/984,609, filed on Aug. 4, 2020, granted, now 11,533,489.
Application 16/984,609 is a continuation of application No. 16/243,740, filed on Jan. 9, 2019, granted, now 10,764,585, issued on Sep. 1, 2020.
Application 16/243,740 is a continuation of application No. 15/403,649, filed on Jan. 11, 2017, granted, now 10,212,428, issued on Feb. 19, 2019.
Prior Publication US 2023/0082705 A1, Mar. 16, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/137 (2014.01); G06T 7/254 (2017.01); H04N 19/597 (2014.01); H04N 19/503 (2014.01); H04N 19/46 (2014.01); G06T 9/00 (2006.01); G06T 7/70 (2017.01); G06T 15/04 (2011.01); G06T 15/40 (2011.01); G06T 19/00 (2011.01)
CPC H04N 19/137 (2014.11) [G06T 7/254 (2017.01); G06T 7/70 (2017.01); G06T 9/00 (2013.01); G06T 9/001 (2013.01); G06T 15/04 (2013.01); G06T 15/405 (2013.01); G06T 19/006 (2013.01); H04N 19/46 (2014.11); H04N 19/503 (2014.11); H04N 19/597 (2014.11); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/30244 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer system comprising one or more processors and memory, the computer system being configured to perform operations comprising:
generating, using a previous camera pose and a 3D representation of a shape of a user's environment, a previous frame image as viewed from the previous camera pose;
receiving compressed video data and camera pose data that defines a current camera pose different than the previous camera pose;
generating, using the current camera pose and the 3D representation of the shape of the user's environment, a reprojection of the previous frame image as if viewed from the current camera pose instead of the previous camera pose, the reprojection of the previous frame image being usable to predict a current frame image as viewed from the current camera pose;
decompressing the compressed video data, the compressed video data defining differences relative to the reprojection of the previous frame image; and
applying the differences to the reprojection of the previous frame image to generate the current frame image.