US 12,348,730 B2
Reprojecting holographic video to enhance streaming bandwidth/quality
Forrest Power Trepte, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Oct. 27, 2023, as Appl. No. 18/384,750.
Application 18/384,750 is a continuation of application No. 17/990,457, filed on Nov. 18, 2022, granted, now 11,838,518.
Application 17/990,457 is a continuation of application No. 16/984,609, filed on Aug. 4, 2020, granted, now 11,533,489, issued on Dec. 20, 2022.
Application 16/984,609 is a continuation of application No. 16/243,740, filed on Jan. 9, 2019, granted, now 10,764,585, issued on Sep. 1, 2020.
Application 16/243,740 is a continuation of application No. 15/403,649, filed on Jan. 11, 2017, granted, now 10,212,428, issued on Feb. 19, 2019.
Prior Publication US 2024/0267524 A1, Aug. 8, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/137 (2014.01); G06T 7/254 (2017.01); G06T 7/70 (2017.01); G06T 9/00 (2006.01); G06T 15/04 (2011.01); G06T 15/40 (2011.01); G06T 19/00 (2011.01); H04N 19/46 (2014.01); H04N 19/503 (2014.01); H04N 19/597 (2014.01)
CPC H04N 19/137 (2014.11) [G06T 7/254 (2017.01); G06T 7/70 (2017.01); G06T 9/00 (2013.01); G06T 9/001 (2013.01); G06T 15/04 (2013.01); G06T 15/405 (2013.01); G06T 19/006 (2013.01); H04N 19/46 (2014.11); H04N 19/503 (2014.11); H04N 19/597 (2014.11); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/30244 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method for generating image data with compressed video data, the method being implemented by a computer system, the method comprising:
receiving compressed video data and pose data that defines a current pose different than a previous pose, the previous pose having a previous location and a previous orientation, and the current pose having a current location and a current orientation;
generating, using the current pose and a 3D representation of a shape of a user's environment, a reprojection of a previous frame image as if viewed from the current pose instead of the previous pose, the reprojection of the previous frame image being usable to predict a current frame image as viewed from the current pose;
decompressing the compressed video data, the compressed video data indicating differences relative to the reprojection of the previous frame image; and
applying the differences to the reprojection of the previous frame image to generate the current frame image.