US 11,800,232 B2
Object pre-encoding for 360-degree view for optimal quality and latency
Jason Tanner, Folsom, CA (US); Wen-Fu Kao, West Sacramento, CA (US); Ping Liu, Sunnyvale, CA (US); Yi-Jen Chiu, San Jose, CA (US); and Ya-Ti Peng, Sunnyvale, CA (US)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Jan. 26, 2021, as Appl. No. 17/158,627.
Application 17/158,627 is a continuation of application No. 15/495,525, filed on Apr. 24, 2017, granted, now 10,939,038.
Prior Publication US 2021/0360155 A1, Nov. 18, 2021
Int. Cl. H04N 23/698 (2023.01); H04N 21/81 (2011.01); G09G 3/00 (2006.01); H04N 21/6587 (2011.01); G06F 3/147 (2006.01); H04N 21/4728 (2011.01); G06T 11/00 (2006.01); G09G 5/14 (2006.01); G02B 27/01 (2006.01); G09G 5/38 (2006.01); G09G 5/39 (2006.01); G09G 5/36 (2006.01); G06F 3/01 (2006.01); H04N 21/41 (2011.01); H04N 21/239 (2011.01); H04N 21/422 (2011.01)
CPC H04N 23/698 (2023.01) [G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06F 3/147 (2013.01); G06T 11/00 (2013.01); G09G 3/001 (2013.01); G09G 3/003 (2013.01); G09G 5/14 (2013.01); G09G 5/363 (2013.01); G09G 5/38 (2013.01); G09G 5/39 (2013.01); H04N 21/2393 (2013.01); H04N 21/4122 (2013.01); H04N 21/42202 (2013.01); H04N 21/4728 (2013.01); H04N 21/6587 (2013.01); H04N 21/816 (2013.01); H04N 21/8146 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0187 (2013.01); G09G 2340/02 (2013.01); G09G 2340/14 (2013.01); G09G 2350/00 (2013.01); G09G 2354/00 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A system, comprising:
a display having a viewable area defining a viewport;
a client communicatively coupled to the display to deliver a portion of a 360-degree video of a scene to substantially fit within the viewport; and
a sideband memory to store in a pre-rendered form objects of interest separate from the scene, wherein one of the objects of interest is a first object that is in motion and is not currently in the viewport,
wherein the objects of interest are pre-rendered separate from any video containing the scene and prior to a determination that the one of the objects of interest has entered the scene,
wherein the display comprises a head mounted display (HMD) communicatively coupled to a motion engine to translate a user's head movement or eye movement to pan around the 360-degree video,
wherein the client is to display in a current frame the first object upon a determination, based on motion information about the first object, that the first object is suddenly entering the viewport, and
wherein the client is to display in a subsequent frame a second object of interest upon a determination, based on the user's head movement or eye movement, that the second object is suddenly entering the viewport.