US 12,355,956 B2
Multi-channel video rate control for extended reality streaming
Danny Hong, New York, NY (US); and Zhuo Chen, Menlo Park, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Sep. 1, 2023, as Appl. No. 18/241,496.
Prior Publication US 2025/0080728 A1, Mar. 6, 2025
Int. Cl. H04N 7/12 (2006.01); G06T 7/50 (2017.01); H04N 19/115 (2014.01); H04N 19/124 (2014.01)
CPC H04N 19/115 (2014.11) [G06T 7/50 (2017.01); H04N 19/124 (2014.11); G06T 2207/10028 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An extended reality system, comprising:
one or more servers comprising:
a rate circuitry configured to:
estimate a total number of encoded output bits for a plurality of frames based on a plurality of a set of quantization parameters including a corresponding quantization parameter for each frame of the plurality of frames, the plurality of frames including a first frame representing a first view of an extended reality scene, a second frame representing a second view of the extended reality scene, a third frame representing depth data associated with the first view of the extended reality scene, and a fourth frame representing depth data associated with the second view of the extended reality scene; and
based on a comparison of the total number of encoded output bits to a target frame size threshold, update the set of quantization parameters; and
an encoder configured to encode the plurality of frames based on the set of quantization parameters.