US 12,381,997 B2
Method and apparatus for dynamic dash picture-in-picture streaming
Iraj Sodagar, Palo Alto, CA (US)
Assigned to TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed by TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed on Sep. 21, 2022, as Appl. No. 17/949,528.
Claims priority of provisional application 63/252,398, filed on Oct. 5, 2021.
Prior Publication US 2023/0108426 A1, Apr. 6, 2023
Int. Cl. H04N 5/45 (2011.01); H04L 65/61 (2022.01); H04L 67/02 (2022.01)
CPC H04N 5/45 (2013.01) [H04L 65/61 (2022.05); H04L 67/02 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method for dynamically signaling picture-in-picture video during a dynamic adaptive streaming over HTTP (DASH) media streaming, the method being performed by one or more processors, the method comprising:
determining whether video data comprises a first main video stream and a second picture-in-picture video stream based on a Role element associated with the first main video stream having a first value indicating a main video stream and a Role element associated with the second picture-in-picture video stream having a second value indicating a picture-in-picture video stream;
determining whether the first main video stream and the second picture-in-picture video stream are to be grouped as a single experience based on a preselection descriptor in an adaptation set of the second picture-in-picture video stream referencing an adaptation set of the first main video stream;
merging, subsequent to independent decoding of the first main video stream and the second picture-in-picture video stream, the first main video stream with the second picture-in-picture video stream as a combined video stream; and
updating, when a resolution of the first main video stream and the second picture-in-picture video stream changes, a location of a second picture-in-picture video content in the combined video stream using an MPD update and inserting a new Period.