US 12,262,072 B2
Live video latency measurement and control
Yurong Jiang, Santa Clara, CA (US); Vidit Mihirbhai Soni, Sunnyvale, CA (US); Karthiek Chandrasekaran, Fremont, CA (US); and Federico Guillermo Hlawaczek, Mountain View, CA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Nov. 29, 2021, as Appl. No. 17/537,313.
Claims priority of provisional application 63/252,578, filed on Oct. 5, 2021.
Prior Publication US 2023/0108310 A1, Apr. 6, 2023
Int. Cl. H04N 21/24 (2011.01); H04N 21/2187 (2011.01); H04N 21/234 (2011.01); H04N 21/242 (2011.01)
CPC H04N 21/24 (2013.01) [H04N 21/2187 (2013.01); H04N 21/23418 (2013.01); H04N 21/242 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method, comprising:
capturing a live video scene with a first device;
ingesting the live video scene into a video segment;
determining a first arrival time of the video segment at an ingestion server;
encoding the video segment with a first timestamp associated with the first arrival time;
creating a producer reference time box (PRFT) for the video segment;
distributing the video segment to one or more second devices, wherein the one or more second devices present the video segment to one or more users;
simulating receiving of the video segment at the one or more second devices to compute an estimated render time;
determining a latency of the video segment based on a plurality of measurements of time between a first time prior to the video segment being presented by the one or more second devices to the one or more users and a second time at or after the video segment is presented by the one or more second devices to the one or more users, wherein the plurality of measurements of time comprise an elapsed time between a time indicated by the PRFT and at least two of: completion of the encoding of the video segment, serving of the video segment by one or more servers of a content distribution network, or the estimated render time; and
based on the plurality of measurements, identifying a particular component of a live video transmission pipeline as contributing to increased latency in the distribution of the live video scene from the first device to the one or more second devices.