US 12,114,024 B2
Streaming video with internally-variable frame quality based on intelligent identification of high-relevance regions
Mrinal Kumar Sharma, Hazaribagh (IN)
Assigned to Microsoft Technology Licensing, LLC., Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on May 16, 2022, as Appl. No. 17/744,911.
Prior Publication US 2023/0370653 A1, Nov. 16, 2023
Int. Cl. H04N 21/234 (2011.01); G06V 10/22 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); H04N 19/167 (2014.01); H04N 19/169 (2014.01); H04N 19/17 (2014.01); H04N 19/176 (2014.01); H04N 21/2187 (2011.01); H04N 21/2343 (2011.01); H04N 21/472 (2011.01)
CPC H04N 21/23418 (2013.01) [G06V 10/22 (2022.01); G06V 10/82 (2022.01); G06V 20/41 (2022.01); G06V 20/46 (2022.01); H04N 19/167 (2014.11); H04N 19/169 (2014.11); H04N 19/17 (2014.11); H04N 19/176 (2014.11); H04N 21/2187 (2013.01); H04N 21/23406 (2013.01); H04N 21/234345 (2013.01); H04N 21/472 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for streaming a video with internally-variable frame quality, wherein the method is implemented via a computing system comprising a processor, and wherein the method comprises:
accessing, via the processor, a video comprising a sequence of video frames;
evenly sampling at least a first video frame in the sequence of video frames and a second video frame in the sequence of video frames, wherein unsampled intermediate video frame(s) are positioned between the first sampled video frame and the second sampled video frame in the sequence of video frames;
analyzing regions of the first sampled video frame using a convolutional neural network (CNN) model to identify a high-relevance region comprising textual information, the high-relevance region being more relevant to a user than low-relevance region(s) within the first sampled video frame;
extracting coordinates of the high-relevance region within the first sampled video frame using the CNN model;
using the coordinates extracted from the first sampled video frame to identify corresponding high-relevance region(s) within the unsampled intermediate video frame(s), wherein the high-relevance region within the first sampled video frame and the corresponding high-relevance region(s) of the unsampled intermediate video frame(s) have identical coordinates; and
streaming the video such that the streamed video has an internally-variable frame quality, wherein streaming the video comprises buffering the high-relevance region of the first sampled video frame and the corresponding high-relevance region(s) of the unsampled intermediate video frame(s) at a higher resolution than the low-relevance region(s) of the first sampled video frame.