US 11,778,219 B2
Method and system for live video streaming with integrated encoding and transmission semantics
Abhijan Bhattacharyya, Kolkata (IN); Ashis Sau, Kolkata (IN); Madhurima Ganguly, Kolkata (IN); and Balamuralidhar Purushothaman, Bangalore (IN)
Assigned to TATA CONSULTANCY SERVICES LIMITED, Mumbai (IN)
Filed by Tata Consultancy Services Limited, Mumbai (IN)
Filed on Aug. 1, 2022, as Appl. No. 17/816,464.
Claims priority of application No. 202221001608 (IN), filed on Jan. 11, 2022.
Prior Publication US 2023/0224486 A1, Jul. 13, 2023
Int. Cl. H04N 7/12 (2006.01); H04N 19/46 (2014.01); H04N 19/167 (2014.01); H04N 19/85 (2014.01); H04N 19/14 (2014.01); H04N 19/127 (2014.01); H04N 19/169 (2014.01); H04N 19/189 (2014.01)
CPC H04N 19/46 (2014.11) [H04N 19/127 (2014.11); H04N 19/14 (2014.11); H04N 19/167 (2014.11); H04N 19/188 (2014.11); H04N 19/189 (2014.11); H04N 19/85 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A processor implemented method for live video streaming with integrated encoding and transmission semantics, comprising:
encoding, via one or more hardware processors, a set of frames associated with a live video stream of a live video streaming protocol to generate a set of data fragments by using,
a reference encoder, a set of full frames comprising of encoded MCU (Minimum Coded Unit) blocks corresponding to a complete jpeg frame of the live video stream, and
a delta encoder, a set of delta frames comprising of encoded MCU blocks corresponding to foreground pixels of a current frame obtained from a background subtraction module;
periodically transmitting, by using a transmitter unit of the live video streaming protocol via the one or more hardware processors,
each packet from the set of full frames and each packet from the set of delta frames are transmitted in sequence with a payload specific header based on a packet mode, and
providing a region of interest (ROI) information to the transmitter unit as pixel boundaries for each packet by computing a scaling factor, wherein each packet of the payload specific header is categorically inferred as at least one of a critical with confirmable communication semantics, and a non-critical with non-confirmable communication semantics; and
receiving, by using a receiver unit of the live video streaming protocol via the one or more hardware processors, each packet of the full frames and each packet of the delta frames based on the packet mode to reconstruct an original sequence of the live video stream from the foreground pixels, wherein each packet comprising the set of delta frames are decoded using a delta decoder and each packet comprising the set of full frames are decoded using a reference decoder by estimating,
a total number of packets expected at each frame interval from the payload specific header, and
a loss incurred in each packet from the set of full frames and the set of delta frames.