US 12,273,601 B2
Live video streaming architecture with real-time frame and subframe level live watermarking
Davide Lucchi, Boston, MA (US); Chris Allen, Jamaica Plain, MA (US); and Alexander Solonsky, Tomsk (RU)
Assigned to Infrared5, Inc., Jamaica Plain, MA (US)
Filed by Infrared5, Inc., Jamaica Plain, MA (US)
Filed on Dec. 14, 2021, as Appl. No. 17/550,472.
Claims priority of provisional application 63/129,711, filed on Dec. 23, 2020.
Prior Publication US 2022/0201372 A1, Jun. 23, 2022
Int. Cl. H04N 21/8358 (2011.01); G06T 1/00 (2006.01); H04L 65/65 (2022.01); H04L 67/55 (2022.01); H04N 21/2187 (2011.01)
CPC H04N 21/8358 (2013.01) [G06T 1/0085 (2013.01); H04L 65/65 (2022.05); H04L 67/55 (2022.05); H04N 21/2187 (2013.01); G06T 2201/0065 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A live media streaming architecture with real-time watermarking, comprising:
an origin device, comprising a first processing unit and a first computer storage medium, configured to receive a real-time live digital media stream from a publisher device associated with a publisher over a first one or more computer networks;
a plurality of edge devices, wherein each edge device in the plurality of edge devices comprises a respective second processing unit and a respective second computer storage medium and wherein each edge device in the plurality of edge devices is configured to deliver real-time live digital media streams to respective subscriber devices assigned to the edge device and connected to the edge device over a second one or more computer networks;
a third one or more computer networks interconnecting the origin device with the plurality of edge devices;
wherein the origin device is configured to stream the real-time live digital media stream through the third one or more computer networks to the plurality of edge devices using a real-time streaming communication protocol allowing direct access to image data within each individual frame of the real-time live digital media stream;
the third one or more computer networks comprising a processor having a first input configured to receive the real-time live digital media stream from the origin device and a second input configured to receive a payload for use in creating a watermark, wherein the processor includes a watermarking module, comprising computer program instructions that when processed by the processor configures the processor to:
apply a respective watermark, including at least a portion of the payload, to each individual frame of the real-time live digital media stream in at least two distinct forms for the frame, such that a plurality of differently watermarked real-time live digital media streams are produced, and
stream the plurality of differently watermarked real-time live digital media streams using the real-time streaming communication protocol over the third one or more computer networks to each edge device; and
wherein each edge device in the plurality of edge devices is further configured to:
receive the plurality of differently watermarked real-time live digital media streams from the processor;
generate a respective uniquely watermarked real-time live digital media stream for each subscriber device by defining a respective unique sequence of individual frames or subframes selected from among the plurality of differently watermarked real-time live digital media streams based on respective information associated the subscriber device, and combining the selected individual frames or subframes from among the plurality of differently watermarked real-time live digital media streams into the respective uniquely watermarked real-time live digital media stream for the subscriber device;
stream the respective uniquely watermarked real-time live digital media streams as real-time live digital media streams to the respective different subscriber devices assigned to the edge device,
whereby each real-time live digital stream transmitted by the plurality of edge devices is uniquely associated with the respective subscriber device.