US 11,930,290 B2
Panoramic picture in picture video
Brian C. Lowry, Emlenton, PA (US); Joseph B. Tomko, Wexford, PA (US); and Evan A. Wimer, Pittsburgh, PA (US)
Assigned to COSM, INC., Dallas, TX (US)
Appl. No. 16/963,738
Filed by COSM, INC., Dallas, TX (US)
PCT Filed Jan. 21, 2019, PCT No. PCT/US2019/014417
§ 371(c)(1), (2) Date Jul. 21, 2020,
PCT Pub. No. WO2019/144076, PCT Pub. Date Jul. 25, 2019.
Claims priority of provisional application 62/620,218, filed on Jan. 22, 2018.
Prior Publication US 2021/0084254 A1, Mar. 18, 2021
Int. Cl. H04N 5/45 (2011.01); H04N 5/262 (2006.01); H04N 21/218 (2011.01); H04N 21/431 (2011.01); H04N 21/485 (2011.01); H04N 23/695 (2023.01); H04N 23/698 (2023.01)
CPC H04N 5/45 (2013.01) [H04N 5/2624 (2013.01); H04N 21/21805 (2013.01); H04N 21/4316 (2013.01); H04N 21/4858 (2013.01); H04N 23/695 (2023.01); H04N 23/698 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
capturing, from each of at least two cameras, video from a vantage point of a live event;
generating, in real time as the live event is occurring and from the video captured by the at least two cameras, an immersive video stream allowing an end user to manipulate, while viewing the immersive video stream streamed to the end user and in real time as the live event is occurring, a portion of the immersive video stream viewed by the end user, wherein the manipulating the portion does not control the at least two cameras capturing the video;
producing a transport video stream by combining the immersive video stream with a production camera video stream comprising video of the live event produced and provided in real time as the live event is occurring, wherein the transport stream is available for user consumption, wherein the producing a transport video streams comprises combining, via multiplexing, multiple elementary video streams into a single transport stream comprising a plurality of discrete individual video streams, wherein at least one of the plurality of discrete individual video streams comprises the immersive video stream and wherein at least another of the plurality of discrete individual video streams comprises the production camera video stream; and
providing, to a display device, a streamed production to the end user from the transport video stream, wherein the streamed production comprises displaying each of the immersive video stream and the production camera video stream as separate, simultaneous video streams on the display device, the streamed production comprising an overlay window comprising at least one of the immersive video stream and the production camera video stream and a primary view comprising at least one of the immersive video stream and the production camera video stream, wherein the end user provides input to manipulate the immersive video stream and change the portion of the immersive video stream being viewed by the end user in real time as the live event is occurring.