US 12,296,257 B2
Compositing multiple video streams into a single media stream
Timothy Cotter, Sunnyvale, CA (US)
Assigned to Sony Interactive Entertainment LLC, San Mateo, CA (US)
Filed by Sony Interactive Entertainment LLC, San Mateo, CA (US)
Filed on Mar. 10, 2022, as Appl. No. 17/692,071.
Application 17/692,071 is a continuation of application No. 15/645,953, filed on Jul. 10, 2017, granted, now 11,273,373.
Application 15/645,953 is a continuation of application No. 13/797,271, filed on Mar. 12, 2013, granted, now 9,700,789, issued on Jul. 11, 2017.
Prior Publication US 2022/0193542 A1, Jun. 23, 2022
Int. Cl. A63F 13/35 (2014.01); A63F 13/355 (2014.01); A63F 13/86 (2014.01); A63F 13/87 (2014.01); A63F 13/795 (2014.01); H04N 21/2365 (2011.01)
CPC A63F 13/355 (2014.09) [A63F 13/86 (2014.09); A63F 13/87 (2014.09); A63F 13/795 (2014.09); H04N 21/2365 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
executing a plurality of instances of a video game by a plurality of game servers to generate a plurality of video streams, wherein the plurality of instances of the video game is executed responsive to user input of a plurality of users participating in a multi-player gaming session, wherein a plurality of gaming communication channels between the plurality of game servers provide for delivery of data related to gaming activity from each of the plurality of instances of the video game to other instances in the plurality of instances of the video game;
receiving at a compositing server from the plurality of game servers the plurality of video streams each of which is uncompressed and formatted for presentation on a corresponding display, wherein the plurality of video streams is accessed before being encoded for streaming to a plurality of client devices, wherein the plurality of video streams are delivered over a plurality of output communication paths directly connecting the plurality of game servers to the compositing server;
scaling by the compositing server each of the plurality of video streams to generate a plurality of thumbnail windows;
generating by the compositing server a composited video stream to combine the plurality of thumbnail windows into a single video stream;
encoding by an encoder the composited video stream, wherein the encoding is performed at an acceptable latency for the multi-player gaming session; and
streaming the composited video stream that is encoded to a client device for simultaneous viewing of the plurality of video streams corresponding with the plurality of thumbnail windows.