US 12,214,277 B2
Method and device for generating video frames
Matthew William Sanders, London (GB); Fabio Cappello, London (GB); Timothy Bradley, London (GB); Jessica Rose Grant, London (GB); and Maurizio Cerrato, London (GB)
Assigned to Sony Interactive Entertainment Inc., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Jun. 19, 2020, as Appl. No. 16/906,198.
Claims priority of application No. 1909447 (GB), filed on Jul. 1, 2019.
Prior Publication US 2021/0001216 A1, Jan. 7, 2021
Int. Cl. A63F 13/352 (2014.01); A63F 13/327 (2014.01); A63F 13/335 (2014.01); A63F 13/525 (2014.01); A63F 13/573 (2014.01); G06N 3/08 (2023.01); G06N 20/00 (2019.01)
CPC A63F 13/352 (2014.09) [A63F 13/327 (2014.09); A63F 13/335 (2014.09); A63F 13/525 (2014.09); A63F 13/573 (2014.09); G06N 3/08 (2013.01); G06N 20/00 (2019.01)] 16 Claims
OG exemplary drawing
 
1. A method of generating video frames at a client device for a cloud-based video game, the method comprising:
obtaining, via a communications network, a plurality of video frames of a video game rendered at a cloud device;
obtaining a player input received at an input device, the input device being used to play the video game, the player input being used to play the video game and being received in response to the display of at least one of the plurality of video frames;
inputting at least one of the plurality of video frames and the player input, which is being used to play the video game, into a trained machine learning model comprised by the client device; and
predicting, via the trained machine learning model, a subsequent video frame for output at a display based on the at least one of the obtained video frames and the player input, which is being used to play the video game, and outputting the subsequent video frame at the display, wherein:
at least some of the plurality of video frames obtained from the cloud device correspond to video frames having a wider field of view than a field of view of the subsequent video frame that is to be output at the display, and
inputting the at least one of the plurality of video frames into the trained by machine learning model comprises inputting a wider field of view frame to the trained machine learning model, the wider field of view frame including an object coming into the player's view.