US 12,034,787 B2
Hybrid streaming
Chetan Ahuja, Burlingame, CA (US); Daniel G. Gelb, Redwood City, CA (US); Angelo Pesce, San Mateo, CA (US); and Adam Miller, San Mateo, CA (US)
Assigned to Roblox Corporation, San Mateo, CA (US)
Filed by Roblox Corporation, San Mateo, CA (US)
Filed on Apr. 1, 2022, as Appl. No. 17/711,109.
Application 17/711,109 is a continuation of application No. 16/703,824, filed on Dec. 4, 2019, granted, now 11,297,116.
Prior Publication US 2022/0224739 A1, Jul. 14, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 15/20 (2011.01); A63F 13/355 (2014.01); H04L 65/611 (2022.01); H04L 65/75 (2022.01); H04N 13/117 (2018.01); H04N 21/426 (2011.01); H04N 21/81 (2011.01)
CPC H04L 65/611 (2022.05) [A63F 13/355 (2014.09); G06T 15/20 (2013.01); G06T 15/205 (2013.01); H04L 65/764 (2022.05); H04N 13/117 (2018.05); H04N 21/42653 (2013.01); H04N 21/8146 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, at a client device, background video that corresponds to at least one layer of a background portion of a virtual environment, wherein the background video is rendered at a server remote from the client device;
rendering, using the client device, one or more objects in a foreground portion of the virtual environment;
determining, using depth information, portions of the at least one layer that are in front of the one or more rendered objects or behind the one or more rendered objects;
reprojecting the at least one layer based upon a single vantage point associated with the client device and the determined portions of the at least one layer;
combining, using the client device, the reprojected at least one layer and at least one of the one or more rendered objects into a composite video that matches the single vantage point associated with the client device; and
causing the composite video to be displayed at the client device.