US 12,340,585 B2
Real-time video dimensional transformations of video for presentation in mixed reality-based virtual spaces
Rocco Haro, Carlsbad, CA (US)
Assigned to Kickback Space Inc., Carlsbad, CA (US)
Filed by Kickback Space Inc., Carlsbad, CA (US)
Filed on Feb. 23, 2024, as Appl. No. 18/585,547.
Application 18/585,547 is a continuation of application No. 18/069,643, filed on Dec. 21, 2022, abandoned.
Application 18/069,643 is a continuation of application No. 17/682,910, filed on Feb. 28, 2022, granted, now 11,568,646, issued on Jan. 31, 2023.
Claims priority of provisional application 63/154,411, filed on Feb. 26, 2021.
Prior Publication US 2024/0312212 A1, Sep. 19, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/40 (2022.01); G06T 19/00 (2011.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01)
CPC G06V 20/46 (2022.01) [G06T 19/003 (2013.01); G06T 19/006 (2013.01); G06V 40/174 (2022.01); G06V 40/23 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A non-transitory, processor-readable medium storing instructions that, when executed by a processor, cause the processor to:
receive, from a first user compute device of a virtual reality system, the first user compute device associated with a first user, a first plurality of images of the first user, each image from the first plurality of images being an image of the first user taken at an associated angle from a plurality of different angles;
receive, from a second user compute device of the virtual reality system, the second user compute device associated with a second user, a second plurality of images of the second user, each image from the second plurality of images being an image of the second user taken at an associated angle from the plurality of different angles;
process a first video of the first user to generate a first processed video;
process a second video of the second user to generate a second processed video;
determine, for a first virtual representation of the first user, (1) a first location of the first virtual representation in a virtual environment, and (2) a first field of view of the first virtual representation in the virtual environment;
determine, for a second virtual representation of the second user, (1) a second location of the second virtual representation in the virtual environment, and (2) a second field of view of the second virtual representation in the virtual environment;
generate at least one first frame for a first video plane of the first virtual representation based on the first processed video, at least one image from the first plurality of images, the first location, the second location, the first field of view, and the second field of view, the at least one first frame including at least one perspective view of the first virtual representation of the first user;
generate at least one second frame for a second video plane of the second virtual representation based on the second processed video, at least one image from the second plurality of images, the first location, the second location, the first field of view, and the second field of view;
cause transmission of at least one first signal representing the at least one first frame for the first video plane to at least one engine, to cause display, at the second user compute device, of the at least one first frame for the first video plane in the virtual environment to the second user;
cause transmission of at least one second signal representing the at least one second frame for the second video plane to the at least one engine, to cause display, at the first user compute device, of the at least one second frame for the second video plane in the virtual environment to the first user; and
cause transmission of at least one third signal to the first user compute device requesting the first plurality of images in response to determining that the first plurality of images has not been received.