| CPC G06T 15/205 (2013.01) [G06T 7/73 (2017.01); G06T 2207/10016 (2013.01); G06T 2207/30244 (2013.01)] | 16 Claims |
|
1. A method for video rendering a background scene without using a background plate, the method comprising:
tracking spatial coordinates of at least one camera during a video sequence forming a shot having multiple frames and outputting the tracked spatial coordinates as sensor data so that movement of the at least one camera is retraceable, wherein each of the at least one camera has a lens,
wherein the at least one camera captures images of the background scene in the shot without a subject;
creating a lens profile storing lens data corresponding to the lens of the at least one camera during the shot;
encoding the lens data;
sending the lens data to a render engine;
retracing the movement of the at least one camera during the shot at the render engine using the sensor data including the tracked spatial coordinates to replicate the shot virtually so that the background scene is rendered without using the background plate;
recreating the lens and one or more characteristics of the lens during the shot using the lens data; and
replicating the shot in a virtual environment using the retraced camera movement and the recreated one or more lens characteristics,
wherein replicating the shot includes mimicking the lens and the lens characteristics, frame by frame, to replicate the shot virtually and to enable defining of a resolution for the background scene.
|