US 11,869,135 B2
Creating action shot video from multi-view capture data
Stefan Johannes Josef Holzer, San Mateo, CA (US); Julius Santiago, San Francisco, CA (US); Milos Vlaski, San Francisco, CA (US); Endre Ajandi, San Francisco, CA (US); and Radu Bogdan Rusu, San Francisco, CA (US)
Assigned to Fyusion, Inc., San Francisco, CA (US)
Filed by Fyusion, Inc., San Francisco, CA (US)
Filed on Jan. 8, 2021, as Appl. No. 17/144,866.
Claims priority of provisional application 62/961,826, filed on Jan. 16, 2020.
Prior Publication US 2021/0225065 A1, Jul. 22, 2021
Int. Cl. G06T 15/20 (2011.01); G06T 13/20 (2011.01); H04N 13/282 (2018.01)
CPC G06T 15/20 (2013.01) [G06T 13/20 (2013.01); H04N 13/282 (2018.05)] 18 Claims
OG exemplary drawing
 
1. A method comprising:
determining a three-dimensional representation of a scene, captured in an action shot base video, the three-dimensional representation of the scene including a three-dimensional representation of a ground surface, the three-dimensional representation of the scene identifying a camera pose for motion of a camera along a path through space in the action shot base video;
determining a representation of an object by estimating a three-dimensional model from a multi-view capture of the object, the multi-view capture including a plurality of images of the object, each of the images being captured from a different respective viewpoint, the multi-view capture being navigable in one or more dimensions; and
generating an action shot video of the scene by combining the three-dimensional representation of the scene captured in the action shot base video and the three-dimensional model from the multi-view capture of the object, the action shot video including a rendered object determined based on the representation of the object and the camera pose and animated via an animation effect, the rendered object being positioned along the path through space.