US 12,217,359 B2
Three-dimensional rendering of sporting event from two-dimensional video stream
Joseph Gratz, Valparaiso, IN (US)
Filed by Joseph Gratz, Valparaiso, IN (US)
Filed on Mar. 10, 2022, as Appl. No. 17/691,888.
Claims priority of provisional application 63/159,272, filed on Mar. 10, 2021.
Prior Publication US 2022/0292766 A1, Sep. 15, 2022
Int. Cl. G06T 17/00 (2006.01); G06V 10/25 (2022.01); G06V 10/764 (2022.01); G06V 20/40 (2022.01)
CPC G06T 17/00 (2013.01) [G06V 10/25 (2022.01); G06V 10/764 (2022.01); G06V 20/42 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A system for translating two-dimensional sporting event video streams onto virtual three-dimensional fields-of-play, the system comprising:
a reference database configured to store information of a virtual three-dimensional rendering of a physical field-of-play;
one or more processors configured to:
generate the virtual three-dimensional rendering;
generate camera angle entries of the reference database each of which corresponds with a virtual image of the virtual three-dimensional rendering captured from a virtual camera position setting and includes a virtual camera angle setting at which the virtual image is captured and two-dimensional coordinates of one or more static features of the virtual three-dimensional rendering;
for each frame within one of a plurality of tracking sessions of a two-dimensional video stream of a sporting event occurring on the physical field-of-play:
identify two-dimensional coordinates of one or more static features of the physical field-of-play;
determine a matching virtual camera angle setting by comparing the two-dimensional coordinates of the one or more static features of the physical field-of-play to the two-dimensional coordinates of the one or more static features of the camera angle entries in the reference database; and
translate objects-of-interest within the frame onto the virtual three-dimensional rendering based on the virtual camera position setting and the matching virtual camera angle setting.