US 12,094,174 B2
Data processing systems for real-time camera parameter estimation
Leonardo Citraro, S. Antonio (CH); Pablo Márquez Neila, Lausanne (CH); Stefano Savarè, Lausanne (CH); Vivek Jayaram, Los Gatos, CA (US); Charles Xavier Quentin Dubout, Écublens (CH); Felix Constant Marc Renaut, Morges (CH); Andres Michael Levering Hasfura, San Antonio, TX (US); Horesh Beny Ben Shitrit, Echichens (CH); and Pascal Fua, Vaux sur Morges (CH)
Assigned to Genius Sports SS, LLC, Los Angeles, CA (US)
Filed by Genius Sports SS, LLC, Los Angeles, CA (US)
Filed on May 22, 2023, as Appl. No. 18/321,407.
Application 18/321,407 is a continuation of application No. 17/224,207, filed on Apr. 7, 2021, granted, now 11,694,362.
Application 17/224,207 is a continuation of application No. 16/798,900, filed on Feb. 24, 2020, granted, now 10,991,125, issued on Apr. 27, 2021.
Application 16/798,900 is a continuation of application No. 16/521,761, filed on Jul. 25, 2019, granted, now 10,600,210, issued on Mar. 24, 2020.
Prior Publication US 2023/0298210 A1, Sep. 21, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/80 (2017.01); G06N 3/08 (2023.01); G06V 20/40 (2022.01)
CPC G06T 7/80 (2017.01) [G06N 3/08 (2013.01); G06V 20/42 (2022.01); G06V 20/46 (2022.01); G06V 20/48 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A system for estimating one or more camera parameters, the system comprising:
one or more computer processors; and
memory storing computer-executable instructions that, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising:
(a) determining one or more semantic keypoints for an image in an image sequence;
(b) determining one or more person keypoints for the image;
(c) determining, for each of the one or more semantic keypoints for the image, a semantic keypoint location in a world coordinate system of a particular environment depicted in the image sequence;
(d) generating a first estimated homography using the one or more semantic keypoints for the image and the semantic keypoint locations in the world coordinate system;
(e) determining, for each of the one or more person keypoints for the image, a person keypoint location in the world coordinate system of the particular environment;
(f) generating a second estimated homography using the one or more semantic keypoints for the image, the semantic keypoint location for each of the one or more semantic keypoints for the image, the one or more person keypoints for the image, and the person keypoint location for each of the one or more person keypoints for the image;
(g) determining a final estimated homography based at least in part on the second estimated homography;
(h) determining one or more intrinsic parameter estimates based at least in part on the final estimated homography; and
(i) determining one or more extrinsic parameter estimates based at least in part on the final estimated homography.