US 11,935,247 B2
System and method for calibrating moving cameras capturing broadcast video
Long Sha, Chicago, IL (US); Sujoy Ganguly, Chicago, IL (US); Xinyu Wei, Melbourne (AU); Patrick Joseph Lucey, Chicago, IL (US); and Aditya Cherukumudi, London (GB)
Assigned to STATS LLC, Chicago, IL (US)
Filed by STATS LLC, Chicago, IL (US)
Filed on Feb. 27, 2023, as Appl. No. 18/175,278.
Application 18/175,278 is a continuation of application No. 16/805,157, filed on Feb. 28, 2020, granted, now 11,593,581.
Claims priority of provisional application 62/811,889, filed on Feb. 28, 2019.
Prior Publication US 2023/0206465 A1, Jun. 29, 2023
Int. Cl. G06T 7/20 (2017.01); G06F 18/2135 (2023.01); G06F 18/214 (2023.01); G06F 18/22 (2023.01); G06F 18/232 (2023.01); G06F 18/2413 (2023.01); G06N 3/08 (2023.01); G06T 7/00 (2017.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 7/80 (2017.01); G06V 10/44 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); G06V 40/20 (2022.01); H04N 21/44 (2011.01)
CPC G06T 7/20 (2013.01) [G06F 18/2135 (2023.01); G06F 18/214 (2023.01); G06F 18/22 (2023.01); G06F 18/232 (2023.01); G06F 18/2413 (2023.01); G06N 3/08 (2013.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 7/80 (2017.01); G06T 7/97 (2017.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/42 (2022.01); G06V 20/46 (2022.01); G06V 20/48 (2022.01); G06V 20/49 (2022.01); G06V 40/20 (2022.01); H04N 21/44008 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30221 (2013.01); G06T 2207/30244 (2013.01); G06V 20/44 (2022.01)] 17 Claims
OG exemplary drawing
 
1. A method of calibrating a moving camera capturing a sporting event, comprising:
identifying, by a computing system, a live broadcast video feed for a sporting event, the live broadcast video feed comprising a plurality of video frames captured by a camera located in a sporting venue;
receiving, by the computing system, pose data for one or more players;
removing, by the computing system, the one or more players from the plurality of video frames based on the pose data to generate a plurality of empty video frames;
analyzing, by the computing system, the plurality of empty video frames to identify a flow field between successive video frames of the plurality of empty video frames;
generating, by the computing system, a homography matrix for each empty video frame based on the flow field between the successive video frames; and
calibrating, by the computing system over a network, the camera based on the homography matrix generated for each empty video frame of the plurality of empty video frames by applying each homography matrix to a corresponding video frame of the plurality of video frames.