US 12,266,176 B2
Data processing systems and methods for generating interactive user interfaces and interactive game systems based on spatiotemporal analysis of video content
Yu-Han Chang, South Pasadena, CA (US); Rajiv Tharmeswaran Maheswaran, San Marino, CA (US); and Jeffrey Wayne Su, South Pasadena, CA (US)
Assigned to Genius Sports SS, LLC, Los Angeles, CA (US)
Filed by Genius Sports SS, LLC, Los Angeles, CA (US)
Filed on Jul. 1, 2022, as Appl. No. 17/856,364.
Application 17/856,364 is a continuation of application No. 16/925,499, filed on Jul. 10, 2020, granted, now 11,380,101.
Application 16/925,499 is a continuation of application No. 16/675,799, filed on Nov. 6, 2019, granted, now 10,713,494, issued on Jul. 14, 2020.
Application 16/675,799 is a continuation in part of application No. 16/351,213, filed on Mar. 12, 2019, granted, now 10,748,008, issued on Aug. 18, 2020.
Application 16/351,213 is a continuation of application No. 16/229,457, filed on Dec. 21, 2018, granted, now 10,460,177, issued on Oct. 29, 2019.
Application 16/229,457 is a continuation in part of application No. PCT/US2017/051768, filed on Sep. 15, 2017.
Application PCT/US2017/051768 is a continuation of application No. 15/586,379, filed on May 4, 2017, granted, now 10,521,671, issued on Dec. 31, 2019.
Application 16/229,457 is a continuation in part of application No. 15/586,379, filed on May 4, 2017, granted, now 10,521,671, issued on Dec. 31, 2019.
Application 15/586,379 is a continuation in part of application No. 14/634,070, filed on Feb. 27, 2015, abandoned.
Claims priority of provisional application 62/808,243, filed on Feb. 20, 2019.
Claims priority of provisional application 62/806,397, filed on Feb. 15, 2019.
Claims priority of provisional application 62/646,012, filed on Mar. 21, 2018.
Claims priority of provisional application 62/532,744, filed on Jul. 14, 2017.
Claims priority of provisional application 62/395,886, filed on Sep. 16, 2016.
Claims priority of provisional application 62/072,308, filed on Oct. 29, 2014.
Claims priority of provisional application 61/945,899, filed on Feb. 28, 2014.
Prior Publication US 2022/0335720 A1, Oct. 20, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/40 (2022.01); A63F 13/60 (2014.01); G06F 3/01 (2006.01); G06N 20/00 (2019.01); G11B 27/031 (2006.01); G11B 27/28 (2006.01); H04N 5/222 (2006.01); H04N 13/204 (2018.01); H04N 21/2187 (2011.01); H04N 21/234 (2011.01); H04N 21/25 (2011.01); H04N 21/4223 (2011.01); H04N 21/434 (2011.01); H04N 21/44 (2011.01); H04N 21/45 (2011.01); H04N 21/466 (2011.01); H04N 21/8549 (2011.01); H04N 13/117 (2018.01); H04N 13/243 (2018.01)
CPC G06V 20/42 (2022.01) [A63F 13/60 (2014.09); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06N 20/00 (2019.01); G06V 20/46 (2022.01); G11B 27/031 (2013.01); G11B 27/28 (2013.01); H04N 5/2224 (2013.01); H04N 13/204 (2018.05); H04N 21/2187 (2013.01); H04N 21/23418 (2013.01); H04N 21/251 (2013.01); H04N 21/4223 (2013.01); H04N 21/4345 (2013.01); H04N 21/44008 (2013.01); H04N 21/4532 (2013.01); H04N 21/4662 (2013.01); H04N 21/8549 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30221 (2013.01); H04N 13/117 (2018.05); H04N 13/243 (2018.05)] 17 Claims
OG exemplary drawing
 
1. A method comprising:
determining, by one or more computer processors, spatiotemporal event data for a first participant in a live event, wherein the spatiotemporal event data comprises a spatiotemporal attribute for an action involving the first participant during a spatiotemporal event and a probability of success of the action involving the first participant during the spatiotemporal event;
retrieving, by the one or more computer processors, scoring criteria, wherein the scoring criteria comprises a point value associated with the action involving the first participant during the spatiotemporal event;
applying, by the one or more computer processors, the scoring criteria to the spatiotemporal event to determine a spatiotemporal event score for the first participant based at least in part on the spatiotemporal event data for the first participant, wherein applying the scoring criteria to the spatiotemporal event comprises modifying the point value based at least in part on the probability of success of the action to generate the spatiotemporal event score;
determining, by the one or more computer processors, a user score based at least in part on the spatiotemporal event score;
generating, by the one or more computer processors, a custom user interface to display the user score on a client device having a computing device display screen, wherein the custom user interface is displayed on the computing device display screen as the computing device display screen is displaying video of the live event such that the custom user interface overlays at least a portion of the video;
determining, by the one or more computer processors, second spatiotemporal event data for a second participant different from the first participant in the live event, wherein the second spatiotemporal event data comprises a second spatiotemporal attribute for a second action involving the second participant during a second spatiotemporal event and a second probability of success of the second action involving the second participant during the second spatiotemporal event;
retrieving, by the one or more computer processors, second scoring criteria, wherein the second scoring criteria comprises a second point value associated with the second action involving the second participant during the second spatiotemporal event;
applying, by the one or more computer processors, the second scoring criteria to the second spatiotemporal event to determine a second spatiotemporal event score for the second participant based at least in part on the second spatiotemporal event data for the second participant, wherein applying the second scoring criteria to the second spatiotemporal event comprises modifying the second point value based at least in part on the second probability of success of the second action to generate the second spatiotemporal event score;
revising, by the one or more computer processors, the user score based at least in part on the second spatiotemporal event score to generate an updated user score; and
updating, by the one or more computer processors, the custom user interface to display the updated user score on the client device.