US 12,190,585 B2
Data processing systems and methods for enhanced augmentation of interactive video content
Yu-Han Chang, South Pasadena, CA (US); Tracey Chui Ping Ho, South Pasadena, CA (US); and Rajiv Tharmeswaran Maheswaran, San Marino, CA (US)
Assigned to Genius Sports SS, LLC, Los Angeles, CA (US)
Filed by Genius Sports SS, LLC, Los Angeles, CA (US)
Filed on Nov. 16, 2023, as Appl. No. 18/511,906.
Application 18/511,906 is a continuation of application No. 17/399,570, filed on Aug. 11, 2021, granted, now 11,861,906.
Application 17/399,570 is a continuation of application No. 17/117,356, filed on Dec. 10, 2020, granted, now 11,120,271, issued on Sep. 14, 2021.
Application 17/117,356 is a continuation in part of application No. 17/006,962, filed on Aug. 31, 2020, granted, now 11,373,405, issued on Jun. 28, 2022.
Application 17/117,356 is a continuation in part of application No. 16/925,499, filed on Jul. 10, 2020, granted, now 11,380,101.
Application 17/006,962 is a continuation of application No. 16/795,834, filed on Feb. 20, 2020, granted, now 10,769,446, issued on Sep. 8, 2020.
Application 16/795,834 is a continuation in part of application No. 16/675,799, filed on Nov. 6, 2019, granted, now 10,713,494, issued on Jul. 14, 2020.
Application 16/925,499 is a continuation of application No. 16/675,799, filed on Nov. 6, 2019, granted, now 10,713,494, issued on Jul. 14, 2020.
Application 17/117,356 is a continuation in part of application No. 16/351,213, filed on Mar. 12, 2019, granted, now 10,748,008, issued on Aug. 18, 2020.
Application 16/351,213 is a continuation of application No. 16/229,457, filed on Dec. 21, 2018, granted, now 10,460,177, issued on Oct. 29, 2019.
Application 16/229,457 is a continuation in part of application No. PCT/US2017/051768, filed on Sep. 15, 2017.
Application 16/229,457 is a continuation in part of application No. 15/586,379, filed on May 4, 2017, granted, now 10,521,671, issued on Dec. 31, 2019.
Application PCT/US2017/051768 is a continuation in part of application No. 14/634,070, filed on Feb. 27, 2015, abandoned.
Claims priority of provisional application 62/947,915, filed on Dec. 13, 2019.
Claims priority of provisional application 62/808,243, filed on Feb. 20, 2019.
Claims priority of provisional application 62/806,397, filed on Feb. 15, 2019.
Claims priority of provisional application 62/646,012, filed on Mar. 21, 2018.
Claims priority of provisional application 62/395,886, filed on Sep. 16, 2016.
Claims priority of provisional application 62/072,308, filed on Oct. 29, 2014.
Claims priority of provisional application 61/945,899, filed on Feb. 28, 2014.
Prior Publication US 2024/0087317 A1, Mar. 14, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/40 (2022.01); A63F 13/60 (2014.01); G06F 3/01 (2006.01); G06N 20/00 (2019.01); G11B 27/031 (2006.01); G11B 27/28 (2006.01); H04N 5/222 (2006.01); H04N 13/204 (2018.01); H04N 21/2187 (2011.01); H04N 21/234 (2011.01); H04N 21/25 (2011.01); H04N 21/4223 (2011.01); H04N 21/434 (2011.01); H04N 21/44 (2011.01); H04N 21/45 (2011.01); H04N 21/466 (2011.01); H04N 21/8549 (2011.01); H04N 13/117 (2018.01); H04N 13/243 (2018.01)
CPC G06V 20/42 (2022.01) [A63F 13/60 (2014.09); G06F 3/012 (2013.01); G06F 3/013 (2013.01); G06N 20/00 (2019.01); G06V 20/46 (2022.01); G11B 27/031 (2013.01); G11B 27/28 (2013.01); H04N 5/2224 (2013.01); H04N 13/204 (2018.05); H04N 21/2187 (2013.01); H04N 21/23418 (2013.01); H04N 21/251 (2013.01); H04N 21/4223 (2013.01); H04N 21/4345 (2013.01); H04N 21/44008 (2013.01); H04N 21/4532 (2013.01); H04N 21/4662 (2013.01); H04N 21/8549 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30221 (2013.01); H04N 13/117 (2018.05); H04N 13/243 (2018.05)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented data processing method for generating augmented video content, the method comprising:
receiving, from at least one external server, by one or more computer processors, video data and spatiotemporal data corresponding to a sporting event, the video data being representative of a plurality of video frames;
determining, by the one or more computer processors, a semantic element in a video frame of the plurality of video frames;
determining, by the one or more computer processors, based at least in part on the spatiotemporal data, a semantic context for the semantic element;
determining, by the one or more computer processors, based at least in part on the semantic context and the semantic element, a plurality of augmentation options for the semantic element;
presenting, by the one or more computer processors, on a graphical interface, video content based on the video data, and a plurality of selectable user interface elements corresponding to the plurality of augmentation options for the semantic element;
detecting, by the one or more computer processors, a selection of one or more augmentation options for the semantic element, by a user, using the selectable user interface elements; and
presenting, by the one or more computer processors, on the graphical interface, augmented video content, which is based on the video data and the one or more user-selected augmentation options.