US 12,437,211 B2
System and method for predicting fine-grained adversarial multi-agent motion
Panna Felsen, Chicago, IL (US); Sujoy Ganguly, Chicago, IL (US); and Patrick Lucey, Chicago, IL (US)
Assigned to STATS LLC, Chicago, IL (US)
Filed by STATS LLC, Chicago, IL (US)
Filed on May 5, 2023, as Appl. No. 18/313,050.
Application 18/313,050 is a continuation of application No. 16/254,037, filed on Jan. 22, 2019, granted, now 11,645,546.
Claims priority of provisional application 62/619,891, filed on Jan. 21, 2018.
Prior Publication US 2023/0274159 A1, Aug. 31, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06N 5/02 (2023.01); G06N 5/04 (2023.01); G06N 20/00 (2019.01)
CPC G06N 5/02 (2013.01) [G06N 5/04 (2013.01); G06N 20/00 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method of predicting multi-player locations, comprising:
receiving, by a computing system, tracking data from a tracking system positioned remotely in a venue hosting a sporting event, the tracking data comprising coordinate data for a plurality of sequences of movements for a first plurality of players and a second plurality of players on a playing surface during the sporting event;
accessing, by the computing system, identity information for each player of the first plurality of players and the second plurality of players, the identity information comprising at least one of a player name, a player team, or a player position;
pre-processing, by the computing system, the tracking data to generate aligned tracking data by aligning at least one path of each of the first plurality of players to reduce a number of tracking data permutations;
modifying, by the computing system, an autoencoder based on the aligned tracking data, the autoencoder including at least a first encoder model, a second encoder model, and a third encoder model, wherein the first encoder model is configurable to at least encode historical tracking data of the first plurality of players, wherein the second encoder model is configurable to encode future tracking data of a second plurality of players, wherein the third encoder is configurable to encode the identity information for each of the first plurality of players, wherein the first encoder model and the second encoder model of the autoencoder are modified using the aligned tracking data by encoding the aligned tracking data as an input to the autoencoder and modifying one or more weights of the first encoder model and the second encoder model to reduce an error between an output of the autoencoder and the aligned tracking data;
projecting, via the modified autoencoder of the computing system, a future location of each player of the first plurality of players based on an output of the first, second, and third encoder models, each player's sequence of movements, the aligned tracking data, and the second plurality of players co-located with the first plurality of players on the playing surface;
generating, by the computing system, a graphical representation of the future location of each player on the playing surface based on an output of the modified autoencoder; and
displaying, on a display device, the graphical representation as an overlay on a visual representation of the playing surface, wherein the overlay includes predicted trajectories of the players based on the output of the modified autoencoder.