US 11,724,171 B2
Reducing human interactions in game annotation
Jorge Piazentin Ono, Brooklyn, NY (US); Arvi Gjoka, New York, NY (US); Justin Jonathan Salamon, San Francisco, CA (US); Carlos Augusto Dietrich, Porto Alegre (BR); and Claudio T Silva, New York, NY (US)
Assigned to New York University, New York, NY (US)
Filed by New York University, New York, NY (US)
Filed on May 1, 2020, as Appl. No. 16/865,230.
Claims priority of provisional application 62/843,279, filed on May 3, 2019.
Prior Publication US 2020/0346093 A1, Nov. 5, 2020
Int. Cl. G06V 20/40 (2022.01); A63B 71/06 (2006.01); A63B 102/18 (2015.01); G09B 19/00 (2006.01); H04N 21/845 (2011.01)
CPC A63B 71/06 (2013.01) [G06V 20/42 (2022.01); A63B 2071/0694 (2013.01); A63B 2102/18 (2015.10); G09B 19/0038 (2013.01); H04N 21/8456 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method for helping a user to annotate a play of a sporting game to provide data describing the play, the computer-implemented method comprising:
a) selecting, via a user input device, video and/or audio of a sequence of events of the play to be manually annotated by a user;
b) providing, for presentation in a user interface, at least one question about content of the sequence of events of the play;
c) receiving, by at least one processor, information describing at least one event of the sequence of events of the play as at least one answer from the user in response to the at least one question about the content of the sequence of events of the play;
d) retrieving, by at least one of the at least one processor, using the received information describing at least one event of the sequence of events of the play, a set of at least one candidate sequence of a previously annotated play of the sporting game that has data describing the previously annotated play that is similar to the received information describing the at least one event of the sequence of events of the play from a corpus dataset of previously annotated plays of the sporting game;
e) selecting, automatically by at least one of the at least one processor, one of the at least one candidate sequence of the previously annotated plays of the sporting game of the retrieved set as a representative play sequence;
f) populating, by at least one of the at least one processor, fields of a manual annotation user interface screen of the user interface for the sequence of events of the play with information based on the data describing the representative play sequence; and
g) annotating the sequence of events of the play using (i) the information based on the data describing the representative play sequence populating the fields of the manual annotation interface, and/or (ii) data manually input to edit the populated fields of the manual annotation interface.