US 11,836,292 B1
Automated musical-score-referenced evaluation of haptic-based rhythmic performance
Sunny Sungeun Choi, Auburn, AL (US); Meghan Michele Kane, New York, NY (US); and Frits van Laarhoven, Valkenswaard (NL)
Assigned to Music App Inc., Houston, TX (US)
Filed by Music App Inc., Houston, TX (US)
Filed on Sep. 29, 2022, as Appl. No. 17/955,949.
Int. Cl. G06F 3/00 (2006.01); G06F 3/01 (2006.01); G10H 1/00 (2006.01)
CPC G06F 3/016 (2013.01) [G10H 1/0008 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for haptic-based evaluation of musical-score-referenced rhythmic performance, the method comprising:
outputting, via an output device interface of a computational device, an audiovisual representation of real-time progress through a musical score at a tempo, the musical score including a musical notation representation of each of a sequence of score-notated rhythm (SNR) events, each SNR event having a stored logical definition that includes an associated SNR onset time and an associated SNR offset time;
obtaining, during the outputting, a plurality of haptic performance (HP) events corresponding to user interactions with a haptic device interface of the computational device representing rhythmic performance by the user of the musical score at the tempo, each HP event having an associated HP onset time and an associated HP offset time;
generating, by a rhythm evaluator subsystem in communication with the output device interface and the haptic device interface, evaluation data for the sequence of SNR events by:
obtaining, for each SNR event of the sequence of SNR events, associated evaluation criteria for the SNR event based on the associated SNR onset time and the associated SNR offset time; and
comparing the associated evaluation criteria for each SNR event with the associated HP onset time and the associated HP offset time of each of at least some of the plurality of HP events, the comparing identifying a plurality of matching events as those of the HP events each determined to temporally correspond to one of the sequence of SNR events, and evaluating a rhythmic compatibility between each of the plurality of matching events and the temporally corresponding one of the sequence of SNR events; and
displaying, via the output device interface, visual feedback to graphically map the evaluation data for the sequence of SNR events to the musical notation representations of the sequence of SNR events on the musical score.