US 12,230,239 B2
Mapping characteristics of music into a visual display
John Fargo Lathrop, Mountain View, CA (US); and Fred Jay Cummins, San Francisco, CA (US)
Assigned to New Resonance, LLC, Mountain View, CA (US)
Filed by New Resonance, LLC, Mountain View, CA (US)
Filed on Mar. 22, 2021, as Appl. No. 17/209,037.
Application 17/209,037 is a continuation of application No. 16/074,077, granted, now 10,978,033, previously published as PCT/US2017/016756, filed on Feb. 6, 2017.
Claims priority of provisional application 62/292,193, filed on Feb. 5, 2016.
Prior Publication US 2021/0295811 A1, Sep. 23, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G10H 1/36 (2006.01); G10G 1/02 (2006.01); G10H 1/00 (2006.01)
CPC G10H 1/368 (2013.01) [G10G 1/02 (2013.01); G10H 1/0008 (2013.01); G10H 2210/086 (2013.01); G10H 2220/005 (2013.01); G10H 2220/126 (2013.01); G10H 2250/235 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method of presenting a visualization of a piece of music, the method comprising:
(a) selecting a translation system, from a set of-more than one translation systems to generate a selected translation system, wherein each of the translation systems comprises,
a. a set of psychoacoustic cues, each psychoacoustic cue selected from a set of psychoacoustic cues, each psychoacoustic cue representing a distinct acoustic element of the piece of music specific to music perception, and
b. an assignment of each selected psychoacoustic cue to a different visual cue to provide a one-to-one correspondence between each selected psychoacoustic cue and each visual cue;
(b) extracting the selected psychoacoustic cues from the piece of music and translating, as a function of the selected translation system, the extracted psychoacoustic cues to corresponding visual cues;
(c) presenting the visualization of the piece of music on a display screen by causing display of the visual cues on the display screen as the piece of music is being played, so that one or more persons sees the corresponding visual cues time synchronized with the piece of music as they hear the piece of music; and
(d) adjusting the assignment of psychoacoustic cues to visual cues to account for the complexity of the piece of music and size and resolution of the display screen.