US 11,947,593 B2
Sound categorization system
Arindam Jati, Los Angeles, CA (US); Naveen Kumar, San Mateo, CA (US); and Ruxin Chen, Foster City, CA (US)
Assigned to SONY INTERACTIVE ENTERTAINMENT INC.
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Sep. 28, 2018, as Appl. No. 16/147,331.
Prior Publication US 2020/0104319 A1, Apr. 2, 2020
Int. Cl. G06F 16/65 (2019.01); G06F 16/632 (2019.01); G06N 3/08 (2023.01)
CPC G06F 16/65 (2019.01) [G06F 16/634 (2019.01); G06N 3/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for hierarchical categorization of sound comprising:
one or more processors;
one or more neural networks implemented on the one or more processors configured to categorize a sound into a two or more tiered hierarchical coarse categorization and a finest level categorization in the hierarchy, wherein the one or more neural networks are trained with a combination of a metric learning function and a cross-entropy loss function learning wherein a loss of the metric learning function and a loss of the cross-entropy loss function are added together; and
one or more haptic feedback devices, wherein a first haptic event for the one or more haptic feedback devices is determined by a coarse categorization in the hierarchical categorization of a sound, and wherein a second haptic event for the one or more haptic feedback devices is determined by a fine categorization in the hierarchy of the sound.