US 12,423,558 B2
Neural network chip for ear-worn device
Andrew Casper, Inver Grove Heights, MN (US); Matthew de Jonge, Brooklyn, NY (US); Igor Lovchinsky, New York, NY (US); Nicholas Morris, Brooklyn, NY (US); and Jonathan Macoskey, Pittsburgh, PA (US)
Assigned to Chromatic Inc., New York, NY (US)
Filed by Chromatic Inc., New York, NY (US)
Filed on May 16, 2024, as Appl. No. 18/665,843.
Application 18/665,843 is a continuation of application No. 18/411,730, filed on Jan. 12, 2024, granted, now 11,995,531.
Application 18/411,730 is a continuation of application No. 18/232,854, filed on Aug. 11, 2023, granted, now 11,886,974, issued on Jan. 30, 2024.
Claims priority of provisional application 63/514,641, filed on Jul. 20, 2023.
Prior Publication US 2025/0028930 A1, Jan. 23, 2025
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 7/544 (2006.01); G06F 9/50 (2006.01); G06N 3/044 (2023.01); H04R 25/00 (2006.01)
CPC G06N 3/044 (2023.01) [G06F 7/5443 (2013.01); G06F 9/5016 (2013.01); H04R 25/507 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An ear-worn device, comprising:
a neural network chip, comprising:
a plurality of tiles arranged in a tile array, each tile comprising memory, a number of multiplier-accumulator circuits (MACs), and routing circuitry;
wherein:
the memory of each tile is configured to store a portion of elements of a matrix A comprising weights of a neural network;
each tile is configured to receive and store elements of an activation vector X, wherein the activation vector X is derived from an input audio signal;
all or a subset of the plurality of tiles are configured to perform a matrix-vector multiplication A*X by performing multiply-and-accumulate sub-operations in parallel among all or the subset of the plurality of tiles;
routing circuitries of tiles in the tile array are configured to combine results of the multiply-and-accumulate sub-operations; and
a tile of the plurality of tiles is configured to share an element of the activation vector X across calculations performed by multiple MACs in the tile.