CPC G06N 3/08 (2013.01) [G06F 18/10 (2023.01); G06F 18/2415 (2023.01); G06N 3/04 (2013.01); G06N 3/084 (2013.01); G06V 10/70 (2022.01); G06V 10/82 (2022.01); G06T 2207/20081 (2013.01)] | 20 Claims |
1. A method performed by one or more computers, the method comprising:
receiving a neural network input; and
generating a neural network output for the neural network input by processing the neural network input using a neural network system, wherein:
the neural network system includes a sequence of neural network layers, wherein the sequence includes a third layer between a first neural network layer and a second neural network layer in the sequence of neural network layers of the neural network system,
the neural network system generates the neural network output from the neural network input by processing the neural network input through each of the layers in the sequence, and
the third layer is configured to:
receive a first layer output generated for the neural network input by the first neural network layer, the first layer output comprising a plurality of components;
normalize each component of the first layer output to generate a normalized output comprising a plurality of normalized components;
generate a transformed version of the normalized output by transforming each normalized component of the normalized output in accordance with a set of normalization parameters for the third layer; and
provide the transformed version of the normalized output as input to the second neural network layer.
|