US 11,900,260 B2
Methods, devices and media providing an integrated teacher-student system
Deepak Sridhar, Richmond Hill (CA); and Juwei Lu, North York (CA)
Assigned to HUAWEI TECHNOLOGIES CO., LTD., Shenzhen (CN)
Filed by Deepak Sridhar, Richmond Hill (CA); and Juwei Lu, North York (CA)
Filed on Mar. 5, 2020, as Appl. No. 16/810,524.
Prior Publication US 2021/0279595 A1, Sep. 9, 2021
Int. Cl. G06N 3/08 (2023.01); G06N 3/088 (2023.01); G06N 3/045 (2023.01)
CPC G06N 3/088 (2013.01) [G06N 3/045 (2023.01); G06N 3/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
operating a first teacher sub-network of a teacher neural network of an integrated system in an inference mode to generate a first intermediate feature map based on an input data received by the integrated system; and
operating a first student sub-network of the integrated system in the inference mode to generate student inference data based on the first intermediate feature map,
wherein:
the first student sub-network has been trained when operating in a training mode, using subsequent inference data provided as a supervision signal, the subsequent inference data being generated by a second student sub-network of the integrated system that is trained using teacher inference data generated by the teacher neural network.