US 11,694,088 B2
Method for object detection using knowledge distillation
Igal Raichelgauz, Tel Aviv (IL); and Eli Passov, Hod Hasharon (IL)
Assigned to CORTICA LTD., Tel Aviv (IL)
Filed by Cortica Ltd., Tel Aviv (IL)
Filed on Feb. 5, 2020, as Appl. No. 16/782,087.
Claims priority of provisional application 62/817,766, filed on Mar. 13, 2019.
Prior Publication US 2020/0293903 A1, Sep. 17, 2020
Int. Cl. G06N 3/08 (2023.01); G06N 3/088 (2023.01); G06N 3/045 (2023.01); G06N 3/048 (2023.01)
CPC G06N 3/088 (2013.01) [G06N 3/045 (2023.01); G06N 3/048 (2023.01)] 16 Claims
OG exemplary drawing
 
1. A method for object detection, the method comprises:
calculating, by a teacher object detection neural network (ODNN), weights to be applied during a calculation of a weighted sum;
training a student object detection neural network (ODNN) to mimic a teacher ODNN;
wherein the training comprises calculating a teacher student detection loss that is based on a pre-bounding-box output of the teacher ODNN that is a weighted sum of pre-bounding-box outputs of different ODNNs that belong to the teacher ODNN; and
detecting one or more objects in an image; wherein the detecting comprises:
feeding the image to the trained student ODNN;
outputting by the trained student ODNN a student pre-bounding-box output; and
calculating one or more bounding boxes based on the student pre-bounding-box output.