US 12,106,226 B2
System and method for knowledge distillation
Janghwan Lee, Pleasanton, CA (US)
Assigned to Samsung Display Co., Ltd., Yongin-si (KR)
Filed by Samsung Display Co., Ltd., Yongin-si (KR)
Filed on Jun. 7, 2023, as Appl. No. 18/207,005.
Application 18/207,005 is a continuation of application No. 16/682,815, filed on Nov. 13, 2019, granted, now 11,710,045.
Claims priority of provisional application 62/909,053, filed on Oct. 1, 2019.
Prior Publication US 2023/0316084 A1, Oct. 5, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06N 3/04 (2023.01); G06N 3/045 (2023.01); G06N 3/047 (2023.01); G06N 3/08 (2023.01); G06N 3/088 (2023.01)
CPC G06N 3/088 (2013.01) [G06N 3/045 (2023.01); G06N 3/047 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a processor, an input dataset;
generating, by the processor, at least first and second instances of a first classifier, wherein the first instance of the first classifier is initialized to a first state, and the second instance of the first classifier is initialized to a second state different from the first state;
training, by the processor, the first and second instances of the first classifier based on the input dataset;
training, by the processor, a second classifier based on the input dataset, wherein the second classifier is configured to learn a representation of the input dataset in a latent space;
invoking, by the processor, the second classifier for generating a first supplemental dataset in the latent space;
generating, by the processor, a first prediction for labeling the first supplemental dataset based on the first instance of the first classifier;
generating, by the processor, a second prediction for labeling the first supplemental dataset based on the second instance of the first classifier;
generating, by the processor, annotations for the first supplemental dataset based on the first prediction and the second prediction, and outputting an annotated first supplemental dataset; and
training, by the processor, a third classifier based on at least the input dataset and the annotated first supplemental dataset.