US 12,217,491 B2
Method for inspecting labeling on bounding box by using deep learning model and apparatus using same
Se Yeob Kim, Seoul (KR)
Assigned to SELECT STAR, INC., Daejeon (KR)
Appl. No. 17/771,476
Filed by SELECT STAR, INC., Daejeon (KR)
PCT Filed Dec. 1, 2020, PCT No. PCT/KR2020/017350
§ 371(c)(1), (2) Date Apr. 24, 2022,
PCT Pub. No. WO2021/125619, PCT Pub. Date Jun. 24, 2021.
Claims priority of application No. 10-2019-0172044 (KR), filed on Dec. 20, 2019.
Prior Publication US 2022/0366677 A1, Nov. 17, 2022
Int. Cl. G06V 10/776 (2022.01); G06V 10/25 (2022.01); G06V 10/774 (2022.01); G06V 20/70 (2022.01)
CPC G06V 10/776 (2022.01) [G06V 10/25 (2022.01); G06V 10/774 (2022.01); G06V 20/70 (2022.01)] 7 Claims
OG exemplary drawing
 
1. A method for inspecting a labeling operation, in which a deep learning model for inspecting the labeling operation for a bounding box corresponding to an object included in an image is present, and a computing apparatus uses the deep learning model, the method comprising:
(a) performing, by the computing apparatus, first training on the deep learning model based on a training image;
(b) obtaining, by the computing apparatus, an operation image and a bounding box labeling value for the operation image;
(c) calculating, by the computing apparatus, an inspection score by performing calculation while passing the operation image and the bounding box labeling value through the deep learning model; and
(d) determining, by the computing apparatus, whether the bounding box labeling value for the operation image is accurate based on the inspection score, and performing any one of pass processing, fail processing, and re-inspection processing,
wherein, upon a first pair of threshold values provided where a first threshold value of the pair is greater than a second threshold value of the pair, the computing apparatus is configured to:
perform the pass processing on the operation image and the bounding box labeling value when the inspection score is greater than or equal to the first threshold value;
perform the re-inspection processing on the operation image and the bounding box labeling value when the inspection score is less than the first threshold and greater than or equal to the second threshold value; and
perform the fail processing on the operation image and the bounding box labeling value when the inspection score is less than the second threshold value; and
wherein, the computing apparatus determines who is qualified to perform the re-inspection processing according to various levels of the labeling operation difficulty by (1) arranging a second pair of threshold values within the first and second threshold values and (2) finding a location of the inspection score within a particular range of the threshold values of the first and second pairs, in which third and fourth threshold values of the second pair are less than the first threshold value and greater than the second threshold value, respectively, and the third threshold value is greater than the fourth threshold value.