US 12,327,399 B2
Co-training framework to mutually improve concept extraction from clinical notes and medical image classification
Ashequl Qadir, Melrose, MA (US); Kathy Mi Young Lee, Westford, MA (US); Claire Yunzhu Zhao, Boston, MA (US); and Minnan Xu, Cambridge, MA (US)
Assigned to KONINKLIJKE PHILIPS N.V., Eindhoven (NL)
Appl. No. 17/781,081
Filed by KONINKLIJKE PHILIPS N.V., Eindhoven (NL)
PCT Filed Dec. 16, 2020, PCT No. PCT/EP2020/086320
§ 371(c)(1), (2) Date May 31, 2022,
PCT Pub. No. WO2021/122670, PCT Pub. Date Jun. 24, 2021.
Claims priority of provisional application 62/949,836, filed on Dec. 18, 2019.
Prior Publication US 2023/0005252 A1, Jan. 5, 2023
Int. Cl. G06V 10/774 (2022.01); G06F 40/279 (2020.01); G06V 10/764 (2022.01); G06V 10/776 (2022.01); G06V 20/70 (2022.01); G16H 15/00 (2018.01); G16H 30/20 (2018.01)
CPC G06V 10/7753 (2022.01) [G06F 40/279 (2020.01); G06V 10/764 (2022.01); G06V 10/7747 (2022.01); G06V 10/776 (2022.01); G06V 20/70 (2022.01); G16H 15/00 (2018.01); G16H 30/20 (2018.01); G06V 2201/03 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A system for training a text report identification machine learning model and an image identification machine learning model, comprising:
a memory;
a processor connected to the memory, the processor configured to:
initially train a text report machine learning model, using a labeled set of text reports including text pre-processing the text report and extracting features from the pre-processed text report, wherein the extracted features are input into the text report machine learning model;
initially train an image machine learning model, using a labeled set of images;
apply the initially trained text report machine learning model to a first set of unlabeled text reports with associated images to label the associated images;
select a first portion of labeled associated images;
re-train the image machine learning model using the selected first portion of labeled associated images;
apply the initially trained image machine learning model to a first set of unlabeled images with associated text reports to label the associated text reports;
select a first portion of labeled associated text reports; and
re-train the text report machine learning model using the selected first portion of labeled associated text reports.