US 12,406,511 B2
Determining scores indicative of times to events from biomedical images
Hassan Muhammad, New York, NY (US); and Chensu Xie, New York, NY (US)
Assigned to Memorial Sloan Kettering Cancer Center, New York, NY (US)
Filed by MEMORIAL SLOAN KETTERING CANCER CENTER, New York, NY (US)
Filed on Sep. 1, 2022, as Appl. No. 17/901,203.
Claims priority of provisional application 63/240,206, filed on Sep. 2, 2021.
Prior Publication US 2023/0077504 A1, Mar. 16, 2023
Int. Cl. G06K 9/00 (2022.01); G06V 10/764 (2022.01); G06V 20/69 (2022.01)
CPC G06V 20/698 (2022.01) [G06V 10/764 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of determining scores from biomedical images, comprising:
identifying, by a computing system, a plurality of tiles in a first biomedical image derived from a sample of a subject, each tile of the plurality of tiles corresponding to one or more features of the sample;
applying, by the computing system, the plurality of tiles to a machine learning (ML) model, the ML model comprising:
an encoder having a first plurality of weights to generate a plurality of feature vectors based on the plurality of tiles,
a clusterer having a plurality of centroids defined in a feature space to select a subset of feature vectors from the plurality of feature vectors, and
an aggregator having a second plurality of weights to combine the subset of feature vectors to determine a first score indicative of a time to an event for the subject resulting from the one or more features of the sample from which the first biomedical image is derived, and
wherein the model is trained in accordance with a loss derived from a second plurality of scores determined for a corresponding second plurality of biomedical images; and
storing, by the computing system, in one or more data structures, an association between the score and the first biomedical image.