US 12,431,245 B2
Attention-based multiple instance learning
Yao Nie, Sunnyvale, CA (US); Xiao Li, Foster City, CA (US); Trung Kien Nguyen, Chelsea, MI (US); Fabien Gaire, Starnberg (DE); Eldad Klaiman, Starnberg (DE); Ido Ben-Shaul, Ramat Hasharon (IL); Jacob Gildenblat, Holon (IL); and Ofir Etz Hadar, Hod Hasharon (IL)
Assigned to Genentech, Inc., South San Francisco, CA (US); Hoffmann-La Roche Inc., Little Falls, NJ (US); and Ventana Medical Systems, Inc., Tucson, AZ (US)
Filed by Genentech, Inc., South San Francisco, CA (US); Hoffmann-La Roche Inc., Little Falls, NJ (US); and Ventana Medical Systems, Inc., Tucson, AZ (US)
Filed on Apr. 26, 2023, as Appl. No. 18/139,873.
Application 18/139,873 is a continuation of application No. PCT/US2021/072166, filed on Nov. 1, 2021.
Claims priority of provisional application 63/108,659, filed on Nov. 2, 2020.
Prior Publication US 2024/0079138 A1, Mar. 7, 2024
Int. Cl. G16H 50/20 (2018.01); G06T 7/00 (2017.01); G16H 30/40 (2018.01); G06N 3/02 (2006.01)
CPC G16H 50/20 (2018.01) [G06T 7/0012 (2013.01); G16H 30/40 (2018.01); G06N 3/02 (2013.01); G06T 2207/20084 (2013.01)] 30 Claims
OG exemplary drawing
 
1. A computer-implemented method for using machine learning to process digital pathology images to predict disease progression, the method comprising:
accessing a digital pathology image that depicts a specimen stained with one or more stains, the specimen having been collected from a subject;
defining a set of patches for the digital pathology image, wherein each patch of the set of patches depicts a portion of the digital pathology image;
generating, for each patch of the set of patches and using an attention-score neural network, an attention score, wherein the attention-score neural network is trained using a loss function, the loss function penalizes attention-score variability across patches in training digital pathology images, the training digital pathology images labeled to indicate subsequent disease progression has occurred;
generating, using a result-prediction neural network and the attention scores, a result representing a prediction of whether or an extent to which a disease of the subject will progress; and
outputting the result.