US 11,935,152 B2
Determining biomarkers from histopathology slide images
Stephen Yip, Chicago, IL (US); Irvin Ho, Wilmette, IL (US); Lingdao Sha, Chicago, IL (US); Boleslaw Osinski, Chicago, IL (US); Aly Azeem Khan, Chicago, IL (US); Andrew J. Kruger, Chicago, IL (US); Michael Carlson, Chicago, IL (US); Abel Greenwald, Chicago, IL (US); and Caleb Willis, Chicago, IL (US)
Assigned to TEMPUS LABS, INC., Chicago, IL (US)
Filed by TEMPUS LABS, INC., Chicago, IL (US)
Filed on Mar. 20, 2023, as Appl. No. 18/123,959.
Application 18/123,959 is a continuation of application No. 17/231,891, filed on Apr. 15, 2021, granted, now 11,682,098.
Application 17/231,891 is a continuation of application No. 17/192,383, filed on Mar. 4, 2021, granted, now 11,610,307.
Application 17/192,383 is a continuation of application No. 16/830,186.
Application 16/830,186 is a continuation in part of application No. 16/732,242, filed on Dec. 31, 2019, granted, now 10,991,097, issued on Apr. 27, 2021.
Application 16/732,242 is a continuation in part of application No. 16/412,362, filed on May 14, 2019, granted, now 11,741,365.
Claims priority of provisional application 62/983,524, filed on Feb. 28, 2020.
Claims priority of provisional application 62/787,047, filed on Dec. 31, 2018.
Claims priority of provisional application 62/889,521, filed on Aug. 20, 2019.
Claims priority of provisional application 62/824,039, filed on Mar. 26, 2019.
Claims priority of provisional application 62/671,300, filed on May 14, 2018.
Prior Publication US 2023/0230195 A1, Jul. 20, 2023
Int. Cl. G06T 1/20 (2006.01); G06F 18/21 (2023.01); G06F 18/2431 (2023.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 11/00 (2006.01); G06V 10/44 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01)
CPC G06T 1/20 (2013.01) [G06F 18/21 (2023.01); G06F 18/2431 (2023.01); G06T 7/0012 (2013.01); G06T 7/11 (2017.01); G06T 11/00 (2013.01); G06V 10/44 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06T 2207/20081 (2013.01); G06T 2207/30024 (2013.01); G06T 2207/30096 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computing system for identifying biomarkers in a digital image of a Hematoxylin and Eosin-stained slide of a target tissue, comprising:
one or more processors;
an electronic network; and
one or more memories having stored thereon computer-executable instructions that, when executed by the one or more processors, cause the computing system to:
process a plurality of segmented tile images each corresponding to a different respective portion of the digital image using a deep learning framework by:
(i) predicting a respective biomarker classification for each tile image using one or more trained biomarker classification models; and
(ii) predicting a respective tissue classification for each tile image using one or more trained deep learning classifier models;
determine, based on (i) and (ii), a predicted presence of one or more biomarkers in the target tissue;
transmit, via the electronic network, the predicted presence of the one or more biomarkers;
receive a molecular training dataset for a plurality of training tissue samples, the molecular training dataset comprising molecular data based on sequencing of a substantially similar sample associated with each training tissue sample; and
identify one or more molecular data subsets in the molecular training dataset, each corresponding to a different respective biomarker, by processing the molecular training dataset using a clustering algorithm.