US 11,915,422 B2
Techniques for determining tissue characteristics using multiplexed immunofluorescence imaging
Viktor Svekolkin, Ulyanovsk (RU); Ilia Galkin, Moscow (RU); Ekaterina Postovalova, Moscow (RU); Ravshan Ataullakhanov, Moscow (RU); Alexander Bagaev, Moscow (RU); Arina Varlamova, Moscow (RU); and Pavel Ovcharov, Moscow (RU)
Assigned to BostonGene Corporation, Waltham, MA (US)
Filed by BostonGene Corporation, Waltham, MA (US)
Filed on Dec. 27, 2021, as Appl. No. 17/562,656.
Application 17/562,656 is a continuation of application No. 17/194,235, filed on Mar. 6, 2021, granted, now 11,250,568.
Claims priority of provisional application 62/986,010, filed on Mar. 6, 2020.
Prior Publication US 2022/0122252 A1, Apr. 21, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/00 (2017.01); G06T 7/194 (2017.01); G06T 7/174 (2017.01); G06V 20/69 (2022.01); G06F 18/2431 (2023.01); G06V 10/74 (2022.01); G06V 10/762 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/44 (2022.01)
CPC G06T 7/0012 (2013.01) [G06F 18/2431 (2023.01); G06T 7/174 (2017.01); G06T 7/194 (2017.01); G06V 10/454 (2022.01); G06V 10/761 (2022.01); G06V 10/764 (2022.01); G06V 10/7635 (2022.01); G06V 10/82 (2022.01); G06V 20/695 (2022.01); G06V 20/698 (2022.01); G06T 2207/10064 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30024 (2013.01)] 31 Claims
OG exemplary drawing
 
1. A method, comprising:
using at least one computer hardware processor to perform:
obtaining at least one multiplexed immunofluorescence (MxIF) image of a tissue sample, wherein the at least one MxIF image comprises a plurality of channels that are associated with respective markers in a plurality of markers;
obtaining, using a machine learning technique, information indicative of locations of cells in the at least one MxIF image;
identifying multiple groups of cells in the at least one MxIF image at least in part by:
identifying pixel values for at least some of the cells using the at least one MxIF image and the information indicative of locations of cells;
determining, using a neural network, marker expression signatures for the at least some of the cells at least in part by using the identified pixel values, wherein each marker expression signature for a particular cell includes, for each particular marker of one or more of the plurality of markers, a respective likelihood output by the neural network that the particular marker is expressed in the particular cell; and
grouping the at least some of the cells into the multiple groups using the marker expression signatures, the grouping performed by using the respective likelihood output by the neural network for each particular marker of the one or more of the plurality of markers; and
determining at least one characteristic of the tissue sample using the multiple groups.