US 12,217,418 B2
Method and system for machine learning classification based on structure or material segmentation in an image
Yu Peng, Melbourne (AU)
Assigned to CURVEBEAM AI LIMITED, Melbourne (AU)
Filed by StraxCorp Pty. Ltd., Melbourne (AU)
Filed on Jan. 26, 2022, as Appl. No. 17/584,752.
Application 17/584,752 is a continuation of application No. 16/448,474, filed on Jun. 21, 2019, granted, now 11,263,497.
Prior Publication US 2022/0147757 A1, May 12, 2022
Int. Cl. G06T 7/00 (2017.01); A61B 5/00 (2006.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06F 18/2431 (2023.01); G06T 7/11 (2017.01); G06F 18/2411 (2023.01); G06F 18/243 (2023.01)
CPC G06T 7/0012 (2013.01) [A61B 5/4509 (2013.01); A61B 5/4842 (2013.01); A61B 5/7267 (2013.01); A61B 5/7275 (2013.01); G06F 18/2148 (2023.01); G06F 18/217 (2023.01); G06F 18/2431 (2023.01); G06T 7/11 (2017.01); G06F 18/2411 (2023.01); G06F 18/24323 (2023.01); G06T 2207/20076 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30008 (2013.01); G06T 2207/30096 (2013.01); G06V 2201/03 (2022.01)] 11 Claims
OG exemplary drawing
 
1. A system for classifying a structure or material in an image of a subject, comprising:
a segmenter configured to segment an image into one or more segmentations that correspond to respective structures or materials in the image, and to generate from the segmentations one or more segmentation maps of the image including categorizations of pixels or voxels of the segmentation maps assigned from one or more respective predefined sets of categories;
a classifier that implements a trained classification machine learning model configured to generate, based on the segmentations maps, one or more classifications and to assign to the classifications respective scores indicative of a likelihood that the structure or material, or the subject, falls into the respective classifications; and
an output for outputting a result indicative of the classifications and scores;
wherein the segmenter comprises:
a structure segmenter configured to generate structure segmentation maps including categorizations of the pixels or voxels assigned from a predefined set of structure categories and to employ a structure segmentation machine learning model to generate the structure segmentation maps,
a material segmenter configured to generate material segmentation maps including categorizations of the pixels or voxels assigned from a predefined set of material categories and to employ a material segmentation machine learning model to generate the material segmentation maps, and/or
an abnormality segmenter configured to generate abnormality segmentation maps including categorizations of the pixels or voxels assigned from a predefined set of abnormality or normality categories and to employ an abnormality segmentation model to generate the abnormality segmentation maps.