US 12,394,187 B2
Synthesis of medical images of brain tumors using 3D-2D GANs
Gengyan Zhao, Plainsboro, NJ (US); Youngjin Yoo, Princeton, NJ (US); Thomas Re, New York, NY (US); Eli Gibson, Plainsboro, NJ (US); and Dorin Comaniciu, Princeton, NJ (US)
Assigned to Siemens Medical Solutions USA, Inc., Malvern, PA (US)
Filed by Siemens Medical Solutions USA, Inc., Malvern, PA (US)
Filed on Jan. 30, 2023, as Appl. No. 18/161,186.
Claims priority of provisional application 63/373,122, filed on Aug. 22, 2022.
Prior Publication US 2024/0062523 A1, Feb. 22, 2024
Int. Cl. G06V 10/774 (2022.01); G06T 5/50 (2006.01); G06T 5/70 (2024.01); G06T 7/00 (2017.01); G06V 10/764 (2022.01); G16H 30/40 (2018.01); G16H 50/50 (2018.01)
CPC G06V 10/774 (2022.01) [G06T 5/50 (2013.01); G06T 5/70 (2024.01); G06T 7/0012 (2013.01); G06V 10/764 (2022.01); G16H 30/40 (2018.01); G16H 50/50 (2018.01); G06T 2200/04 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20212 (2013.01); G06T 2207/30016 (2013.01); G06T 2207/30096 (2013.01); G06V 2201/03 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving 1) a 3D mask of an anatomical structure generated from a 3D medical image and 2) a 3D image of a plurality of concentric spheres;
generating a 3D mask of a tumor based on the 3D mask of the anatomical structure and the 3D image of the plurality of concentric spheres using a first 3D generator network;
generating a 3D intensity map of the tumor based on the 3D mask of the tumor and the 3D image of the plurality of concentric spheres using a second 3D generator network;
generating a 3D synthesized medical image of the tumor based on one or more 2D slices of the 3D intensity map of the tumor and one or more 2D slices of the 3D medical image using a 2D generator network; and
outputting the 3D synthesized medical image of the tumor.