US 12,228,722 B2
Microscopy system and method for modifying microscope images in the feature space of a generative network
Manuel Amthor, Jena (DE); and Daniel Haase, Zoellnitz (DE)
Assigned to Carl Zeiss Microscopy GmbH, Jena (DE)
Filed by Carl Zeiss Microscopy GmbH, Jena (DE)
Filed on Dec. 16, 2022, as Appl. No. 18/083,182.
Claims priority of application No. 10 2021 133 868.9 (DE), filed on Dec. 20, 2021.
Prior Publication US 2023/0194847 A1, Jun. 22, 2023
Int. Cl. G02B 21/36 (2006.01); G06T 7/00 (2017.01)
CPC G02B 21/367 (2013.01) [G06T 7/0012 (2013.01); G06T 2207/10056 (2013.01); G06T 2207/20076 (2013.01); G06T 2207/20081 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for modifying microscope images, comprising:
training a generative model using a training dataset which comprises a plurality of microscope images, wherein after the training the generative model is configured to calculate a generated microscope image from a feature vector derived from a feature space;
establishing which image properties are affected by which feature variables in the feature space;
receiving a microscope image to be modified;
projecting the microscope image to be modified into the feature space in order to obtain an associated feature vector;
generating a modified feature vector by modifying one or more feature variables of the feature vector in order to change one or more image properties; and
generating a modified microscope image from projecting the modified feature vector back into an image space by inputting the modified feature vector into the generative model.