US 12,154,274 B2
Systems and methods for generating clinically relevant images that preserve physical attributes of humans while protecting personal identity
Stanislav Khirman, Jerusalem (IL); Uri Neeman, Tel-Aviv (IL); Alon Gat, Tel-Aviv (IL); David P. Rapaport, Tel-Aviv (IL); and Yoav Duek, Kochav Yair (IL)
Assigned to RealizeMD Ltd., Givatayim (IL)
Filed by RealizeMD Ltd., Givatayim (IL)
Filed on Dec. 28, 2023, as Appl. No. 18/398,238.
Application 18/398,238 is a division of application No. 18/135,283, filed on Apr. 17, 2023, granted, now 11,935,238.
Application 18/135,283 is a continuation in part of application No. 17/960,881, filed on Oct. 6, 2022, granted, now 11,631,208, issued on Apr. 18, 2023.
Claims priority of provisional application 63/292,507, filed on Dec. 22, 2021.
Prior Publication US 2024/0135534 A1, Apr. 25, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/00 (2017.01); G06T 5/50 (2006.01); G06T 7/11 (2017.01); G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 10/46 (2022.01); G06V 10/74 (2022.01)
CPC G06T 7/0012 (2013.01) [G06T 5/50 (2013.01); G06T 7/11 (2017.01); G06V 10/25 (2022.01); G06V 10/44 (2022.01); G06V 10/46 (2022.01); G06V 10/761 (2022.01); G06T 2207/20084 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30104 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer implemented method of generating at least one synthetic fundus image, comprising:
extracting and preserving at least one real fundus region from at least one real image of a real human fundus;
generating at least one synthetic fundus image comprising a synthetic human fundus and the preserved at least one real fundus region,
wherein an identity of the real human fundus is non-determinable from the at least one synthetic fundus image;
designating pairs of images, each pair including the one real image and the at least one synthetic fundus image;
feeding the at least one real image and the at least one synthetic fundus image into a machine learning model trained to recognize fundus regions to obtain an outcome of a similarity value denoting an amount of similarity between the at least one real image and the at least one synthetic fundus image, and
verifying that the at least one synthetic fundus image does not depict the real human fundus when the similarity value is below a threshold,
wherein a fully synthetic fundus image of the synthetic fundus used for generating the at least one synthetic fundus image is created by feeding input into a pre-trained latent-space based generative adversarial network (GAN) that converts the input into latent vectors within an intermediary latent space, and feeding the latent vectors into a second GAN trained to generate a photo-realistic synthetic image of a fundus according to the latent vectors.