US 12,133,712 B2
Systems, methods, and media for selectively presenting images captured by confocal laser endomicroscopy
Mohammadhassan Izadyyazdanabadi, Tempe, AZ (US); Mark C. Preul, Scottsdale, AZ (US); and Evgenii Belykh, Phoenix, AZ (US)
Assigned to DIGNITY HEALTH, San Francisco, CA (US)
Filed by DIGNITY HEALTH, San Francisco, CA (US)
Filed on Mar. 20, 2023, as Appl. No. 18/123,760.
Application 18/123,760 is a continuation of application No. 16/485,701, granted, now 11,633,256, previously published as PCT/US2018/018240, filed on Feb. 14, 2018.
Claims priority of provisional application 62/458,886, filed on Feb. 14, 2017.
Prior Publication US 2023/0218172 A1, Jul. 13, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. A61B 5/00 (2006.01); A61B 90/00 (2016.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06T 7/00 (2017.01); G06V 10/44 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/69 (2022.01); G16H 30/20 (2018.01); G16H 30/40 (2018.01); G16H 50/20 (2018.01)
CPC A61B 5/0068 (2013.01) [A61B 5/7267 (2013.01); A61B 90/361 (2016.02); A61B 90/37 (2016.02); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 7/0012 (2013.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/693 (2022.01); G06V 20/698 (2022.01); G16H 30/20 (2018.01); G16H 30/40 (2018.01); G16H 50/20 (2018.01); A61B 2090/373 (2016.02); G06T 2207/20084 (2013.01); G06T 2207/30016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for selectively presenting images captured by a confocal laser endomicroscopy (CLE) device, comprising:
receiving a first plurality of images captured by a CLE device during brain surgery;
providing each of the first plurality of images to a convolutional neural network (CNN) trained using at least a second plurality of images, wherein each of the second plurality of images is an image of brain tissue that was captured using CLE techniques and is labeled as either a diagnostic image or a non-diagnostic image, wherein images labeled as diagnostic provide at least a threshold level of identifiable histological features and images labeled as non-diagnostic do not provide the threshold level of identifiable histological features;
identifying, based on outputs of the CNN, a first subset of the first plurality of images as non-diagnostic images; and
identifying, based on outputs of the CNN, a second subset of the first plurality of images as diagnostic images.