US 11,994,664 B2
Augmented reality laser capture microdissection machine
Jason Hipp, Mountain View, CA (US); and Martin Stumpe, Mountain View, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Appl. No. 17/295,353
Filed by GOOGLE LLC, Mountain View, CA (US)
PCT Filed Oct. 31, 2019, PCT No. PCT/US2019/059215
§ 371(c)(1), (2) Date May 19, 2021,
PCT Pub. No. WO2020/146037, PCT Pub. Date Jul. 16, 2020.
Claims priority of provisional application 62/790,221, filed on Jan. 9, 2019.
Prior Publication US 2022/0019069 A1, Jan. 20, 2022
Int. Cl. G02B 21/32 (2006.01); G02B 21/36 (2006.01); G06F 3/16 (2006.01); G06N 20/00 (2019.01)
CPC G02B 21/32 (2013.01) [G02B 21/365 (2013.01); G06F 3/167 (2013.01); G06N 20/00 (2019.01)] 15 Claims
OG exemplary drawing
 
1. An augmented reality laser capture microdissection machine for capturing cells of interest from a sample, comprising, in combination;
a) a microscope having an eyepiece and a camera configured to capture images of a field of view of the microscope as seen through the eyepiece;
b) an augmented reality subsystem configured to receive the images from the camera, the subsystem including a machine learning model stored on a non-transitory machine readable medium identifying cells of potential interest in the images and a optics module projecting into a view of the microscope as seen through the eyepiece an outline of cells of potential interest identified by the machine learning model;
c) a laser capture and microdissection subsystem configured for excising the cells of interest from the sample with one or more lasers and placing such cells of interest on a suitable medium; and
d) an operator-activated input mechanism configured to provide input to the laser capture and microdissection subsystem whereby operator activation of the input mechanism while viewing the specimen and the outline of cells identified by the machine leaning model at the eyepiece invokes the laser capture and microdissection subsystem so as to excise the cells of interest from the sample within the outline and place them on the medium.