US 12,130,418 B2
Microscope system
Tatsuo Nakata, Tokyo (JP); Hiroshi Sasaki, Tokyo (JP); and Tetsuya Shirota, Tokyo (JP)
Assigned to Evident Corporation, Nagano (JP)
Filed by Evident Corporation, Nagano (JP)
Filed on Mar. 9, 2021, as Appl. No. 17/196,705.
Application 17/196,705 is a continuation of application No. PCT/JP2018/047494, filed on Dec. 25, 2018.
Claims priority of application No. 2018-183761 (JP), filed on Sep. 28, 2018.
Prior Publication US 2021/0215923 A1, Jul. 15, 2021
Int. Cl. G02B 21/36 (2006.01); G02B 21/02 (2006.01); G02B 21/22 (2006.01)
CPC G02B 21/368 (2013.01) [G02B 21/025 (2013.01); G02B 21/22 (2013.01); G02B 21/364 (2013.01); G02B 21/365 (2013.01); G02B 21/367 (2013.01)] 27 Claims
OG exemplary drawing
 
1. A microscope system comprising:
an eyepiece;
an objective that guides light from a sample to the eyepiece;
a tube lens that is disposed on a light path between the eyepiece and the objective and that forms an optical image of the sample based on light therefrom;
an imaging apparatus comprising a photodetector, the photodetector detecting light from the sample and converting the light into an electric signal, and the imaging apparatus acquiring digital image data of the sample based on the electric signal;
a projection apparatus comprising a display device, the projection apparatus projecting a projection image onto an image plane between the tube lens and the eyepiece on which the optical image is formed; and
a control apparatus that manages microscope information including at least a first magnification at which an image of the sample is projected onto the image plane, a second magnification at which an image of the sample is projected onto the imaging apparatus, a third magnification at which an image of the projection apparatus is projected onto the image plane, a size of the imaging apparatus, and a size of the projection apparatus,
wherein the control apparatus includes a processor configured to execute processes including:
generating projection image data representing the projection image based on the basis of at least the microscope information; and
analyzing the digital image data acquired by the imaging apparatus,
wherein the analyzing the digital image data comprises:
classifying at least one structure present in a digital image represented by the digital image data into at least two classes; and
outputting an analysis result including information specifying class information and a position of the at least one structure classified in the classifying, and
wherein the generating the projection image data comprises, based on the microscope information and the analysis result, generating the projection image data so as to specify the position of the at least one structure in the optical image by using (i) a first relationship between a position of each pixel of the digital image and a position of an object plane, the object plane being a plane of the sample, and the first relationship being calculated based on the second magnification and the size of the imaging apparatus that are included in the microscope information, and (ii) a second relationship between a position of each pixel of the projection apparatus and the position of the object plane, the second relationship being calculated from the first and third magnifications and the size of the projection apparatus that are included in the microscope information.