US 12,329,458 B2
Control device, ophthalmic microscope system, ophthalmic microscope, and image processing apparatus
Junichiro Enoki, Tokyo (JP); Tomoyuki Ootsuki, Tokyo (JP); and Yoshio Soma, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/430,027
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Feb. 7, 2020, PCT No. PCT/JP2020/004902
§ 371(c)(1), (2) Date Aug. 11, 2021,
PCT Pub. No. WO2020/170866, PCT Pub. Date Aug. 27, 2020.
Claims priority of application No. 2019-028043 (JP), filed on Feb. 20, 2019.
Prior Publication US 2022/0115122 A1, Apr. 14, 2022
Int. Cl. A61B 3/14 (2006.01); A61B 3/13 (2006.01); A61B 90/20 (2016.01); A61F 9/007 (2006.01); G02B 21/00 (2006.01); G02B 21/02 (2006.01); G02B 21/06 (2006.01); G02B 21/36 (2006.01); G06T 3/60 (2006.01); G06T 7/00 (2017.01); G06T 7/70 (2017.01); G16H 20/40 (2018.01); G16H 30/40 (2018.01); G16H 40/63 (2018.01); H04N 7/18 (2006.01); H04N 13/239 (2018.01); H04N 23/56 (2023.01); H04N 23/69 (2023.01); H04N 23/698 (2023.01); A61B 17/34 (2006.01)
CPC A61B 3/13 (2013.01) [A61B 90/20 (2016.02); A61F 9/007 (2013.01); G02B 21/0004 (2013.01); G02B 21/02 (2013.01); G02B 21/06 (2013.01); G02B 21/361 (2013.01); G06T 3/60 (2013.01); G06T 7/0012 (2013.01); G06T 7/70 (2017.01); G16H 20/40 (2018.01); G16H 30/40 (2018.01); G16H 40/63 (2018.01); H04N 7/183 (2013.01); H04N 13/239 (2018.05); H04N 23/56 (2023.01); H04N 23/69 (2023.01); H04N 23/698 (2023.01); A61B 17/3423 (2013.01); G06T 2207/10056 (2013.01); G06T 2207/30041 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A control device, comprising:
a control unit configured to:
acquire, from an ophthalmic microscope, an image of an eye under examination, wherein the ophthalmic microscope includes:
an image pickup element that captures the image; and
a front lens that inverts a first region in the captured image;
determine, based on the acquired image, whether a tip of a surgical instrument is present one of inside a second region in the acquired image, or outside of the second region, wherein the front lens is present in the second region;
in a case where the tip of the surgical instrument is present outside of the second region, determine a first situation indicating that an insertion position of the surgical instrument is being set;
acquire, based on the determination of the first situation, a first setting information associated with the first situation;
in a case where the tip of the surgical instrument is present inside the second region, determine a second situation indicating that the surgical instrument is inside the eye under examination;
acquire, based on the determination of the second situation, a second setting information associated with the second situation; and
control, based on one of the first setting information or the second setting information, at least one of:
an imaging condition of the image pickup element, or
an inversion process that inverts the inverted first region in the acquired image.