US 12,262,866 B2
Visualization system comprising an observation apparatus and an endoscope
Christian Voigt, Abtsgmuend (DE); Stefan Saur, Aalen (DE); Christoph Hauger, Aalen (DE); Martin Fanenbruck, Oberkochen (DE); Helge Jess, Oberkochen (DE); and Roland Guckler, Ulm (DE)
Assigned to Carl Zeiss Meditec AG, Jena (DE)
Filed by Carl Zeiss Meditec AG, Jena (DE)
Filed on Oct. 22, 2021, as Appl. No. 17/508,865.
Application 17/508,865 is a continuation in part of application No. 16/139,032, filed on Sep. 22, 2018, abandoned.
Claims priority of application No. 10 2017 216 853.6 (DE), filed on Sep. 22, 2017; and application No. 10 2017 219 621.1 (DE), filed on Nov. 6, 2017.
Prior Publication US 2022/0079415 A1, Mar. 17, 2022
Int. Cl. A61B 1/00 (2006.01); G06T 7/00 (2017.01); G06T 7/30 (2017.01)
CPC A61B 1/0005 (2013.01) [A61B 1/00006 (2013.01); A61B 1/00183 (2013.01); G06T 7/0012 (2013.01); G06T 7/30 (2017.01); G06T 2207/10068 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30004 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A visualization system for operating an optical inspection tool, the visualization system comprising:
an observation apparatus having a first image recording device configured to observe an operation region at a first observation plane having a first observation plane axis and a second observation plane axis and defining a first viewing axis which is perpendicular to the first observation plane axis and the second observation plane axis;
the optical inspection tool having a second image recording device configured to observe the operation region at a second observation plane having a third observation plane axis and a fourth observation plane axis and defining a second viewing axis which is perpendicular to the third observation plane axis and the fourth observation plane axis;
a display device configured to represent at least one of a first image recorded by the first image recording device and a second image recorded by the second image recording device;
a tracking system including a target detection device and at least one target and being configured to determine an orientation of the optical inspection tool relative to the observation apparatus;
a controller including a memory and a processor in communication with the display device, the first image recording device, the second image recording device, the tracking system, and the memory; and
the processor being configured to transform the second image based on the orientation of the optical inspection tool relative to the observation apparatus,
wherein to transform the second image, the processor is further configured to:
generate a projected observation plane by projecting the second observation plane onto the first observation plane, wherein the projected observation plane has a projected third observation plane axis and a projected fourth observation plane axis and defines a projected second viewing axis which is aligned perpendicular to the projected third observation plane axis and the projected fourth observation plane axis, and wherein the projected third observation plane axis, the projected fourth observation plane axis, and projected second viewing axis define a projected coordinate system;
determine a rotation angle which indicates a rotation of the projected coordinate system about the projected second viewing axis such that the projected third observation plane axis is aligned parallel to and equally oriented with the first observation plane axis, and the projected fourth observation plane axis is aligned parallel to and equally oriented with the second observation plane axis; and
rotate the second image about the rotation angle about the projected second viewing axis.