| CPC A61B 34/10 (2016.02) [A61B 5/0059 (2013.01); A61B 17/00 (2013.01); A61B 34/20 (2016.02); A61B 90/11 (2016.02); A61B 90/13 (2016.02); A61B 90/30 (2016.02); A61B 6/12 (2013.01); A61B 6/4441 (2013.01); A61B 6/461 (2013.01); A61B 6/582 (2013.01); A61B 8/0841 (2013.01); A61B 8/4416 (2013.01); A61B 8/4438 (2013.01); A61B 8/461 (2013.01); A61B 2017/00398 (2013.01); A61B 2034/107 (2016.02); A61B 90/361 (2016.02); A61B 2090/363 (2016.02); A61B 2090/364 (2016.02); A61B 2090/3916 (2016.02); A61B 2090/3954 (2016.02); A61B 2090/3966 (2016.02); A61B 2090/3991 (2016.02)] | 19 Claims |

|
1. A method for visualizing and targeting anatomical structures inside a patient utilizing a handheld screen device, the method comprising:
projecting a structured light pattern onto a surface of an anatomical feature of the patient with a structured light source;
grasping the handheld screen device and manipulating a position of the handheld screen device relative to the patient, the handheld screen device comprising:
a camera; and
a display;
orienting the camera on the handheld screen device relative to the anatomical feature of the patient by manipulating the position of the handheld screen device relative to the patient;
capturing first image data of light reflecting from the surface of the anatomical feature with the camera on the handheld screen device, wherein the first image data represents a deformed structured light pattern reflecting from the surface of the anatomical feature; and
comparing the first image data with a pre-operative 3-D image of the patient to determine a location of an anatomical structure located inside the patient and positioned relative to the anatomical feature of the patient;
generating a 3-D surface map of the anatomical feature of the patient based on the deformed structured light pattern; and
registering the 3-D surface map with the pre-operative 3-D image of the patient comprising:
second image data of the anatomical feature of the patient; and
third image data of an anatomical structure located inside the patient.
|