CPC G06T 19/006 (2013.01) [A61B 34/10 (2016.02); A61B 90/37 (2016.02); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/017 (2013.01); G06F 3/0346 (2013.01); G06T 19/20 (2013.01); A61B 2034/105 (2016.02); A61B 2090/365 (2016.02); A61B 2090/368 (2016.02); A61B 2090/372 (2016.02); G06T 2207/30204 (2013.01); G06T 2210/41 (2013.01); G06T 2219/2016 (2013.01)] | 15 Claims |
1. A method for performing a surgical procedure, said method comprising:
providing an augmented reality surgical system including:
a display comprising a see-through display screen that display images while allowing transmission of ambient light therethrough;
a motion sensor connected to the display and configured to output a motion signal indicating measured movement of the display; and
at least one camera configured to observe a first set of reference markers connected to a patient, and a second set of reference markers connected to a surgical tool located within a surgical room; and
a computer,
computing the relative location and orientation of the display and the first and second set of reference markers;
generating a three dimensional anatomical image using patient data created by medical imaging equipment that has imaged a portion of the patient;
generating a video signal based on at least a portion of the three dimensional anatomical image and the location and orientation of the first and second set of reference markers coupled to the patient and the surgical instrument; and
output a video signal to the display screen on the display,
wherein the computer is configured to animate movement of a displayed graphical representation of the patient, surgical tool or surgical site to illustrate a planned procedure relative to a defined location of the surgical site or other targeted anatomical site.
|