| CPC A61B 1/04 (2013.01) [A61B 1/233 (2013.01); A61B 5/0077 (2013.01); A61B 5/064 (2013.01); A61B 5/065 (2013.01); A61B 5/066 (2013.01); A61B 34/20 (2016.02); A61B 90/37 (2016.02); A61B 90/39 (2016.02); G06T 7/73 (2017.01); G06T 11/60 (2013.01); H04N 7/181 (2013.01); A61B 2034/2051 (2016.02); A61B 2034/2055 (2016.02); A61B 2034/2057 (2016.02); A61B 2034/2065 (2016.02); A61B 90/361 (2016.02); A61B 2090/363 (2016.02); A61B 2090/365 (2016.02); A61B 2090/371 (2016.02); A61B 2090/372 (2016.02); A61B 2090/376 (2016.02); A61B 2090/3762 (2016.02); A61B 2090/3937 (2016.02); A61B 2090/3954 (2016.02); A61B 2090/3966 (2016.02); A61B 2090/3983 (2016.02); A61B 2090/3991 (2016.02); A61B 2090/502 (2016.02); G02B 2027/0132 (2013.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0141 (2013.01); G02B 27/0172 (2013.01); G06T 2207/30204 (2013.01); H04N 5/272 (2013.01)] | 19 Claims |
|
1. A system for viewing a subject when performing an operation on the subject, comprising:
a user wearable viewscreen and camera system configured to be carried by a single user and having a field of view, the viewscreen and camera system including:
a first viewscreen configured to be positioned near a first eye of a user;
a second viewscreen configured to be positioned near a second eye of the user; and
at least a first camera configured to have a first field of view from the user wearable viewscreen and camera system when worn by the single user;
an instrument tracking device fixable to an instrument that is separate from the user wearable viewscreen and camera system and is viewable by the first camera;
a subject marker fixed to the subject at a first location on the subject and having an identifiable shape viewable by the first camera;
a user wearable viewscreen and camera system tracking device fixed to the user wearable viewscreen and camera system configured to allow the user wearable viewscreen and camera system to be tracked and registered relative to the subject;
a processor system configured to execute instructions (i) to determine a relative position of the instrument tracking device relative to the subject marker fixed to the subject based on a first signal from the first camera and (ii) generate an instrument representation to be displayed in at least one of the first viewscreen or the second viewscreen to be viewed by at least one of the first eye or the second eye; and
a supplemental viewing area displayed within the field of view of the single user with the user wearable viewscreen and camera system, where the single user can selectively select or choose information to be displayed in the supplemental viewing area including displaying real time images, pre-acquired images, and other information in the supplemental viewing area;
wherein the processor system is further configured to generate an anatomy representation;
wherein the instrument representation is represented as an instrument icon and the anatomy representation is represented as an anatomy icon;
wherein the instrument icon and the anatomy icon each have a selected opacity to view both the instrument icon and the anatomy icon substantially simultaneously such that the instrument icon can be viewed within the anatomy icon substantially simultaneously;
wherein the first viewscreen or the second viewscreen are substantially transparent and configured to allow the user to view the subject, through the first or second viewscreens;
wherein the processor system is further configured to generate the instrument icon and the anatomy icon and display the instrument icon and anatomy icon at a position spaced away from the subject on at least one of the first view screen or the second view screen to allow the single user to have a substantially unobstructed view of the subject while viewing the instrument icon and the anatomy icon.
|