CPC A61B 90/37 (2016.02) [A61B 90/361 (2016.02); G06T 7/73 (2017.01); G06T 11/00 (2013.01); A61B 2090/372 (2016.02); A61B 2090/373 (2016.02); A61B 2090/3937 (2016.02); A61B 2090/502 (2016.02); G06T 2207/30204 (2013.01)] | 22 Claims |
1. A computer-implemented method, comprising:
acquiring an image by a camera attached to a head-mounted display worn by an operator that is performing a procedure on a human subject, the image including a patient marker that defines a plane of asymmetry, the plane of asymmetry having a first side and a second side, the patient marker being attached to the human subject such that the plane of asymmetry makes an angle between +20° and −20° with one of a sagittal plane or an axial plane of the human subject,
wherein the image further includes at least a portion of a tool being used by the operator in performing the procedure on the human subject;
analyzing the image, by one or more processors, so as to identify:
whether the camera resides on the first side of the plane of asymmetry or on the second side of the plane of asymmetry; and
a position and orientation of the tool;
accessing in a memory a graphical representation of the tool and an image of anatomy of the human subject;
rendering to the head-mounted display the image of the anatomy of the human subject with the graphical representation of the tool superimposed thereon based on the identified position and orientation of the tool, the rendered image being depicted from a point of view based on the identified side on which the camera resides;
acquiring an additional image by the camera, the additional image including the patient marker and at least a portion of the tool;
analyzing the additional image, by the one or more processors, so as to identify that the camera has moved from the identified side of the plane of asymmetry and now resides on the other side of the plane of asymmetry; and
rendering to the head-mounted display the image of the anatomy of the human subject with the graphical representation of the tool superimposed thereon, from a point of view based on the identified other side on which the camera resides.
|