CPC G06F 3/011 (2013.01) [A61B 34/20 (2016.02); A61B 90/36 (2016.02); G02B 27/0172 (2013.01); G06T 19/006 (2013.01); H04N 21/4405 (2013.01); A61B 2034/107 (2016.02); A61B 2034/2055 (2016.02)] | 25 Claims |
1. A method for using an augmented reality (AR) headset to align a fluoroscopic image with respect to a body of a person and an image projection from an image data set, comprising:
detecting a fluoroscopic device, which is mobile with respect to the body of the person, using a sensor of the AR headset;
identifying one or more optical codes on the body of the person and on the fluoroscopic device, wherein one or more optical codes on the body of the person have a fixed position relative to an image visible marker;
aligning an image data set of the body of the person using the fixed position of the image visible marker relative to the one or more optical codes on the body of the person as viewed through the AR headset;
determining a position and orientation of the fluoroscopic device with respect to the body of the person using the one or more optical codes on the fluoroscopic device;
displaying an image projection of the image data set based in part on the position and orientation of the fluoroscopic device; and
displaying a fluoroscopic image from the fluoroscopic device that is aligned with the body of the person and the image projection based on the image visible marker or the position and orientation of the fluoroscopic device, using the AR headset.
|