US 12,229,900 B2
Augmented reality system and methods for stereoscopic projection and cross-referencing of live x-ray fluoroscopic and computed tomographic c-arm imaging during surgery
Jeffrey H. Yanof, Solon, OH (US); and Peter Nicholas Braido, Linwood, MN (US)
Assigned to MEDIVIEW XR, INC., Cleveland, OH (US)
Filed by MEDIVIEW XR, INC., Cleveland, OH (US)
Filed on Aug. 11, 2022, as Appl. No. 17/885,912.
Claims priority of provisional application 63/231,866, filed on Aug. 11, 2021.
Prior Publication US 2023/0050636 A1, Feb. 16, 2023
Int. Cl. G06T 19/00 (2011.01); G03H 1/04 (2006.01); G06T 5/50 (2006.01); G06V 10/25 (2022.01); G06V 20/20 (2022.01)
CPC G06T 19/006 (2013.01) [G03H 1/04 (2013.01); G06T 5/50 (2013.01); G06V 10/25 (2022.01); G06V 20/20 (2022.01); G06T 2207/10021 (2013.01); G06T 2207/10081 (2013.01); G06T 2207/10121 (2013.01); G06T 2207/10132 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method for performing a procedure on a patient utilizing an augmented reality system, the method comprising:
acquiring, by a first image acquisition system, an image dataset including multiple images, the image dataset forming a three-dimensional image of a location of interest on the patient, wherein the first image acquisition system is one of a cone-beam computed tomography imaging system and a multidetector row computed tomography imaging system;
acquiring a two-dimensional image of the location of interest on the patient;
relating, by a computer system, the three-dimensional image with the two-dimensional image to form a three-dimensional holographic image dataset;
projecting, by the augmented reality system, the holographic image dataset with the patient;
rendering, by the augmented reality system, a hologram based on the holographic image dataset from the patient for three-dimensional stereoscopic viewing by a practitioner, the hologram including a projection of the three-dimensional image and a projection of the two-dimensional image;
viewing, by the practitioner, the hologram with the augmented reality system; and
performing, by the practitioner, the procedure on the patient;
wherein the practitioner employs the augmented reality system to visualize and cross-reference a selected point on the projection of the three-dimensional image and a corresponding point on the projection of the two-dimensional image during the procedure.