US 12,112,437 B2
Positioning medical views in augmented reality
Christian Schmaler, Munich (DE); Juliane Weinzierl, Munich (DE); and Oliver Fleig, Baldham (DE)
Assigned to Brainlab AG, Munich (DE)
Appl. No. 17/793,225
Filed by Brainlab AG, Munich (DE)
PCT Filed Jan. 28, 2021, PCT No. PCT/EP2021/051952
§ 371(c)(1), (2) Date Jul. 15, 2022,
PCT Pub. No. WO2022/161610, PCT Pub. Date Aug. 4, 2022.
Prior Publication US 2023/0360334 A1, Nov. 9, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 11/00 (2006.01); G06V 10/24 (2022.01)
CPC G06T 19/006 (2013.01) [G06T 11/008 (2013.01); G06V 10/24 (2022.01)] 15 Claims
OG exemplary drawing
 
1. A computer-implemented method of determining a reconstructed image augmentation of a field of view provided by an augmented reality device, the method comprising:
acquiring 3D-image data which describes at least one three-dimensional image representation of a patient's body part;
acquiring object position data which describes a spatial position of the augmented reality device and a spatial position of at least one object including a device or instrument present within the field of view of the augmented reality device with respect to the patient's body part;
determining reconstructed image data based at least on the 3D-image data, which describes at least one two-dimensional reconstructed image calculated from the three-dimensional image representation, wherein a location of the at least one two-dimensional reconstructed image relative to the three-dimensional image representation is determined based on the spatial position of the device or instrument relative to the patient's body part;
determining image augmentation data based on the reconstructed image data and the object position data, which describes the at least one two-dimensional reconstructed image displayed within the field of view provided by the augmented reality device, wherein an image location and/or at least one image orientation of the at least one displayed two-dimensional reconstructed image is defined with respect to the spatial position of the at least one object being selected from a group consisting of:
one or more sections of an at least temporarily static installation of an operating theatre,
one or more sections of a medical device or instrument, and
one or more sections of a patient's anatomy including one or more anatomical directions.