US 12,002,147 B2
Method and system for optimizing distance estimation
Christoph Vetter, Hopewell, NJ (US); Kaloian Petkov, Lawrenceville, NJ (US); Rishabh Shah, Wentworth Point (AU); and Sandra Sudarsky, Bedminster, NJ (US)
Assigned to Siemens Healthineers AG, Forchheim (DE)
Filed by SIEMENS HEALTHINEERS AG, Forchheim (DE)
Filed on Apr. 20, 2022, as Appl. No. 17/659,905.
Claims priority of application No. 10 2021 110 797.0 (DE), filed on Apr. 27, 2021.
Prior Publication US 2022/0343586 A1, Oct. 27, 2022
Int. Cl. G06T 15/08 (2011.01); A61B 34/10 (2016.01); A61B 34/20 (2016.01); A61B 90/00 (2016.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 15/04 (2011.01); G06T 15/20 (2011.01); G06T 15/50 (2011.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01)
CPC G06T 15/08 (2013.01) [A61B 34/10 (2016.02); A61B 34/20 (2016.02); A61B 90/36 (2016.02); G06T 7/0012 (2013.01); G06T 7/11 (2017.01); G06T 15/04 (2013.01); G06T 15/205 (2013.01); G06T 15/50 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); A61B 2034/107 (2016.02); A61B 2034/2065 (2016.02); A61B 2090/365 (2016.02); G06T 2207/30056 (2013.01); G06T 2210/41 (2013.01); G06T 2215/16 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method for optimizing distance estimation in virtual or augmented reality, the method comprising:
a) providing a medical three-dimensional (3D) image of a volume comprising a segmented anatomical object within a region of interest,
b) providing 3D information of a position of a surgical instrument,
c) determining a distance map of the surgical instrument to the region of interest, at least at a beginning of the method and in the case the position of the surgical instrument has changed, the distance map comprising a field of distances from multiple locations of the region of interest to the surgical instrument at a given time,
d) rendering a render-image based on the 3D image and the information of the position of a surgical instrument, at least at the beginning of the method and in the case the position of the surgical instrument has changed,
wherein at least the region of interest is shown and those parts of the surgical instrument positioned in a volume of the render-image, and
wherein based on the distance map, at least for a predefined area of the region of interest, visible, acoustic, and/or haptic distance-information is added to the render-image, the render-image having the visible, acoustic, and/or haptic distance-information that varies by position based on the field of distances,
e) outputting the render-image and repeating at least acts b) to e).