US 12,481,243 B2
Method and system for displaying holographic images within a real object
Shaul Alexander Gelman, Raanana (IL); Carmel Rotschild, Ganei-Tikva (IL); Elchanan Bruckheimer, Zikhron-Yaakov (IL); Aviad Kaufman, Zikhron-Yaakov (IL); and Dalia Dickman, Moshav Manof (IL)
Assigned to Real View Imaging Ltd., Yokneam (IL)
Filed by Real View Imaging Ltd., Yokneam (IL)
Filed on Jul. 26, 2023, as Appl. No. 18/226,285.
Application 18/226,285 is a continuation of application No. 17/015,126, filed on Sep. 9, 2020, granted, now 11,754,971.
Application 17/015,126 is a continuation of application No. 16/078,639, granted, now 10,788,791, issued on Sep. 29, 2020, previously published as PCT/IL2017/050225, filed on Feb. 22, 2017.
Claims priority of provisional application 62/353,718, filed on Jun. 23, 2016.
Claims priority of provisional application 62/298,070, filed on Feb. 22, 2016.
Prior Publication US 2023/0384734 A1, Nov. 30, 2023
Int. Cl. G03H 1/00 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01); G03H 1/22 (2006.01)
CPC G03H 1/0005 (2013.01) [G02B 27/017 (2013.01); G06T 19/006 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0174 (2013.01); G03H 2001/0061 (2013.01); G03H 2001/2236 (2013.01); G03H 2001/2284 (2013.01); G03H 2226/05 (2013.01); G03H 2227/02 (2013.01); G03H 2270/55 (2013.01); G09G 2340/12 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for producing an image comprising visual representations of a real internal organ of a patient and a real medical tool which are at least partially hidden from view in the real-world by the patient's body, the image depicting the internal organ and the medical tool as visible, and further as located in space at the same real-world positions as the respective real internal organ and the real medical tool relative to a body of the patient, the method comprising:
(a) obtaining, by a circuitry, a dataset comprising a three-dimensional (3D) location and orientation in space of the following:
i. an imaging device relative to a display;
ii. at least a portion of an internal organ of a patient
(b) tracking, by the circuitry, a location and orientation in space of the medical tool;
(c) generating, by the circuitry, locations of the internal organ and the medical tool relative to the display, based on the dataset and the tracked location of the medical tool;
(d) generating the visual representations of the at least a portion of the internal organ and the portion of the medical tool that are hidden from view;
(e) producing an image which includes the visual representations positioned based on the generated locations; and
(f) displaying, on the display, the image such that the visual representations appear in co-registration with their respective real-world internal organ and medical tool;
wherein the displaying comprises displaying the visual representation of the portion of the medical tool that is hidden from view as an extension of a portion of the real medical tool that is not hidden;
wherein the displaying comprises displaying with depth cues comprising eye focus accommodation corresponding to: a first depth within the real internal organ, and a second depth within the real medical tool.