US 11,656,735 B2
Method for real time update of fly-through camera placement
Jetmir Palushi, Irvine, CA (US); Henry F. Salazar, Pico Rivera, CA (US); Jordan R. Trott, Redondo Beach, CA (US); Moran Levi, Kiryat-Tivon (IL); Itamar Bustan, Zichron Ya'acov (IL); Yoav Pinsky, Yokneam (IL); Noam Racheli, Hadera (IL); and Athanasios Papadakis, Newport Beach, CA (US)
Assigned to Acclarent, Inc., Irvine, CA (US); and Biosense Webster (Israel) Ltd., Yokneam (IL)
Filed by Acclarent, Inc., Irvine, CA (US); and Biosense Webster (Israel) Ltd., Yokneam (IL)
Filed on Nov. 17, 2021, as Appl. No. 17/528,429.
Application 17/528,429 is a continuation of application No. 16/577,019, filed on Sep. 20, 2019, granted, now 11,204,677.
Claims priority of provisional application 62/748,571, filed on Oct. 22, 2018.
Prior Publication US 2022/0137788 A1, May 5, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/04815 (2022.01); A61B 34/20 (2016.01); G06T 15/20 (2011.01); G06F 3/04842 (2022.01); G16H 30/20 (2018.01); G16H 20/40 (2018.01); A61B 34/00 (2016.01); A61B 90/00 (2016.01); A61B 34/10 (2016.01)
CPC G06F 3/04815 (2013.01) [A61B 34/20 (2016.02); A61B 34/25 (2016.02); G06F 3/04842 (2013.01); G06T 15/205 (2013.01); G16H 20/40 (2018.01); G16H 30/20 (2018.01); A61B 2034/105 (2016.02); A61B 2090/374 (2016.02); A61B 2090/378 (2016.02); A61B 2090/3762 (2016.02); G06F 2203/04803 (2013.01); G06T 2200/24 (2013.01); G06T 2210/41 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system comprising:
a) a display;
b) user input;
c) a set of preoperative images associated with a patient; and
d) a processor configured to provide a virtual camera placement interface to a user via the display and receive inputs via the user input; wherein the virtual camera placement interface comprises a set of preoperative image panes and a virtual camera view, wherein each of the set of preoperative image panes corresponds to a distinct viewpoint and comprises a preoperative image selected from the set of preoperative images based on the distinct viewpoint, and wherein the user input is operable to move a cursor over and make selections from the set of preoperative image panes,
e) wherein the processor is further configured to:
i) define a first point based upon a first selection received via the user input, wherein the first selection comprises a point on one of the set of preoperative image panes that corresponds to a first cursor position of the cursor when the first selection is received and the distinct viewpoint corresponding to the preoperative image pane on which the first cursor position is located;
ii) define a second point based upon a second cursor position of the cursor located on any of the set of preoperative image panes and the distinct viewpoint corresponding to the preoperative image pane on which the second cursor position is located;
iii) display a real-time virtual endoscopic preview in the virtual camera view based upon the first point and the second point, wherein the real-time virtual endoscopic preview is a virtual camera view having a location defined by a point from a group consisting of the first point and the second point, and an orientation defined by a different point selected from the group consisting of the first point and the second point;
iv) after displaying the real-time virtual endoscopic preview, receive a second selection via the user input, wherein the second selection comprises a selected second point determined based upon the second point;
v) based upon a modify selection received via the user input, discard one of the first point or the selected second point;
vi) define a modified point based upon a third cursor position, wherein the modified point is the point that was discarded; and
vii) display the real-time virtual endoscopic preview in the virtual camera view based upon a retained point and the modified point, wherein the retained point is the point that was not discarded.