US 11,989,930 B2
UI for head mounted display system
Eran Segev, Haifa (IL); Shahaf Zommer, Haifa (IL); Yaara Solomon, Haifa (IL); Ron Schneider, Haifa (IL); and Rani Ben-Yishai, Haifa (IL)
Assigned to BEYEONICS SURGICAL LTD., Haifa (IL)
Appl. No. 17/288,455
Filed by BEYEONICS SURGICAL LTD, Haifa (IL)
PCT Filed Oct. 27, 2019, PCT No. PCT/IL2019/051155
§ 371(c)(1), (2) Date Apr. 23, 2021,
PCT Pub. No. WO2020/084625, PCT Pub. Date Apr. 30, 2020.
Claims priority of provisional application 62/925,269, filed on Oct. 24, 2019.
Claims priority of provisional application 62/857,834, filed on Jun. 6, 2019.
Claims priority of provisional application 62/750,276, filed on Oct. 25, 2018.
Prior Publication US 2021/0382559 A1, Dec. 9, 2021
Int. Cl. A61B 90/00 (2016.01); A61B 17/00 (2006.01); A61B 34/00 (2016.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/033 (2013.01); G06F 3/0482 (2013.01); G06F 3/0485 (2022.01); G06V 10/80 (2022.01); G06V 10/94 (2022.01); G06V 20/20 (2022.01); G06V 40/18 (2022.01); H04N 23/56 (2023.01); H04N 23/62 (2023.01); H04N 23/695 (2023.01); A61B 90/50 (2016.01); H04N 5/45 (2011.01)
CPC G06V 10/806 (2022.01) [A61B 34/25 (2016.02); A61B 90/37 (2016.02); G02B 27/0172 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/017 (2013.01); G06F 3/0334 (2013.01); G06V 10/94 (2022.01); G06V 20/20 (2022.01); G06V 40/193 (2022.01); H04N 23/62 (2023.01); A61B 2017/00216 (2013.01); A61B 2017/00973 (2013.01); A61B 90/361 (2016.02); A61B 2090/373 (2016.02); A61B 2090/502 (2016.02); G02B 2027/0138 (2013.01); G06F 3/0482 (2013.01); G06F 3/0485 (2013.01); G06F 2203/04806 (2013.01); H04N 5/45 (2013.01); H04N 23/56 (2023.01); H04N 23/695 (2023.01)] 19 Claims
OG exemplary drawing
 
1. A head mounted display system for use in surgical applications, allowing for different systems responses to same user inputs in different system modes, the system comprising:
a head mounted display configured to be worn by a surgeon;
a tracker configured to track head gesture inputs by said surgeon;
a footswitch configured to detect foot motion inputs by said surgeon; and
a computer coupled to said head mounted display, said tracker, and said footswitch and configured to:
display an image relating to a surgical procedure via said head mounted display;
receive a head gesture input from said tracker,
receive, in association with said head gesture input, a foot motion input from said footswitch, and
apply said head gesture input received in association with said foot motion input to perform a first action on said head mounted display system when said head mounted display system is in a first system mode, and perform a second action on said head mounted display system when said head mounted display system is in a second system mode,
wherein said first action is different than said second action,
wherein said head gesture input and said foot motion input are the same in said first and second system modes,
wherein said first system mode and said second system mode are two different modes selected from the group consisting of:
a display mode for displaying images from a camera system;
a visor-guided surgery (VGS) mode for performing visor-guided surgery;
a pre-operative mode for enabling said surgeon to view pre-operative data related to said surgical procedure;
an intraoperative mode for enabling said surgeon to view intraoperative data related to said surgical procedure;
an intraoperative optical coherence tomography (OCT) mode for controlling an intraoperative OCT device;
a teaching mode for enabling said surgeon to guide a second surgeon during said surgical procedure;
a preplanning mode for enabling said surgeon to draw symbols on a live image;
an external mode for controlling an external device;
a procedure-specific mode for displaying at least one of data and overlays specific to said surgical procedure; and
a stage-specific mode for displaying at least one of data and overlays specific to a stage of said surgical procedure.