US 12,446,976 B2
System and method for hybrid control using eye tracking
Heath Feather, Cupertino, CA (US); Brandon D. Itkowitz, San Jose, CA (US); and Alexandre V. Matveev, Santa Clara, CA (US)
Assigned to INTUITIVE SURGICAL OPERATIONS, INC., Sunnyvale, CA (US)
Appl. No. 17/055,073
Filed by INTUITIVE SURGICAL OPERATIONS, INC., Sunnyvale, CA (US)
PCT Filed May 15, 2019, PCT No. PCT/US2019/032479
§ 371(c)(1), (2) Date Nov. 12, 2020,
PCT Pub. No. WO2019/222395, PCT Pub. Date Nov. 21, 2019.
Claims priority of provisional application 62/672,467, filed on May 16, 2018.
Prior Publication US 2021/0212773 A1, Jul. 15, 2021
Int. Cl. A61B 34/00 (2016.01); A61B 34/20 (2016.01); A61B 34/37 (2016.01); A61B 90/00 (2016.01)
CPC A61B 34/25 (2016.02) [A61B 34/20 (2016.02); A61B 34/37 (2016.02); A61B 90/361 (2016.02); A61B 90/37 (2016.02); A61B 2034/2051 (2016.02); A61B 2034/2059 (2016.02); A61B 2034/2061 (2016.02); A61B 2090/368 (2016.02); A61B 2090/3735 (2016.02); A61B 2090/374 (2016.02); A61B 2090/3762 (2016.02); A61B 2090/378 (2016.02)] 20 Claims
OG exemplary drawing
 
1. A console for a medical system comprising:
a display;
an eye tracking input module;
a second input module; and
one or more processors coupled to the display, the eye tracking input module, and the second input module, the one or more processors being configured to perform operations comprising:
displaying, via the display, a surgical image view;
receiving a first user input from the eye tracking input module, the first user input corresponding to a gaze point of a user relative to the display;
determining, based on the first user input, whether the gaze point of the user moves within a primary activation region of the display;
in response to determining that the gaze point of the user moves within the primary activation region, overlaying a plurality of secondary activation regions on the surgical image view;
receiving a second user input from the eye tracking input module, the second user input corresponding to the gaze point of the user relative to the display;
determining, based on the second user input, that the gaze point of the user moves within a selected one of the plurality of secondary activation regions;
in response to determining that the gaze point of the user moves within the selected one of the plurality of secondary activation regions, changing an appearance of the selected one of the plurality of secondary activation regions to include displaying of an adjustable control, the adjustable control configured to adjust a parameter in a surgical procedure;
receiving a third user input from the second input module; and
adjusting the displayed adjustable control, based on the third user input, to increase or decrease the parameter.