US 11,922,581 B2
Systems and methods of controlling an operating room display using an augmented reality headset
John W. Komp, Dillon, CO (US)
Assigned to Coviden LP, Mansfield, MA (US)
Filed by Covidien LP, Mansfield, MA (US)
Filed on Mar. 9, 2021, as Appl. No. 17/196,344.
Claims priority of provisional application 63/022,219, filed on May 8, 2020.
Prior Publication US 2021/0350624 A1, Nov. 11, 2021
Int. Cl. G06T 19/00 (2011.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/0482 (2013.01); G06F 3/04855 (2022.01)
CPC G06T 19/006 (2013.01) [G02B 27/0093 (2013.01); G02B 27/017 (2013.01); G06F 3/013 (2013.01); G06F 3/0482 (2013.01); G06F 3/04855 (2013.01); G02B 2027/0187 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method comprising:
displaying three-dimensional (3D) medical scan information of a portion of a patient in 3D space on an operating room display;
communicating planes of the 3D medical scan information displayed on the operating room display to an augmented reality (AR) head-mounted device (HMD) configured to be mounted on a head of a user;
displaying, on a display of the AR HMD, the planes of the 3D medical scan information perpendicular to one another, yielding perpendicular planes;
monitoring a location of a focus of a user's gaze;
updating the perpendicular planes of the 3D medical scan information on the operating room display based on monitored movement of the location of the focus of the user's gaze;
detecting that the user's gaze is focused on a perpendicular plane of the perpendicular planes of the 3D medical scan information;
in response to detecting that the user's gaze is focused on the perpendicular plane of the 3D medical scan information, highlighting the perpendicular plane of the 3D medical scan information, yielding a highlighted perpendicular plane of the 3D medical scan information, and displaying control objects associated with the highlighted perpendicular plane of the 3D medical scan information;
detecting that the user's gaze is focused on a control object of the control objects; and
in response to detecting that the user's gaze is focused on the control object, determining selection of the control object and modifying the highlighted perpendicular plane of the 3D medical scan information in a way defined by the control object,
wherein displaying the control objects associated with the highlighted perpendicular plane of the 3D medical scan information includes displaying movement direction control objects on opposite sides of the highlighted perpendicular plane of the 3D medical scan information, and
wherein the movement direction control objects include up and down control objects and forward and backward control objects.