US 12,080,393 B2
Medical assistant
Nastasja U. Robaina, Coconut Grove, FL (US); Nicole Elizabeth Samec, Ft. Lauderdale, FL (US); Mark Baerenrodt, Milbrae, CA (US); and Christopher M. Harrises, Nashua, NH (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Nov. 16, 2022, as Appl. No. 18/056,164.
Application 18/056,164 is a continuation of application No. 15/865,023, filed on Jan. 8, 2018, abandoned.
Claims priority of provisional application 62/448,656, filed on Jan. 20, 2017.
Claims priority of provisional application 62/445,182, filed on Jan. 11, 2017.
Prior Publication US 2023/0075466 A1, Mar. 9, 2023
Int. Cl. G16H 10/60 (2018.01); A61B 3/00 (2006.01); A61B 3/10 (2006.01); A61B 3/113 (2006.01); A61B 5/00 (2006.01); A61B 5/06 (2006.01); A61B 5/1171 (2016.01); A61B 5/339 (2021.01); A61B 90/00 (2016.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 16/22 (2019.01); G06F 16/23 (2019.01); G06F 21/32 (2013.01); G06F 21/62 (2013.01); G06F 40/205 (2020.01); G06F 40/289 (2020.01); G06V 20/20 (2022.01); G10L 15/26 (2006.01); G16H 40/67 (2018.01); A61B 17/00 (2006.01); A61B 34/20 (2016.01); A61B 90/50 (2016.01); G16H 30/40 (2018.01)
CPC G16H 10/60 (2018.01) [A61B 3/0041 (2013.01); A61B 3/10 (2013.01); A61B 3/113 (2013.01); A61B 5/0077 (2013.01); A61B 5/06 (2013.01); A61B 5/1171 (2016.02); A61B 5/1176 (2013.01); A61B 5/339 (2021.01); A61B 5/4803 (2013.01); A61B 90/37 (2016.02); G02B 27/0093 (2013.01); G02B 27/0172 (2013.01); G06F 16/22 (2019.01); G06F 16/2379 (2019.01); G06F 21/32 (2013.01); G06F 40/205 (2020.01); G06F 40/289 (2020.01); G06V 20/20 (2022.01); G10L 15/26 (2013.01); G16H 40/67 (2018.01); A61B 2017/00207 (2013.01); A61B 2017/00216 (2013.01); A61B 2034/2048 (2016.02); A61B 2090/365 (2016.02); A61B 2090/372 (2016.02); A61B 2090/502 (2016.02); G02B 2027/0127 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0141 (2013.01); G06F 21/6245 (2013.01); G16H 30/40 (2018.01)] 20 Claims
OG exemplary drawing
 
1. A display system for facilitating a medical procedure, the display system comprising:
a head-mountable three-dimensional (3D) display configured to present virtual content to a user of the display system while the display is being worn on a head of the user, wherein the display is at least partly transparent to provide the user a view of an environment in proximity to the user while the display presents the virtual content to augment the view of the environment, and wherein the display is configured to present the virtual content at a plurality of depth planes by outputting, to an eye of the user, light that conveys the virtual content with different levels of wavefront curvature corresponding to different depth planes of the plurality of depth planes;
one or more environmental sensors configured to collect data associated with the environment; and
at least one hardware processor in communication with the display and the one or more environmental sensors, the at least one hardware processor programmed to:
analyze the data collected by the one or more environmental sensors to update a map describing at least a portion of the environment;
receive information describing the medical procedure to be performed on a patient currently present in the environment and described in the map;
identify a region within the portion of the environment;
based on the data collected by the one or more environmental sensors, identify a medical instrument that is currently present in the region and described in the map and determine a current 3D position of the medical instrument in the region;
detect an anomaly based on the medical instrument being currently present in the region, wherein the anomaly is detected based at least partly on comparing the information describing the medical procedure to semantic information that describes the medical instrument; and
responsive to detecting the anomaly, cause the display to present an alert indicating the anomaly, wherein the alert is included in the virtual content presented through the display, wherein the alert is presented at one of the plurality of depth planes supported by the display such that the alert appears to be located in proximity to the 3D position of the medical instrument and at a distance corresponding to a depth of the 3D position of the medical instrument, wherein presenting the alert includes presenting a focus indicator that is a halo presented around the medical instrument, and wherein the halo has a color based on the semantic information that describes the medical instrument.