US 11,838,493 B2
Extended reality headset camera system for computer assisted navigation in surgery
Weston Healy, Cambridge, MA (US); Thomas Calloway, Pelham, NH (US); Norbert Johnson, North Andover, MA (US); and Keerthighaan Kanagasegar, Norristown, PA (US)
Assigned to Globus Medical Inc., Audubon, PA (US)
Filed by GLOBUS MEDICAL, INC., Audubon, PA (US)
Filed on Sep. 17, 2021, as Appl. No. 17/478,201.
Application 17/478,201 is a continuation of application No. 16/869,735, filed on May 8, 2020, granted, now 11,153,555.
Prior Publication US 2022/0007006 A1, Jan. 6, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 13/344 (2018.01); A61B 34/20 (2016.01); H04N 13/239 (2018.01); H04N 5/33 (2023.01); H04N 23/12 (2023.01); A61B 34/30 (2016.01); A61B 90/00 (2016.01); A61B 90/50 (2016.01); A61B 17/00 (2006.01)
CPC H04N 13/344 (2018.05) [A61B 34/20 (2016.02); H04N 5/33 (2013.01); H04N 13/239 (2018.05); H04N 23/12 (2023.01); A61B 34/30 (2016.02); A61B 2017/00991 (2013.01); A61B 2034/2057 (2016.02); A61B 2034/2072 (2016.02); A61B 2090/365 (2016.02); A61B 2090/3764 (2016.02); A61B 2090/3945 (2016.02); A61B 2090/502 (2016.02)] 20 Claims
OG exemplary drawing
 
1. A method of generating extended reality (XR) imagery comprising the steps of:
providing a head-mounted extended reality (XR) display device comprising:
a frame configured to be worn by a user's head;
a rigid mounting element coupled to the frame;
a right-side visible light camera coupled to the rigid mounting element;
a left-side visible light camera coupled to the rigid mounting element;
a right-side near-infrared (NIR) camera coupled to the rigid mounting element;
a left-side NIR camera coupled to the rigid mounting element; and
at least one NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the right-side NIR camera and the left-side NIR camera,
wherein the right-side visible light camera and the left-side visible light camera are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and
wherein the right-side NIR camera and the left-side NIR camera are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame,
providing a tracking system adapted to determine a pose of dynamic reference arrays attached to a patient and to surgical instruments based on stereoscopic visible light images received through the right-side and left-side visible cameras, the tracking system further adapted to determine hand gesture based commands based on the stereoscopic NIR images received through the right-side and left-side NIR cameras.