US 11,918,310 B1
Interactive extended-reality system for robotic medicine
Jeffrey Roh, Seattle, WA (US); and Justin Esterberg, Mesa, AZ (US)
Assigned to IX Innovation LLC, Seattle, WA (US)
Filed by IX Innovation LLC, Seattle, WA (US)
Filed on Feb. 6, 2023, as Appl. No. 18/165,309.
Int. Cl. A61B 34/35 (2016.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01); G16H 20/40 (2018.01); A61B 34/00 (2016.01); A61B 34/10 (2016.01); A61B 90/00 (2016.01); A61B 90/50 (2016.01)
CPC A61B 34/35 (2016.02) [G06T 19/006 (2013.01); G06T 19/20 (2013.01); G16H 20/40 (2018.01); A61B 2034/104 (2016.02); A61B 2034/105 (2016.02); A61B 2034/252 (2016.02); A61B 2090/364 (2016.02); A61B 2090/502 (2016.02); G06T 2210/41 (2013.01); G06T 2219/004 (2013.01); G06T 2219/2016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An extended-reality (XR) computer-implemented method, comprising:
obtaining a digital anatomical model representing anatomical features of a patient;
generating an immersive experiential XR environment that includes the digital anatomical model,
wherein the XR environment and a granularity of the anatomical features are associated with a surgery type, and
wherein the immersive experiential XR environment is configured to enable the at least one user to
virtually perform one or more surgical steps associated with the surgery type on the digital anatomical model and
view, using an XR device, the one or more surgical steps and the digital anatomical model within the immersive experiential XR environment;
receiving anatomical mapping information from the at least one user; and
performing confidence-score augmented-reality (AR) mapping to meet a confidence threshold for the one or more surgical steps to be performed on the patient by:
selecting at least a portion of the anatomical mapping information for the AR mapping to an anatomy of the patient,
mapping the selected anatomical mapping information to the anatomical features of the patient, and
robotically performing, using a surgical robot, one or more physical surgical actions associated with the surgery type within an AR environment,
wherein the AR environment includes the mapping of the selected anatomical mapping information to the anatomical features.