| CPC G06T 7/75 (2017.01) [A61B 34/30 (2016.02); G06T 17/00 (2013.01); G06T 2200/08 (2013.01); G06T 2207/10132 (2013.01); G06T 2207/20081 (2013.01)] | 19 Claims |

|
1. A system for reconstructing a three-dimensional representation comprising:
an imaging device that captures images using a first imaging modality;
a processor; and
a memory storing data for processing by the processor, the data, when processed, causing the processor to:
orient the imaging device at one or more poses;
receive an intraoperative image from the image device at each of the one or more poses to form a set of intraoperative images, the set of intraoperative images depicting one or more anatomical elements;
receive pose information at each of the one or more poses;
input the set of intraoperative images and the pose information to a reconstruction model, the reconstruction model configured to generate a three-dimensional representation of the one or more anatomical elements based on the set of intraoperative images, the pose information, and a preoperative image of the one or more anatomical elements captured using a second imaging modality different than the first imaging modality;
receive, from the reconstruction model, the three-dimensional representation of the one or more anatomical elements; and
generate instructions for navigating at least one instrument based on the three-dimensional representation of the one or more anatomical elements.
|