US 12,456,267 B2
Automatic registration of landmarks for augmented reality assisted surgery
Long Qian, Watchung, NJ (US); Christopher Morley, New York, NY (US); Osamah Choudhry, New York, NY (US); and Florentin Jonas Liebmann, New York, NY (US)
Assigned to Medivis, Inc., New York, NY (US)
Filed by Medivis, Inc., New York, NY (US)
Filed on Sep. 8, 2023, as Appl. No. 18/244,138.
Application 18/244,138 is a continuation in part of application No. 18/243,402, filed on Sep. 7, 2023.
Application 18/244,138 is a continuation in part of application No. 18/208,136, filed on Jun. 9, 2023.
Prior Publication US 2024/0412465 A1, Dec. 12, 2024
Int. Cl. G06T 19/00 (2011.01); G06T 7/73 (2017.01)
CPC G06T 19/006 (2013.01) [G06T 7/73 (2017.01); G06T 2207/10028 (2013.01); G06T 2207/10048 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
identifying a region of interest from one or more infrared images portraying a target portion of a physical anatomy in a current physical pose, the physical pose comprising a current position and orientation represented by coordinates in a unified three-dimensional (3D) coordinate space;
generating a 3D point cloud, based in part on the one or more infrared images, of the region of interest at the target portion of the physical anatomy;
identifying region of interest isosurface data by detecting matches between one or more portions of the isosurface data and the 3D point cloud;
determining a display location, at the target portion of the physical anatomy, for the region of interest isosurface data according to coordinates in the unified 3D coordinate space, wherein determining the display location comprises:
determining a position and orientation of a current pose of a reference array, the current pose of the reference array comprising coordinates in the unified coordinate system, the reference array situated proximate to the target portion of the physical anatomy; and
rendering an Augmented Reality (AR) display of medical data with respect to the display location for the region of interest isosurface data.