US 12,343,218 B2
Methods for autoregistration of arthroscopic video images to preoperative models and devices thereof
Brian William Quist, Salem, NH (US); Nathan Anil Netravali, Littleton, MA (US); and Paul Alexander Torrie, Marblehead, MA (US)
Assigned to SMITH & NEPHEW, INC., Memphis, TN (US); SMITH & NEPHEW ORTHOPAEDICS AG, Zug (CH); and SMITH & NEPHEW ASIA PACIFIC PTE. LIMITED, Singapore (SG)
Appl. No. 17/998,835
Filed by SMITH & NEPHEW, INC., Memphis, TN (US); SMITH & NEPHEW ORTHOPAEDICS AG, Zug (CH); and SMITH & NEPHEW ASIA PACIFIC PTE. LIMITED, Singapore (SG)
PCT Filed Jun. 16, 2021, PCT No. PCT/US2021/037580
§ 371(c)(1), (2) Date Nov. 15, 2022,
PCT Pub. No. WO2021/257672, PCT Pub. Date Dec. 23, 2021.
Claims priority of provisional application 63/111,844, filed on Nov. 10, 2020.
Claims priority of provisional application 63/040,664, filed on Jun. 18, 2020.
Prior Publication US 2023/0200928 A1, Jun. 29, 2023
Int. Cl. A61B 90/00 (2016.01); A61B 34/00 (2016.01); A61B 34/10 (2016.01); A61B 34/20 (2016.01)
CPC A61B 90/36 (2016.02) [A61B 34/10 (2016.02); A61B 34/20 (2016.02); A61B 34/25 (2016.02); A61B 2034/105 (2016.02); A61B 2034/2065 (2016.02); A61B 2034/252 (2016.02); A61B 2090/365 (2016.02); A61B 2090/366 (2016.02); A61B 2090/368 (2016.02); G06T 2207/30008 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for registration of arthroscopic video images to preoperative models, the method implemented by one or more surgical computing devices and comprising:
applying a machine learning model to diagnostic video data captured via an arthroscope to identify an anatomical structure represented in the diagnostic video data;
registering one of a plurality of anatomical structures in a three-dimensional (3D) anatomical model to the anatomical structure represented in the diagnostic video data, wherein the 3D anatomical model is generated from preoperative image data;
tracking the anatomical structure intraoperatively based on the registration;
generating a simulated projected view of the registered one of the plurality of anatomical structures from the 3D anatomical model based on a determined orientation of the arthroscope during capture by the arthroscope of intraoperative video data; and
outputting the simulated projected view scaled and oriented based on one or more landmark features of the anatomical structure extracted from the intraoperative video data.