US 12,472,002 B2
Surgical devices, systems, and methods using fiducial identification and tracking
Frederick E. Shelton, IV, Hillsboro, OH (US); Charles J. Scheib, Loveland, OH (US); and Andrew C. Deck, Cincinnati, OH (US)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Oct. 5, 2021, as Appl. No. 17/493,920.
Claims priority of provisional application 63/249,652, filed on Sep. 29, 2021.
Prior Publication US 2023/0100989 A1, Mar. 30, 2023
Int. Cl. A61B 8/00 (2006.01); A61B 1/00 (2006.01); A61B 1/04 (2006.01); A61B 34/20 (2016.01); A61B 34/30 (2016.01); A61B 90/00 (2016.01); A61B 90/30 (2016.01); A61B 90/96 (2016.01); A61B 90/98 (2016.01); G06T 5/50 (2006.01); G06T 5/77 (2024.01); G06T 5/80 (2024.01); G06T 7/00 (2017.01); G06V 10/10 (2022.01)
CPC A61B 34/20 (2016.02) [A61B 1/000095 (2022.02); A61B 1/042 (2013.01); A61B 34/30 (2016.02); A61B 90/30 (2016.02); A61B 90/37 (2016.02); A61B 90/39 (2016.02); A61B 90/96 (2016.02); A61B 90/98 (2016.02); G06T 5/50 (2013.01); G06T 5/77 (2024.01); G06T 5/80 (2024.01); G06T 7/00 (2013.01); G06T 7/0014 (2013.01); G06V 10/10 (2022.01); A61B 2034/2051 (2016.02); A61B 2034/2055 (2016.02); A61B 2034/2068 (2016.02); A61B 2034/302 (2016.02); A61B 2090/371 (2016.02); A61B 2090/374 (2016.02); A61B 2090/3762 (2016.02); A61B 2090/378 (2016.02); A61B 2090/3958 (2016.02); G06T 2207/10016 (2013.01); G06T 2207/10081 (2013.01); G06T 2207/10088 (2013.01); G06T 2207/10132 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30168 (2013.01); G06T 2207/30204 (2013.01); G06V 2201/034 (2022.01)] 20 Claims
OG exemplary drawing
 
14. A surgical method, comprising:
receiving information during performance of a surgical procedure, wherein the information indicates a first image of an undistorted visualization of a surgical site from a first surgical device and a second image of a distorted visualization of the surgical site;
identifying a critical structure associated with the surgical site;
determining that the distorted visualization of the surgical site includes a portion of the identified critical structure;
based on the determination that the distorted visualization of the surgical site includes at least the portion of the identified critical structure, supplementing the second image by filling in an element missing from the second image with the element present in the first image to reduce the distorted visualization of the second image;
generating a third image based on the supplemented second image; and
sending an indication of the third image to a display, to cause the display to show the third image.