US 12,293,432 B2
Cooperative overlays of interacting instruments which result in both overlays being effected
Frederick E. Shelton, IV, Hillsboro, OH (US); Shane R. Adams, Lebanon, OH (US); Kevin M. Fiebig, Cincinnati, OH (US); Matthew D. Cowperthwait, Cincinnati, OH (US); Cory G. Kimball, Hamilton, OH (US); Monica L. Z. Rivard, Cincinnati, OH (US); Leonardo N. Rossoni, Rahway, NJ (US); Risto Kojcev, Santa Clara, CA (US); and Felix J. Bork, Schnürpflingen (DE)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Mar. 7, 2022, as Appl. No. 17/688,646.
Claims priority of provisional application 63/284,326, filed on Nov. 30, 2021.
Claims priority of provisional application 63/174,674, filed on Apr. 14, 2021.
Prior Publication US 2022/0331056 A1, Oct. 20, 2022
Int. Cl. G06T 11/00 (2006.01); A61B 34/00 (2016.01); A61B 34/10 (2016.01); A61B 34/20 (2016.01); A61B 34/30 (2016.01); A61B 34/32 (2016.01); A61B 90/00 (2016.01); G06F 3/14 (2006.01); G06F 3/147 (2006.01); G06T 7/00 (2017.01); G06T 7/20 (2017.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01); G08B 21/18 (2006.01); G16H 20/40 (2018.01); G16H 40/67 (2018.01); H04L 9/40 (2022.01); H04L 67/12 (2022.01); H04W 24/10 (2009.01); H04W 76/14 (2018.01)
CPC G06T 11/00 (2013.01) [A61B 34/20 (2016.02); A61B 34/25 (2016.02); A61B 34/30 (2016.02); A61B 34/32 (2016.02); A61B 34/76 (2016.02); A61B 90/36 (2016.02); A61B 90/361 (2016.02); A61B 90/37 (2016.02); A61B 90/39 (2016.02); G06F 3/14 (2013.01); G06F 3/1454 (2013.01); G06F 3/147 (2013.01); G06T 7/0012 (2013.01); G06T 7/20 (2013.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); G08B 21/182 (2013.01); G16H 20/40 (2018.01); G16H 40/67 (2018.01); H04L 63/105 (2013.01); H04L 67/12 (2013.01); H04W 24/10 (2013.01); H04W 76/14 (2018.02); A61B 2034/102 (2016.02); A61B 2034/2055 (2016.02); A61B 2034/2072 (2016.02); A61B 2090/365 (2016.02); A61B 2090/371 (2016.02); A61B 2090/372 (2016.02); G06T 2210/41 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method for displaying a cooperative overlay of interacting instruments, the method comprising:
determining an operation of a first surgical instrument;
generating, for displaying via a first intraoperative display of a surgical field, a first data overlay based on the operation of the first surgical instrument;
detecting an interaction between the first surgical instrument and a second surgical instrument;
generating, for displaying via the first intraoperative display, an indicator of the interaction based on the interaction between the first surgical instrument and second surgical instrument;
determining a combined force applied to a tissue by the first surgical instrument and the second surgical instrument; and
generating, for displaying via the first intraoperative display, an indication of the combined force applied to the tissue by the first surgical instrument and the second surgical instrument.