US 11,659,023 B2
Method of hub communication
Frederick E. Shelton, IV, Hillsboro, OH (US); David C. Yates, Morrow, OH (US); Eitan T. Wiener, Loveland, OH (US); Jeffrey L. Aldridge, Lebanon, OH (US); Jeffrey D. Messerly, Cincinnati, OH (US); Jason L. Harris, Lebanon, OH (US); Tamara Widenhouse, Clarksville, OH (US); and Jerome R. Morgan, Cincinnati, OH (US)
Assigned to Cilag GmbH International, Zug (CH)
Filed by Cilag GmbH International, Zug (CH)
Filed on Dec. 4, 2018, as Appl. No. 16/209,395.
Claims priority of provisional application 62/773,728, filed on Nov. 30, 2018.
Claims priority of provisional application 62/773,778, filed on Nov. 30, 2018.
Claims priority of provisional application 62/773,741, filed on Nov. 30, 2018.
Claims priority of provisional application 62/773,742, filed on Nov. 30, 2018.
Claims priority of provisional application 62/750,529, filed on Oct. 25, 2018.
Claims priority of provisional application 62/750,539, filed on Oct. 25, 2018.
Claims priority of provisional application 62/750,555, filed on Oct. 25, 2018.
Claims priority of provisional application 62/729,176, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,185, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,191, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,184, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,182, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,183, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,186, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,195, filed on Sep. 10, 2018.
Claims priority of provisional application 62/729,177, filed on Sep. 10, 2018.
Claims priority of provisional application 62/721,995, filed on Aug. 23, 2018.
Claims priority of provisional application 62/721,999, filed on Aug. 23, 2018.
Claims priority of provisional application 62/721,998, filed on Aug. 23, 2018.
Claims priority of provisional application 62/721,996, filed on Aug. 23, 2018.
Claims priority of provisional application 62/721,994, filed on Aug. 23, 2018.
Claims priority of provisional application 62/692,748, filed on Jun. 30, 2018.
Claims priority of provisional application 62/692,768, filed on Jun. 30, 2018.
Claims priority of provisional application 62/692,747, filed on Jun. 30, 2018.
Claims priority of provisional application 62/691,227, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,257, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,251, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,228, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,219, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,230, filed on Jun. 28, 2018.
Claims priority of provisional application 62/691,262, filed on Jun. 28, 2018.
Claims priority of provisional application 62/665,192, filed on May 1, 2018.
Claims priority of provisional application 62/665,134, filed on May 1, 2018.
Claims priority of provisional application 62/665,139, filed on May 1, 2018.
Claims priority of provisional application 62/665,128, filed on May 1, 2018.
Claims priority of provisional application 62/665,129, filed on May 1, 2018.
Claims priority of provisional application 62/665,177, filed on May 1, 2018.
Claims priority of provisional application 62/659,900, filed on Apr. 19, 2018.
Claims priority of provisional application 62/650,887, filed on Mar. 30, 2018.
Claims priority of provisional application 62/650,882, filed on Mar. 30, 2018.
Claims priority of provisional application 62/650,877, filed on Mar. 30, 2018.
Claims priority of provisional application 62/650,898, filed on Mar. 30, 2018.
Claims priority of provisional application 62/649,294, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,310, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,327, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,291, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,315, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,333, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,320, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,323, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,302, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,313, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,300, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,307, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,309, filed on Mar. 28, 2018.
Claims priority of provisional application 62/649,296, filed on Mar. 28, 2018.
Claims priority of provisional application 62/611,339, filed on Dec. 28, 2017.
Claims priority of provisional application 62/611,341, filed on Dec. 28, 2017.
Claims priority of provisional application 62/611,340, filed on Dec. 28, 2017.
Prior Publication US 2019/0201136 A1, Jul. 4, 2019
Int. Cl. A61B 34/00 (2016.01); H04L 67/10 (2022.01); A61M 1/00 (2006.01); A61B 1/00 (2006.01); A61B 90/00 (2016.01); A61B 34/20 (2016.01); A61B 34/32 (2016.01); A61B 90/35 (2016.01); G16H 40/67 (2018.01); G16H 10/60 (2018.01); G16H 50/20 (2018.01); G16H 40/63 (2018.01); G16H 70/20 (2018.01); A61B 1/05 (2006.01); A61B 1/06 (2006.01); A61B 5/00 (2006.01); A61B 5/026 (2006.01); A61B 6/00 (2006.01); A61B 17/068 (2006.01); A61B 17/072 (2006.01); A61B 17/11 (2006.01); A61B 17/115 (2006.01); A61B 17/128 (2006.01); A61B 17/32 (2006.01); A61B 18/14 (2006.01); B25J 9/16 (2006.01); B25J 13/00 (2006.01); G06K 7/10 (2006.01); G06K 19/077 (2006.01); H01Q 1/22 (2006.01); H04L 9/40 (2022.01); H04L 67/12 (2022.01); H04N 5/272 (2006.01); H04N 7/18 (2006.01); H05K 1/02 (2006.01); H05K 1/18 (2006.01); A61B 34/30 (2016.01); A61B 90/30 (2016.01); A61B 17/00 (2006.01); A61B 18/00 (2006.01); A61M 13/00 (2006.01)
CPC H04L 67/10 (2013.01) [A61B 1/00045 (2013.01); A61B 1/000094 (2022.02); A61B 1/000096 (2022.02); A61B 1/051 (2013.01); A61B 1/0661 (2013.01); A61B 5/0066 (2013.01); A61B 5/0075 (2013.01); A61B 5/0261 (2013.01); A61B 6/5247 (2013.01); A61B 17/0682 (2013.01); A61B 17/072 (2013.01); A61B 17/1114 (2013.01); A61B 17/1155 (2013.01); A61B 17/1285 (2013.01); A61B 17/320092 (2013.01); A61B 18/1442 (2013.01); A61B 18/1445 (2013.01); A61B 34/20 (2016.02); A61B 34/25 (2016.02); A61B 34/32 (2016.02); A61B 34/71 (2016.02); A61B 90/35 (2016.02); A61B 90/361 (2016.02); A61B 90/37 (2016.02); A61M 1/73 (2021.05); A61M 1/79 (2021.05); B25J 9/1697 (2013.01); B25J 13/006 (2013.01); G06K 7/10316 (2013.01); G06K 19/07749 (2013.01); G16H 10/60 (2018.01); G16H 40/63 (2018.01); G16H 40/67 (2018.01); G16H 50/20 (2018.01); G16H 70/20 (2018.01); H01Q 1/22 (2013.01); H04L 63/1416 (2013.01); H04L 67/12 (2013.01); H04N 5/272 (2013.01); H04N 7/183 (2013.01); H05K 1/028 (2013.01); H05K 1/189 (2013.01); A61B 34/30 (2016.02); A61B 2017/0003 (2013.01); A61B 2017/0011 (2013.01); A61B 2017/00022 (2013.01); A61B 2017/00026 (2013.01); A61B 2017/00039 (2013.01); A61B 2017/00044 (2013.01); A61B 2017/00057 (2013.01); A61B 2017/00061 (2013.01); A61B 2017/00075 (2013.01); A61B 2017/00084 (2013.01); A61B 2017/00097 (2013.01); A61B 2017/00106 (2013.01); A61B 2017/00115 (2013.01); A61B 2017/00119 (2013.01); A61B 2017/00199 (2013.01); A61B 2017/00203 (2013.01); A61B 2017/00221 (2013.01); A61B 2017/00398 (2013.01); A61B 2017/00402 (2013.01); A61B 2017/00734 (2013.01); A61B 2017/00809 (2013.01); A61B 2017/00818 (2013.01); A61B 2017/07257 (2013.01); A61B 2017/07271 (2013.01); A61B 2017/07278 (2013.01); A61B 2017/07285 (2013.01); A61B 2017/1132 (2013.01); A61B 2017/32007 (2017.08); A61B 2017/320074 (2017.08); A61B 2017/320084 (2013.01); A61B 2017/320095 (2017.08); A61B 2017/320097 (2017.08); A61B 2018/0063 (2013.01); A61B 2018/00541 (2013.01); A61B 2018/00589 (2013.01); A61B 2018/00595 (2013.01); A61B 2018/00601 (2013.01); A61B 2018/00607 (2013.01); A61B 2018/00642 (2013.01); A61B 2018/00684 (2013.01); A61B 2018/00791 (2013.01); A61B 2018/00827 (2013.01); A61B 2018/00875 (2013.01); A61B 2018/00892 (2013.01); A61B 2018/00988 (2013.01); A61B 2018/00994 (2013.01); A61B 2034/2055 (2016.02); A61B 2034/2057 (2016.02); A61B 2034/301 (2016.02); A61B 2034/305 (2016.02); A61B 2090/309 (2016.02); A61B 2217/005 (2013.01); A61B 2217/007 (2013.01); A61B 2218/002 (2013.01); A61B 2218/007 (2013.01); A61B 2218/008 (2013.01); A61M 1/80 (2021.05); A61M 13/003 (2013.01); A61M 2205/3306 (2013.01); A61M 2205/3327 (2013.01); A61M 2205/3331 (2013.01); A61M 2205/3365 (2013.01); A61M 2205/3368 (2013.01); G05B 2219/40174 (2013.01); G05B 2219/45119 (2013.01)] 4 Claims
OG exemplary drawing
 
1. A method, comprising:
establishing a first communication link between a surgical visualization system outside a sterile field in an operating room and a primary display inside the sterile field, wherein the surgical visualization system comprises at least one imaging display, at least one image processing unit, and at least one imaging sensor;
modifying an image frame captured from a live feed of a surgical site during a surgical procedure based on a diagnostic input;
transmitting the modified image frame from the surgical visualization system to the primary display;
determining surgical procedure information using the image frame captured from the live feed of the surgical site during the surgical procedure, the surgical procedure information indicating an upcoming step of the surgical procedure;
establishing, based on the determined surgical procedure information, a second communication link between a robotic hub in the operating room and the primary display;
automatically activating and configuring one or more surgical instruments coupled to the robotic hub based on the determined surgical procedure information, wherein the one or more surgical instruments are to be utilized in the upcoming step of the surgical procedure; and
transmitting another image frame from the robotic hub to the primary display.