US 11,730,545 B2
System and method for multi-client deployment of augmented reality instrument tracking
Zigang Jimmy Qiu, Toronto (CA); Stefan Hofer, Toronto (CA); Blake Murphy, Toronto (CA); Tomas J. Saun, Toronto (CA); Lukasz Brzozowski, Mississauga (CA); Trinette Wright, Toronto (CA); and Xun Lin, Toronto (CA)
Assigned to University Health Network, Toronto (CA)
Filed by University Health Network, Toronto (CA)
Filed on Aug. 11, 2022, as Appl. No. 17/886,195.
Application 17/886,195 is a continuation of application No. 16/882,703, filed on May 25, 2020, granted, now 11,413,094.
Claims priority of provisional application 62/852,763, filed on May 24, 2019.
Prior Publication US 2022/0378510 A1, Dec. 1, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. A61B 34/10 (2016.01); G06T 15/00 (2011.01); G06T 19/00 (2011.01); G06T 15/06 (2011.01)
CPC A61B 34/10 (2016.02) [G06T 15/005 (2013.01); G06T 19/006 (2013.01); A61B 2034/101 (2016.02); G06T 15/06 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method of guiding augmented reality (AR) intervention using a primary client device and a server, the primary client device having a first processor and a first input device, the method comprising:
receiving, at the primary client device, model sets, an intervention plan having an intervention field, and session information about a session related to the AR intervention from the server;
receiving, at the primary client device, first real-time input data from the first input device;
generating, at the first processor, metrics by determining an evaluation of an execution of the intervention plan by comparing the intervention plan to the first real-time input data;
displaying, on the primary client device, real-time graphics, based at least in part on the metrics, spatially over the intervention field;
receiving, at the primary client device, real-time status data, from the server, about a replicate client device connected to the server after the replicate client device joins the session;
sending, from the primary client device, the first real-time input data, through the server, to the replicate client device within the session;
sending, from the primary client device, the metrics and the evaluation computed from the intervention plan, through the server, to the replicate client device within the session;
receiving, at the primary client device, second real-time input data from the server, the second real-time input data originating from the replicate client device and relating to the intervention plan; and
displaying, at the primary client device, real-time graphics based at least in part on the second real-time input data from the replicate client device.