CPC A61B 34/10 (2016.02) [G06T 15/005 (2013.01); G06T 19/006 (2013.01); A61B 2034/101 (2016.02); G06T 15/06 (2013.01)] | 20 Claims |
1. A computer-implemented method of guiding augmented reality (AR) intervention using a primary client device and a server, the primary client device having a first processor and a first input device, the method comprising:
receiving, at the primary client device, model sets, an intervention plan having an intervention field, and session information about a session related to the AR intervention from the server;
receiving, at the primary client device, first real-time input data from the first input device;
generating, at the first processor, metrics by determining an evaluation of an execution of the intervention plan by comparing the intervention plan to the first real-time input data;
displaying, on the primary client device, real-time graphics, based at least in part on the metrics, spatially over the intervention field;
receiving, at the primary client device, real-time status data, from the server, about a replicate client device connected to the server after the replicate client device joins the session;
sending, from the primary client device, the first real-time input data, through the server, to the replicate client device within the session;
sending, from the primary client device, the metrics and the evaluation computed from the intervention plan, through the server, to the replicate client device within the session;
receiving, at the primary client device, second real-time input data from the server, the second real-time input data originating from the replicate client device and relating to the intervention plan; and
displaying, at the primary client device, real-time graphics based at least in part on the second real-time input data from the replicate client device.
|