| CPC G16H 40/40 (2018.01) [G06Q 10/087 (2013.01); G06T 11/00 (2013.01)] | 18 Claims |
|
1. A medical device computer system comprising:
a processor;
a display configured to display virtual objects along with a view of a medical device kit, the medical device kit including a plurality of storage locations each corresponding to a respective one of a plurality of medical devices, such that the plurality of storage locations are each configured to store a respective medical device;
an image sensor in communication with the processor, the image sensor configured to detect one or more physical characteristics of at least one of the medical device kit and the plurality of medical devices, the one or more physical characteristics including a geometrical dimension of a first one of the plurality of medical devices; and
at least one memory having stored therein instructions that, upon execution by the processor, cause the computer system to perform operations comprising:
determining a rule set corresponding to the at least one of the medical device kit and the plurality of medical devices;
comparing the one or more physical characteristics of the first one of the plurality of medical devices to the rule set;
determining, based on the one or more physical characteristics detected by the image sensor, that an incorrect medical device is at a first storage location of the plurality of storage locations;
selecting, based on the comparing the one or more physical characteristics to the rule set, a first virtual object to augment the view of the medical device kit indicating that the incorrect medical device is at the first storage location;
inserting the first virtual object into the view of the medical device kit so as to generate a first augmented view;
after the inserting step, generating a second virtual object that includes instructions that guide the retrieval of a correct first one of the plurality of medical devices from inventory, and overlaying the instructions over the first storage location;
determining that the first one of the plurality of medical devices has been loaded at the first storage location and is correct and, in response to determining that the first medical device loaded at the first storage location is correct, modifying the first virtual object within the view of the medical device kit, wherein the first virtual object indicates that the first one of the plurality of medical devices is required for a medical procedure;
comparing the geometrical dimension of the first one of the plurality of medical devices to a threshold;
displaying a virtual indication that the geometrical dimension of the first one of the plurality of medical devices is outside of the threshold;
comparing the one or more physical characteristics of a second one of the plurality of medical devices to the rule set;
selecting, based on the comparing the one or more physical characteristics to the rule set, a third virtual object to augment the view of the medical device kit; and
inserting the third virtual object into the view of the medical device kit so as to generate a second augmented view, wherein the third virtual object is different from the first virtual object and the third virtual object indicates that the second one of the plurality of medical devices is optional for the medical procedure.
|