US 12,444,487 B2
System and method for augmented reality detection of loose pharmacy items
Christopher M. Myers, Dublin, OH (US); and Ellen E. Seeser, St. Louis, MO (US)
Assigned to Express Scripts Strategic Development, Inc., St. Louis, MO (US)
Filed by Express Scripts Strategic Development, Inc., St. Louis, MO (US)
Filed on Jul. 28, 2023, as Appl. No. 18/227,447.
Application 18/227,447 is a continuation of application No. 17/498,408, filed on Oct. 11, 2021, granted, now 11,776,673.
Application 17/498,408 is a continuation of application No. 16/779,223, filed on Jan. 31, 2020, granted, now 11,145,397, issued on Oct. 12, 2021.
Prior Publication US 2023/0368884 A1, Nov. 16, 2023
Int. Cl. G16H 20/10 (2018.01); G06N 3/08 (2023.01); G06T 19/00 (2011.01); G06V 20/20 (2022.01)
CPC G16H 20/10 (2018.01) [G06N 3/08 (2013.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for fulfilling an order using augmented reality, the method comprising:
retrieving, using a processor of a wearable augmented reality device, a request for at least one item to be transported between at least two locations;
receiving, at the processor of the wearable augmented reality device, an input to operate the wearable augmented reality device in one of a training mode, and a non-training mode;
capturing, by an image capturing device of the wearable augmented reality device, a plurality of images of an environment within a field of view of the wearable augmented reality device;
detecting retrieval of the at least one item from one of a first location and a second location of the at least two locations, the first location being circumscribed by a superimposed highlight;
monitoring delivery of the at least one item at one of the second location, and a third location of the at least two locations, the third location being lidded by a virtual boundary superimposed at the third location; and
in response to receiving the input to operate in the training mode:
compiling a training video with the plurality of images;
prior to detecting retrieval of the at least one item, associating a first timestamp at a beginning of the training video;
in response to monitoring delivery of the at least one item, associating a second timestamp at an end of the training video; and
storing the training video in accumulated training data.