US 11,694,776 B2
Generating prescription records from a prescription label on a medication package
Walter R. Smith, Seattle, WA (US); Chi-Kai Chien, Los Altos Hills, CA (US); Christian Hagel-Sorensen, Sammamish, WA (US); Frédéric Médous, San Francisco, CA (US); Peyman Oreizy, Seattle, WA (US); Jonathan Schwartz, San Francisco, CA (US); Brittany Staten, San Francisco, CA (US); and Paul Teixeira, San Francisco, CA (US)
Assigned to WALMART APOLLO, LLC, Bentonville, AR (US)
Filed by WALMART APOLLO, LLC, Bentonville, AR (US)
Filed on Aug. 24, 2018, as Appl. No. 16/111,697.
Application 16/111,697 is a continuation of application No. 14/656,691, filed on Mar. 12, 2015.
Prior Publication US 2018/0366218 A1, Dec. 20, 2018
Int. Cl. G16H 10/60 (2018.01); G16H 20/10 (2018.01); G16Z 99/00 (2019.01); G06V 30/142 (2022.01); G16H 30/20 (2018.01); G06V 30/10 (2022.01); H04N 23/60 (2023.01); G06V 30/14 (2022.01)
CPC G16H 10/60 (2018.01) [G06V 30/142 (2022.01); G16H 20/10 (2018.01); G16H 30/20 (2018.01); G16Z 99/00 (2019.02); G06V 30/10 (2022.01); G06V 30/141 (2022.01); H04N 23/64 (2023.01)] 26 Claims
OG exemplary drawing
 
1. A method comprising:
maintaining a medication management system that is connected to a plurality of client devices via a network, wherein the plurality of client devices connected via the network includes a first subset of mobile client devices operated by one or more patients and a second subset of client devices operated by reviewing users associated with the medication management system;
responsive to an application having been launched on at least one patient-operated mobile client device of the first subset, enabling access to the medication management system on the at least one patient-operated mobile client device, wherein the at least one patient-operated mobile client device is operated by a patient of the one or more patients, wherein the application comprises a user interface on the at least one patient-operated mobile client device for capturing one or more images, and wherein the at least one patient-operated mobile client device operates a camera;
responsive to the patient operating the camera, the application checks a motion of the camera via a motion sensor of the at least one patient-operated mobile client device on which the application is launched, wherein the application displays information to the patient via the user interface describing the motion of the camera during image capture by the camera when sensor readings of the motion sensor exceed a first threshold measurement associated with the sensor readings;
determining an edge density associated with a set of images, wherein the application displays information to the patient via the user interface on the camera describing a value of the edge density in the set of images when the value exceeds a second threshold measurement, and wherein the information, as displayed via the user interface, comprises instructions to the patient to operate the camera to execute one or more corrective measures based on the value of the edge density;
receiving, by the medication management system from the at least one patient-operated mobile client device, the one or more images, wherein each image of the one or more images comprises a different portion of a prescription label on a medication package associated with the patient and captured by the camera of the at least one patient-operated mobile client device;
determining, using contrast, a location of each image in the set of images that is associated with a respective portion of the prescription label on a non-planar surface;
for the images of the one or more images determined to be of the prescription label, storing the images as a batch of images for the prescription label;
associating each of the images of the batch of images with a patient identifier for the patient who provided the one or more images to the medication management system via the at least one patient-operated mobile client device;
receiving, from the at least one patient-operated mobile client device of the second subset operated by a reviewing user of the reviewing users, a confirmation of review of the prescription label in the batch of images associated with the patient identifier;
storing, by the medication management system, the confirmation of review for each prescription label in association with the patient identifier of a respective patient who provided the one or more images; and
generating, by the medication management system, a structured prescription record for the prescription label based on the confirmation of review, wherein the structured prescription record includes information about a prescription identified by the prescription label on the medication package.