CPC G06Q 10/06315 (2013.01) [G06F 18/241 (2023.01); G06F 18/2431 (2023.01); G06N 3/02 (2013.01); G06N 5/02 (2013.01); G06Q 10/087 (2013.01); G06T 7/73 (2017.01); G06T 11/20 (2013.01); G06T 11/60 (2013.01); G06V 10/25 (2022.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/10 (2022.01); G06V 20/176 (2022.01); G06T 2207/20084 (2013.01); G06T 2210/12 (2013.01)] | 16 Claims |
1. A system for identifying consumer packaged goods (CPGs), comprising: an imaging device mounted on a mobile platform:
a CPG detector which is equipped with a neural network and which
(a) utilizes the imaging device to obtain an image containing a plurality of CPGs,
(b) detects a set of CPG superclass features in the image, and
(c) generates a CPG feature map which maps the location of CPG features in the image,
wherein said neural network has been trained on a set of images of CPGs to recognize which of a set of superclasses a detected CPG belongs to;
a region proposal network which accepts the CPG feature map as input and which returns a first set of regions in the image where a CPG could be located;
a superclassifier which examines each region in the first set of regions to determine if the region contains an instance of a superclass of a CPG, and which outputs a second set of regions containing a CPG; and
a superclass proposal layer which operates on each member of the second set of regions and returns a set of superclass proposals for each region;
wherein said imaging device is mounted on a drone;
wherein said region proposal network, said superclassifier, and said superclass proposal layer are defined in an operating system running in a tangible, non-transient memory medium installed on said drone.
|