US 12,229,741 B2
Methods, systems, articles of manufacture, and apparatus for decoding purchase data using an image
Jose Javier Yebes Torres, Valladolid (ES); Aditi Sinha, Weehawken, NY (US); Christine Lebrun, Paris (FR); Fabio Oppini, Milan (IT); Atul Bansal, New York, NY (US); Mukul Kumar, New York, NY (US); Vignesh Chandramouli, New York, NY (US); Filipa Sousa, New York, NY (US); and Gisella Mercaldi, Oxford (GB)
Assigned to Nielsen Consumer LLC, Chicago, IL (US)
Filed by Nielsen Consumer LLC, New York, NY (US)
Filed on Mar. 31, 2022, as Appl. No. 17/710,660.
Claims priority of provisional application 63/214,571, filed on Jun. 24, 2021.
Prior Publication US 2022/0414630 A1, Dec. 29, 2022
Int. Cl. G06Q 20/20 (2012.01); G06K 7/14 (2006.01); G06V 30/414 (2022.01); G06V 30/42 (2022.01)
CPC G06Q 20/201 (2013.01) [G06K 7/1413 (2013.01); G06V 30/414 (2022.01); G06V 30/42 (2022.01)] 18 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a first dictionary including images of product descriptions and barcodes;
interface circuitry;
machine readable instructions; and
at least one processor circuit to be programmed by the machine readable instructions to:
train a region detection machine learning model based on (a) the images of the product descriptions and barcodes, (b) ground truth annotations, and (c) intersection over union (IoU) comparisons of bounding boxes associated with the images;
based on satisfying a threshold IoU value of the region detection machine learning model, obtain purchase details and barcodes corresponding to a receipt, the purchase details including a first product description;
generate a first search query that includes the first product description, a list of barcodes corresponding to the barcodes, and a store identifier associated with the receipt;
execute a first search against the first dictionary using the first search query to identify a first barcode from the list of barcodes that corresponds to the first product description;
generate a second search query when the first search does not identify the first barcode, the second search query to include the first product description, the list of barcodes, and the store identifier;
execute a second search against a second dictionary based on the second search query to identify the first barcode;
associate the first barcode and the first product description; and
add the association to the first dictionary.