US 12,367,457 B2
Systems and methods of verifying price tag label-product pairings
Lingfeng Zhang, Dallas, TX (US); Wei Wang, Dallas, TX (US); Avinash Madhusudanrao Jade, Bangalore (IN); Raghava Balusu, Achanta (IN); Mingquan Yuan, Flower Mound, TX (US); Jing Wang, Dallas, TX (US); Han Zhang, Allen, TX (US); Zhaoliang Duan, Frisco, TX (US); William Craig Robinson, Jr., Centerton, AR (US); Benjamin R. Ellison, San Francisco, CA (US); and Paul Lewis Lobo, Irving, TX (US)
Assigned to Walmart Apollo, LLC, Bentonville, AR (US)
Filed by Walmart Apollo, LLC, Bentonville, AR (US)
Filed on Nov. 9, 2022, as Appl. No. 17/983,773.
Prior Publication US 2024/0152863 A1, May 9, 2024
Int. Cl. G06Q 10/087 (2023.01); G06V 20/50 (2022.01); G06V 30/19 (2022.01); G06V 30/30 (2022.01)
CPC G06Q 10/087 (2013.01) [G06V 20/50 (2022.01); G06V 30/19007 (2022.01); G06V 30/30 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A system for verifying pairings of on-shelf tag labels and products at a product storage facility, the system comprising:
an electronic database configured to store inventory data for the product storage facility;
a device configured for movement throughout the product storage facility;
a single camera incorporated into the device, the single camera configured to capture a single image of a product storage structure in the product storage facility, wherein the single camera has a field of view that is wide enough to capture the entirety of the product storage structure in the single image, and wherein the product storage structure is a free-standing product display that is independent from other product storage structures in the product storage facility; and
a computing device communicatively coupled to the single camera, the computing device configured to:
detect, in the single image, a price tag label affixed to the product storage structure and a product arranged on the product storage structure;
extract character(s) from the product in the single image and character(s) from the price tag label in the single image, wherein the character(s) extracted from the product are independent from a bar code on the product and the character(s) extracted from the price tag label are independent from a bar code on the price tag label;
determine, based on the character(s) extracted from the price tag label, a product code associated with the price tag label, the product code being identified without referencing the bar code on the price tag label;
determine, based on the character(s) extracted from the product, a keyword instance indicating both a keyword on the product and a specific location of the keyword on the product;
correlate the keyword instance with the inventory data stored in the electronic database to identify a product name associated with the product, the product name being identified without referencing the bar code on the product;
determine that the product name associated with the product matches the product code associated with the price tag label; and
transmit, to the electronic database, a signal indicating that the price tag label is properly allocated to the product storage structure responsive to determining that the product name associated with the product matches the product code associated with the price tag label.