US 12,469,005 B2
Methods and systems for creating reference image templates for identification of products on product storage structures of a product storage facility
Ashlin Ghosh, Ernakulam (IN); Raghava Balusu, Achanta (IN); Abhinav Pachauri, Kanpur (IN); Avinash M. Jade, Bangalore (IN); Lingfeng Zhang, Dallas, TX (US); Amit Jhunjhunwala, Bangalore (IN); William Craig Robinson, Jr., Centerton, AR (US); Benjamin R. Ellison, San Francisco, CA (US); Srinivas Muktevi, Bengaluru (IN); and Zhaoliang Duan, Frisco, TX (US)
Assigned to Walmart Apollo, LLC, Bentonville, AR (US)
Filed by Walmart Apollo, LLC, Bentonville, AR (US)
Filed on Jan. 24, 2023, as Appl. No. 18/158,983.
Prior Publication US 2024/0249239 A1, Jul. 25, 2024
Int. Cl. G06Q 10/087 (2023.01); G06Q 10/10 (2023.01)
CPC G06Q 10/087 (2013.01) 20 Claims
OG exemplary drawing
 
1. A system of creating reference template images for detecting and recognizing products at product storage areas of a product storage facility, the system comprising:
an image capture device having a field of view that includes at least a portion of a product storage structure in a product storage area of the product storage facility, the product storage structure having products arranged thereon, wherein the image capture device is configured to capture one or more images of the product storage structure; and
a computing device including a control circuit, the computing device being communicatively coupled to the image capture device, the control circuit being configured to:
receive, from the computing device, directional movement instructions;
obtain, using a sensor communicatively coupled to the control circuit, based on the directional movement instructions received, a plurality of images of the product storage structure captured by the image capture device;
analyze the obtained images of the product storage structure captured by the image capture device to detect individual ones of the products located on the product storage structure;
based on detection of the individual ones of the products in the images, recognize the individual ones of the products detected in the images as corresponding to a known product identifier;
crop each of the individual ones of the recognized products from the images to generate a plurality of cropped images;
create a cluster of the cropped images, wherein each of the cropped images in the cluster depicts one of the recognized individual products; and
analyze the cluster of the cropped images to select one of the cropped images as a reference template image representing the one of the recognized individual products.