US 12,346,874 B2
Vision-based system and method for providing inventory data collection and management
Fouad Bousetouane, Vernon Hills, IL (US); Ojasve Srikanth, Chicago, IL (US); Shubham Nagarkar, Chicago, IL (US); Toheeb Okenla, South Holland, IL (US); and Ling Ouyang, Chicago, IL (US)
Assigned to W.W. Grainger, Inc., Lake Forest, IL (US)
Filed by W.W. Grainger, Inc., Lake Forest, IL (US)
Filed on Sep. 6, 2022, as Appl. No. 17/903,114.
Prior Publication US 2024/0078505 A1, Mar. 7, 2024
Int. Cl. G06Q 10/087 (2023.01); G06F 3/0482 (2013.01); G06Q 30/0601 (2023.01); G06V 30/19 (2022.01); G06V 30/30 (2022.01)
CPC G06Q 10/087 (2013.01) [G06F 3/0482 (2013.01); G06V 30/19 (2022.01); G06V 30/30 (2022.01); G06Q 30/0633 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A non-transitory, computer-readable media having stored thereon instructions, the instructions, when executed by a computing device, cause the computing device to perform steps comprising:
determining from data collected by one or more imaging elements of the computing device a plurality of discrete product storage locations within a product storage system with a first model trained to determine a layout of the product storage system, wherein each of the plurality of discrete storage locations corresponds to a product, wherein the first model comprises a trained edge detection model;
causing each of the plurality of plurality of discrete product storage locations to be associated with at least one cell of a grid comprised of a plurality of cells;
automatically generating a label for each of the plurality of cells of the grid, wherein the label includes information indicative of a location of the product storage system within a customer facility and a location of a corresponding one of the plurality of discrete storage locations within the product storage system;
displaying in a display of the computing device a first graphical user interface comprising the grid overlayed upon an image of the product storage system;
receiving via the first graphical user interface a selection of a one or more of the plurality of cells of the grid;
determining product related information captured via use of the one more imaging elements of the computing device with a second model trained to recognize product related information; and
causing the product related information to be linked in a memory storage associated with the computing device to the one of the plurality of discrete product storage locations that was associated with the selected at least one cell of the grid.