US 12,112,512 B1
Virtual planogram automation and modification with computer vision
Mayank Tiwari, Telangana (IN); Ankit Belchandan, Chhattisgarh (IN); Bharani Sarvepalli, Hyderabad (IN); and Santosh Kumar, Jharkhand (IN)
Assigned to Blue Yonder Group, Inc., Scottsdale, AZ (US)
Filed by Blue Yonder Group, Inc., Scottsdale, AZ (US)
Filed on Jun. 8, 2022, as Appl. No. 17/835,726.
Claims priority of provisional application 63/220,740, filed on Jul. 12, 2021.
Claims priority of provisional application 63/214,965, filed on Jun. 25, 2021.
Claims priority of provisional application 63/208,638, filed on Jun. 9, 2021.
Int. Cl. G06V 10/22 (2022.01); G06T 7/60 (2017.01); G06T 15/20 (2011.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01)
CPC G06V 10/235 (2022.01) [G06T 7/60 (2013.01); G06T 15/205 (2013.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
a retail entity comprising a product display area; and
a planogram planner comprising a server and configured to:
access one or more images of one or more products prior to the display of the one or more products in the product display area;
classify the one or more images by using a convolutional neural network;
assign a bounding box to the one or more products identified in the one or more images;
localize and detect one or more objects and estimate one or more product dimensions corresponding to the one or more objects;
determine one or more changes in the estimated one or more product dimensions by comparing the one or more estimated product dimensions with one or more corresponding baseline product dimensions to determine whether one or more product dimensions has changed; and
determine a total area remaining in a simulated planogram for alternative product placements after factoring in the determined one or more changes in product dimensions.