US 12,079,765 B2
Method for tracking and maintaining inventory in a store
Bradley Bogolea, San Francisco, CA (US); Durgesh Tiwari, San Francisco, CA (US); Jariullah Safi, San Francisco, CA (US); Shiva Reddy, San Francisco, CA (US); and Lorin Vandegrift, San Francisco, CA (US)
Assigned to Simbe Robotics, Inc., South San Francisco, CA (US)
Filed by Simbe Robotics, Inc., South San Francisco, CA (US)
Filed on Jul. 28, 2021, as Appl. No. 17/387,866.
Application 17/387,866 is a continuation of application No. 17/104,610, filed on Nov. 25, 2020.
Claims priority of provisional application 62/940,157, filed on Nov. 25, 2019.
Prior Publication US 2021/0357851 A1, Nov. 18, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06K 9/00 (2022.01); G06Q 10/087 (2023.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06V 10/22 (2022.01); G06V 20/00 (2022.01); G06V 20/10 (2022.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G06V 30/224 (2022.01)
CPC G06Q 10/087 (2013.01) [G06T 7/0008 (2013.01); G06T 7/11 (2017.01); G06V 10/22 (2022.01); G06V 20/10 (2022.01); G06V 20/36 (2022.01); G06V 20/41 (2022.01); G06V 20/52 (2022.01); G06V 30/2247 (2022.01); G06T 2207/30108 (2013.01); G06T 2207/30242 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for tracking and maintaining inventory in a store comprising:
accessing a first image of a first inventory structure in the store;
identifying a top shelf, in a first set of shelves in the first inventory structure, depicted in the first image;
identifying a first shelf, in the first set of shelves in the first inventory structure, depicted in the first image, the first shelf arranged below the top shelf in the first inventory structure;
detecting an understock condition at a first slot on the first shelf based on a first set of features detected in a first region of the first image adjacent the first shelf, the first slot assigned to a first product type;
identifying a first set of product units, of the first product type, occupying the top shelf at the first inventory structure based on a second set of features detected in a second region of the first image adjacent the top shelf;
annotating a visual representation of the first inventory structure to indicate locations of the first set of product units on the top shelf at the first inventory structure; and
generating a first prompt, associated with the visual representation, to transfer product units of the first product type from the top shelf into the first slot on the first shelf at the first inventory structure.