US 12,177,387 B2
Method for stock keeping in a store with fixed cameras
Bradley Bogolea, South San Francisco, CA (US); Mirza Akbar Shah, South San Francisco, CA (US); Lorin Vandegrift, South San Francisco, CA (US); Luke Fraser, South San Francisco, CA (US); Jariullah Safi, South San Francisco, CA (US); Jeffrey Gee, South San Francisco, CA (US); and Durgesh Tiwari, South San Francisco, CA (US)
Assigned to Simbe Robotics, Inc., South San Francisco, CA (US)
Filed by Simbe Robotics, Inc., South San Francisco, CA (US)
Filed on Jan. 20, 2023, as Appl. No. 18/099,901.
Application 18/099,901 is a continuation of application No. 16/880,582, filed on May 21, 2020, granted, now 11,593,755.
Application 16/880,582 is a continuation in part of application No. 16/817,972, filed on Mar. 13, 2020, granted, now 10,891,589, issued on Jan. 12, 2021.
Application 16/817,972 is a continuation of application No. 16/578,406, filed on Sep. 23, 2019, granted, now 11,341,454, issued on May 24, 2022.
Application 16/880,582 is a continuation of application No. 15/600,527, filed on May 19, 2017, granted, now 10,467,587, issued on Nov. 5, 2019.
Claims priority of provisional application 62/818,080, filed on Mar. 13, 2019.
Claims priority of provisional application 62/339,039, filed on May 19, 2016.
Prior Publication US 2023/0421705 A1, Dec. 28, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 10/087 (2023.01); G05D 1/00 (2006.01); G06F 18/21 (2023.01); G06F 18/22 (2023.01); G06V 10/75 (2022.01); G06V 10/98 (2022.01); G06V 20/52 (2022.01); H04N 1/00 (2006.01); H04N 23/60 (2023.01); H04N 23/698 (2023.01); H04N 23/80 (2023.01); H04N 25/61 (2023.01)
CPC H04N 1/00 (2013.01) [G05D 1/0274 (2013.01); G05D 1/0282 (2013.01); G06F 18/21 (2023.01); G06F 18/22 (2023.01); G06Q 10/087 (2013.01); G06V 10/751 (2022.01); G06V 10/987 (2022.01); G06V 20/52 (2022.01); H04N 23/60 (2023.01); H04N 23/698 (2023.01); H04N 23/80 (2023.01); H04N 25/61 (2023.01); G05D 1/0246 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
accessing an image captured by an optical sensor, arranged within a store, at a first time;
detecting a segment of an inventory structure in the store in a first region of the image;
identifying a set of slots within the segment of the inventory structure;
accessing a first product model representing a first set of visual characteristics of a first product type assigned to a first slot, in the set of slots, by a graphical representation of the store;
detecting a first set of features in a subregion of the image;
detecting presence of a first product unit of the first product type occupying the segment of the inventory structure at the first time in response to the first set of features approximating the first set of visual characteristics;
detecting a first shelf tag in the image;
interpreting a set of possible product identifiers from the first shelf tag; and
flagging the first shelf tag for inspection in response to the set of possible product identifiers excluding a first product identifier of the first product type.