US 12,079,771 B2
Withholding notifications due to temporary misplaced products
Yair Adato, Kfar Shmuel (IL); Youval Bronicki, Los Altos, CA (US); Ziv Mhabary, Tel Aviv (IL); and Dolev Pomeranz, Hod Hasharon (IL)
Assigned to Trax Technology Solutions Pte Ltd., Singapore (SG)
Filed by Trax Technology Solutions Pte Ltd., Singapore (SG)
Filed on Dec. 20, 2022, as Appl. No. 18/085,023.
Application 18/085,023 is a continuation of application No. 17/130,994, filed on Dec. 22, 2020, granted, now 11,562,581.
Application 17/130,994 is a continuation of application No. 16/739,920, filed on Jan. 10, 2020, granted, now 10,902,240, issued on Jan. 6, 2021.
Application 16/739,920 is a continuation of application No. 16/353,390, filed on Mar. 14, 2019, granted, now 10,558,843, issued on Feb. 11, 2020.
Application 16/353,390 is a continuation of application No. PCT/US2019/013054, filed on Jan. 10, 2019.
Claims priority of provisional application 62/695,469, filed on Jul. 9, 2018.
Claims priority of provisional application 62/681,718, filed on Jun. 7, 2018.
Claims priority of provisional application 62/615,512, filed on Jan. 10, 2018.
Prior Publication US 2023/0124850 A1, Apr. 20, 2023
Int. Cl. G06V 10/00 (2022.01); G06F 16/23 (2019.01); G06F 16/28 (2019.01); G06F 16/55 (2019.01); G06F 16/583 (2019.01); G06F 16/903 (2019.01); G06F 17/18 (2006.01); G06F 18/2115 (2023.01); G06Q 10/0631 (2023.01); G06Q 10/0633 (2023.01); G06Q 10/08 (2023.01); G06Q 10/087 (2023.01); G06Q 10/0875 (2023.01); G06Q 20/20 (2012.01); G06Q 30/0242 (2023.01); G06Q 30/0601 (2023.01); G06T 7/00 (2017.01); G06T 7/13 (2017.01); G06T 7/20 (2017.01); G06T 7/521 (2017.01); G06T 7/55 (2017.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06V 20/00 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/52 (2022.01); G06V 20/62 (2022.01); G06V 20/64 (2022.01); G06V 40/10 (2022.01); G08B 21/18 (2006.01); H04N 23/51 (2023.01); H04N 23/54 (2023.01); H04N 23/611 (2023.01); H04N 23/66 (2023.01); H04N 23/80 (2023.01); H04N 23/90 (2023.01); G06Q 30/0201 (2023.01); G06V 20/68 (2022.01); G06V 30/10 (2022.01)
CPC G06Q 10/087 (2013.01) [G06F 16/23 (2019.01); G06F 16/235 (2019.01); G06F 16/288 (2019.01); G06F 16/55 (2019.01); G06F 16/583 (2019.01); G06F 16/5846 (2019.01); G06F 16/90335 (2019.01); G06F 17/18 (2013.01); G06F 18/2115 (2023.01); G06Q 10/06311 (2013.01); G06Q 10/063112 (2013.01); G06Q 10/06316 (2013.01); G06Q 10/0633 (2013.01); G06Q 10/08 (2013.01); G06Q 10/0875 (2013.01); G06Q 20/203 (2013.01); G06Q 30/0246 (2013.01); G06Q 30/0629 (2013.01); G06Q 30/0639 (2013.01); G06Q 30/0643 (2013.01); G06T 7/0002 (2013.01); G06T 7/13 (2017.01); G06T 7/20 (2013.01); G06T 7/521 (2017.01); G06T 7/55 (2017.01); G06T 7/70 (2017.01); G06T 7/75 (2017.01); G06V 20/00 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/52 (2022.01); G06V 20/62 (2022.01); G06V 20/64 (2022.01); G06V 40/10 (2022.01); G08B 21/18 (2013.01); G08B 21/182 (2013.01); H04N 23/51 (2023.01); H04N 23/54 (2023.01); H04N 23/611 (2023.01); H04N 23/66 (2023.01); H04N 23/80 (2023.01); H04N 23/90 (2023.01); G06Q 30/0201 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30232 (2013.01); G06T 2207/30242 (2013.01); G06V 20/68 (2022.01); G06V 30/10 (2022.01)] 21 Claims
OG exemplary drawing
 
1. A system for processing images captured in a retail store and automatically identifying misplaced products, the system comprising:
at least one processor configured to:
receive one or more images captured by one or more image sensors from an environment of a retail store and depicting a plurality of products displayed on at least one store shelf;
detect in the one or more images a first product, wherein the first product has an associated first correct display location, wherein detecting the first product comprises:
retrieving, from a database, a product model associated with the first product, the product model including parameters for a machine learning model configured to identify the first product; and
detecting the first product using the machine learning model;
determine, based on analysis of the one or more images, that the first product is not located in the first correct display location;
determine an indicator of a first level of urgency for returning the first product to the first correct display location;
cause an issuance of a user-notification associated with the first product, wherein the user-notification is issued within a first period of time from when the first product was determined not to be located in the first correct display location;
detect in the one or more images a second product, wherein the second product has an associated second correct display location;
determine, based on analysis of the one or more images, that the second product is not located in the second correct display location;
determine an indicator of a second level of urgency for returning the second product to its associated second correct display location; and
after determining that the second product is not located in the second correct display location and when the second urgency level is lower than the first urgency level, withhold issuance of a user-notification associated with the second product within a time duration equal to the first period of time.