US 12,223,458 B2
Analyzing images to assess task performance
Youval Bronicki, Los Altos, CA (US); and Sheila Meftah, San Francisco, CA (US)
Assigned to Trax Technology Solutions Pte Ltd., Singapore (SG)
Filed by Trax Technology Solutions Pte Ltd., Singapore (SG)
Filed on May 12, 2023, as Appl. No. 18/316,606.
Application 18/316,606 is a continuation of application No. 17/661,929, filed on May 4, 2022, granted, now 11,687,865.
Application 17/661,929 is a continuation of application No. 17/357,554, filed on Jun. 24, 2021, granted, now 11,354,693, issued on Jun. 7, 2022.
Application 17/357,554 is a continuation of application No. PCT/US2021/034885, filed on May 28, 2021.
Claims priority of provisional application 63/113,490, filed on Nov. 13, 2020.
Claims priority of provisional application 63/091,009, filed on Oct. 13, 2020.
Claims priority of provisional application 63/084,086, filed on Sep. 28, 2020.
Claims priority of provisional application 63/033,055, filed on Jun. 1, 2020.
Prior Publication US 2023/0281549 A1, Sep. 7, 2023
Int. Cl. G06K 9/00 (2022.01); G01C 21/20 (2006.01); G01G 19/52 (2006.01); G05D 1/00 (2006.01); G06F 18/20 (2023.01); G06F 18/2431 (2023.01); G06F 18/25 (2023.01); G06N 5/04 (2023.01); G06N 20/00 (2019.01); G06Q 10/0631 (2023.01); G06Q 10/0637 (2023.01); G06Q 10/0639 (2023.01); G06Q 30/018 (2023.01); G06Q 30/02 (2023.01); G06Q 30/0201 (2023.01); G06Q 30/0208 (2023.01); G06Q 30/0601 (2023.01); G06T 7/00 (2017.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 7/80 (2017.01); G06V 10/82 (2022.01); G06V 20/00 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/52 (2022.01); H04L 67/303 (2022.01); H04W 4/024 (2018.01); H04W 4/029 (2018.01); A47L 11/40 (2006.01); G01G 19/14 (2006.01); G01G 23/18 (2006.01); G01J 1/42 (2006.01); G01L 1/00 (2006.01); G06Q 10/087 (2023.01); H04N 7/18 (2006.01)
CPC G06Q 10/06395 (2013.01) [G01C 21/206 (2013.01); G01G 19/52 (2013.01); G05D 1/0219 (2013.01); G05D 1/0246 (2013.01); G06F 18/2431 (2023.01); G06F 18/253 (2023.01); G06F 18/285 (2023.01); G06N 5/04 (2013.01); G06N 20/00 (2019.01); G06Q 10/06311 (2013.01); G06Q 10/06315 (2013.01); G06Q 10/06375 (2013.01); G06Q 10/0639 (2013.01); G06Q 30/018 (2013.01); G06Q 30/0201 (2013.01); G06Q 30/0208 (2013.01); G06Q 30/0281 (2013.01); G06Q 30/0601 (2013.01); G06Q 30/0609 (2013.01); G06Q 30/0623 (2013.01); G06Q 30/0639 (2013.01); G06Q 30/0643 (2013.01); G06T 7/0002 (2013.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06T 7/73 (2017.01); G06T 7/80 (2017.01); G06T 7/97 (2017.01); G06V 10/82 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/36 (2022.01); G06V 20/52 (2022.01); H04L 67/303 (2013.01); H04W 4/024 (2018.02); H04W 4/029 (2018.02); A47L 11/4011 (2013.01); A47L 2201/04 (2013.01); G01G 19/14 (2013.01); G01G 23/18 (2013.01); G01J 1/4204 (2013.01); G01L 1/00 (2013.01); G06Q 10/087 (2013.01); G06Q 30/0633 (2013.01); G06T 2207/30242 (2013.01); G06V 2201/09 (2022.01); H04N 7/188 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for assessing quality of tasks performed by persons in retail stores, the method comprising:
receiving an indication that a person completed a task corresponding to at least one shelf in a retail store;
receiving at least one image of the at least one shelf, the at least one image being captured using an image sensor after the completion of the task;
analyzing the at least one image to determine at least one property associated with performing the task, wherein analyzing the at least one image to determine the at least one property comprises:
identifying at least one visual indicator in the at least one image, the visual indicator comprising at least one of: a color, a brightness, a character, or a shape;
comparing the at least one visual indicator to a reference visual indicator; and
determining a degree of similarity between the identified at least one visual indicator and the reference visual indicator; and
using the at least one property to determine a reward for performing the task.