US 12,093,912 B2
Apparatus, method for controlling the same, and storage medium
Akihiro Hamana, Tokyo (JP)
Assigned to Canon Kabushiki Kaisha, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Jun. 25, 2021, as Appl. No. 17/359,177.
Claims priority of application No. 2020-114212 (JP), filed on Jul. 1, 2020.
Prior Publication US 2022/0005009 A1, Jan. 6, 2022
Int. Cl. G06Q 20/20 (2012.01); G06Q 20/32 (2012.01); G06Q 20/40 (2012.01); G06Q 30/02 (2023.01); G06Q 30/0601 (2023.01); G06V 20/52 (2022.01)
CPC G06Q 20/201 (2013.01) [G06Q 20/204 (2013.01); G06Q 20/4037 (2013.01); G06Q 30/0281 (2013.01); G06Q 30/0631 (2013.01); G06V 20/52 (2022.01); G06Q 20/322 (2013.01)] 19 Claims
OG exemplary drawing
 
1. An apparatus comprising:
one or more processors; and
one or more memories containing instructions that, when executed by the one or more processors, cause the one or more processors to function as:
an acquisition unit configured to receive user information via a network from a storage apparatus possessed by a user;
a first detection unit configured to detect, from a captured image, the user for which the user information is acquired by the acquisition unit at an entrance and control an entrance gate to allow the user to enter;
a second detection unit configured to detect the user at an exit and control an exit gate based on the user information to allow the user to exit;
a generation unit configured to generate a person identifier of the user detected from the captured image at the entrance;
an association unit configured to associate (i) a storage identifier of the storage apparatus from which the acquisition unit receives the user information, (ii) the user information acquired by the acquisition unit and (iii) the person identifier of the user generated by the generation unit;
a recognition unit configured to recognize one or more products held by the user based on an image transmitted via the network by an image capturing unit in a store and configured to associate product information of the recognized one or more products with the person identifier;
a determination unit configured to determine, based on the user information and the product information each of which are associated with the person identifier, if the product information of the recognized one or more products does not match the user information;
an identification unit configured to identify, when the product information of the recognized one or more products does not match the user information, the storage identifier of the storage apparatus to be notified based on association performed by the association unit; and
an output unit configured to notify the storage apparatus corresponding to the identified storage identifier via the network in a case where product information associated with the recognized one or more products does not match the user information,
wherein the recognition unit tracks the detected one or more products using a plurality of chronologically consecutive images to determine a product status regarding whether the detected one or more products are taken from a store shelf or returned to the store shelf in a store,
wherein the recognition unit further determines product information based on the product status,
wherein the identification unit further identifies a voice notification apparatus nearest to the user from among a plurality of the voice notification apparatuses in the store when the product information associated with the recognized one or more products does not match the user information, and
wherein the output unit is configured to notify the user using the identified voice notification apparatus in a case where product information associated with the recognized one or more products does not match the user information.