US 12,314,967 B2
Familiarity degree estimation apparatus, familiarity degree estimation method, and recording medium
Azusa Furukawa, Tokyo (JP); Kan Arai, Tokyo (JP); Kei Shibuya, Tokyo (JP); Hiroshi Hashimoto, Tokyo (JP); Ken Hanazawa, Tokyo (JP); and Makiko Akiguchi, Tokyo (JP)
Assigned to NEC CORPORATION, Tokyo (JP)
Appl. No. 17/801,639
Filed by NEC Corporation, Tokyo (JP)
PCT Filed Mar. 12, 2020, PCT No. PCT/JP2020/010737
§ 371(c)(1), (2) Date Aug. 23, 2022,
PCT Pub. No. WO2021/181597, PCT Pub. Date Sep. 16, 2021.
Prior Publication US 2023/0099665 A1, Mar. 30, 2023
Int. Cl. G06Q 30/0201 (2023.01); G06V 20/52 (2022.01); G06V 40/16 (2022.01)
CPC G06Q 30/0201 (2013.01) [G06V 20/52 (2022.01); G06V 40/174 (2022.01); G06V 2201/07 (2022.01)] 9 Claims
OG exemplary drawing
 
1. A system comprising:
a line-of-sight camera disposed above an item shelf and configured to capture a video of a customer in front of the item shelf, including a face of the customer;
a first item camera disposed on a left portion of the item shelf and including a first illumination unit at a bottom of the item shelf, the first item camera and configured to capture a video of the item shelf in an upper right direction while the first illumination unit is illuminating the item shelf in the upper right direction, the video including a hand of the customer taking or putting back an item from the item shelf;
a second item camera disposed on a right portion of the item shelf and including a second illumination unit at a top of the item shelf, the second item camera and configured to capture a video of the item shelf in a lower left direction while the second illumination unit is illuminating the item shelf in the lower left direction, the video including the hand of the customer taking or putting back the item from the item shelf, wherein the second item camera is vertically higher than the first item camera;
a memory storing instructions; and
one or more processors configured to execute the instructions to:
calculate a time while a hand is being viewed when a customer is viewing the hand, based on the video of the customer captured by line-of-sight camera;
calculate a time while an item is being held when the customer is holding the item, based on the videos of the item shelf captured by the first and second item cameras; and
estimate a degree of familiarity of the customer with respect to the item based on the time while the hand is being viewed and the time while the item is being held,
wherein disposition of the first and second item cameras on the left and right portions of the item shelf, respectively, where the second item camera is vertically higher than the first item camera, ensures that the item is included in the video captured by one of the first and second item cameras includes the item even when the item is hidden by the hand of the customer in the video captured by another of the first and second item cameras.