US 12,223,729 B2
System and method for surveillance of goods
Calin Barburescu, Timis (RO); Robert Preda, Arad (RO); Alexandra Laicu, Timis (RO); Ana Cristina Todoran, Arad (RO); Paul Iusztin, Timis (RO); Marius Badea, Timis (RO); Laura Vasilie, Timis (RO); Alexandru Hulea, Buchare (RO); and Qintilian-Emanuel Vintila, Timisoara (RO)
Assigned to Everseen Limited, Blackpool (IE)
Filed by Everseen Limited, Cork (IE)
Filed on Jan. 30, 2023, as Appl. No. 18/161,694.
Claims priority of provisional application 63/305,933, filed on Feb. 2, 2022.
Prior Publication US 2023/0245460 A1, Aug. 3, 2023
Int. Cl. G06V 20/52 (2022.01); G06K 7/14 (2006.01); G06Q 10/083 (2024.01); G06Q 10/087 (2023.01); G06T 7/20 (2017.01); G06V 10/764 (2022.01); G06V 20/40 (2022.01)
CPC G06V 20/52 (2022.01) [G06K 7/1417 (2013.01); G06Q 10/083 (2013.01); G06Q 10/087 (2013.01); G06T 7/20 (2013.01); G06V 10/764 (2022.01); G06V 20/44 (2022.01); G06T 2207/30196 (2013.01); G06T 2207/30242 (2013.01); G06V 2201/07 (2022.01)] 11 Claims
OG exemplary drawing
 
1. An order checking system comprising:
a plurality of video sensors configured to capture video footage of a monitored area located within an order receiving area or an order dispatch area of a receipt/dispatch portal;
a processing unit configured to:
perform event analysis on the captured video footage;
detect an entity in the video footage captured by the video sensors;
detect from a door opening event in the captured video footage, an incoming delivery from a third-party supplier;
identify the third-party supplier and implement a check-in process for delivery persons from the third-party supplier;
detect an ingress/egress of merchandise through the receipt/dispatch portal and validate that detected delivered products matches with data regarding products that the third-party supplier should be delivering;
analyse the video footage captured by the video sensors to determine if the receipt/dispatch portal is in an open state or a closed state using a Door State Detector;
analyse the video footage captured by the video sensors to detect if a delivery person has arrived at the receipt/dispatch portal using a Person Detector;
track movements of the delivery person from the captured video footage upon detection of the delivery person by the Person Detector using a Person Tracker;
detect a presence of a quick response (QR) code in the captured video footage and to read the QR code using a quick response (QR) Detector,
wherein the QR detector compares the detected QR code with known pre-approved QR codes for third-party suppliers/delivery persons to find a match, and
wherein if a match is found, the QR detector is configured to:
classify the delivery person presenting the QR code as an authorized entrant to an order fulfillment facility/order receiving facility; and
grant the delivery person access to the order fulfillment facility/order receiving facility; and
check one or more contents of merchandise to be delivered from, or received into, a premises of the order fulfillment facility/order receiving facility using a Pallet Monitor Module, wherein the Pallet Monitor Module comprises:
a Pallet Detector Module configured to detect a pallet;
a Pallet Tracker Module configured to track the detected pallet;
a Merchandise Classification per Pallet Module configured to classify merchandise on the detected pallet;
a Pallet Volume Estimator configured to estimate a quantity of merchandise on the detected pallet; and
an IN-OUT counter configured to extract information about a total number of pallets passing through the receipt/dispatch portal; and
a database communicably coupled to the processing unit, the database configured to store:
at least a dataset of face images/logos for use in detecting faces/brands;
a dataset of product images for use in identification of products; and
record an outcome of an order checking process and a check out of a delivery person at an end of a delivery for future retrieval upon request to the processing unit.