US 12,254,752 B2
Facility surveillance systems and methods
Bernhard Metzler, Dornbirn (AT); Barbara Haupt, Walzenhausen (CH); Markus Kächele, Walzenhausen (CH); Bernd Reimann, Heerbrugg (CH); Stefan Martin Benjamin Gächter Toya, St. Gallen (CH); and Alexandre Heili, Altstätten (CH)
Assigned to HEXAGON TECHNOLOGY CENTER GMBH, Heerbrugg (CH)
Filed by HEXAGON TECHNOLOGY CENTER GMBH, Heerbrugg (CH)
Filed on Dec. 23, 2021, as Appl. No. 17/561,129.
Application 17/561,129 is a continuation of application No. 17/289,700, previously published as PCT/EP2018/079602, filed on Oct. 29, 2018.
Prior Publication US 2022/0157137 A1, May 19, 2022
Int. Cl. G06V 20/52 (2022.01); G06F 18/2431 (2023.01); G06N 3/02 (2006.01); G06V 20/00 (2022.01); G08B 13/196 (2006.01)
CPC G08B 13/19613 (2013.01) [G06F 18/2431 (2023.01); G06N 3/02 (2013.01); G06V 20/35 (2022.01); G06V 20/52 (2022.01); G08B 13/1968 (2013.01); G08B 13/19682 (2013.01)] 27 Claims
OG exemplary drawing
 
1. The mobile surveillance system adapted for patrolling a surveillance area of a facility, particularly of a building, the system comprising a plurality of sensors, in particular comprising at least two cameras, wherein the system comprises at least one unmanned ground vehicle (UGV) that is adapted to move autonomously on a ground of the surveillance area, the UGV comprising a housing enclosing:
a first battery;
first sensor means, particularly comprising a first camera, the first sensor means being adapted to generate first sensor data,
a first computing unit comprising a processor and a data storage, the first computing unit being adapted to receive and evaluate the first sensor data in real time,
wherein the system comprises at least one unmanned aerial vehicle (UAV), the UGV and the UAV being adapted for collaboratively patrolling the surveillance area, wherein:
the UAV comprises second sensor means, particularly comprising a second camera, the second sensor means being adapted to generate second sensor data,
the UGV comprises a first data exchange module and the UAV comprises a second data exchange module, the first and second data exchange modules being adapted to exchange data; and
the first computing unit is adapted to receive and evaluate the second sensor data in real time,
wherein the system is adapted to fully-autonomously perform a state detection functionality, the functionality comprising detecting, based on the evaluation of the first and/or second sensor data, a state in the surveillance area and
wherein the UAV comprises a second computing unit, comprising a processor and a data storage, wherein the second computing unit is adapted to receive and evaluate second sensor data from the second sensor means, and to perform the state detection functionality based on the evaluation of the second sensor data, wherein, if a state has been detected, state data and/or second sensor data related to the state is transmitted to the first computing unit,
wherein the first sensor means comprise sensors that have superior specifications relative to corresponding sensors of the second sensor means, allowing to generate the first sensor data with a higher resolution than the second sensor data,
wherein, if the state has been detected, task data is generated comprising instructions for the UGV to move to a position of the detected state and/or to generate first sensor data related to the detected state.