| CPC B66B 5/0012 (2013.01) [B66B 1/3461 (2013.01); B66B 5/0031 (2013.01); B66B 5/02 (2013.01); G06V 20/52 (2022.01); G16Y 20/20 (2020.01); G16Y 40/10 (2020.01)] | 3 Claims |
|
1. System of monitoring an occurrence of abnormal events in an elevator, the system comprising:
an IoT terminal installed on a inside surface of an elevator and configured to detect abnormal situation in the elevator automatically and to transmitting real-time detection results;
a control center terminal configured to receive the abnormal situation from the IoT terminal in real time, to identify an abnormal situation in the elevator, and to control the abnormal situation and to propagate it in real time;
an on-site personnel mobile terminal configured to receive the abnormal situation and output the abnormal situation that is propagated from the control center terminal;
an occupant mobile terminal with pre-installed elevator application running in background mode,
wherein the IoT terminal includes:
an external CCTV video real-time reception module configured to receive external CCTV video in real time from an external CCTV device installed in the elevator;
an external CCTV video storage module configured to store external CCTV video received in real time from the external CCTV video real-time reception module;
a motion sensor configured to detect motion of occupants, pets or fire smoke in the elevator;
an object detection module configured to detect an object based on the detection of the motion sensor;
an abnormal situation AI recognition module configured to recognize abnormal situation of the object detected by the object detection module in the external CCTV video stored in the external CCTV video storage module using an AI algorithm;
an elevator operational information extraction module configured to extract elevator operational information from an elevator controller installed in the elevator;
a 3D acceleration sensor configured to detect acceleration of the elevator;
an elevator abnormal operation real-time detection module configured to estimate a current floor of the elevator by tracking a change in acceleration of the 3D acceleration sensor, and to detect abnormal operation of the elevator in real time by comparing the estimated current floor with a destination floor in the elevator operation information extracted from the elevator operation information extraction module;
an elevator information storage module configured to store elevator information including the building address of the elevator, an elevator number, and a map of the elevator's installation location in the building;
a GPS sensor configured to detect a GPS location of the elevator;
an abnormal situation event real-time generation module configured to generate an abnormal situation event in real time that includes at least one of the elevator information stored in the elevator information storage module and the GPS location detected by the GPS sensor, the current floor, and the abnormal operation detected in real time by the elevator abnormal operation real-time detection module or at least one of the abnormal situation recognized by the abnormal situation AI recognition module;
an abnormal situation event real-time transmission module configured to transmit abnormal situation event in real time generated by the abnormal situation event real-time generation module to the control center terminal in real time;
an embedded camera module configured to be embedded in the IoT terminal;
an embedded microphone configured to be embedded in the IoT terminal;
an embedded speaker module configured to be embedded in the IoT terminal;
a touchscreen display configured to be provided on the IoT terminal;
an IoT terminal video call module configured to automatically perform a video call with the control center terminal using the embedded camera module the embedded microphone, the embedded speaker module and the touchscreen display, in response to an abnormal situation event being generated by the abnormal situation event real-time generation module;
Wherein the control center terminal includes:
an abnormal situation event real-time reception module configured to receive abnormal situation event in real time that is transmitted from the abnormal event real-time transmission module;
an abnormal event real-time identification module configured to identify the abnormal situation event received in real time from the abnormal situation event real-time reception module;
a platform video call module configured to automatically perform video calls with the IoT terminal video call module;
an abnormal situation reception/control module configured to receive and control the abnormal situation based on the real-time identification results of the abnormal situation event real-time identification module and the video call performed on the platform video call module;
an on-site personnel real-time location identification module configured to automatically determine the real-time location of the on-site personnel mobile terminal;
an on-site personnel real-time location storage module configured to store the real-time location determined by the on-site personnel real-time location identification module;
an on-site personnel auto-designation module configured to automatically designate an on-site personnel using real-time location and elevator information of the abnormal situation stored in the on-site personnel real-time location storage module;
an on-site personnel location information real-time transmission module configured to transmit the real-time location determined by the on-site personnel real-time localization module for the on-site personnel automatically designated by the on-site personnel auto-designation module to the IoT terminal,
wherein the IoT terminal further includes:
an on-site personnel real-time location reception module configured to receive the real-time location of the on-site personnel transmitted from the on-site personnel location information real-time transmission module,
wherein the touchscreen display is configured to output the real-time location of the on-site personnel received by the on-site personnel real-time location reception module,
wherein the elevator abnormal operation real-time detection module configured to estimate the current floor of the elevator by tracking the change in acceleration of the 3D acceleration sensor,
wherein the abnormal situation event is configured to include an abnormal operation, elevator information, a GPS location of the elevator, current floor estimated by the elevator abnormal operation real-time detection module,
wherein the IoT terminal further includes:
a separate backup light configured to turn on, the in response to a power source failing;
a built-in battery configured to provide the separate backup light,
wherein an abnormal situation AI recognition module is configured to automatically adjust a contrast of exterior CCTV images until the object is detected again, and analyze the abnormal situation, in response to the separate backup light being turned or darkening the interior of the elevator is making it difficult to detect objects or analyze the video,
wherein the occupant mobile terminal is configured to detect the elevator's elevation immediately by acceleration detection of the 3D acceleration senor, and to automatically launch the elevator application that in response to the elevator's elevation being detected, and to cause an attention signal to be sent to the control center terminal, upon pressing a watch button of the elevator application,
wherein the control center terminal is configured to immediately output an alarm in response to receiving the attention signal from the occupant mobile terminal, and to automatically identify the occupant's elevator by contrasting the GPS location transmitted by the elevator application to the control center terminal with the GPS location of each of the elevator pre-registered with the control center terminal, and to view the corresponding external CCTV images and to make a video call via the occupant mobile terminal or the corresponding IoT terminal,
wherein the occupant mobile terminal is configured to detect the elevator's elevation immediately by acceleration detection of the 3D acceleration senor, and to automatically launch the elevator application in response to the elevator's elevation being detected, and to initiate a video call to the control center terminal immediately upon pressing the emergency button on the elevator application.
|