US 11,812,196 B2
Construction site safety monitoring system based on computer vision
Bin Yang, Tianjin (CN); Pengju Liu, Tianjin (CN); Yihang Liu, Tianjin (CN); Dacheng Jin, Tianjin (CN); Bingan Pan, Tianjin (CN); Pengfei Yang, Tianjin (CN); and Angui Li, Tianjin (CN)
Assigned to TIANJIN CHENGJIAN UNIVERSITY, Tianjin (CN); and XI'AN UNIVERSITY OF ARCHITECTURE AND TECHNOLOGY, Xi'an (CN)
Filed by Tianjin Chengjian University, Tianjin (CN); and Xi'an University of Architecture and Technology, Xi'an (CN)
Filed on Nov. 18, 2021, as Appl. No. 17/529,762.
Claims priority of application No. 202110456106.2 (CN), filed on Apr. 26, 2021.
Prior Publication US 2022/0345667 A1, Oct. 27, 2022
Int. Cl. H04N 7/18 (2006.01); G06Q 50/08 (2012.01); G06Q 50/26 (2012.01)
CPC H04N 7/181 (2013.01) [G06Q 50/08 (2013.01); G06Q 50/265 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A construction site safety monitoring system based on computer vision, comprising:
a data acquisition system, an information processing system and a terminal reminder system;
wherein the data acquisition system is configured to collect a video information of personnel on the construction site and operation platforms in real time and send the video information to the information processing system, and the operation platforms comprise a scaffold and a tower crane;
wherein the information processing system comprises an object detector, an information calculator, an information catcher and an information transmitter;
the object detector is configured to detect and distinguish the personnel and the operation platforms appeared in the video information to obtain object information, and transmit the object information to the information calculator;
the information calculator is configured to calculate personnel facial temperatures and inclination angles of the operation platforms;
the information catcher is configured to intercept a feature image of a corresponding personnel whose the personnel facial temperature is greater than or equal to one of preset values and send the feature image to the information transmitter, and further intercept a feature video of the operation platform whose the inclination angle is greater than or equal to another of the preset values and send the feature video to the information transmitter;
the information transmitter is configured to mark the feature image and the feature video as a personnel safety incident and a platform safety incident respectively, and send information of at least one of the personnel safety incident and the platform safety incident to the terminal reminder system;
wherein the terminal reminder system is configured to receive the information of the at least one of the personnel safety incident and the platform safety incident transmitted by the information processing system and provide a reminder;
wherein the information catcher is specifically configured to:
compare the corresponding personnel with marked personnel;
calculate a maximum time interval for the same personnel when the corresponding personnel and one of the marked personnel are the same personnel, and intercept the feature image of the same personnel and transmit the feature image to the information transmitter when the maximum time interval exceeds 15 minutes, thereby to enable the information transmitter to mark the feature image as the personnel safety incident; and
mark the corresponding personnel with a personnel number different from that of the marked personnel when the corresponding personnel is different from the marked personnel;
wherein the terminal reminder system comprises a voice announcing module, and a video and image playing module; the voice announcing module is configured to remind a manager of the at least one the personnel safety incident and the platform safety incident, and the video and image playing module is configured to play the feature image of the corresponding personnel and video of a tilted one of the operation platforms to the manager;
wherein the voice announcing module is specifically configured to broadcast “there is a risk of personnel safety incident” when the personnel safety incident occurs, and the video and image playing module is specifically configured to play the feature image of the corresponding personnel for the manager to view when the personnel safety incident occurs;
wherein the voice announcing module is specifically configured to broadcast “there is a risk of platform safety incident” when the platform safety incident occurs, and the video and image playing module is specifically configured to play the video of the tilted operation platform for the manager to view when the platform safety incident occurs;
wherein when the personnel safety incident and the platform safety incident occur at the same time, the video of the tilted operation platform for the manager is played as a priority.