US 12,361,714 B2
Proximity danger detection based on subject and object distance analysis
Nageswara Sastry Renduchintala, Kolkata (IN); Hamid Majdabadi, Ottawa (CA); Su Liu, Austin, TX (US); and Yang Liang, BeiJing (CN)
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed by INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed on Aug. 9, 2022, as Appl. No. 17/818,706.
Prior Publication US 2024/0054788 A1, Feb. 15, 2024
Int. Cl. G06V 20/52 (2022.01); G06T 7/70 (2017.01); G06V 20/40 (2022.01); G08B 21/02 (2006.01); G16Y 10/60 (2020.01)
CPC G06V 20/52 (2022.01) [G06T 7/70 (2017.01); G06V 20/41 (2022.01); G08B 21/02 (2013.01); G16Y 10/60 (2020.01); G06T 2207/10016 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A computer-based method of detecting the danger of an object in close proximity of a subject, the method comprising:
receiving real-time data from one or more IoT devices in a surrounding environment, wherein the real-time data includes a video feed of one or more subjects engaged in one or more activities;
detecting and classifying the one or more subjects and one or more objects in an image from the one or more IoT devices;
identifying one or more risk factors associated with each object based on the classification of the one or more objects;
correlating the one or more risk factors associated with each object with the one or more subjects in the image based on the one or more activities and the classification of the one or more subjects, wherein correlating the one or more risk factors includes correlating a first risk factor of the one or more risk factors with a first subject of the one or more subjects and correlating a different risk factor of the one or more risk factors with a different subject of the one or more subjects based on one or more characteristics associated with the first subject and the different subject;
identifying relative positions of the one or more subjects and the one or more objects in the image;
determining whether a current position of at least one subject is dangerous based on the relative positions of the one or more subjects and the one or more objects and the one or more correlated risk factors; and
in response to determining the current position of the at least one subject is dangerous based on a current distance between the at least one subject and at least one object of the one or more objects being less than a minimum risk distance, notifying a user of the danger to the at least one subject, wherein notifying the user of the danger to the at least one subject further comprises:
sending a simultaneous notification to a robotic device to perform a preventive action, wherein the simultaneous notification causes the robotic device to at least remove the at least one object to a location where a distance between the at least one subject and the at least one object is greater than the minimum risk distance.