US 11,842,538 B2
System and method of intelligent vegetation management
Rahul Saxena, Santa Clara, CA (US); Nitin Das, Santa Clara, CA (US); and Abhishek Vinod Singh, Santa Clara, CA (US)
Assigned to AIDash, Inc., San Jose, CA (US)
Filed by AIDASH Inc., Santa Clara, CA (US)
Filed on Jan. 27, 2021, as Appl. No. 17/160,231.
Claims priority of provisional application 62/966,531, filed on Jan. 27, 2020.
Prior Publication US 2021/0232818 A1, Jul. 29, 2021
Int. Cl. G06V 20/10 (2022.01); G06N 3/04 (2023.01); G08B 21/18 (2006.01); H04L 67/53 (2022.01); G06F 18/2431 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/44 (2022.01)
CPC G06V 20/176 (2022.01) [G06F 18/2431 (2023.01); G06N 3/04 (2013.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/188 (2022.01); G08B 21/182 (2013.01); H04L 67/53 (2022.05)] 19 Claims
OG exemplary drawing
 
1. A system comprising:
at least one processor; and
memory, the memory containing instructions to control one or more of the at least one processor to:
receive a first set of aerial images of a geographic area, the geographic area including assets of an infrastructure, the infrastructure including the assets distributed over a geographic region, the first set of aerial images being received from a first image source over a communication network;
receive location information regarding a location of the assets, the first set of aerial images being taken during a first duration of time;
determine a likely location of at least one asset within each image of the first set of aerial images based on the location information;
create one or more bounding boxes within each of the images of the first set of aerial images, the one or more bounding boxes within each of the images of the first set of aerial images encompassing the likely location of one or more assets within a particular image of the first set of aerial images;
provide one or more of the images of the first set of aerial images to a convolutional neural network to classify pixels within the one or more bounding boxes, a classification of each of the pixels indicating if the pixels are part of one or more obstructions depicted in the one or more of the images of the first set of aerial images or are part of a different classification;
determine at least one zone within at least one of the one or more of the images, the zone encompassing the at least one asset depicted in the at least one of the one or more of the images;
determine a first distance between at least one pixel that is part of the one or more obstructions within at least one of the bounding boxes and the at least one zone;
generate a criticality score based on the first distance;
compare the criticality score to a threshold;
provide an alert of a future hazardous condition based on the comparison of the criticality score and the threshold
receive a second set of aerial images of the geographic area, the second set of aerial images having been captured during a second duration of time, the second duration of time being after the first duration of time;
create one or more bounding boxes within each of the images of the second set of aerial images, the one or more bounding boxes within each of the images of the second set of aerial images encompassing the likely location of one or more assets within the particular image of the second set of aerial images;
provide one or more of the images of the second set of aerial images to the convolutional neural network to classify pixels within the one or more bounding boxes within each of the images of the second set of aerial images, the classification of each of the pixels indicating if the pixels are part of one or more obstructions depicted in the one or more of the images of the second set of aerial images or are part of the different classification;
determine a second distance between at least one pixel that is part of the one or more obstructions within at least one of the bounding boxes within each of the images of the second set of aerial images and the at least one zone;
determine a rate of change between the first distance and the second distance;
determine a future impact based on the rate of change to the asset
generate a second criticality score based on the future impact and
provide an alert of the future hazardous condition based on the second criticality score.