US 12,307,912 B1
Multi-sensor data fusion-based aircraft detection, tracking, and docking
Rajesh V. Poojary, Bangalore (IN); Raghu Seelamonthula, Banglore (IN); Vinay Sridhara Murthy, Bangalore (IN); and Manuj Sharma, Bangalore (IN)
Assigned to Honeywell International Inc., Charlotte, NC (US)
Filed by Honeywell International Inc., Charlotte, NC (US)
Filed on Feb. 23, 2024, as Appl. No. 18/585,837.
Application 18/585,837 is a continuation of application No. 18/244,361, filed on Sep. 11, 2023.
Application 18/244,361 is a continuation of application No. 18/088,937, filed on Dec. 27, 2022, granted, now 11,756,440, issued on Sep. 12, 2023.
Application 18/088,937 is a continuation of application No. 16/983,657, filed on Aug. 3, 2020, granted, now 11,538,349, issued on Dec. 27, 2022.
This patent is subject to a terminal disclaimer.
Int. Cl. G08G 5/06 (2006.01); B64D 45/00 (2006.01); G05D 1/00 (2006.01); G06F 18/25 (2023.01); G06T 7/521 (2017.01); G06V 20/13 (2022.01); G08G 5/51 (2025.01)
CPC G08G 5/51 (2025.01) [B64D 45/00 (2013.01); G05D 1/0202 (2013.01); G06F 18/251 (2023.01); G06T 7/521 (2017.01); G06V 20/13 (2022.01)] 10 Claims
OG exemplary drawing
 
1. A system for determining parameters of an aircraft, comprising:
a camera image sensor device configured to capture camera image data of an aircraft at a ramp area of an airport;
a light detection and ranging (LIDAR) sensor device configured to capture LIDAR sensor data of the aircraft at the ramp area of the airport; and
a controller having a processor configured to:
receive the camera image data of the aircraft from the camera image sensor device;
process the received camera image data using machine learning, wherein processing the received camera image data using machine learning includes:
generating a three dimensional virtual model of the aircraft using the received camera image data; and
comparing the generated three dimensional virtual model of the aircraft to a number of aircraft reference models stored in a three dimensional model database to find a match between the generated three dimensional virtual model of the aircraft and one of the number of aircraft reference models;
receive the LIDAR sensor data of the aircraft from the LIDAR sensor device;
merge the processed camera image data and the received LIDAR sensor data into a merged data set;
determine, using the merged data set:
a type of the aircraft;
a speed of the aircraft;
distance data associated with the aircraft;
directional data associated with the aircraft; and
a position and orientation of the aircraft; and
cause a display of a message to provide directional and speed guidance to a pilot based, at least in part, on the determined type of the aircraft, the determined speed of the aircraft, the determined distance data associated with the aircraft, the determined directional data associated with the aircraft, and the determined position and orientation of the aircraft; and
a display device configured to display the message.