US 11,851,215 B2
Systems and methods for calibrating a synthetic image on an avionic display
Zuowei He, Shanghai (CN); Gang He, Morris Plains, NJ (US); Zhiguo Ren, Shanghai (CN); and Zhong Chen, Beijing (CN)
Assigned to HONEYWELL INTERNATIONAL INC., Charlotte, NC (US)
Filed by HONEYWELL INTERNATIONAL INC., Charlotte, NC (US)
Filed on May 27, 2021, as Appl. No. 17/332,236.
Prior Publication US 2022/0380065 A1, Dec. 1, 2022
Int. Cl. B64F 5/60 (2017.01); B64D 43/00 (2006.01); B64D 45/08 (2006.01); B64D 47/06 (2006.01); B64D 47/08 (2006.01); G06K 9/00 (2022.01); G06N 3/08 (2023.01); G06V 20/58 (2022.01); G06V 20/56 (2022.01)
CPC B64F 5/60 (2017.01) [B64D 43/00 (2013.01); B64D 45/08 (2013.01); B64D 47/06 (2013.01); B64D 47/08 (2013.01); G06N 3/08 (2013.01); G06V 20/582 (2022.01); G06V 20/588 (2022.01)] 17 Claims
OG exemplary drawing
 
1. A method for calibrating a synthetic image on an avionic display in a cockpit of an aircraft, the method comprising:
at a controller circuit,
receiving a synthetic image frame generated by an avionic display module, the synthetic image frame being forward-facing and depicting airport features surrounding an aircraft position and location;
receiving a sensor image frame depicting airport features surrounding the aircraft position and location, the sensor image frame being generated by a forward-facing sensor system on the aircraft;
sub-dividing the synthetic image frame into two or more regions;
performing object recognition separately and concurrently on the two or more regions to generate a first search region for a first Federal Aviation Administration (FAA) marking, defined as a first search region-FAA marking pair, and a second search region-FAA marking pair of a respective two or more search region-FAA marking pairs;
processing the sensor image frame, the first search region-FAA marking pair, and the second search region-FAA marking pair, using a deep learning method (DLM), to determine, for the first FAA marking of the first search region-FAA marking pair and for a second FAA marking associated with the second search region-FAA marking pair, each of: a position deviation calculation, an orientation deviation calculation, and a synthetic image distortion factor;
updating the synthetic image frame, in accordance with (i) the position deviation calculation, the orientation deviation calculation, and the synthetic image distortion factor of the first FAA marking and (ii) the position deviation calculation, the orientation deviation calculation, and the synthetic image distortion factor of the second FAA marking, thereby calibrating the synthetic image frame; and
rendering the updated synthetic image frame on the avionic display.