US 12,106,516 B2
Pose estimation refinement for aerial refueling
Leon Nhat Nguyen, Santa Ana, CA (US); Haden Harrison Smith, Topanga, CA (US); Fan Hin Hung, Los Angeles, CA (US); Deepak Khosla, Camarillo, CA (US); and Taraneh Sadjadpour, San Jose, CA (US)
Assigned to The Boeing Company, Chicago, IL (US)
Filed by The Boeing Company, Chicago, IL (US)
Filed on Jan. 5, 2022, as Appl. No. 17/569,440.
Prior Publication US 2023/0215041 A1, Jul. 6, 2023
Int. Cl. G06K 9/00 (2022.01); B64D 39/00 (2006.01); G05D 1/00 (2006.01); G06T 7/73 (2017.01); G06T 19/00 (2011.01)
CPC G06T 7/75 (2017.01) [B64D 39/00 (2013.01); G05D 1/104 (2013.01); G06T 19/006 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of aerial refueling, the method comprising:
receiving a video frame showing an aircraft to be refueled;
receiving an initial position estimate and an initial pose estimate for the aircraft;
based on at least the initial position estimate and the initial pose estimate, generating an initial rendering of an aircraft model of the aircraft;
based on at least the video frame and the initial rendering of the aircraft model, determining refinement parameters for the initial position estimate and the initial pose estimate;
based on at least the initial position estimate, the initial pose estimate, and the refinement parameters, determining a refined position estimate and a refined pose estimate for the aircraft;
based on at least the refined position estimate and the refined pose estimate for the aircraft, determining a position and pose of a fuel receptacle on the aircraft; and
based on at least the position and pose of the fuel receptacle, controlling an aerial refueling boom to engage the fuel receptacle.