US 12,014,574 B2
Human gesture recognition for autonomous aircraft operation
Amir Afrasiabi, University Place, WA (US); Kwang Hee Lee, Seoul (KR); Bhargavi Patel, Huntsville, AL (US); Young Suk Cho, Seoul (KR); and Junghyun Oh, Seongnam-Si (KR)
Assigned to The Boeing Company, Chicago, IL (US)
Filed by The Boeing Company, Chicago, IL (US)
Filed on Oct. 25, 2021, as Appl. No. 17/452,206.
Claims priority of provisional application 63/105,774, filed on Oct. 26, 2020.
Prior Publication US 2022/0129667 A1, Apr. 28, 2022
Int. Cl. G06V 40/20 (2022.01); B64D 47/08 (2006.01); G06V 10/46 (2022.01); G06V 10/75 (2022.01)
CPC G06V 40/23 (2022.01) [B64D 47/08 (2013.01); G06V 10/462 (2022.01); G06V 10/751 (2022.01)] 40 Claims
OG exemplary drawing
 
1. A gesture recognition system, the gesture recognition system comprising:
a computer system; and
a machine learning model manager in the computer system, wherein the machine learning model manager is configured to:
identify temporal color images for a set of gestures used for ground operations for an aircraft;
generate optical flow data identifying a distribution of visual velocities of a movement of a set of brightness patterns in the temporal color images on a per image basis from the temporal color images;
generate saliency maps identifying movement in the temporal color images using image segmentation in which a saliency map in the saliency maps is generated on the per image basis, wherein the temporal color images, the optical flow data and the saliency maps form training data;
train a set of feature machine learning models to recognize features using the training data; and
train a set of classifier machine learning models to recognize gestures using the features recognized by the set of feature machine learning models trained using the training data, wherein the set of feature machine learning models and the set of classifier machine learning models form a gesture recognition machine learning model system.