US 12,358,623 B2
Augmented reality through digital aircraft windows of aircraft inflight entertainment systems
Samuel Santos, Eastvale, CA (US)
Assigned to Thales Avionics, Inc., Irvine, CA (US)
Filed by Thales Avionics, Inc., Irvine, CA (US)
Filed on Jul. 3, 2023, as Appl. No. 18/346,349.
Claims priority of provisional application 63/358,705, filed on Jul. 6, 2022.
Prior Publication US 2024/0010340 A1, Jan. 11, 2024
Int. Cl. G06T 19/00 (2011.01); B64D 11/00 (2006.01); G06T 7/70 (2017.01); G06V 20/59 (2022.01); G06V 40/10 (2022.01)
CPC B64D 11/0015 (2013.01) [G06T 7/70 (2017.01); G06T 19/006 (2013.01); G06V 20/59 (2022.01); G06V 40/10 (2022.01); G06T 2207/30244 (2013.01); G06T 2207/30268 (2013.01)] 16 Claims
OG exemplary drawing
 
1. An augmented reality (AR) system for an aircraft, the AR system comprising:
at least one network interface;
at least one processor connected to communicate through the at least one network interface; and
at least one memory storing instructions executable by the at least one processor to perform operations comprising to:
obtain an aircraft pose for the aircraft;
determine a passenger pose indicating a pose of a passenger relative to a window in the aircraft;
compute a field-of-view of the passenger through the window toward real-world objects viewable by the passenger through the window, based on the passenger pose and the aircraft pose;
select a set of passenger-relevant points of information (POIs) from a database that satisfy a relevance rule to the real-world objects viewable by the passenger through the window based on the aircraft pose and the field-of-view;
for each of the passenger-relevant POIs in the set,
determine an AR indicia to be displayed, and
determine an AR indicia pose where the AR indicia is to be rendered on a display device associated with the passenger, based on the aircraft pose and the field-of-view;
generate a display command based on the AR indicia and the AR indicia pose for the passenger-relevant POIs in the set; and
provide the display command to the display device to display renderings of the AR indicias with the AR indicia poses to augment the real-world objects viewed by the passenger through the window.