US 12,148,322 B2
Head tracking with virtual avionics training products
Paul Heyd, Marion, IA (US); Spencer Owen, Lisbon, IA (US); and Vincent Loschiavo, Cedar Rapids, IA (US)
Assigned to Rockwell Collins, inc., Cedar Rapids, IA (US)
Filed by Rockwell Collins, Inc., Cedar Rapids, IA (US)
Filed on Apr. 16, 2021, as Appl. No. 17/232,375.
Claims priority of provisional application 63/011,848, filed on Apr. 17, 2020.
Prior Publication US 2021/0327295 A1, Oct. 21, 2021
Int. Cl. G09B 9/30 (2006.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06F 3/0488 (2022.01); G06T 7/521 (2017.01)
CPC G09B 9/302 (2013.01) [G06F 3/012 (2013.01); G06F 3/016 (2013.01); G06F 3/04815 (2013.01); G06F 3/0488 (2013.01); G06T 7/521 (2017.01); G09B 9/307 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/30201 (2013.01)] 8 Claims
OG exemplary drawing
 
1. A simulator comprising:
a display configured to display a 3D simulated environment;
a tracking system configured to track a target, comprising:
a projector configured to illuminate the target;
a sensor configured to obtain a depth image of the target; one or more processors;
a memory communicatively coupled to the one or more processors and having instructions stored upon, which when executed by the one or more processors, cause the one or more processors to determine at least one of a distance of the target or an angle of a face of the target relative the display;
a computing unit communicatively coupled to the display and the tracking system configured to:
send a 3D simulated environment signal to the display; and
perform an adjustment of the 3D simulated environment based on at least one of the distance of the target or the angle of the face of the target relative to the display,
wherein the adjustment of the 3D simulated environment is configured to be an adjustment of a virtualized component within the 3D simulated environment and as a global adjustment, wherein the global adjustment excludes any adjustment of the display of the 3D virtualized component based on at least one of the distance of the target or the angle of the face of the target relative to at least one of the display or tracking system;
wherein the adjustment of the virtualized component is transiently tracked on the display using a mark that follows a path of movement and thereby indicates the movement of the virtualized component, wherein the virtualized component is configured as an instrument,
wherein the instrument is configured as a floor instrument, wherein the instrument is configured as a throttle quadrant,
wherein the instrument is configured as an avionic instrument panel,
wherein the display is configured as a touch sensitive display, wherein the instrument is operated via a touch upon the touch sensitive display.