US 12,455,140 B2
System and method for video image registration and/or providing supplemental data in a heads up display
John Richard Scales, Huntsville, AL (US); Michael Harris Rodgers, Huntsville, AL (US); and Mark D. Hose, Huntsville, AL (US)
Assigned to Science Applications International Corporation, Reston, VA (US)
Filed by Science Applications International Corporation, Reston, VA (US)
Filed on Mar. 21, 2024, as Appl. No. 18/612,519.
Application 18/612,519 is a continuation of application No. 17/723,730, filed on Apr. 19, 2022, granted, now 11,965,714.
Application 17/723,730 is a continuation of application No. 16/165,210, filed on Oct. 19, 2018, abandoned.
Application 16/165,210 is a continuation of application No. 15/483,086, filed on Apr. 10, 2017, granted, now 10,139,629, issued on Nov. 27, 2018.
Application 15/483,086 is a continuation of application No. 14/950,643, filed on Nov. 24, 2015, granted, now 9,618,752, issued on Apr. 11, 2017.
Application 14/950,643 is a continuation of application No. 11/680,207, filed on Feb. 28, 2007, granted, now 9,229,230, issued on Jan. 5, 2016.
Prior Publication US 2024/0230279 A1, Jul. 11, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. F41G 3/16 (2006.01); G02B 27/01 (2006.01); G06T 7/20 (2017.01); G06T 7/32 (2017.01); G06T 19/00 (2011.01); G06V 10/75 (2022.01); H04N 5/265 (2006.01); H04N 23/90 (2023.01)
CPC F41G 3/165 (2013.01) [G02B 27/017 (2013.01); G02B 27/0172 (2013.01); G02B 27/0176 (2013.01); G02B 27/0189 (2013.01); G06T 7/20 (2013.01); G06T 7/32 (2017.01); G06T 19/006 (2013.01); G06V 10/751 (2022.01); H04N 5/265 (2013.01); H04N 23/90 (2023.01); G02B 2027/0134 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0159 (2013.01); G02B 2027/0178 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising:
selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;
determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:
a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and
a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;
determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and
generating a modified version of the third image comprising the portion of the fourth image in the determined position.