US 11,689,808 B2
Image synthesis system
Simon Cope, Burswood (AU); Peter Kovesi, Shenton Park (AU); and Jianzhong Xiao, South Perth (AU)
Assigned to Spookfish Innovations PTY LTD, Bentley (AU)
Filed by Spookfish Innovations PTY LTD, Bentley (AU)
Filed on Jul. 2, 2021, as Appl. No. 17/366,709.
Application 17/366,709 is a continuation of application No. 16/343,610, granted, now 11,057,566, previously published as PCT/AU2017/051143, filed on Oct. 20, 2017.
Claims priority of application No. 2016904256 (AU), filed on Oct. 20, 2016.
Prior Publication US 2021/0385381 A1, Dec. 9, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 23/68 (2023.01); H04N 25/53 (2023.01)
CPC H04N 23/6812 (2023.01) [H04N 23/683 (2023.01); H04N 25/53 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to a 3D object space, the 3D object space including information indicative of height of features in the 3D object space, by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by ray tracing each pixel of the rolling shutter image from the rolling shutter image to the 3D object space; and
project, subsequently, from the 3D object space to a synthetic global shutter image by ray tracing each pixel from the 3D object space to the synthetic global shutter image.