US 11,057,566 B2
Image synthesis system
Simon Cope, Burswood (AU); Peter Kovesi, Shenton Park (AU); and Jianzhong Xiao, South Perth (AU)
Assigned to Spookfish Innovations PTY LTD, Bentley (AU)
Appl. No. 16/343,610
Filed by Spookfish Innovations PTY LTD, Bentley (AU)
PCT Filed Oct. 20, 2017, PCT No. PCT/AU2017/051143
§ 371(c)(1), (2) Date Apr. 19, 2019,
PCT Pub. No. WO2018/071983, PCT Pub. Date Apr. 26, 2018.
Claims priority of application No. 2016904256 (AU), filed on Oct. 20, 2016.
Prior Publication US 2020/0059601 A1, Feb. 20, 2020
Int. Cl. H04N 5/232 (2006.01); H04N 5/353 (2011.01)
CPC H04N 5/23258 (2013.01) [H04N 5/23267 (2013.01); H04N 5/353 (2013.01)] 28 Claims
OG exemplary drawing
 
1. An image synthesis system for synthesizing a global shutter image based on a rolling shutter image, the image synthesis system arranged to:
use an elevation dataset to define a 3D object space that includes information indicative of height of features in object space;
project a rolling shutter image captured by a rolling shutter camera in a moving aerial camera system, the rolling shutter image having a plurality of scanlines having associated different position and pose information, to the 3D object space by projecting each scanline of the rolling shutter image from a camera optical center determined for the scanline using the position and pose information associated with the scanline, each scanline having a different camera optical center, by ray tracing each pixel of the rolling shutter image from the rolling shutter image to the 3D object space; and
project, subsequently, from the 3D object space to a synthetic global shutter image by ray tracing each pixel from the 3D object space to the synthetic global shutter image.