US 11,677,921 B2
System and method for generating dewarped image using projection patterns captured from omni-directional stereo cameras
Rajat Aggarwal, Iudhiana (IN); Anoop M Namboodiri, Kothamangalam (IN); and Parikshit Sakurikar, Hyderabad (IN)
Assigned to DREAMVU INC., Philadelphia, PA (US)
Filed by DREAMVU INC, Philadelphia, PA (US)
Filed on Jan. 2, 2022, as Appl. No. 17/567,140.
Claims priority of application No. 202141000084 (IN), filed on Jan. 2, 2021.
Prior Publication US 2022/0217315 A1, Jul. 7, 2022
Int. Cl. H04N 13/122 (2018.01); H04N 5/247 (2006.01); H04N 13/243 (2018.01); H04N 13/363 (2018.01); H04N 13/296 (2018.01); G06T 5/00 (2006.01); H04N 9/31 (2006.01); H04N 13/324 (2018.01); G03B 35/08 (2021.01); G06T 3/00 (2006.01); H04N 13/00 (2018.01)
CPC H04N 13/122 (2018.05) [G03B 35/08 (2013.01); G06T 3/0012 (2013.01); G06T 5/006 (2013.01); H04N 5/247 (2013.01); H04N 9/3188 (2013.01); H04N 13/243 (2018.05); H04N 13/296 (2018.05); H04N 13/324 (2018.05); H04N 13/363 (2018.05); G06T 2200/04 (2013.01); G06T 2207/10012 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20068 (2013.01); H04N 2013/0077 (2013.01); H04N 2013/0096 (2013.01)] 19 Claims
OG exemplary drawing
 
1. An image de-warping system for generating at least one high-resolution de-warped omni-directional stereo image from at least one captured omni-directional stereo image by correcting optical distortions using projection patterns, the image de-warping system comprising:
a projection pattern capturing arrangement that comprises a plurality of onmi-directional stereo cameras, wherein the projection pattern capturing arrangement is configured to capture at least one captured omni-directional stereo image from each omni-directional stereo camera by obtaining a required field of view for the at least one captured omni-directional stereo image and captures a plurality of projection patterns from the plurality of omni-directional stereo cameras by adjusting dimensional details of a projector or a display with a plurality of orientations of the plurality of omni-directional stereo cameras;
the projector or the display that is configured to display the plurality of projection patterns that are obtained from the projection pattern capturing arrangement wherein the projector or the display is placed at a distance from the projection pattern capturing arrangement to cover the required field of view for the at least one captured omni-directional stereo image both horizontally and vertically;
a de-warping server that is configured to obtain the plurality of projection patterns that are displayed on the projector or the display and processes the plurality of projection patterns, wherein the de-warping server comprises:
a memory module that stores a database;
a processor that is configured to execute modules and is configured to, characterized in that,
modify a count of the plurality of projection patterns to match with a resolution of the plurality of omni-directional stereo cameras;
acquire, from the plurality of omni-directional stereo cameras, the plurality of projection patterns based on the count of the plurality of projection patterns;
determine a structured projection pattern by synchronizing, using a sequential project and capture synchronization technique, the plurality of projection patterns from the projector or the display sequentially within a delta error; and
generate, using an image processing method, at least one high resolution de-warped omni-directional stereo image from the structured projection pattern by correcting optical distortions in the at least one captured omni-directional stereo image and mapping the at least one captured omni-directional stereo image and the at least one high resolution de-warped omni-directional stereo image.