US 11,922,610 B2
Multi-eye camera system, multi-eye photographing camera head, image processing device, multi-eye photographing program and multi-eye photographing method
Takashi Masuda, Sapporo (JP); and Katsuji Matsuura, Sapporo (JP)
Assigned to KAMUY Innovation Corporation, Sapporo (JP)
Appl. No. 16/982,133
Filed by KAMUY Innovation Corporation, Sapporo (JP)
PCT Filed Mar. 22, 2019, PCT No. PCT/JP2019/012030
§ 371(c)(1), (2) Date Sep. 18, 2020,
PCT Pub. No. WO2019/182101, PCT Pub. Date Sep. 26, 2019.
Claims priority of application No. 2018-055674 (JP), filed on Mar. 23, 2018.
Prior Publication US 2021/0097660 A1, Apr. 1, 2021
Int. Cl. G06K 9/00 (2022.01); G06T 5/50 (2006.01); G06T 7/00 (2017.01)
CPC G06T 5/50 (2013.01) [G06T 3/403 (2013.01); G06T 7/97 (2017.01); G06T 2207/20021 (2013.01)] 8 Claims
OG exemplary drawing
 
1. A multi-eye camera system, comprising:
multi-eye photographing camera heads that each capture a partial image that forms a corresponding part of a whole image when synthesized based on an attaching positions thereof, and
an image processing device to which a plurality of the multi-eye photographing camera heads are connected and which synthesizes partial images received from the multi-eye photographing camera heads to form the whole image, wherein
each of the multi-eye photographing camera heads is provided with
a single lens and a single image element,
a partial image acquiring part that acquires a partial image photographing prescribed part in a multi-eye photographing range from the image element,
a parameter memory part that stores correction parameters, which is determined according to the attaching position of the corresponding multi-eye photographing camera head, and is used to correct distortions of the partial image,
an image correcting part that corrects distortions of the partial image using the correction parameters, outputs the partial image in which the distortions have been corrected to the image processing device which is separated from the multi-eye photographing camera heads as data for whole image that constitute part of a whole image, and makes the image processing device synthesize the data for whole image as the whole image,
a camera control part that acquires enlargement information from the image processing device, and
an enlarged area extracting part that extracts at least a portion of the partial image of the corresponding one of the corresponding multi-eye photographing camera head based on the enlargement information, and
the image processing device which is separated from the multi-eye photographing camera heads is provided with
an input processing part that acquires the data for whole image corrected by the image correcting part from all the connected multi-eye photographing camera heads,
a resizing processing part that resizes all the data for whole image acquired by the input processing part to match resolution of a whole image display device, and
a whole image memory that synthesizes all the data for whole image resized by the resizing processing part, and outputs the synthesized data for the whole image to the whole image display device,
wherein when the camera control part receives an instruction to display an enlarged image of a part of the whole image that has been synthesized, the camera control part of each of the multi-eye photographing camera heads acquires, from the image processing device, the enlargement information specifying the part of the whole image to be enlarged according to the instruction,
the enlarged area extracting part of each of the multi-eye photographing camera heads determines whether the part of the whole image to be enlarged is included in the partial image captured by the corresponding multi-eye photographing camera head, and
when it is determined that the part of the whole image to be enlarged is included in the partial image, the enlarged area extracting part of the corresponding one or more of the multi-eye photographing camera heads that has captured the partial image including the part of the whole image to be enlarged extracts a corresponding portion of the part of the whole image to be enlarged from the partial image captured by the corresponding one or more of the multi-eye photographing camera heads based on the enlargement information, and outputs the extracted portion of the partial image as data for enlarged image to the image processing device to allow the image processing device to synthesize the outputted extracted portion of the partial image to form an enlarged image of the part of the whole image.