US 11,838,674 B2
Image processing system, image processing method and storage medium
Kiwamu Kobayashi, Kawasaki (JP)
Assigned to CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed by CANON KABUSHIKI KAISHA, Tokyo (JP)
Filed on Jun. 1, 2020, as Appl. No. 16/889,075.
Claims priority of application No. 2019-104733 (JP), filed on Jun. 4, 2019.
Prior Publication US 2020/0389573 A1, Dec. 10, 2020
Int. Cl. H04N 5/222 (2006.01); H04N 5/272 (2006.01); G06T 7/11 (2017.01)
CPC H04N 5/2226 (2013.01) [G06T 7/11 (2017.01); H04N 5/272 (2013.01)] 16 Claims
OG exemplary drawing
 
1. An image processing system comprising:
at least one processor connected to at least one memory, the at least one processor and at least one memory being configured to cause the image processing system to operate as:
a first acquisition unit configured to acquire a plurality of foreground masks for extracting an object, corresponding to each of a plurality of captured images acquired by capturing the object with a plurality of image capturing units;
a second acquisition unit configured to acquire a plurality of inappropriate area masks for masking an exposure inappropriate area corresponding to the plurality of captured images by detecting an area whose exposure value is inappropriate in each of the plurality of captured images; and
a generation unit configured to generate shape data representing a three-dimensional shape of the object based on the plurality of foreground masks and the plurality of inappropriate area masks, wherein
the second acquisition unit detects:
a portion whose pixel value is greater than an upper limit threshold value of a first luminance range in the captured image as a first inappropriate area, which is acquired by performing image capturing with the image capturing unit of which the first luminance range is set relatively lower among the plurality of image capturing units;
a portion whose pixel value is less than a lower limit threshold value of a second luminance range in the captured image as a second inappropriate area, which is acquired by performing image capturing with the image capturing unit of which the second luminance range is set relatively higher among the plurality of image capturing units, and
wherein the generation unit generates, in a case where the foreground mask corresponding to the area whose exposure value is inappropriate can be used as a silhouette mask for shape data generation, the shape data by using the foreground mask.