| CPC G06T 11/00 (2013.01) [G06T 7/50 (2017.01); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30252 (2013.01)] | 5 Claims |
|
1. A peripheral video generation device comprising:
at least one memory having a set of computer-executable instructions stored thereon;
at least one processor communicable with the memory and a plurality of cameras; and
the set of computer-executable instructions stored on the memory cause the processor to implement:
inputting peripheral video data captured by the plurality of cameras;
compositing the peripheral video data to generate a composite video as viewed from a predetermined viewpoint;
estimating a three-dimensional shape of a peripheral object existing around the periphery of a vehicle to be parked based on the peripheral video data;
using an estimation result of the three-dimensional shape to estimate a shielded area which is shielded by the peripheral object of the estimated three-dimensional shape and is not visible from the predetermined viewpoint in the composite video;
inferring a video of the shielded area using deep learning, wherein:
the video of the shielded area is inferred using a generator and a discriminator;
the generator comprising a first neural network model configured to generate a false image intended to fool the discriminator; and
the discriminator comprising a second neural network model configured to discriminate between the false image generated by the generator and a correct image corresponding to true data,
wherein:
the generator is subjected to learning with updating of parameters of the generator such that the discriminator discriminates the false image as the correct image, the video of the shielded area is inferred using the correct image; and
the discriminator is subjected to learning with updating of parameters of the discriminator such that there is a large difference in output between when the discriminator is supplied the true data and when the discriminator is supplied the false image generated by the generator;
generating the correct image corresponding to the true data as the generator by alternately repeating the learning of the generator and the learning of the discriminator;
the video of the shielded area is inferred using the generator after learning, which can generate the correct image, and is generated using the correct image inferred by the generator; and
superimposing the video of the shielded area in the composite video, wherein
the processor transmits a control signal to the vehicle to automatically park the vehicle based on the composite video superimposed the video inferred and generated on the shielded area.
|