CPC H04N 13/106 (2018.05) [H04N 5/265 (2013.01); H04N 13/232 (2018.05); H04N 13/239 (2018.05); H04N 13/254 (2018.05); H04N 13/271 (2018.05); H04N 23/45 (2023.01); G06T 2207/20221 (2013.01); H04N 23/698 (2023.01)] | 21 Claims |
1. A device comprising:
a housing including:
at least one camera having a fisheye camera lens configured to capture 2D image data of an environment from a fixed location;
at least one depth sensor device including at least one light imaging detection and ranging (LiDAR) device, the at least one depth sensor device being configured to capture 3D depth data of the environment;
a horizontal rotatable mount configured to enable the fisheye camera lens of the at least one camera to move in a horizontal x axis relative to the device, the at least one camera being capable of capturing a plurality of images with mutually overlapping fields of view at different viewpoints;
at least one processor configured to map the 2D image data from the at least one camera and the 3D depth data from the at least one depth sensor device to a common spatial 3D coordinate space based on known capture positions and orientations of the at least one camera and the at least one depth sensor device to facilitate associating 3D coordinates with respective visual features included in the 2D image data relative to the common spatial 3D coordinate space; and
a 3D model generation component configured to generate a 3D model of the environment from the 2D image data from the at least one camera and 3D depth data from the at least one depth sensor.
|