| CPC G06T 17/05 (2013.01) [G01C 11/00 (2013.01); G06T 7/10 (2017.01); G06T 7/20 (2013.01); G06T 7/543 (2017.01); G06T 7/62 (2017.01); G06T 7/70 (2017.01); G06T 11/00 (2013.01); G06T 17/20 (2013.01); G06V 10/95 (2022.01); G06V 20/64 (2022.01); H04N 23/80 (2023.01); G06T 2200/08 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20021 (2013.01)] | 19 Claims |
|
1. A Method, Comprising:
capturing, with a capturing device, a video of a three-dimensional (3D) space by moving or scanning the capturing device about the 3D space;
capturing, with the capturing device, motion data of the capturing device as it is moved about the space simultaneously with the captured video;
generating, from video and motion data, a 3D mesh representation of the 3D space;
assisting a user of the capturing device to complete a closed loop scan for layout estimation of the 3D space by:
orienting, using the motion data, the 3D mesh representation into a top-down camera view to simplify current scanning information from 3D to 2D;
identifying, from the 3D mesh representation, one or more planes;
assigning, from the one or more planes, a plane with a largest area that is located most distant from the top-down camera view as a 2D floor plane;
identifying, from the 3D mesh representation, an exterior boundary of the 2D floor plane;
identifying, from the 3D mesh representation and the motion data, one or more segments of the exterior boundary located in at least one of the one or more planes;
determining, using the motion data, the 3D mesh representation, and the 2D floor plane, a physical layout of each of the one or more planes that is of equal scale to the three-dimensional space, the physical layout including the one or more segments localized onto the at least one of the one or more planes; and
displaying the physical layout on a display device to the user to enable the user to adjust a location of at least a portion of the one or more segments or to add and subtract from the one or more segments.
|