US 11,935,286 B2
Method and device for detecting a vertical planar surface
Luca Prasso, Mountain View, CA (US); and Seth Raphael, Portland, OR (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Appl. No. 17/278,935
Filed by GOOGLE LLC, Mountain View, CA (US)
PCT Filed Oct. 1, 2019, PCT No. PCT/US2019/054033
§ 371(c)(1), (2) Date Mar. 23, 2021,
PCT Pub. No. WO2020/072472, PCT Pub. Date Apr. 9, 2020.
Claims priority of provisional application 62/739,636, filed on Oct. 1, 2018.
Prior Publication US 2022/0051018 A1, Feb. 17, 2022
Int. Cl. G06V 20/10 (2022.01); G06V 10/40 (2022.01)
CPC G06V 20/10 (2022.01) [G06V 10/40 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
identifying, at an electronic device by performing raycasting, a plurality of feature points of an environment proximate the electronic device based on imagery captured at the electronic device and based on received non-visual pose information obtained from non-visual sensors, the raycasting projecting rays into the electronic device's view of the environment and returning feature points that the rays intersect, along with the pose of that intersection in world space, to determine whether a perceived plane passes through the feature points at the intersection of the rays, the raycasting resolving whether a ray along the normal from a screen of the electronic device returns a planar surface;
identifying one or more planar surfaces based on the plurality of feature points;
computing, at the electronic device, a plurality of oriented point vectors associated with the one or more planar surfaces, comprising determining a surface normal to each of the identified plurality of feature points;
detecting a vertical planar surface within the one or more planar surfaces based at least in part on one or more of the plurality of oriented point vectors being aligned in a direction perpendicular to gravity within a predetermined threshold; and
generating a floor plan of the environment proximate the electronic device based on one or more of the plurality of oriented point vectors corresponding to vertical planar surfaces.