US 12,450,834 B2
Modifying a portion of a semantically segmented 3D mesh
Ghislain Tasse, Portland, OR (US); Nikilesh Urella, Portland, OR (US); and Pavan K. Kamaraju, London (GB)
Assigned to STREEM, LLC., Portland, OR (US)
Filed by STREEM, LLC, Portland, OR (US)
Filed on Mar. 30, 2023, as Appl. No. 18/128,979.
Prior Publication US 2024/0331292 A1, Oct. 3, 2024
Int. Cl. G06T 17/20 (2006.01); G06T 7/11 (2017.01); G06T 19/20 (2011.01)
CPC G06T 17/20 (2013.01) [G06T 7/11 (2017.01); G06T 19/20 (2013.01); G06T 2207/20084 (2013.01); G06T 2210/56 (2013.01); G06T 2219/2021 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method for implementing a device, the method comprising:
receiving, from a first device of a first user, a 3D model generated based upon a physical environment of the first user;
generating, by a second device, a semantically segmented 3D mesh based upon the 3D model, wherein the semantically segmented 3D mesh includes a plurality of segments, wherein at least some of the plurality of segments are associated, respectively, with a plurality of physical objects in the physical environment;
displaying or causing to display, by the second device, at least a portion of the semantically segmented 3D mesh on a third device of a second user;
enabling, by the second device, the second user to search for a desired object of the plurality of physical objects to be found within the semantically segmented 3D mesh;
displaying, by the second device on the third device, a set of one or more segments returned from the search that are associated with the desired object, the set of one or more segments including additional segments associated with other objects that are in proximity to the desired object;
receiving, by the second device, a modified segmented 3D mesh, wherein modifications to the modified segmented 3D mesh include the second user removing, adding, and moving one or more of the plurality of physical objects represented in the set of one or more segments returned from the search; and
displaying or causing to display, by the second device, at least a portion of the modified segmented 3D mesh on the first device of the first user.