US 12,437,489 B2
Presenting meshed representations of physical objects within defined boundaries for interacting with artificial-reality content, and systems and methods of use thereof
Boyang Zhang, San Francisco, CA (US); Yifu Zhang, Foster City, CA (US); Yuichi Taguchi, Los Gatos, CA (US); Gaurav Chaurasia, Meilen (CH); Manuel Werlberger, Zurich (CH); and Alexandru-Eugen Ichim, Rüschlikon (CH)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 25, 2023, as Appl. No. 18/494,711.
Claims priority of provisional application 63/419,318, filed on Oct. 25, 2022.
Prior Publication US 2024/0135662 A1, Apr. 25, 2024
Prior Publication US 2024/0233291 A9, Jul. 11, 2024
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06T 7/593 (2017.01); G06T 15/08 (2011.01); G06T 17/20 (2006.01)
CPC G06T 19/006 (2013.01) [G02B 27/017 (2013.01); G06T 7/593 (2017.01); G06T 15/08 (2013.01); G06T 17/20 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An artificial-reality (AR) headset, comprising:
one or more cameras;
one or more displays;
one or more programs, wherein the one or more programs are stored in memory and configured to be executed by one or more processors, the one or more programs including instructions for:
obtaining a predefined interaction boundary;
while displaying an artificial reality at the one or more displays:
while the AR headset has a first position within a physical environment and the physical environment includes a physical object at a distance and angle from the AR headset:
in accordance with a determination that the distance is within a threshold collision distance from the AR headset, presenting a meshed representation of the physical object within the artificial reality, wherein the meshed representation is displayed at first respective locations on the one more displays, such that the meshed representation is viewable within the artificial reality at the angle;
after the AR headset moves to a second position, distinct from the first position, within the physical environment, the physical object being at a different distance and a different angle from the AR headset while it is at the second position:
in accordance with a determination that the different distance is within the threshold collision distance from the AR headset, moving the meshed representation of the physical object to second respective locations within the artificial reality in accordance with movement of the AR headset from the first position to the second position, wherein the second respective locations are selected to correspond to a physical position of the physical object in the physical environment and the meshed representation is viewable within the artificial reality at the different angle.