US 11,961,191 B2
Perceptual property vector for an object
Mark Drummond, Palo Alto, CA (US); Bo Morgan, Emerald Hills, CA (US); and Siva Chandra Mouli Sivapurapu, Santa Clara, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 2, 2021, as Appl. No. 17/465,320.
Application 17/465,320 is a continuation of application No. PCT/US2020/028963, filed on Apr. 20, 2020.
Claims priority of provisional application 62/837,285, filed on Apr. 23, 2019.
Prior Publication US 2021/0398359 A1, Dec. 23, 2021
Int. Cl. G06T 19/00 (2011.01); G06T 15/04 (2011.01); G06T 15/08 (2011.01); G06V 20/40 (2022.01)
CPC G06T 19/006 (2013.01) [G06T 15/04 (2013.01); G06T 15/08 (2013.01); G06V 20/41 (2022.01)] 25 Claims
OG exemplary drawing
 
1. A method comprising:
at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory:
obtaining a semantic construction of a physical environment, wherein the semantic construction of the physical environment includes a representation of a physical element and a semantic label for the physical element;
obtaining a graphical representation of the physical element;
determining, based on the semantic label for the physical element, one or more perceptual characteristic values that indicate how a virtual object can detect and interact with the graphical representation of the physical element; and
compositing an affordance in association with the graphical representation of the physical element, wherein the affordance allows the virtual object to interact with the graphical representation of the physical element in accordance with the one or more perceptual characteristic values.