US 12,277,621 B2
Responding to representations of physical elements
Mark Drummond, Palo Alto, CA (US); Bo Morgan, Emerald Hills, CA (US); and Siva Chandra Mouli Sivapurapu, Santa Clara, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 2, 2021, as Appl. No. 17/465,334.
Application 17/465,334 is a continuation of application No. PCT/US2020/028966, filed on Apr. 20, 2020.
Claims priority of provisional application 62/837,287, filed on Apr. 23, 2019.
Prior Publication US 2021/0398327 A1, Dec. 23, 2021
Int. Cl. G06T 11/00 (2006.01); G06T 13/40 (2011.01); G06T 13/80 (2011.01)
CPC G06T 11/00 (2013.01) [G06T 13/40 (2013.01); G06T 13/80 (2013.01); G06T 2200/24 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method comprising:
at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory, wherein the device includes an action generator:
providing to the action generator for an intelligent agent (IA), one or more perceptual characteristic values that define properties of a graphical representation of a physical element within a degree of similarity to physical properties of the corresponding physical element;
instantiating a graphical representation of the IA in a graphical environment that includes the graphical representation of the physical element and an affordance that is associated with the graphical representation of the physical element;
generating, by the action generator for the IA, an action for the graphical representation of the IA based on the one or more perceptual characteristic values to interact with the graphical representation of the physical element; and
displaying a manipulation of the affordance by the graphical representation of the IA to effectuate the action generated by the action generator for the IA, wherein the manipulation of the affordance allows the graphical representation of the IA to interact with the graphical representation of the physical element within the degree of similarity to interacting with the corresponding physical element according to the physical properties.