US 11,727,650 B2
Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments
Nicolas V. Scapel, London (GB); Kyle E. Fisher, Sunnyvale, CA (US); Patrick W. O'Keefe, Mountain View, CA (US); and Grant R. Paul, San Francisco, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Mar. 15, 2021, as Appl. No. 17/202,233.
Claims priority of provisional application 62/991,062, filed on Mar. 17, 2020.
Prior Publication US 2021/0295602 A1, Sep. 23, 2021
Int. Cl. G06T 19/00 (2011.01); G06T 7/70 (2017.01); G06F 3/04815 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/04815 (2013.01); G06T 7/70 (2017.01)] 24 Claims
OG exemplary drawing
 
1. A method, comprising:
at a computer system having a display generation component and one or more cameras:
displaying, via the display generation component, a representation of a field of view of the one or more cameras, wherein the field of view includes a physical object in a physical environment, and the representation of the field of view of the one or more cameras includes a representation of the physical object;
receiving one or more inputs corresponding to a request to display the representation of the field of view with the physical object at a first pose in the physical environment, a virtual object at a simulated second pose in the physical environment, and the one or more cameras at a third pose in the physical environment; and
in response to receiving the one or more inputs:
in accordance with a determination that a first portion of the virtual object corresponds to physical space in the physical environment that is occluded by the physical object in the physical environment:
displaying the representation of the physical object;
forgoing displaying the first portion of the virtual object; and
in accordance with a determination that a second portion of the virtual object corresponds to physical space in the physical environment that is not occluded:
 displaying the second portion of the virtual object, including visually deemphasizing a displayed first region of the second portion of the virtual object relative to a displayed second region of the second portion of the virtual object;
wherein:
the first portion of the virtual object corresponds to physical space in the physical environment that is occluded by the physical object in the physical environment, and the second portion of the virtual object corresponds to physical space in the physical environment that is not occluded;
a first set of environmental conditions are present in the physical environment; and
the method further includes:
detecting a change to a second set of environmental conditions in the physical environment; and
while the second set of environmental conditions are present in the physical environment, the physical object is at the first pose in the physical environment, the virtual object is at the simulated second pose in the physical environment, and the one or more cameras are at the third pose in the physical environment:
displaying the representation of the physical object;
forgoing displaying the first portion of the virtual object; and
displaying a third portion of the virtual object, different from the second portion, including visually deemphasizing a displayed first region of the third portion of the virtual object relative to a displayed second region of the third portion of the virtual object, wherein visually deemphasizing the displayed first region of the third portion of the virtual object is in accordance with the change to the second set of environmental conditions in the physical environment.