US 12,131,417 B1
Devices, methods, and graphical user interfaces for depth-based annotation
Joseph A. Malia, Isle of Wight (GB); Mark K. Hauenstein, London (GB); Praveen Sharma, Brooklyn, NY (US); Matan Stauber, San Francisco, CA (US); Julian K. Missig, Burlingame, CA (US); Jeffrey T. Bernstein, San Francisco, CA (US); Lukas Robert Tom Girling, Stoke Bishop (GB); and Matthaeus Krenn, Sunnyvale, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Nov. 8, 2023, as Appl. No. 18/388,176.
Application 18/388,176 is a continuation of application No. 18/107,381, filed on Feb. 8, 2023, granted, now 11,818,455.
Application 18/107,381 is a continuation of application No. 17/716,984, filed on Apr. 8, 2022, granted, now 11,632,600, issued on Apr. 18, 2023.
Application 17/716,984 is a continuation of application No. 16/997,860, filed on Aug. 19, 2020, granted, now 11,303,812, issued on Apr. 12, 2022.
Application 16/997,860 is a continuation of application No. 16/574,029, filed on Sep. 17, 2019, granted, now 10,785,413, issued on Sep. 22, 2020.
Claims priority of provisional application 62/739,178, filed on Sep. 29, 2018.
Int. Cl. G06T 13/60 (2011.01); G06F 3/04815 (2022.01); G06F 3/0484 (2022.01); G06T 19/00 (2011.01)
CPC G06T 13/60 (2013.01) [G06F 3/04815 (2013.01); G06F 3/0484 (2013.01); G06T 19/006 (2013.01); G06T 2200/24 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method, comprising:
at a computer system that is in communication with a display generation component and one or more sensors for detecting user inputs:
while a view of a physical environment is visible via the display generation component, receiving a request to display a first virtual effect with the view of the physical environment; and
in response to detecting the request to display the first virtual effect with the view of the physical environment, displaying one or more virtual objects overlaid on the view of the physical environment, including:
displaying respective animated movements of the one or more virtual objects over at least a portion of the view of the physical environment, wherein the respective animated movements are constrained in accordance with a direction of simulated gravity associated with the view of the physical environment;
in accordance with a determination that a current position of a first virtual object of the one or more virtual objects during the respective animated movement of the first virtual object corresponds to a first surface detected in the view of the physical environment, constraining the respective animated movement of the first virtual object in accordance with the first surface detected in the view of the physical environment; and
in accordance with a determination that a current position of a second virtual object of the one or more virtual objects during the respective animated movement of the second virtual object corresponds to a second surface detected in the view of the physical environment, wherein the second surface is lower than the first surface in the direction of the simulated gravity, constraining the respective animated movement of the second virtual object in accordance with the second surface detected in the view of the physical environment.