US 12,307,067 B2
Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
Allison W. Dryer, Tiburon, CA (US); Giancarlo Yerkes, San Carlos, CA (US); Grant R. Paul, San Francisco, CA (US); Lisa K Forssell, Palo Alto, CA (US); and Joseph A. Malia, Isle of Wight (GB)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Oct. 20, 2023, as Appl. No. 18/382,444.
Application 18/382,444 is a continuation of application No. 17/344,846, filed on Jun. 10, 2021, granted, now 11,797,146.
Application 17/344,846 is a continuation of application No. 17/018,980, filed on Sep. 11, 2020, granted, now 11,138,771, issued on Oct. 5, 2021.
Claims priority of provisional application 62/969,647, filed on Feb. 3, 2020.
Prior Publication US 2024/0045562 A1, Feb. 8, 2024
Int. Cl. G06F 3/04815 (2022.01); G06F 3/03 (2006.01); G06F 3/048 (2013.01); G06F 3/0482 (2013.01); G06F 3/0484 (2022.01); G06T 7/13 (2017.01); G06T 7/55 (2017.01); G06T 7/62 (2017.01); G06T 11/20 (2006.01); G06T 13/00 (2011.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01); G06V 20/20 (2022.01)
CPC G06F 3/04815 (2013.01) [G06F 3/0304 (2013.01); G06F 3/0484 (2013.01); G06T 7/13 (2017.01); G06T 7/55 (2017.01); G06T 7/62 (2017.01); G06T 11/203 (2013.01); G06T 13/00 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06V 20/20 (2022.01); G06F 3/048 (2013.01); G06F 3/0482 (2013.01); G06T 2200/24 (2013.01); G06T 2219/004 (2013.01); G06T 2219/2004 (2013.01)] 48 Claims
OG exemplary drawing
 
1. A method, comprising:
at a computer system with a display device and one or more cameras:
displaying, in a first region of a user interface, a representation of a field of view of the one or more cameras, wherein the one or more cameras are in a three-dimensional physical environment, and the representation of the field of view includes a representation of a first view of a first respective portion of the physical environment that is in the field of view of the one or more cameras;
capturing depth information indicative of a first subset of the first respective portion of the physical environment;
displaying, over the representation of the field of view, a first indication that indicates an extent of the first respective portion of the physical environment for which depth information has been captured, including displaying the first indication overlaid on at least a first portion of the representation of the field of view that includes a representation of the first subset, and displaying at least a second portion of the representation of the field of view without the first indication overlaid;
detecting movement of the one or more cameras that moves the field of view to include a second respective portion of the physical environment;
in response to detecting the movement of the one or more cameras:
updating the representation of the field of view of the one or more cameras to include a representation of the first view of the second respective portion of the physical environment;
capturing additional depth information indicative of a second subset of the second respective portion of the physical environment; and
updating a spatial arrangement of the first indication relative to the physical environment, displayed over the updated representation of the field of view, to indicate an extent of the second respective portion of the physical environment for which depth information has been captured, including displaying the first indication overlaid on the second portion of the representation of the field of view, wherein:
the second portion of the representation of the field of view includes a representation of the second subset of the second respective portion of the physical environment; and
the first indication with the updated spatial arrangement indicates additional depth information that was captured in response to detecting movement of the one or more cameras.