US 12,469,207 B2
Systems, methods, and graphical user interfaces for scanning and modeling environments
Allison W. Dryer, Tiburon, CA (US); Giancarlo Yerkes, San Carlos, CA (US); Praveen Sharma, Brooklyn, NY (US); Grant R. Paul, San Francisco, CA (US); and Joseph A. Malia, Isle of Wight (GB)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on May 8, 2023, as Appl. No. 18/144,746.
Claims priority of provisional application 63/340,444, filed on May 10, 2022.
Prior Publication US 2023/0368458 A1, Nov. 16, 2023
Int. Cl. G06T 15/10 (2011.01); G06F 3/04815 (2022.01); G06T 15/50 (2011.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01)
CPC G06T 15/10 (2013.01) [G06F 3/04815 (2013.01); G06T 15/50 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06T 2200/24 (2013.01); G06T 2219/2004 (2013.01); G06T 2219/2016 (2013.01)] 50 Claims
OG exemplary drawing
 
1. A method, comprising:
at a computer system that is in communication with a display generation component, one or more input devices, and one or more cameras:
displaying, via the display generation component, a first user interface, wherein the first user interface concurrently includes:
a representation of a field of view of the one or more cameras, the representation of the field of view including a first view of a physical environment that corresponds to a first viewpoint of a user in the physical environment, and
a preview of a three-dimensional model of the physical environment that is being generated during a scan of the physical environment, wherein the preview includes the three-dimensional model of the physical environment that is not completed and that is displayed with a first orientation that corresponds to the first viewpoint of the user;
while displaying the first user interface, detecting first movement of the one or more cameras in the physical environment that changes a current viewpoint of the user in the physical environment from the first viewpoint to a second viewpoint; and
in response to detecting the first movement of the one or more cameras:
updating the preview of the three-dimensional model while the three-dimensional model is not completed, in accordance with the first movement of the one or more cameras, including adding additional information to the three-dimensional model in the preview, and rotating the three-dimensional model from the first orientation that corresponds to the first viewpoint of the user to a second orientation that corresponds to the second viewpoint of the user, in the preview;
while displaying the first user interface, with the representation of the field of view including a second view of the physical environment that corresponds to the second viewpoint of the user, and with the preview of the three-dimensional model including the three-dimensional model with the second orientation while the three-dimensional model in the preview is not completed, detecting first input directed to the preview of the three-dimensional model in the first user interface; and
in response to detecting the first input directed to the preview of the three-dimensional model in the first user interface:
updating the preview of the three-dimensional model in the first user interface in accordance with the first input, including, in accordance with a determination that the first input meets first criteria, rotating the three-dimensional model from the second orientation that corresponds to the second viewpoint of the user to a third orientation that does not correspond to the second viewpoint of the user, in the preview, while the three-dimensional model in the preview is not completed.