US 12,307,614 B2
Methods for sharing content and interacting with physical devices in a three-dimensional environment
Lorena S. Pazmino, San Francisco, CA (US); Vitalii Kramar, Duvall, WA (US); Jonathan R. Dascola, San Francisco, CA (US); Zoey C. Taylor, San Francisco, CA (US); and Alejandro A. Rodriguez, Saratoga, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Dec. 23, 2022, as Appl. No. 18/146,234.
Claims priority of provisional application 63/265,969, filed on Dec. 23, 2021.
Prior Publication US 2023/0206572 A1, Jun. 29, 2023
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 3/14 (2006.01); G06T 19/20 (2011.01)
CPC G06T 19/006 (2013.01) [G06F 3/013 (2013.01); G06F 3/14 (2013.01); G06T 19/20 (2013.01); G06T 2219/2016 (2013.01)] 39 Claims
OG exemplary drawing
 
1. A method comprising:
at a computer system in communication with a display generation component, one or more input devices, and a second electronic device:
displaying, via the display generation component, a three-dimensional environment including:
one or more virtual control elements associated with the second electronic device, wherein the one or more virtual control elements are selectable to cause one or more corresponding operations associated with the second electronic device to be performed, wherein the second electronic device is located at a first respective location in a portion of a physical environment that is visible via the display generation component; and
a representation of the portion of the physical environment that includes a representation of the second electronic device at a first location in the three-dimensional environment corresponding to the first respective location in the physical environment;
while displaying the three-dimensional environment including the representation of the second electronic device at the first location in the three-dimensional environment and the one or more virtual control elements associated with the second electronic device, detecting, via the one or more input devices, movement of the second electronic device from the first respective location to a second respective location in the physical environment;
while detecting the movement of the second electronic device from the first respective location to the second respective location in the physical environment, ceasing to display the one or more virtual control elements in the three-dimensional environment while the representation of the second electronic device is being moved from the first location to a second location in the three-dimensional environment, wherein the second location in the three-dimensional environment corresponds to the second respective location in the physical environment; and
after detecting the movement of the second electronic device from the first respective location to the second respective location in the physical environment:
redisplaying the one or more virtual control elements associated with the second electronic device in the three-dimensional environment while the representation of the second electronic device is visible via the display generation component at the second location in the three-dimensional environment.