US 12,374,069 B2
Devices, methods, and graphical user interfaces for real-time communication
Jesse Chand, San Francisco, CA (US); Shih-Sang Chiu, San Francisco, CA (US); Wesley M. Holder, Union City, CA (US); Stephen O. Lemay, Palo Alto, CA (US); William A. Sorrentino, III, Mill Valley, CA (US); Rajat Bhardwaj, Walnut Creek, CA (US); Giancarlo Yerkes, San Francisco, CA (US); Jason D. Rickwald, Santa Cruz, CA (US); Rupert Burton, San Francisco, CA (US); Kaely Coon, San Francisco, CA (US); Connor A. Smith, Sunnyvale, CA (US); Joseph P. Cerra, San Francisco, CA (US); and Tommy Rochette, Santa Cruz, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Mar. 19, 2024, as Appl. No. 18/610,103.
Claims priority of provisional application 63/527,530, filed on Jul. 18, 2023.
Claims priority of provisional application 63/470,968, filed on Jun. 4, 2023.
Prior Publication US 2024/0402868 A1, Dec. 5, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06F 3/0484 (2022.01); G06T 5/70 (2024.01); G06T 19/20 (2011.01); H04L 65/1069 (2022.01); H04L 65/1083 (2022.01); H04L 65/1089 (2022.01); H04N 7/15 (2006.01)
CPC G06T 19/20 (2013.01) [G06F 3/013 (2013.01); G06F 3/04815 (2013.01); G06F 3/0484 (2013.01); G06T 5/70 (2024.01); G06T 19/006 (2013.01); H04L 65/1069 (2013.01); H04L 65/1086 (2013.01); H04L 65/1089 (2013.01); H04N 7/152 (2013.01); H04N 7/157 (2013.01); G06T 2200/24 (2013.01); G06T 2219/024 (2013.01); G06T 2219/2004 (2013.01)] 51 Claims
OG exemplary drawing
 
1. A computer system configured to communicate with one or more display generation components, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the one or more display generation components and within a three-dimensional environment, a real-time communication user interface that corresponds to a real-time communication session between a user of the computer system and one or more participants in the real-time communication session different from the user of the computer system;
displaying, via the one or more display generation components, a first spatially-constrained representation of a first participant of the one or more participants in the real-time communication session, wherein the first spatially-constrained representation of the first participant includes:
a first portal that has a spatial position in the three-dimensional environment that is determined by the computer system; and
a first visual representation of the first participant that moves based on detected movement of the first participant, wherein the first visual representation is displayed at least partially within the first portal;
while displaying the first spatially-constrained representation of the first participant within the real-time communication user interface, detecting a request from a respective participant in the real-time communication session to transition from a spatially-constrained representation mode, in which the first participant in the real-time communication session is visually represented using the first spatially-constrained representation, to a spatially-flexible representation mode, in which the first participant in the real-time communication session is visually represented using a first spatially-flexible representation, wherein the spatially-flexible representation mode is different from the spatially-constrained representation mode; and
in response to detecting the request from the respective participant in the real-time communication session to transition from the spatially-constrained representation mode to the spatially-flexible representation mode:
displaying, via the one or more display generation components, the first spatially-flexible representation of the first participant that moves based on detected movement of the first participant and has a spatial position in the three-dimensional environment relative to one or more other objects in the three-dimensional environment that is determined at least in part based on movement of the first participant, wherein the spatially-flexible representation mode includes one of displaying the first participant without the first portal, displaying the first participant with the first portal having a non-visible border, and displaying the first participant with the first portal having a partially surrounding border.