US 12,489,815 B1
Toolbox and context for user interactions
Miao Ren, Sunnyvale, CA (US); Connor A. Smith, San Mateo, CA (US); Bruno M. Sommer, Sunnyvale, CA (US); and Tucker B. Morgan, Sunnyvale, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 19, 2023, as Appl. No. 18/470,077.
Application 18/470,077 is a continuation of application No. 17/317,205, filed on May 11, 2021, granted, now 11,805,176.
Claims priority of provisional application 63/022,943, filed on May 11, 2020.
Int. Cl. H04L 67/131 (2022.01); G06T 19/00 (2011.01); H04L 67/1095 (2022.01); H04L 67/30 (2022.01); H04L 67/50 (2022.01)
CPC H04L 67/131 (2022.05) [G06T 19/006 (2013.01); H04L 67/1095 (2013.01); H04L 67/30 (2013.01); H04L 67/535 (2022.05)] 20 Claims
OG exemplary drawing
 
1. A method for facilitating collaboration in a multi-user communication session, comprising:
detecting, at a first electronic device, an inconsistent environment representation of a multi-user communication session in which a first user of the first electronic device and a second user of a second electronic device are active, wherein a first location of a shared virtual element in a first environment representation at the first electronic device differs from a second location of the shared virtual element in a second environment representation at the second electronic device;
in response to detecting the inconsistent environment representation, launching a system-level toolkit comprising a plurality of system-level tools for generating virtual modifications within the multi-user communication session, wherein the system-level toolkit is accessible to multiple applications executing on the first electronic device; and
in response to detecting a first user interaction between the shared virtual element and a first tool in the system-level toolkit by the first user, providing, to the second electronic device, an indication of a virtual modification corresponding to the first user interaction and the shared virtual element to the second electronic device, wherein virtual modification is presented at the second location at the second electronic device in accordance with the indication of the shared virtual element.