US 12,405,703 B2
Digital assistant interactions in extended reality
Jessica J. Peck, Morgan Hill, CA (US); James N. Jones, San Francisco, CA (US); Ieyuki Kawashima, Pleasanton, CA (US); Lynn I. Streja, San Francisco, CA (US); Stephen O. Lemay, Palo Alto, CA (US); and William A. Sorrentino, III, Mill Valley, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Appl. No. 18/278,372
Filed by Apple Inc., Cupertino, CA (US)
PCT Filed Feb. 22, 2022, PCT No. PCT/US2022/017343
§ 371(c)(1), (2) Date Aug. 22, 2023,
PCT Pub. No. WO2022/182668, PCT Pub. Date Sep. 1, 2022.
Claims priority of provisional application 63/152,723, filed on Feb. 23, 2021.
Prior Publication US 2024/0134492 A1, Apr. 25, 2024
Prior Publication US 2024/0231558 A9, Jul. 11, 2024
Int. Cl. G06F 3/04815 (2022.01); G06F 3/01 (2006.01); G10L 15/22 (2006.01)
CPC G06F 3/04815 (2013.01) [G06F 3/013 (2013.01); G06F 3/017 (2013.01); G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] 44 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device having a display and a microphone, cause the electronic device to:
while displaying, on the display, an extended reality (XR) environment:
receive, from a user, a user input;
sample, with the microphone, a user speech input;
in accordance with a determination that the user input satisfies a criterion for initiating a digital assistant, initiate the digital assistant, including:
displaying, within the XR environment, a digital assistant indicator at a first location of the XR environment; and
while displaying the digital assistant indicator at the first location, provide, by the digital assistant, a response to the user speech input;
after providing the response, cease to display the digital assistant indicator at the first location;
in accordance with ceasing to display the digital assistant indicator at the first location, display the digital assistant indicator at a second location of the XR environment, the second location corresponding to a physical location of an external electronic device implementing a second digital assistant;
while displaying the digital assistant indicator at the second location:
determine that a pose of the user corresponds to the second location; and
sample, with the microphone, a second user speech input; and
in accordance with a determination that the pose corresponds to the second location while sampling the second user speech input, cause a second response to the second user speech input to be provided.