US 12,236,543 B2
Systems and methods for artificial intelligence-based virtual and augmented reality
Andrew Rabinovich, San Francisco, CA (US); and John Monos, Venice, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Nov. 17, 2023, as Appl. No. 18/513,312.
Application 18/513,312 is a continuation of application No. 17/704,998, filed on Mar. 25, 2022, granted, now 11,948,256.
Application 17/704,998 is a continuation of application No. 16/596,610, filed on Oct. 8, 2019, granted, now 11,315,325, issued on Apr. 26, 2022.
Claims priority of provisional application 62/743,492, filed on Oct. 9, 2018.
Prior Publication US 2024/0087260 A1, Mar. 14, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06F 1/16 (2006.01); G06F 3/01 (2006.01); G06F 21/53 (2013.01); G06T 15/00 (2011.01)
CPC G06T 19/006 (2013.01) [G02B 27/01 (2013.01); G06F 1/163 (2013.01); G06F 3/011 (2013.01); G06F 21/53 (2013.01); G06T 15/005 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, at a first time, via a first sensor of a first device, a first input from an environment of a user;
receiving user data via a second device in communication with the first device via a network;
determining, based on the first input and the user data, an occurrence of an event in the environment;
receiving, via a second sensor of the first device, a second input from the user;
identifying, based on the second input, an emotional reaction of the user;
receiving, via the second sensor at a second time later than the first time, a third input from the user;
in accordance with a determination that the third input comprises a request for information about the event:
constructing a query based on the third input, wherein the query is associated with the event and further associated with the requested information; and
presenting a response to the query via a display; and
in accordance with a determination that the third input does not comprise a request for information about the event, forgoing constructing the query.