US 12,086,314 B2
Systems and methods that involve BCI (brain computer interface), extended reality and/or eye-tracking devices, detect mind/brain activity, generate and/or process saliency maps, eye-tracking information and/or various control(s) or instructions, implement mind-based selection of UI elements and/or perform other features and functionality
Jack Baber, London (GB); and Ekram Alam, London (GB)
Assigned to MindPortal, Inc., San Francisco, CA (US)
Filed by MindPortal, Inc., San Francisco, CA (US)
Filed on Sep. 30, 2023, as Appl. No. 18/375,517.
Application 18/375,517 is a continuation of application No. PCT/US2023/030184, filed on Aug. 14, 2023.
Claims priority of provisional application 63/397,399, filed on Aug. 12, 2022.
Claims priority of provisional application 63/397,398, filed on Aug. 12, 2022.
Prior Publication US 2024/0053825 A1, Feb. 15, 2024
Int. Cl. G06F 3/01 (2006.01)
CPC G06F 3/015 (2013.01) [G06F 3/013 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
monitoring, via a brain computer interface (BCI), brain data of a user associated with the user's interaction with GUI elements, the BCI being configured to detect brain activity of the user associated with the user's interaction with interface elements within an environment, the environment comprising GUI elements and at least one of a mixed reality environment or a 2D software environment;
recording gaze information associated with a gaze location of the user during interaction with the environment,
decoding brain data of the user in temporal conjunction with detecting, via the gaze information, the user's visual attention on a particular element of the environment;
determining, based on decoding the brain data of the user, an imagined action indicating that the user wishes to interact with the particular element of the environment; and
generating, in response to determining the imagined action indicating that the user wishes to interact with the particular element, an interaction event with the particular element of the environment.