CPC G06F 1/163 (2013.01) [A61B 3/113 (2013.01); A61B 5/0006 (2013.01); A61B 5/0022 (2013.01); A61B 5/0024 (2013.01); A61B 5/1114 (2013.01); A61B 5/16 (2013.01); A61B 5/165 (2013.01); A61B 5/369 (2021.01); A61B 5/378 (2021.01); A61B 5/38 (2021.01); A61B 5/486 (2013.01); A61B 5/6803 (2013.01); A61B 5/6814 (2013.01); A61B 5/6821 (2013.01); A61B 5/6831 (2013.01); A61B 5/7203 (2013.01); A61B 5/7264 (2013.01); A61B 5/744 (2013.01); A61B 5/7445 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/015 (2013.01); G06F 3/016 (2013.01); G16H 40/67 (2018.01); A61B 5/318 (2021.01); A61B 2503/12 (2013.01); A61B 2560/0475 (2013.01); A61B 2560/0493 (2013.01); A61B 2562/0219 (2013.01); A61B 2562/125 (2013.01); A61B 2562/164 (2013.01); A61B 2562/166 (2013.01); G06F 2203/011 (2013.01)] | 26 Claims |
1. An apparatus comprising:
an input device and a wearable computing device with a bio-signal sensor and a display to provide an augmented reality or virtual reality (“AR/VR”) environment for a user, the AR/VR environment containing virtual elements, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor,
the computing device having or in communication with a processor configured to:
as part of the AR/VR environment, present content on the display where the content includes the virtual elements and has an AR/VR event occurring within the AR/VR environment, the AR/VR event having one or more changes on the virtual elements in the AR/VR environment;
continuously receive user manual inputs from the input device for user interaction with the virtual elements in the AR/VR environment including during the AR/VR event;
continuously receive the bio-signal data of the user from the bio-signal sensor, including during the AR/VR event;
process the bio-signal data to extract and select features of the bio-signal data;
determine user states of the user, including brain states, using a prediction model and based on the features of the bio-signal data;
modify the AR/VR environment based on the user states and manual input from a third party.
|