US 12,253,882 B2
System and method for enhanced training using a virtual reality environment and bio-signal data
Christopher Allen Aimone, Scarborough (CA); Trevor Ce Coleman, Toronto (CA); Ariel Stephanie Garten, Toronto (CA); Kapil Jay Mishra Vidyarthi, Toronto (CA); Locillo (Lou) Giuseppe Pino, Cambridge (CA); Michael Apollo Chabior, Oakville (CA); Paul Harrison Baranowski, Toronto (CA); Raul Rajiv Rupsingh, Brampton (CA); Madeline Ashby, Brampton (CA); and Paul V. Tadich, Toronto (CA)
Assigned to INTERAXON INC., Toronto (CA)
Filed by INTERAXON INC., Toronto (CA)
Filed on Oct. 18, 2023, as Appl. No. 18/489,579.
Application 18/489,579 is a continuation of application No. 17/677,780, filed on Feb. 22, 2022, granted, now 11,815,951.
Application 17/677,780 is a continuation of application No. 16/937,762, filed on Jul. 24, 2020, granted, now 11,287,848, issued on Mar. 29, 2022.
Application 16/937,762 is a continuation of application No. 16/144,854, filed on Sep. 27, 2018, granted, now 10,768,665, issued on Sep. 8, 2020.
Application 16/144,854 is a continuation of application No. 14/851,853, filed on Sep. 11, 2015, granted, now 10,120,413, issued on Nov. 6, 2018.
Claims priority of provisional application 62/048,923, filed on Sep. 11, 2014.
Prior Publication US 2024/0045470 A1, Feb. 8, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); A61B 3/113 (2006.01); A61B 5/00 (2006.01); A61B 5/11 (2006.01); A61B 5/16 (2006.01); A61B 5/369 (2021.01); A61B 5/378 (2021.01); A61B 5/38 (2021.01); G06F 1/16 (2006.01); G16H 40/67 (2018.01); A61B 5/318 (2021.01)
CPC G06F 1/163 (2013.01) [A61B 3/113 (2013.01); A61B 5/0006 (2013.01); A61B 5/0022 (2013.01); A61B 5/0024 (2013.01); A61B 5/1114 (2013.01); A61B 5/16 (2013.01); A61B 5/165 (2013.01); A61B 5/369 (2021.01); A61B 5/378 (2021.01); A61B 5/38 (2021.01); A61B 5/486 (2013.01); A61B 5/6803 (2013.01); A61B 5/6814 (2013.01); A61B 5/6821 (2013.01); A61B 5/6831 (2013.01); A61B 5/7203 (2013.01); A61B 5/7264 (2013.01); A61B 5/744 (2013.01); A61B 5/7445 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/015 (2013.01); G06F 3/016 (2013.01); G16H 40/67 (2018.01); A61B 5/318 (2021.01); A61B 2503/12 (2013.01); A61B 2560/0475 (2013.01); A61B 2560/0493 (2013.01); A61B 2562/0219 (2013.01); A61B 2562/125 (2013.01); A61B 2562/164 (2013.01); A61B 2562/166 (2013.01); G06F 2203/011 (2013.01)] 26 Claims
OG exemplary drawing
 
1. An apparatus comprising:
an input device and a wearable computing device with a bio-signal sensor and a display to provide an augmented reality or virtual reality (“AR/VR”) environment for a user, the AR/VR environment containing virtual elements, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor,
the computing device having or in communication with a processor configured to:
as part of the AR/VR environment, present content on the display where the content includes the virtual elements and has an AR/VR event occurring within the AR/VR environment, the AR/VR event having one or more changes on the virtual elements in the AR/VR environment;
continuously receive user manual inputs from the input device for user interaction with the virtual elements in the AR/VR environment including during the AR/VR event;
continuously receive the bio-signal data of the user from the bio-signal sensor, including during the AR/VR event;
process the bio-signal data to extract and select features of the bio-signal data;
determine user states of the user, including brain states, using a prediction model and based on the features of the bio-signal data;
modify the AR/VR environment based on the user states and manual input from a third party.