CPC G06F 3/013 (2013.01) [G06F 3/015 (2013.01); G06F 3/017 (2013.01); G06F 3/04842 (2013.01); G06F 2203/0381 (2013.01)] | 23 Claims |
1. An apparatus, comprising:
a display configured to present a control interface to a user;
an eye-tracking device configured to record eye-movement signals associated with the user;
a neural recording device configured to record neural signals associated with the user;
an interfacing device operatively coupled to the display, the eye-tracking device, and the neural recording device, the interfacing device including:
a memory; and
a processor operatively coupled to the memory and configured to:
receive the eye-movement signals from the eye-tracking device and the neural signals from the neural recording device;
generate and present a stimulus, via the control interface and to the user, the stimulus including a set of control items, each control item from the set of control items associated with an action from a set of actions;
provide a sticky control item configured to be (1) transitioned to a picked-up state in response to an eye-movement signal indicating a foveation over the sticky control item, (2) moved based on an eye-movement signal of the user, and (3) transitioned to a dropped state on a target control item to activate the target control item;
provide a grabber object configured to manipulate the sticky control item;
associate the sticky control item with the grabber object when the sticky control item is transitioned to the picked-up state based on an eye-movement signal indicating a foveation on the sticky control item;
determine a point of focus of the user based on at least one of the eye-movement signals or the neural signals, the point of focus being associated with an identified control item from the set of control items;
dissociate, when the sticky control item is at the dropped state and on the identified control item, the sticky control item from the grabber object and associate the sticky control item with the identified control item;
and
activate the identified control item to implement an action intended by the user.
|