Method for controlling device using detected change in neural-related signal

Abstract

To provide a system and a method for controlling a device using a detected change in a neural-related signal of a subject.SOLUTION: In one embodiment, a method for controlling a device or a software application comprises steps of: detecting a first change in a neural-related signal of a subject; detecting a second change in the neural-related signal; and transmitting an input command to a device upon or after detecting the second change in the neural-related signal. The neural-related signal can be detected using a neural interface implanted in a brain of the subject.SELECTED DRAWING: Figure 2ABCD

Description

[Technical Field]

[0001] The present disclosure relates generally to brain-computer interfaces. More particularly, the present disclosure relates to systems and methods for controlling devices using detected changes in neural-related signals of a subject. [Background technology]

[0002] It has been shown that people with limited mobility can use brain-computer interfaces (BCIs) to control peripherals such as personal electronic devices, IoT devices, software, and vehicles. BCIs should enable all people with limited mobility to effectively control such peripherals, including people with severe mobility limitations, such as homebound patients, who may only be able to control a single switch or virtual switch through their BCI. Summary of the Invention [Problem to be solved by the invention]

[0003] However, current BCIs that allow such homebound patients to access peripherals with a single switch sometimes use automatic switch scanning to affect such control. Automatic switch scanning involves continuously scanning a number of interaction items on a given control panel and selecting a desired item by operating a switch when the desired item is highlighted. This method is cumbersome and unuser-friendly, since if an incorrect selection is made, the user must wait for the continuous scanning to finish before restarting the entire process to correct the selection.

[0004] Furthermore, current BCI systems often rely on neural signals that are difficult to detect, potentially resulting in false positives, meaning that homebound patients may have difficulty operating even a single virtual switch.

[0005] Therefore, there is a need for a solution that allows patients with limited mobility to maintain or continue their independence even when they can only control one virtual switch. Such a solution should not be overly complex and should address the shortcomings of current BCI systems and methods. [Means for solving the problem]

[0006] Systems and methods are disclosed for controlling a device using detected changes in a subject's neural-related signal. In one embodiment, a method for controlling a device or software application is disclosed. The method may include detecting a decrease in the intensity of the subject's neural-related signal from a measured baseline level, detecting an increase in the intensity of the neural-related signal from the baseline level following the decrease, and sending an input command to the device upon or after detecting the increase in the intensity of the neural-related signal.

[0007] In some embodiments, the subject's neural-related signals may be neural oscillations or electroencephalograms of the subject. The neural oscillations may be comprised of oscillations in one or more frequency bands. In certain embodiments, the neural oscillations are comprised of beta-band oscillations at frequencies between about 12 Hz and 30 Hz.

[0008] In some embodiments, the neural-related signals can be measured or monitored using an intravascular device implanted within the subject's body. In these and other embodiments, the steps of detecting a decrease or increase in the intensity of the neural-related signals and sending the input commands can be performed using one or more processors of a device separate from the intravascular device, or one or more processors of a device incorporated within or coupled to the intravascular device.

[0009] In some embodiments, the device may be configured to be placed outside, i.e., extracorporeally, the subject's body. In other embodiments, the device may be configured to be implanted inside, the subject's body (e.g., in the chest region or within the arm of the subject).

[0010] A device can refer to a telemetry unit and / or a host device. In other examples, a device can refer to a computing device or a controller / control unit of an implanted or non-implanted device.

[0011] The neural-related signals can be sensed via electrodes of an intravascular device implanted in the subject's body, for example, via electrodes of an intravascular device implanted in the subject's brain.

[0012] The method can further include filtering raw nerve-related signals obtained from the intravascular device using one or more software filters, using one or more processors. The method can further include feeding the filtered signals into a classification layer of software running on the apparatus or other device, the classification layer configured to automatically detect decreases and increases in intensity of the nerve-related signals using machine learning classifiers.

[0013] In some embodiments, detecting a decrease in the strength of the neural-related signal can include detecting a decrease in the power of the neural oscillations below a baseline oscillation power level. For example, a decrease in the strength of the neural-related signal below a measured baseline level can be referred to as desynchronization of the neural-related signal. The decrease in the strength of the neural-related signal can be caused by the subject recalling or holding task-related or task-unrelated thoughts.

[0014] In these and other embodiments, detecting an increase in the intensity of the neural-related signal can include detecting an increase in the power of the neural oscillation above a baseline oscillation power level. For example, an increase in the intensity of the neural-related signal above a measured baseline level can be referred to as a rebound of the neural-related signal. The increase in the intensity of the neural-related signal can be caused by the subject mentally disengaging from task-related or non-task-related thoughts.

[0015] A non-task related thought may be a thought related to the subject's physical function, such as the subject holding a thought that causes the subject's hamstrings to contract.

[0016] The method may further include providing at least one of visual feedback, auditory feedback, tactile feedback, and feedback in the form of neurostimulation to the subject after transmitting the input command to the device.

[0017] Sending the input commands may include sending the input commands to one or more end applications executing on the device, and the input commands may be commands to the device to accomplish at least a portion of a task associated with the task-related thoughts.

[0018] The device may be at least one of a personal computing device (e.g., a laptop, a mobile phone, and / or a tablet computer) or an Internet of Things (IoT) device (e.g., a smart light switch, a refrigerator, an oven, and / or a washing machine). In some embodiments, the device may be a mobile object, such as a wheelchair.

[0019] Another example method of controlling a device or software application is disclosed, which may include detecting a decrease in the intensity of a nerve-related signal of a subject from a measured baseline level, detecting an increase in the intensity of the nerve-related signal from the baseline level following the decrease, determining a duration of the decrease in the intensity of the nerve-related signal, selecting an input command from a plurality of conditional input commands based on the duration, and transmitting the selected input command to the device.

[0020] In some embodiments, selecting the input command based on the duration may include comparing the duration to one or more temporal thresholds associated with the conditional input commands, and selecting the input command from the plurality of conditional input commands based on whether the duration exceeds or does not meet the one or more temporal thresholds. The duration during which the intensity of the neural-related signal is reduced may be a predetermined time during which the subject holds a thought.

[0021] In some embodiments, the subject's neural-related signals may be neural oscillations or electroencephalograms of the subject. The neural oscillations may be comprised of oscillations in one or more frequency bands. In certain embodiments, the neural oscillations are comprised of beta-band oscillations at frequencies between about 12 Hz and 30 Hz.

[0022] In some embodiments, the neural-related signals can be measured or monitored using an intravascular device implanted within the subject's body. In these and other embodiments, the steps of detecting a decrease or increase in intensity of the neural-related signals, determining a duration of the decrease in intensity of the neural-related signals, selecting an input command from a plurality of conditional input commands based on the duration, and transmitting the selected input command to the device can be performed using one or more processors of an apparatus separate from the intravascular device or one or more processors of an apparatus incorporated within or coupled to the intravascular device.

[0023] In some embodiments, the device may be configured to be placed outside, i.e., extracorporeally, the subject's body. In other embodiments, the device may be configured to be implanted inside, the subject's body (e.g., in the chest region or within the arm of the subject).

[0024] A device can refer to a telemetry unit and / or a host device. In other examples, a device can refer to a computing device or a controller / control unit of an implanted or non-implanted device.

[0025] The neural-related signals can be sensed via electrodes of an intravascular device implanted in the subject's body, for example, via electrodes of an intravascular device implanted in the subject's brain.

[0026] The method can further include filtering raw nerve-related signals obtained from the intravascular device using one or more software filters, using one or more processors. The method can further include feeding the filtered signals into a classification layer of software running on the apparatus or other device, the classification layer configured to automatically detect decreases and increases in intensity of the nerve-related signals using machine learning classifiers.

[0027] In some embodiments, detecting a decrease in the strength of the neural-related signal can include detecting a decrease in the power of the neural oscillation below a baseline oscillation power level. For example, a decrease in the strength of the neural-related signal below a measured baseline level can be referred to as desynchronization of the neural-related signal. The decrease in strength of the neural-related signal can be caused by the subject having or holding task-related or task-unrelated thoughts.

[0028] In these and other embodiments, detecting an increase in the intensity of the neural-related signal can include detecting an increase in the power of the neural oscillation above a baseline vibration power level. For example, an increase in the intensity of the neural-related signal above a measured baseline level can be referred to as a rebound of the neural-related signal. The increase in the intensity of the neural-related signal can be caused by the subject mentally releasing a task-related or non-task-related thought. The non-task-related thought can be a thought related to the subject's physical function, such as the subject holding a thought that causes the subject's hamstrings to contract.

[0029] The method may further include providing at least one of visual feedback, auditory feedback, tactile feedback, and feedback in the form of neurostimulation to the subject regarding the selected input command before transmitting the input command to the device.

[0030] Sending the input commands may include sending the input commands to one or more end applications executing on the device, and the input commands may be commands to the device to accomplish at least a portion of a task associated with the task-related thoughts.

[0031] The device may be at least one of a personal computing device (e.g., a laptop, a mobile phone, and / or a tablet computer) or an Internet of Things (IoT) device (e.g., a smart light switch, a refrigerator, an oven, and / or a washing machine). In some embodiments, the device may be a mobile object, such as a wheelchair.

[0032] Another example method of controlling a device or software application is disclosed, which may include detecting a first change in a nerve-related signal of a subject, detecting a second change in the nerve-related signal, and sending an input command to the device upon or after detecting the second change in the nerve-related signal.

[0033] The method may further include determining a duration of the first change in the neural-related signal and using the duration to select an input command from a plurality of conditional input commands based on the duration. The method may further include providing at least one of visual feedback, auditory feedback, tactile feedback, and feedback in the form of neural stimulation to the subject regarding the selected input command.

[0034] In some embodiments, the first change can be a decrease in the intensity of the neural-related signal below a baseline signal level. In these embodiments, the second change can be an increase in the intensity of the neural-related signal above the baseline signal level. Further, in these embodiments, the first change can occur when the subject generates and holds a thought, and the second change can occur when the subject generates and holds a second thought.

[0035] In other embodiments, the first change may be an increase in the intensity of the neural-related signal above a baseline signal level. In these embodiments, the second change may be a decrease in the intensity of the neural-related signal below a baseline signal level. Furthermore, in these embodiments, the first change may occur when the subject generates and holds a thought, and the second change may occur when the subject generates and holds a second thought. Alternatively, the first change may occur when the subject mentally releases a first thought, and the second change may occur when the subject generates and holds a second thought.

[0036] In some embodiments, the thoughts may be task-related thoughts. In other embodiments, the thoughts may be non-task-related thoughts. The thoughts may be related to the subject's bodily functions.

[0037] The change in the nerve-related signal can be detected by an intravascularly placed device implanted within the subject's body. In these and other embodiments, the steps of detecting a first change in the nerve-related signal, detecting a second change in the nerve-related signal, determining a duration of the change(s) in the nerve-related signal, selecting an input command from the plurality of conditional input commands based on the duration, and transmitting the selected input command to the device can be performed using one or more processors of an apparatus separate from the intravascularly placed device or one or more processors of an apparatus incorporated into or coupled to the intravascularly placed device.

[0038] In some embodiments, the device may be configured to be placed outside, i.e., extracorporeally, the subject's body. In other embodiments, the device may be configured to be implanted inside, the subject's body (e.g., in the chest region or within the arm of the subject).

[0039] A device can refer to a telemetry unit and / or a host device. In other examples, a device can refer to a computing device or a controller / control unit of an implanted or non-implanted device.

[0040] The neural-related signals can be sensed via electrodes of an intravascular device implanted in the subject's body, for example, via electrodes of an intravascular device implanted in the subject's brain.

[0041] The method can further include filtering raw nerve-related signals obtained from the intravascular device using one or more software filters, using one or more processors. The method can further include feeding the filtered signals into a classification layer of software running on the apparatus or other device, the classification layer configured to automatically detect decreases and increases in intensity of the nerve-related signals using machine learning classifiers.

[0042] Also disclosed is a system for controlling a device. The system may include an intravascularly placed device configured to measure or monitor a subject's nerve-related signals and an apparatus including one or more processors. The one or more processors can be programmed to detect a decrease in the intensity of the subject's nerve-related signals below a measured baseline level, detect an increase in the intensity of the nerve-related signals above the baseline level following the decrease, and send an input command to the device upon or following detection of the increase in the intensity of the nerve-related signals.

[0043] In some embodiments, the one or more processors can be programmed to detect a reduction in the intensity of the subject's neural-related signal below a measured baseline level, detect an increase in the intensity of the neural-related signal above the baseline level following the reduction, determine a duration of the reduction in the intensity of the neural-related signal, select an input command from a plurality of conditional input commands based on the duration, and send the selected input command to the device.

[0044] The one or more processors may be further programmed to compare the duration to one or more temporal thresholds associated with the conditional input commands and select an input command from the plurality of conditional input commands based on whether the duration exceeds or does not meet the one or more temporal thresholds.

[0045] The subject's neural-related signal may be a neural oscillation of the subject. For example, the one or more processors may be programmed to detect a decrease in the intensity of the neural-related signal by detecting a decrease in the power of the neural oscillation below a baseline oscillation power level. The one or more processors may also be programmed to detect an increase in the intensity of the neural-related signal by detecting an increase in the power of the neural oscillation above the baseline oscillation power level.

[0046] Neural oscillations may consist of oscillations in one or more frequency bands. For example, neural oscillations may consist of beta band oscillations at frequencies between about 12 Hz and 30 Hz.

[0047] In other embodiments, the decrease in the intensity of the neural-related signal may be caused by the subject recalling and holding a non-task-related thought. In these embodiments, the increase in the intensity of the neural-related signal may be caused by the subject mentally releasing a task-related thought. The input command may be a command to the device to accomplish at least a portion of a task associated with the task-related thought.

[0048] In other embodiments, the decrease in the intensity of the neural-related signal may be caused by the subject recalling and holding a non-task-related thought. The increase in the intensity of the neural-related signal may be caused by the subject mentally releasing the non-task-related thought. The input command may be a command to the device to accomplish at least a portion of a task that is not associated with the non-task-related thought. For example, the non-task-related thought may be a thought related to the subject's physical function.

[0049] In certain embodiments, a decrease in the strength of a neural-related signal below a measured baseline level may be referred to as desynchronization of the neural-related signal, and in these embodiments, an increase in the strength of the neural-related signal above a measured baseline level may be considered a rebound of the neural-related signal.

[0050] The intravascular device can be configured to be placed within the brain of a subject. For example, the intravascular device can be configured to be placed within a vein or sinus of the subject. Nerve-related signals can be measured or monitored using electrodes of the intravascular device implanted in the subject.

[0051] In some embodiments, the device may be configured to be placed external to the subject's body, hi other embodiments, the device may be configured to be implanted internally to the subject's body.

[0052] The one or more processors can be further programmed to filter raw nerve-related signals obtained from the intravascular device using one or more software filters, and to feed the filtered signals to a classification layer to automatically detect decreases and increases in intensity of the nerve-related signals using a machine learning classifier.

[0053] The one or more processors can be further programmed to provide at least one of visual feedback, auditory feedback, and tactile feedback to the subject regarding the input command. In these and other embodiments, the intravascular device can be configured to provide feedback to the subject in the form of neural stimulation regarding the input command.

[0054] The one or more processors can be further programmed to send the input commands to one or more end applications executing on the device. In some embodiments, the device can be at least one of a personal computing device (e.g., a laptop, a mobile phone, and / or a tablet computer) or an Internet of Things (IoT) device (e.g., a smart light switch, a refrigerator, an oven, and / or a washing machine). In other embodiments, the device can be a mobile object, such as a wheelchair.

[0055] A system for controlling a device may include an intravascular device configured to measure or monitor a nerve-related signal of a subject, and an apparatus configured to detect a change in the nerve-related signal.

[0056] In some embodiments, the apparatus may comprise one or more processors programmed to detect a first change in a neural-related signal of the subject, detect a second change in the neural-related signal, and send an input command to the device upon or after detecting the second change in the neural-related signal.

[0057] The one or more processors may be further programmed to determine a duration of the first change in the neural-related signal and use the duration to select an input command from the plurality of conditional input commands based on the duration.

[0058] In some embodiments, the first change may be a decrease in the intensity of the neural-related signal below the baseline signal level. In these embodiments, the second change may be an increase in the intensity of the neural-related signal above the baseline signal level.

[0059] In other embodiments, the first change may be an increase in the intensity of the neural-related signal above a baseline signal level. In these embodiments, the second change may be a decrease in the intensity of the neural-related signal below the baseline signal level.

[0060] For example, a first change may occur when a subject generates and holds a thought, and a second change may occur when a subject mentally releases the thought.

[0061] Alternatively, a first change may occur when the subject mentally releases a first thought, and a second change may occur when the subject generates and holds a second thought. [Brief explanation of the drawings]

[0062] The drawings shown and described are of exemplary embodiments and are not limiting. Like reference numbers generally indicate identical or functionally equivalent elements.

[0063] [Figure 1A] FIG. 1A illustrates a universal switch module according to one embodiment. [Figure 1B] FIG. 1B illustrates the universal switch module of FIG. 1A according to one embodiment when the patient is thinking. [Figure 1C] FIG. 1C is a diagram illustrating a user interface of a host device for the universal switch module of FIGS. 1A and 1B, according to one embodiment. [Figure 2ABCD] 2A-2D are diagrams illustrating a universal switch model according to one aspect for communicating with an end application. [Figure 3] FIG. 3 is a diagram illustrating a wireless universal switch module according to one embodiment communicating with an end application. [Figure 4] FIG. 4 illustrates a universal switch module, according to one embodiment, for recording nerve-related signals from a patient. [Figure 5] FIG. 5 illustrates a method according to one embodiment performed by the universal switch module of FIGS. 1A-1C. [Figure 6]FIG. 6 illustrates a method according to one embodiment performed by the universal switch module of FIGS. 1A-1C. [Figure 7] FIG. 7 illustrates a method according to one embodiment performed by the universal switch module of FIGS. 1A-1C. [Figure 8] FIG. 8 illustrates a method for controlling devices and software using changes in detected neural-related signals of a subject, according to one embodiment. [Figure 9] FIG. 9 is a diagram showing an example of a spectrogram in which changes in nerve-related signals of a subject are detected. [Figure 10] FIG. 10 illustrates another example method for using changes in detected neural-related signals of a subject to control a device or software. [Figure 11] FIG. 11 illustrates another example module that uses changes in detected neural-related signals of a subject to control a device or software. [Figure 12A] FIG. 12A is a diagram showing an example of a spectrogram illustrating a state in which a subject holds a thought for only a short time. [Figure 12B] FIG. 12B shows an example of a spectrogram illustrating how the subject holds onto thoughts for longer periods of time. [Figure 13] FIG. 13 illustrates yet another example method for controlling a device or software using changes in a detected nerve-related signal of a subject. [Figure 14] FIG. 14 illustrates the change in power of frequencies in the beta band (e.g., 12 Hz to 30 Hz) and gamma band (e.g., 60 Hz to 80 Hz) when a subject recalls / holds and then releases thoughts about moving the subject's left and right ankles. DETAILED DESCRIPTION OF THE INVENTION

[0064] A universal switch module, a universal switch, and methods of use thereof are disclosed. For example, FIGS. 1A-1C illustrate one embodiment of a universal switch module 10 that can be used by a patient 8 (e.g., a BCI user) to control one or more end applications 12 by thinking a thought 9. The module 10 may include a neural interface 14 and a host device 16. The module 10 (e.g., the host device 16) can communicate with one or more end applications 12 via wired and / or wireless communication. The neural interface 14 can be a biological medium signal detector (e.g., an electrical conductor, a biochemical sensor), the host device 16 can be a computer (e.g., a laptop, a smartphone), and the end application 12 can be any electronic device or software. The neural interface 14 can monitor neural-related signals 17 of the biological medium via one or more sensors. A processor in the module 10 can analyze the detected neural-related signals 17 to determine whether the detected neural-related signals 17 are associated with a thought 9 assigned to an input command 18 of the end application 12. Once a thought 9 assigned to an input command 18 is detected by the neural interface 14 and associated with the input command 18 by the processor, the input command 18 can be transmitted (e.g., via a processor, controller, or transceiver) to the end application 12 with which the input command 18 is associated. A thought 9 can be assigned to input a command 18 of multiple end applications 12. The module 10 thereby advantageously enables the patient 8 to independently control multiple end applications 12, e.g., a first end application and a second end application, with a single thought (e.g., thought 9), which can be used to control the first and second applications at different times and / or simultaneously.In this way, the module 10 can function as a universal switch module capable of controlling multiple end applications 12 (e.g., software and devices) using the same thought 9. The thought 9 can be a universal switch that can be assigned to any input command 18 of any end application 12 (e.g., to an input command 18 of a first end application and to an input command 18 of a second end application). The first end application can be a first device or first software. The second end application can be a second device or second software.

[0065] When the patient 8 thinks a thought 9, the input commands 18 associated with the thought 9 can be transmitted by the module 10 (e.g., via a processor, controller, or transceiver) to their corresponding end applications 12. For example, if a thought 9 is assigned to an input command 18 for a first end application, the input command 18 for the first end application can be transmitted to the first end application when the patient 8 thinks the thought 9, and if a thought 9 is assigned to an input command 18 for a second end application, the input command 18 for the second end application can be transmitted to the second end application when the patient 8 thinks the thought 9. This allows a thought 9 to interface with or control multiple end applications 12, functioning like a universal button (e.g., thought 9) on a universal controller (e.g., the patient's brain). Any number of thoughts 9 can be used as switches. The number of thoughts 9 used as switches can correspond, for example, to the number of controls (e.g., input commands 18) needed or desired to control the end applications 12.

[0066] Using a video game controller as an example, a patient's thoughts 9 can be assigned to any input command 18 associated with any individual button, any combination of buttons, and any directional movement of a control pad (e.g., of a joystick, directional pad, or other control pad) on the control, allowing the patient 8 to play any game on any video game system using thoughts 9 with or without traditional physical controls. A video game system is just one example of an end application 12. Module 10 allows the patient's thoughts 9 to be assigned to input commands 18 for any end application 12 so that the patient's thoughts 9 can be mapped to the controls of any software or device. Module 10 thereby organizes the patient's thoughts 9 into assignable switches that are essentially universal but whose execution is specific when assigned to input commands 18. Additional illustrative examples of end applications 12 include mobility devices (e.g., vehicles, wheelchairs, wheelchair lifts), prosthetic limbs (e.g., prosthetic arms, prosthetic legs), phones (e.g., smartphones), smart appliances, and smart home systems.

[0067] The neural interface 14 can detect neural-related signals 17, including signals associated with thoughts 9 and signals not associated with thoughts 9. For example, the neural interface 14 can have one or more sensors that can detect (also referred to as acquiring, detecting, recording, and measuring) neural-related signals 17, including those generated by the patient 8's biological media when the patient 8 thinks thoughts 9 and those generated by the patient 8's biological media not associated with thoughts 9 (e.g., the patient's response to stimuli not associated with thoughts 9). The sensors of the neural interface 14 can record signals from and / or stimulate the patient 8's biological media. Examples of biological media include nervous tissue, vascular tissue, blood, bone, muscle, cerebrospinal fluid, or any combination thereof. The sensors can be, for example, electrodes, and the electrodes can be any electrical conductor for detecting electrical activity in the biological media. The sensors can be, for example, biochemical sensors. The neural interface 14 can have a single type of sensor (e.g., only electrodes) or multiple types of sensors (e.g., one or more electrodes and one or more biochemical sensors).

[0068] The neural-related signal can be any signal (e.g., electrical, biochemical) detectable from a biological medium, any one or more features extracted (e.g., via a computer processor) from the detected neural-related signal, or both. The extracted features may be or include feature information about the patient's 8 thoughts (9) so that different thoughts (9) can be distinguished from one another. Alternatively, the neural-related signal can be an electrical signal, any signal (e.g., a biochemical signal) caused by an electrical signal, any one or more features extracted (e.g., via a computer processor) from the detected neural-related signal, or any combination thereof. The neural-related signal can also be a brain-related signal. If the biological medium is within the patient's skull, the neural-related signal can be, for example, a brain signal (e.g., detected from brain tissue) resulting from or caused by the patient 8 thinking a thought (9). Thus, the neural-related signal can be a brain-related signal, such as an electrical signal from any one or more portions of the patient's brain (e.g., motor cortex, sensory cortex). When the biological medium is outside the patient's skull, the neural-related signals can be, for example, electrical signals associated with muscle contractions (e.g., of a body part, such as an eyelid, eye, nose, ear, finger, arm, toe, leg, etc.) resulting from or caused by the patient 8 thinking a thought 9. The thought 9 (e.g., a body part movement, memory, task) thought by the patient 8 when the neural-related signals are detected from brain tissue of the patient 8 can be the same as or different from the thought 9 thought by the patient 8 when the neural-related signals are detected from non-brain tissue. Neural interface 14 can be positioned inside the patient's brain, outside the patient's brain, or both.

[0069] The module 10 can include one or more neural interfaces 14, e.g., 1 to 10 or more neural interfaces 14, including increments of neural interfaces within this range (e.g., one neural interface, two neural interfaces, ten neural interfaces), each of which can have one or more sensors (e.g., electrodes) configured to detect neural-related signals (e.g., neural signals). The location of the neural interface 14 can be selected to optimize recording of the neural-related signals, e.g., by selecting a location with the strongest signal, minimizing interference from noise, minimizing trauma to the patient 8 caused by implantation or engagement of the neural interface 14 (e.g., via surgery) with the patient 8, or any combination thereof. For example, the neural interface 14 can be a brain-machine interface, such as an intravascular device (e.g., a stent) having one or more electrodes for detecting electrical activity in the brain. When multiple neural interfaces 14 are used, the neural interfaces 14 can be the same or different from one another. For example, when two neural interfaces 14 are used, both of the neural interfaces 14 may be intravascular devices with electrodes (e.g., expandable and collapsible stents with electrodes), or one of the neural interfaces 14 may be an intravascular device with electrodes and the other of the two neural interfaces 14 may be a device with a different sensor than the intravascular device with electrodes.

[0070] 1A and 1B further illustrate that the module 10 may include a telemetry unit 22 configured to communicate with the neural interface 14, and a communication conduit 24 (e.g., a wire) for facilitating communication between the neural interface 14 and the telemetry unit 22. The host device 16 may be configured for wired and / or wireless communication with the telemetry unit 22. The host device 16 may communicate with the telemetry unit 22 wired and / or wirelessly.

[0071] 1A and 1B further illustrate that the telemetry unit 22 can include an internal telemetry unit 22a and an external telemetry unit 22b. The internal telemetry unit 22a can communicate with the external telemetry unit 22b via wires or wirelessly. For example, the external telemetry unit 22b can be wirelessly connected to the internal telemetry unit 22a across the patient's skin. The internal telemetry unit 22a can communicate with the neural interface 14 via wires or wirelessly, and the neural interface 14 can be electrically connected to the internal telemetry unit 22a via a communication conduit 24. The communication conduit 24 can be, for example, a wire such as a stent lead.

[0072] The module 10 may include a processor (also referred to as a processing unit) capable of analyzing and decoding the neural-related signals detected by the neural interface 14. The processor may be a computer processor (e.g., a microprocessor). The processor may apply a mathematical algorithm or model to detect the neural-related signals corresponding to when the patient 8 generates thoughts 9. For example, once the neural-related signals 17 are detected by the neural interface 14, the processor may apply the mathematical algorithm or model to detect, decode, and / or classify the detected neural-related signals 17. As another example, once the neural-related signals 17 are detected by the neural interface 14, the processor may apply the mathematical algorithm or model to detect, decode, and / or classify information in the detected neural-related signals 17. Once the neural-related signals 17 detected by the neural interface 14 are processed by the processor, the processor may associate the processed information (e.g., the detected, decoded, and / or classified neural-related signals 17 and / or the detected, decoded, and / or classified information of the detected neural-related signals 17) with input commands 18 of the end application 12.

[0073] The neural interface 14, the host device 16, and / or the telemetry unit 22 can include a processor. Alternatively, the neural interface 14, the host device 16, and / or the telemetry unit 22 can include a processor (e.g., a processor described above). For example, the host device 16 can analyze and decode the neural-related signals 17 sensed by the neural interface 14 via the processor. The neural interface 14 can communicate with the host device 16 via wired or wireless communication, and the host device 16 can communicate with the end application 12 via wired or wireless communication. Alternatively, the neural interface 14 can communicate with the telemetry unit 22 via wired or wireless communication, and the telemetry unit 22 can communicate with the host device 16 via wired or wireless communication, and the host device 16 can communicate with the end application 12 via wired or wireless communication. Data may be passed from the neural interface 14 to the telemetry unit 22, from the telemetry unit 22 to the host device 16, from the host device 16 to one or more end applications 12, or any combination thereof, to detect thoughts 9 and trigger input commands 18, for example. Alternatively, data may be passed in reverse order, for example, from one or more end applications 12 to the host device 16, from the host device 16 to the telemetry unit 22, from the telemetry unit 22 to the neural interface 14, or any combination thereof, to stimulate biological media via one or more sensors. Data may be data collected or processed by a processor, including, for example, neural-related signals and / or features extracted therefrom. When data is flowing, for example, from the processor to a sensor, the data may include stimulation commands such that, when the stimulation commands are processed by the neural interface 14, the sensor of the neural interface can stimulate biological media.

[0074] 1A and 1B further illustrate that when patient 8 thinks a thought 9, the patient's 8's biological media (e.g., intracranial biological media, extracranial biological media, or both) can generate neural-related signals 17 detectable by neural interface 14. Sensors in neural interface 14 can detect neural-related signals 17 associated with thought 9 when patient 8 thinks thought 9. The neural-related signals 17 associated with thought 9, features extracted from these neural-related signals 17, or both, can be assigned or associated with any input command 18 of any end application 12 controllable by universal switch module 10. Each of the detectable neural-related signals 17 and / or its extracted features can thereby advantageously function as a universal switch assignable to any input command 18 of any end application 12. In this manner, when thought 9 is detected by neural interface 14, the input command 18 associated with thought 9 can be triggered and sent to the end application 12 with which the triggered input command 18 is associated.

[0075] For example, when a thought 9 is detected by the neural interface 14 (e.g., via a detected neural-related signal 17), the processor may analyze (e.g., detect, decode, classify, or any combination thereof) the detected neural-related signal 17 and associate the detected neural-related signal 17 and / or features extracted therefrom with a corresponding assigned input command 18. This allows the processor to determine whether the thought 9 (e.g., the detected neural-related signal 17 and / or features extracted therefrom) is associated with one of the input commands 18. If the processor or controller determines that the thought 9 is associated with an input command 18, the processor or controller may activate (also referred to as trigger) the input command 18. Once the input command 18 is triggered by the module 10 (e.g., by the processor or controller of the host device 16), the triggered input command 18 may be sent to the corresponding end application 12 (e.g., a wheelchair, a prosthetic hand, a smart appliance such as a coffee machine, etc.) so that the triggered input command 18 can control the corresponding end application 12. Once the end application 12 receives the triggered input command 18, the end application 12 can execute one or more instructions of the input command 18 (e.g., move a wheelchair forward at one meter per second, pinch the thumb and index finger of a prosthetic hand together, start a smart coffee machine). Thus, once a thought 9 (e.g., a detected neural-related signal 17 and / or features extracted therefrom) is determined to be associated with the input command 18, the input command 18 can be sent to its corresponding end application 12.

[0076] The extracted features may be elements of the detected neural-related signals 17, including, for example, patterns of voltage fluctuations in the detected neural-related signals 17, fluctuations in power in specific frequency bands embedded within the detected neural-related signals 17, or both. For example, the neural-related signals 17 may have various ranges of oscillation frequencies that correspond to when the patient 8 thinks thoughts 9. Particular frequency bands may contain specific information. For example, high-band frequencies (e.g., 65 Hz to 150 Hz) may contain information that correlates with movement-related thoughts, and therefore, features in this high-band frequency range may be used (e.g., extracted or identified from the detected neural-related signals 17) to classify and / or decode neural events (e.g., thoughts 9).

[0077] The thought 9 can be a universal switch. The thought 9 can function as (e.g., be used as) a universal switch that can assign the thought 9 to any input command 18, or vice versa. The thought 9 can be assigned or associated with any input command 18 of the end application 12 controllable by the universal switch module 10 by its associated detectable neural-related signal 17 and / or features extractable therefrom. The patient 8 can activate the desired input command 18 by thinking the thought 9 associated with the patient 8's desired input command 18. For example, when a thought 9 (e.g., the patient's memory of their 9th birthday party) assigned to a particular input command 18 (e.g., moving the wheelchair forward) is detected by the neural interface 14, a processor (e.g., of the host device 16) can associate the neural-related signal 17 associated with that thought 9 (e.g., the memory of the 9th birthday party) and / or features extracted therefrom with the corresponding associated input command 18 (e.g., moving the wheelchair forward). Once the detected neural-related signal (e.g., and / or the extracted features associated therewith) is associated with an assigned input command 18, the host device 16, via a processor or controller, can transmit the input command 18 to the end application 12 with which the input command 18 is associated, and control the end application 12 with the input command 18 triggered by the patient 8 thinking a thought 9.

[0078] When a thought 9 is assigned to multiple end applications 12 and only one of the end applications 12 is active (e.g., powered on and / or running), the host device 16 can send the triggered input command 18 to the active end application 12. As another example, when a thought 9 is assigned to multiple end applications 12 and some of the end applications 12 are active (e.g., powered on or running) and some of the end applications 12 are inactive (e.g., powered off or in standby mode), the host device 16 can send the triggered input command 18 to both the active and inactive end applications 12. The active end application 12 can execute the input command 18 when the input command 18 is received by the active end application 12. An inactive end application 12 can execute the input command 18 when the inactive application 12 becomes active (e.g., powers on or begins execution), or the input command 18 can be queued (e.g., by the module 16 or the end application 12) to be executed when the inactive application 12 becomes active.As yet another example, if a thought 9 is assigned to multiple end applications 12 and two or more of the end applications 12, e.g., a first end application and a second end application, are active (e.g., powered on and / or running), the host device 16 can send triggered input commands 18 associated with the first end application to the first end application, can send triggered input commands 18 associated with the second end application to the second end application, or the module 10 can select which triggered input commands 18 the patient 8 wants to send (e.g., send only the triggered input commands 18 associated with the first end application, send only the triggered input commands 18 associated with the second end application, or send both triggered input commands 18).

[0079] Thought 9 may be any thought or a combination of thoughts. For example, patient 8 may have thoughts 9 that are a single thought, multiple thoughts, multiple thoughts in succession, multiple thoughts simultaneously, thoughts of different durations, thoughts of different frequencies, thoughts in one or more sequences, one or more combinations of thoughts, or any combination thereof. Thought 9 may be task-related thoughts, task-irrelevant thoughts, or both, where task-related thoughts are related to the patient 8's intended task and task-irrelevant thoughts are not related to the patient 8's intended task. For example, thought 9 may be for a first task, and patient 8 may use module 10 to think about the first task, for example, in order to complete a second task (also referred to as an intended task and a target task). The first task may be the same as or different from the second task. If the first task is the same as the second task, thought 9 may be a task-related thought. If the first task and the second task are different, thought 9 may be a task-irrelevant thought. For example, a thought 9 (e.g., of a first task) can be a task-related thought if a first task the patient 8 thinks about is moving a limb (e.g., an arm, a leg) and a second task is the same as the first task, i.e., moving a prosthetic limb (e.g., an arm, a leg). The prosthetic limb can be, for example, an end application 12 that the patient 8 is controlling with thought 9. For example, in a task-related thought, the patient 8 can think about moving a cursor if the target task is to move a cursor. In contrast, in a task-irrelevant thought 9 in which the patient 8 thinks about moving a limb (e.g., an arm) as the first task, the second task can be a task of any end application 12 that is different from the first task of moving a limb (e.g., an arm). For example, in a task-irrelevant thought, the patient 8 can think about moving a body part (e.g., a hand) to the right if the target task is to move a cursor to the right.This allows the patient 8 to think a first task (e.g., thought 9) to accomplish any second task, which may be the same as or different from the first task. The second task can be any task of any end application 12. For example, the second task can be any input command 18 of any end application 12. Thought 9 (e.g., first task) can be assigned to any second task. This allows the patient 8 to think a first task to trigger any input command 18 (e.g., any second task) of any end application 12. This allows the first task to advantageously function as a universal switch. Each thought 9 can generate a repeatable neural-related signal (e.g., detectable neural-related signal 17) that can be detected by the neural interface 14. Each detectable neural-related signal and / or features extractable therefrom can be a switch. The switch may be activated (also referred to as triggered) when, for example, a sensor detects that the patient 8 thinks a thought 9 and activates the switch, and / or a processor determines that one or more extracted features are present in the detected neural-related signals. The switch may be a universal switch that can be assigned and reassigned to any input command 18, for example, to any set of input commands 18. An input command 18 may be added to, removed from, and / or modified from any set of input commands. For example, each end application 12 may have a set of input commands 18 associated with it, to which neural-related signals 17 of thoughts 9 may be assigned.

[0080] Some of the thoughts 9 may be non-task related thoughts (e.g., the patient 8 tries to move his / her hand to move the cursor to the right), some of the thoughts 9 may be task related thoughts (e.g., the patient 8 tries to move the cursor when the target task is to move the cursor), some of the thoughts 9 may be both task related and task related thoughts, or any combination thereof. When a thought 9 is both a task related thought and a task related thought, the thought 9 can be used as both a task related thought (e.g., the patient 8 tries to move his / her hand to move the cursor to the right) and a task related thought (e.g., the patient tries to move the cursor when the target task is to move the cursor), thereby allowing the thought 9 to be associated with multiple input commands 18, one or more of which may be task related to the thought 9 and one or more of which may be task non-related to the thought 9.

[0081] In this manner, thoughts 9 can be universal switches that can be assigned to any input command 18 in any end application 12, and each thought 9 can be assigned to one or more end applications 12. Module 10 advantageously enables each patient 8 to use their thoughts 9 like buttons on a control device (e.g., a video game controller, any control interface) to control any end application 12 desired by the patient 8. For example, a thought 9 can be assigned to each input command 18 in an end application 12, and the assigned input commands 18 can be used in any combination like buttons on a control device to control the end application 12. For example, if the end application 12 has four input commands 18 (e.g., four buttons for controls—first input command, second input command, third input command, and fourth input command), a different thought 9 can be assigned to each of the four input commands 18 (e.g., a first thought 9 can be assigned to the first input command 18, a second thought 9 can be assigned to the second input command 18, a third thought 9 can be assigned to the third input command 18, and a fourth thought 9 can be assigned to the fourth input command 18), allowing the patient 8 to use these four thoughts 9 to activate the four input commands 18 and combinations thereof (e.g., any order, number, frequency, and duration of the four input commands 18) to control the end application 12. For example, for an end application 12 having four input commands 18, the four input commands 18 can control the end application 12 using any combination of four thoughts 9 assigned to the first, second, third, and fourth input commands 18, such as single activation of each input command, single activation of each input command multiple times (e.g., two activations within five seconds, three activations within ten seconds), combinations of multiple input commands 18 (e.g., the first and second input commands simultaneously or in series), or any combination thereof. Each combination of thoughts 9, as well as each individual thought 9, can function as a universal switch.The patient 8 may control multiple end applications 12 with first, second, third, and fourth thoughts 9. For example, a first thought 9 may be assigned to a first input command 18 of the first end application 12, a first thought 9 may be assigned to a first input command 18 of the second end application 12, a second thought 9 may be assigned to a second input command 18 of the first end application 12, a second thought 9 may be assigned to a second input command 18 of the second end application 12, a third thought 9 may be assigned to a third input command 18 of the first end application 12, a third thought 9 may be assigned to a third input command 18 of the second end application 12, a fourth thought 9 may be assigned to a fourth input command 18 of the first end application 12, a fourth thought 9 may be assigned to a fourth input command 18 of the first end application 12, and a fourth thought 9 may be assigned to a fourth input command 18 of the second end application 12, or any combination thereof. For example, a first thought 9 can be assigned to a first input command 18 of a first end application 12 and a first input command 18 of a second end application 12, a second thought 9 can be assigned to a second input command 18 of the first end application 12 and a second input command 18 of the second end application 12, a third thought 9 can be assigned to a third input command 18 of the first end application 12 and a third input command 18 of the second end application 12, a fourth thought 9 can be assigned to a fourth input command 18 of the first end application 12 and a fourth input command 18 of the second end application 12, or any combination thereof. The first, second, third, and fourth thoughts 9 can be assigned to any application 12 (e.g., to the first and second end applications). Some thoughts may be assigned to only a single application 12, while other thoughts may be assigned to multiple applications 12.Even if a thought 9 is assigned to only one application 12, the thought 9 may be assignable to multiple applications 12 so that the patient 8 can take advantage of the universal applicability of the thought 9 (e.g., assigned to only one end application 12) as needed or desired. Alternatively, all thoughts 9 may be assigned to multiple end applications 12.

[0082] The function of each input command 18 or combination of input commands for the end application 12 can be defined by the patient 8. Alternatively, the function of each input command 18 or combination of input commands for the end application 12 can be defined by the end application 12 so that a third party can plug and assign (also called mappable) the end application's input commands 18 to a patient's set or subset of repeatable thoughts 9. This advantageously allows the third party's program to be more accessible and tailored to the different desires, needs, and capabilities of different patients 8. Module 10 is advantageously an application programming interface (API) that a third party can interface with to assign and reassign the patient's 8 thoughts 9 to various input commands 18, where each input command 18 can be activated by the patient 8 thinking the thought 9 assigned to the input command 18 they wish to activate, as described herein.

[0083] A patient's thoughts 9 can be assigned to input commands 18 of the end application 12 via a person (e.g., the patient or another person), a computer, or both. For example, a patient's 8 thoughts 9 (e.g., detectable neural-related signals and / or extractable features associated with the thoughts 9) can be assigned input commands 18 by the patient 8, assigned by a computer algorithm (e.g., based on signal strength of detectable neural-related signals associated with the thoughts 9), changeable (e.g., reassigned) by the patient 8, changeable by an algorithm (e.g., based on relative signal strength of a switch or the availability of new recurring thoughts 9), or any combination thereof. The input commands 18 and / or functions associated with the input commands 18 may, but need not, be independent of the thoughts 9 associated with activating the input commands 18. 1A-1C illustrate an exemplary embodiment of a non-specific or universal mode-switching program (e.g., an application programming interface (API)) that a third party can plug in and assign and reassign thoughts 9 (e.g., detectable neural-related signals and / or extractable features associated with thoughts 9) to various input commands 18. By assigning the input command 18 to which a thought 9 is assigned, or vice versa, a patient 8 can use the same thought 9 for various input commands 18 in the same or different end applications 12. Similarly, by reassigning the input command 18 to which a thought 9 is assigned, or vice versa, a patient 8 can use the same thought 9 for various input commands 18 in the same or different end applications 12.For example, a thought 9 assigned to an input command 18 that causes a prosthetic hand (e.g., a first end application) to open can be assigned to another input command 18 that causes a cursor (e.g., a second end application) to do something on a computer (e.g., any function associated with a computer mouse or touchpad, such as cursor movement, e.g., left-click and right-click, and selection using the cursor).

[0084] 1A-1C further illustrate that a patient's 8 thoughts 9 can be assigned to multiple end applications 12, thereby enabling the patient 8 to switch between multiple end applications 12 without reassigning input commands 18 each time a different end application 12 is used. For example, a thought 9 can be assigned to multiple end applications 12 simultaneously (e.g., the process of assigning a thought 9 to both a first end application and a second end application can, but need not, occur simultaneously). The patient's thoughts 9 can thereby advantageously control any end application 12, including, for example, an external gaming device or various home appliances and devices (e.g., light switches, appliances, locks, thermostats, security systems, garage doors, windows, shades, etc., any smart device or system). The neural interface 14 can thereby sense non-task-related neural-related signals 17 (e.g., brain signals) for functions associated with input commands 18 of the end application 12, where the end application 12 can be any electronic device or software, including devices internal and / or external to the patient's body. As another example, the neural interface 14 may thereby detect task-related neural-related signals 17 (e.g., brain signals) for functions associated with input commands 18 of the end application 12, where the end application 12 may be any electronic device or software, including devices internal and / or external to the patient's body. As yet another example, the neural interface 14 may thereby detect neural-related signals 17 (e.g., brain signals) associated with task-related thoughts, task-unrelated thoughts, or both task-related and task-unrelated thoughts.

[0085] Some of the thoughts 9 may be non-task-related thoughts (e.g., the patient 8 tries to move his / her hand to move the cursor to the right), some of the thoughts 9 may be task-related thoughts (e.g., the patient 8 tries to move the cursor when the target task is to move the cursor), some of the thoughts 9 may be both task-related and task-related thoughts, or any combination thereof. When a thought 9 is both a task-related thought and a task-related thought, the thought 9 can be used as both a task-related thought (e.g., the patient 8 tries to move his / her hand to move the cursor to the right) and a task-related thought (e.g., the patient tries to move the cursor when the target task is to move the cursor), thereby allowing the thought 9 to be associated with multiple input commands 18, one or more of which may be task-related to the thought 9 and one or more of which may be task-unrelated to the thought 9. Alternatively, all of the thoughts 9 may be task-related thoughts. Task-non-relevant thoughts 9 and / or thoughts 9 used by the patient 8 as task-non-relevant thoughts (e.g., thoughts 9 assigned to input commands 18 not related to thoughts 9) are utilized by the patient 8 (e.g., a BCI user) to independently control various end applications 12, including software and devices, utilizing predetermined task-non-relevant thoughts (e.g., thoughts 9).

[0086] 1A-1C illustrate, for example, that patient 8 can think thought 9 (e.g., whether or not they are asked to think thought 9) and then rest. This task of thinking thought 9 can generate detectable neural-related signals corresponding to the thought 9 the patient was thinking. The task of thinking thought 9 and then resting can be performed only once, for example, while patient 8 is thinking thought 9 to control end application 12. Alternatively, the task of thinking thought 9 can be repeated multiple times, for example, while patient 8 is controlling end application 12 by thinking thought 9 or while the patient is training how to control end application 12 using thought 9. When recording neural-related signals (e.g., brain-related signals), such as neural signals, features can be extracted (e.g., spectral power / time-frequency domain) and identified from the signal itself (e.g., time-domain signal). These features contain characteristic information about thought 9 and can be used to identify thought 9, distinguish multiple thoughts 9 from one another, or both. Alternatively, these features can be used to formulate or train a mathematical model or algorithm, using methods such as machine learning, that can predict the type of thought that generated the neural signal. This algorithm and / or model can be used to predict in real time what the patient 8 is thinking and associate this prediction with any desired input command 18. The process of the patient 8 thinking the same thought 9 can be repeated, for example, until the prediction provided by the algorithm and / or model matches the patient 8's thought 9. In this way, the patient 8 can calibrate each of his or her thoughts 9 used to control the end application 12 so that each thought 9 assigned to an input command 18 generates a repeatable neural-related signal that can be detected by the neural interface 14.The algorithm can provide feedback 19 to the patient 8 on whether the prediction matches the actual thoughts 9 the patient 8 is supposed to think. The feedback can be visual, auditory, and / or tactile, which can induce learning by the patient 8 through trial and error. Feedback 19 can also be via neural stimulation. Machine learning methods and mathematical algorithms can be used to classify thoughts 9 based on features extracted and / or identified from the detected neural-related signals 17. For example, a training data set can be recorded in which the patient 8 rests and thinks multiple times, and the processor can extract relevant features from the detected neural-related signals 17 and, based on this data, optimize the parameters and hyperparameters of the mathematical model or algorithm used to distinguish between rest and thinking to predict real-time signals. The same mathematical model or algorithm tuned to predict real-time signals can then allow module 10 to effectively convert thoughts 9 into a real-time universal switch.

[0087] FIG. 1A further illustrates that the neural interface 14 can monitor a biological medium (e.g., the brain), e.g., monitor electrical signals from a monitored tissue (e.g., neural tissue). FIG. 1A further illustrates that the neural-related signal 17 can be a brain-related signal. The brain-related signal can be, for example, an electrical signal from any one or more portions of the patient's brain (e.g., motor cortex, sensory cortex). As another example, the brain-related signal can be any signal (e.g., electrical, biochemical) detectable at the skull, any one or more features extracted (e.g., via a computer processor) from the detected brain-related signal, or both. As a further example, the brain-related signal can be an electrical signal, any signal (e.g., a biochemical signal) caused by an electrical signal, any one or more features extracted (e.g., via a computer processor) from the detected brain-related signal, or any combination thereof.

[0088] FIG. 1A further illustrates that the end application 12 is separate from the module 10 but can communicate with the module 10 via wired or wireless communication. Alternatively, the module 10 (e.g., the host device 16) can be permanently or removably attached to the end application 12. For example, the host device 16 can be removably docked with the application 12 (e.g., a device having software with which the module 10 can communicate). The host device 16 can have a port that can engage with the application 12, or vice versa. The port can be a charging port, a data port, or both. For example, if the host device is a smartphone, the port can be a Lightning port. As a further example, the host device 16 can be tethered to the application 12, e.g., via a cable. The cable can be a power cable, a data cable, or both.

[0089] 1B further illustrates that when patient 8 thinks thought 9, neural-related signals 17 can be brain-related signals corresponding to thought 9. FIG. 1B illustratively illustrates that host device 16 can have a processor (e.g., a microprocessor) that analyzes (e.g., detects, decodes, classifies, or any combination thereof) neural-related signals 17 received from neural interface 14, associates neural-related signals 17 received from neural interface 14 with their corresponding input commands 18, associates features extracted from or identified in neural-related signals 17 themselves (e.g., spectral power / time-frequency domain) received from neural interface 14 with their corresponding input commands 18, stores neural-related signals 17 received from neural interface 14, stores signal analysis (e.g., features extracted from or identified in neural-related signals 17), stores associations between neural-related signals 17 and input commands 18, stores associations between features extracted from or identified in neural-related signals 17 and input commands 18, or any combination thereof.

[0090] FIG. 1B further illustrates that the host device 16 can have memory. Data stored by the processor can be stored locally in memory, on a server (e.g., on the cloud), or both. The thoughts 9 and the resulting data (e.g., the detected neural-related signals 17, the extracted features, or both) can serve as a reference library. For example, once the thoughts 9 are calibrated, the neural-related signals 17 and / or their signature (also referred to as extracted) features associated with the calibrated thoughts can be stored. The thoughts 9 can be considered calibrated, for example, if the neural-related signals 17 and / or their extracted features have a reproducible signature or characteristic that is identifiable by the processor when the neural-related signals 17 are detected by the neural interface 14. This stored calibration data can then be compared in real time with the neural-related signals being monitored and detected in real time. Whenever the detected signals 17 and / or one of their extracted features matches a calibrated signal, a corresponding input command 18 associated with the calibrated signal can be sent to the corresponding end application 12. 1A and 1B illustrate that a patient 8 can be trained to use the module 10 by calibrating neural-related signals 17 associated with their thoughts 9 and storing those calibrations in a reference library. The training can provide feedback 19 to the patient 8.

[0091] FIG. 1C further illustrates an exemplary user interface 20 of the host device 16. The user interface 20 may be a computer screen (e.g., touchscreen, non-touchscreen). FIG. 1C illustrates an exemplary display of the user interface 20, including selectable systems 13, selectable input commands 18, and selectable end applications 12. A system 13 may be a grouping of one or more end applications 12. A system 13 may be added to or removed from the host device 16. An end application 12 may be added to or removed from the host device 16. An end application 12 may be added to or removed from the system 13. Each system 13 may have a corresponding set of input commands 18 that may be assigned to the corresponding set of end applications 12. As another example, the user interface 20 may display input commands 18 for each activated end application 12 (e.g., remote). As yet another example, the user interface 20 can display input commands 18 for activated end applications (e.g., remote) and / or deactivated end applications 12 (e.g., stimulation sleeve, phone, smart home device, wheelchair). This advantageously allows the module 10 to control any end application 12. The user interface 20 allows thoughts 9 to be easily assigned to various input commands 18 for multiple end applications 12. System grouping of end applications (e.g., System 1 and System 2) advantageously allows the patient 8 to organize end applications 12 together using the user interface 20. Pre-made systems 13 can be uploaded to the module and / or the patient 8 can create their own systems 13.For example, a first system may include all end applications 12 associated with mobility (e.g., wheelchair, wheelchair lift) used by patient 8. As another example, a second system may include all end applications 12 associated with prosthetic limbs used by patient 8. As yet another example, a third system may include all end applications 12 associated with smart appliances used by patient 8. As yet another example, a fourth system may include all end applications 12 associated with software or devices used by patient 8 professionally. End applications 12 may be located on one or more systems 13. For example, an end application 12 (e.g., wheelchair) may be located on both System 1 and / or System 2. This organizational efficiency allows patient 8 to easily manage end applications 12. A module 10 can have one or more systems 13, for example, from 1 to 1000 or more systems 13, including increments of 1 system within this range (e.g., 1 system, 2 systems, 10 systems, 100 systems, 500 systems, 1000 systems, 1005 systems, 2000 systems). For example, FIG. 1C illustrates that a module 10 can have a first system 13a (e.g., System 1) and a second system 13b (e.g., System 2). Also, while FIG. 1C illustrates that end applications 12 are grouped into various systems 13, each having one or more end applications 12, the user interface 20 may alternatively not group end applications into systems 13.

[0092] FIG. 1C further illustrates that the host device 16 can be used to assign thoughts 9 to input commands 18. For example, a thought 9, a neural-related signal 17 associated with the thought 9, an extracted feature of the neural-related signal 17 associated with the thought 9, or any combination thereof can be assigned to the input command 18 of the system 13 by selecting the input command 18 (e.g., a left arrow) and selecting from a drop-down menu indicating the thought 9 and / or associated data (e.g., a neural-related signal 17 associated with the thought 9, an extracted feature of the neural-related signal 17 associated with the thought 9, or both) that can be assigned to the selected input command 18. FIG. 1C further illustrates that feedback (e.g., visual, auditory, tactile, and / or neurostimulation feedback) can be provided to the patient 8 when the input command 18 is triggered by the thought 9 or the associated data. FIG. 1C further illustrates that one or more end applications 12 can be activated and deactivated in the system 13. An activated end application 12 may be powered on, powered off, or in a standby state. An activated end application 12 can receive triggered input commands 18. A deactivated end application 12 can be powered on, powered off, or in a standby state. In one example, a deactivated end application 12 may not be controllable by the patient's 8 thoughts 9 unless the end application 12 is activated. Activating the end application 12 using the user interface 20 can power on the end application 12. Deactivating the end application 12 using the user interface 20 can power off or otherwise decouple the module 10 from the deactivated end application 12 so that the processor does not associate the neural-related signals 17 with the thoughts 9 assigned to the deactivated end application 12.For example, FIG. 1C illustrates an exemplary system 1 having five end applications 12, including five devices (e.g., a remote, a stimulation sleeve, a phone, a smart home device, and a wheelchair), one of which (e.g., the remote) is activated and the others are deactivated. Once "Start" is selected (e.g., via icon 20a), the patient 8 can control the end application 12 of the activated system (e.g., system 1) using input commands 18 associated with the end application 12 of the activated system (e.g., the remote). FIG. 1C further illustrates that any changes made using the user interface 20 can be saved using save icon 20b, and any changes made using the user interface 20 can be canceled using cancel icon 20c. FIG. 1C further illustrates that the end application 12 can be an electronic device.

[0093] 1A-1C illustrate that the same set of specific thoughts 9 can be used to control multiple end applications 12 (e.g., multiple end devices), thereby making module 10 a universal switch module. Module 10 advantageously enables patient 8 (e.g., BCI user) to utilize thoughts (e.g., thoughts 9) unrelated to a given task to independently control various end applications 12, including, for example, multiple software and devices. Module 10 can acquire neural-related signals (e.g., via neural interface 14), decode the acquired neural-related signals (e.g., via a processor), associate the acquired neural-related signals 17 and / or features extracted from these signals (e.g., via a processor) with corresponding input commands 18 for one or more end applications 12, and control multiple end applications 12 (e.g., via module 10). Using module 10, thoughts 9 can be advantageously used to control multiple end applications 12. For example, module 10 can be used to control multiple end applications 12, each of which can control a single end application 12 at a time. Alternatively, the module 10 can be used to simultaneously control multiple end applications. Each thought 9 can be assigned to an input command 18 for multiple applications 12. In this manner, the thoughts 9 can function as universal digital switches, where the module 10 effectively reorganizes the patient's motor cortex to represent a digital switch, where each thought 9 can be a digital switch. These digital switches can be universal switches that the patient 8 can use to control multiple end applications 12, since each switch can be assigned (e.g., via the module 10) to any input command 18 for multiple end applications 12 (e.g., an input command for a first end application and an input command for a second end application).The module 10, via the processor, is able to distinguish between different thoughts 9 (eg between different switches).

[0094] Module 10 can interface with, for example, 1 to 1000 or more end applications 12, including increments of end applications 12 within this range (e.g., 1 end application, 2 end applications, 10 end applications, 100 end applications, 500 end applications, 1000 end applications, 1005 end applications, 2000 end applications). For example, FIG. 1C illustrates that first system 13a can include first end application 12a (e.g., a remote), second end application 12b (e.g., a stimulation sleeve), third end application 12c (e.g., a phone), fourth end application 12d (e.g., a smart home device), and fifth end application 12e (e.g., a wheelchair).

[0095] Each end application may have, for example, 1 to 1000 or more input commands 18 that can be associated with the patient's 8 thoughts 9, or alternatively, 1 to 500 or more input commands 18 that can be associated with the patient's 8 thoughts 9, or as yet another alternative, 1 to 100 or more input commands 18 that can be associated with the patient's 8 thoughts 9, including every single input command 18 within these ranges (e.g., 1 input command, 2 input commands, 10 input commands, 100 input commands, 500 input commands, 1000 input commands, 1005 input commands, 2000 input commands), and any sub-range within these ranges (e.g., 1 to 25 or less input commands 18, 1 to 100 or less input commands 18, 25 to 1000 or less input commands 18), such that any number of input commands 18 may be triggered by the patient's thoughts 9, which may be, for example, the number of input commands 18 to which the patient's 8 thoughts 9 are assigned. For example, FIG. 1C illustrates an exemplary set of input commands 18 associated with activated end application(s) 12 (e.g., first end application 12a), including a first end application first input command 18a (e.g., left arrow), a first end application second input command 18b (e.g., right arrow), and a first end application third input command 18c (e.g., enter). As another example, FIG. 1C illustrates an exemplary set of input commands 18 associated with deactivated end application(s) 12 (e.g., second end application 12b), including a second end application first input command 18d (e.g., select output), where the second end application first input command 18d has not yet been selected but could be any input command 18 of the second end application 12b. It should be noted that the first end application first input command 18a is also referred to as the first end application first input command 18a of the first end application 12a.The second input command 18b of the first end application is also referred to as the second input command 18b of the first end application 12a. The third input command 18c of the first end application is also referred to as the third input command 18c of the first end application 12a. The first input command 18d of the second end application is also referred to as the first input command 18d of the second end application 12b.

[0096] When the patient 8 thinks a thought 9, the module 10 (e.g., via a processor) can associate the neural-related signal 17 associated with the thought 9 and / or features extracted therefrom with an input command 18 to which the thought 9 is assigned, and the input command 18 associated with the thought 9 can be transmitted by the module 10 (e.g., via a processor, controller, or transceiver) to its corresponding end application 12. For example, if the thought 9 is assigned to a first input command 18a in a first end application 18a, the first input command 18a in the first end application 12a can be transmitted to the first end application 12a when the patient 8 thinks the thought 9, and if the thought 9 is assigned to a first input command 18d in a second end application 12b, the first input command 18d in the second end application 12b can be transmitted to the second end application 12b when the patient 8 thinks the thought 9. A single thought (e.g., thought 9) can interface with or be used to control multiple end applications 12 (first end application 12a and second end application 12b). Any number of thoughts 9 can be used as switches. The number of thoughts 9 used as switches can correspond, for example, to the number of controls (e.g., input commands 18) needed or desired to control the end applications 12. A thought 9 can be assigned to multiple end applications 12. For example, a neural-related signal 17 associated with a first thought and / or features extracted therefrom can be assigned to a first input command 18a of a first end application and a first input command 18d of a second end application. As another example, a neural-related signal 17 associated with a second thought and / or features extracted therefrom can be assigned to a second input command 18a of a first end application and a first input command of a third end application. The first thought and the second thought may be different.Multiple end applications 12 (e.g., first end application 12a and second end application 12b) can be operated independently of each other. When module 10 is used to control one end application (e.g., first end application 12a), a first thought can be assigned to multiple input commands 18. For example, a first thought alone can activate a first input command, and a first thought together with a second thought can activate a second input command different from the first input command. This allows a thought 9 to function as a universal switch even when only one end application 12 is being controlled by module 10, because one thought can be combined with other thoughts to form additional switches. As another example, a thought can be combined with other thoughts to form additional universal switches that can be assigned to any input command 18 for multiple end applications 12 that can be controlled by module 10 via thoughts 9.

[0097] 2A-2D illustrate that the neural interface 14 can be a stent 101. The stent 101 can have struts 108 and sensors 131 (e.g., electrodes). The stent 101 is collapsible and expandable.

[0098] 2A-2D further illustrate that the stent 101 can be implanted in a vessel traversing a subject's vascular system, e.g., a sinus or vein. As a more specific example, the stent 101 can be implanted in the subject's superior sagittal sinus. FIG. 2A illustrates an exemplary module 10, and FIGS. 2B-2D illustrate three enlarged views of the module 10 in FIG. 2A. The stent 101 can be implanted, for example, via the jugular vein into the superior sagittal sinus (SSS), located above the primary motor cortex, to passively record brain signals and / or stimulate tissue. Because the stent 101 can detect neural signals 17 associated with thought 9 via sensors 131, for example, a person paralyzed due to neural injury or disease may be able to communicate, improve mobility, and achieve independence through direct brain control of assistive technology, such as end application 12. 2C illustrates that a communication conduit 24 (e.g., a stent lead) can extend from the stent 101, pass through the wall of the carotid artery, and tunnel under the skin to the subclavian pocket. In this manner, the communication conduit 24 can facilitate communication between the stent 101 and the telemetry unit 22.

[0099] 2A-2D further illustrate that the end application 12 can be a wheelchair.

[0100] FIG. 3 illustrates that the neural interface 14 (e.g., stent 101) can be a wireless sensor system 30 capable of wireless communication with the host device 16 (e.g., without using the telemetry unit 22). FIG. 3 illustrates a stent 101 in a blood vessel 14 overlying the motor cortex of a patient 8, picking up neural-related signals and relaying this information to a wireless transmitter 32 located on the stent 101. The neural-related signals recorded by the stent 101 can be wirelessly transmitted through the patient's skull to a wireless transceiver 34 (e.g., located on the head), which can then decode and transmit the acquired neural-related signals to the host device 16. Alternatively, the wireless transceiver 34 can be part of the host device 16.

[0101] FIG. 3 further illustrates that the end application 12 may be a prosthetic hand.

[0102] FIG. 4 illustrates that a neural interface 14 (e.g., stent 101) can be used to record neural-related signals 17 from the brain, for example, from neurons in the superior sagittal sinus (SSS) or branched cortical veins, and includes the steps of (a) implanting the neural interface 14 into a blood vessel 14 of the brain (e.g., superior sagittal sinus, branched cortical vein), (b) recording the neural-related signals, (c) generating data representing the recorded neural-related signals, and (d) transmitting the data to a host device 16 (e.g., with or without a telemetry unit 22).

[0103] The entirety of U.S. Patent No. 10,512,555 is incorporated herein in its entirety for all purposes, including all systems, devices, and methods disclosed therein, and any combination of the elements and acts disclosed therein. For example, neural interface 14 (e.g., stent 101) can be, for example, any of the stents (e.g., stent 101) disclosed in U.S. Patent No. 10,512,555.

[0104] Additionally, the neural interfaces, stents, or scaffolds disclosed herein may be any of the neural interfaces, stents, or scaffolds disclosed in any of the following publications: U.S. Patent Application Publication Nos. 2020 / 0363869; 2020 / 0078195; 2020 / 0016396; 2019 / 0336748; 2014 / 0288667; U.S. Patent Application Publication Nos. Nos. 10,575,783; U.S. Patent Nos. 10,485,968; 10,729,530; International Patent Application No. PCT / US2020 / 059509, filed November 6, 2020; U.S. Patent Application No. 62 / 927,574, filed October 29, 2019; U.S. Patent Application No. 62 / 932,906, filed November 8, 2019 No. 62 / 932,935, filed November 8, 2019; U.S. Patent Application No. 62 / 935,901, filed November 15, 2019; U.S. Patent Application No. 62 / 941,317, filed November 27, 2019; U.S. Patent Application No. 62 / 950,629, filed December 19, 2019; U.S. Patent Application No. 63 / 003,480, filed April 1, 2020; U.S. Patent Application No. 63 / 057,379, filed July 28, 2020; and U.S. Patent Application No. 63 / 062,633, filed August 7, 2020, the contents of which are incorporated herein by reference in their entireties.

[0105] Using module 10, patient 8 can be prepared to interface with multiple end applications 12. Using module 10, patient 8 can perform multiple tasks using a single electronic command that is a function of a thought (e.g., thought 9) that is not related to a specific task. For example, using module 10, patient 8 can perform multiple tasks using a single non-task related thought (e.g., thought 9).

[0106] For example, FIG. 5 illustrates a method 50 according to one embodiment for preparing an individual to interface with an electronic device or software (e.g., end application 12) having operations 52, 54, 56, and 58. FIG. 5 illustrates that method 50 may include measuring the individual's neural-related signals to obtain a first detected neural signal when the individual generates a first non-task-related thought at operation 52. Method 50 may include transmitting the first detected neural signal to a processing unit at operation 54. Method 50 may include associating the first non-task-related thought and the first detected neural signal with a first input command at operation 56. Method 50 may include compiling the first non-task-related thought, the first detected neural signal, and the first input command into an electronic database at operation 58.

[0107] As another example, FIG. 6 illustrates a method 60 according to one embodiment for controlling a first device and a second device (e.g., first end application 12a and second end application 12b) having operations 62, 64, 66, and 68. FIG. 6 illustrates that method 60 can include measuring neural-related signals of an individual to obtain detected neural signals when the individual generates non-task-related thoughts at operation 62. Method 60 can include transmitting the detected neural signals to a processor at operation 64. The method can include associating the detected neural signals with input commands for the first device and input commands for the second device via the processor at operation 66. The method can include electrically transmitting the input command for the first device to the first device or electrically transmitting the input command for the second device to the second device at operation 68 upon associating the detected neural signals with the input commands for the first device and the input commands for the second device.

[0108] As another example, FIG. 7 illustrates a method 70 according to one embodiment for preparing an individual to interface with a first device and a second device (e.g., first end application 12a and second end application 12b) having operations 72, 74, 76, 78, and 80. FIG. 7 illustrates that method 70 may include, at operation 72, measuring brain-related signals of the individual when the individual generates task-specific thoughts by thinking about a first task to obtain detected brain-related signals. The method may include, at operation 74, transmitting the detected brain-related signals to a processing unit. The method may include, via the processing unit, associating the detected brain-related signals with a first device input command associated with the first device task at operation 76. The first device task may be different from the first task. The method may include, via the processing unit, associating the detected brain-related signals with a second device input command associated with a second device task at operation 78. The second device task may be different from the first device task and the first task. Upon associating the detected brain-related signal with the first device input command and the second device input command, the method may include, in operation 80, electrically transmitting the first device input command to the first device to perform the first device task associated with the first device input command, or electrically transmitting the second device input command to the second device to perform the second device task associated with the second device input command.

[0109] As another example, FIGS. 5-7 illustrate variations of how a universal switch (e.g., a thought 9) can be used to control multiple end applications 12.

[0110] As another example, the acts illustrated in Figures 5-7 may be performed and repeated in any order and in any combination. Figures 5-7 do not limit the disclosure to the methods shown or the particular order of acts described. For example, the acts listed in methods 50, 60, and 70 may be performed in any order, and one or more acts may be omitted or added.

[0111] As another example, a method of using module 10 according to one embodiment may include measuring brain-related signals of an individual when the individual generates a non-task-related thought (e.g., thought 9) to obtain a first detected brain-related signal. The method may include transmitting the first detected brain-related signal to a processing unit. The method may include the processing unit applying a mathematical algorithm or model to detect a corresponding brain-related signal when the individual generates thought 9. The method may include associating the non-task-related thought and the first detected brain-related signal with one or more N input commands 18. The method may include compiling the non-task-related thought (e.g., thought 9), the first detected brain-related signal, and the N input commands 18 into an electronic database. The method may include monitoring the individual for the first detected brain-related signal (e.g., using a neural interface) and, upon detecting the first detected brain-related signal, electronically transmitting at least one of the N input commands 18 to a control system. The control system may be a control system of the end application 12. The N input commands 18 may be, for example, 1 to 100 input commands 18, including every increment of input commands 18 within this range. The N input commands may be assigned to Y end applications 12, where the Y end applications may be, for example, 1 to 100 end applications 12, including every increment of end applications 12 within this range. As another example, the Y end applications 12 may be, for example, 2 to 100 end applications 12, including every increment of end applications 12 within this range. The Y end applications 12 may include, for example, at least one of mouse cursor control, wheelchair control, and speller control.The N input commands 18 can be at least one of a binary input associated with a task-unrelated thought, a gradient input associated with a task-unrelated thought, and a continuous trajectory input associated with a task-unrelated thought. The method can include associating M detections of a first detected brain-related signal with the N input commands 18, where M is 1 to 10 or less detections. For example, if M is 1 detection, the task-unrelated thought (e.g., thought 9) and the first detected brain-related signal can be associated with a first input command (e.g., first input command 18a). As another example, if M is 2 detections, the task-unrelated thought (e.g., thought 9) and the first detected brain-related signal can be associated with a second input command (e.g., first input command 18b). As yet another example, if M is 3 detections, the task-unrelated thought (e.g., thought 9) and the first detected brain-related signal can be associated with a third input command (e.g., third input command 18c). The first, second, and third input commands can be associated with one or more end applications 12. For example, the first input command can be an input command for a first end application, the second input command can be an input command for a second end application, and the third input command can be an input command for a third application, thereby allowing one thought 9 to control multiple end applications 12. Each of the M sense numbers of the thought 9 can be assigned to multiple end applications, thereby allowing the M sense numbers (e.g., 1, 2, or 3 sense numbers) to function as a universal switch that can be assigned to any input command 18. The first, second, and third input commands can each be associated with a different function. The first, second, and third input commands can be associated with the same function, such that the first input command is associated with a first parameter of the function, the second input command is associated with a second parameter of the function, and the third input command is associated with a third parameter of the function.The first, second, and third parameters of the function can, for example, vary in incremental levels of speed, volume, or both. The incremental levels of speed can, for example, be associated with the movement of a wheelchair, the movement of a mouse cursor on a screen, or both. The incremental levels of volume can, for example, be associated with the volume of an automobile sound system, a computer, a telephone, or any combination thereof. At least one of the N input commands 18 can be a click-and-hold command associated with a computer mouse. The method can include associating a combination of non-task-related thoughts (e.g., thoughts 9) with the N input commands 18. The method can include associating a combination of Z non-task-related thoughts with the N input commands 18, where the Z non-task-related thoughts can range from 2 to 10 or more non-task-related thoughts, or more broadly, from 1 to 1000 or more non-task-related thoughts, and each unit increment within these ranges. At least one of the Z task-unrelated thoughts can be a task-unrelated thought, and the task-unrelated thought can be a first task-unrelated thought, whereby the method includes measuring the individual's brain-related signals to obtain a second detected brain-related signal when the individual generates a second task-unrelated thought; transmitting the second detected brain-related signal to a processing unit; and associating the second task-unrelated thought and the second detected brain-related signal with N2 input commands, whereby when a combination of the first and second detected brain-related signals is obtained sequentially or simultaneously, the combination can be associated with N3 input commands. The task-unrelated thought can be a thought to move a limb of the body. The first detected brain-related signal can be at least one of electrical activity of brain tissue and functional activity of brain tissue. Any operations in this exemplary method can be performed in any combination and in any order.

[0112] As another example, a method of using module 10 according to one embodiment may include measuring brain-related signals of an individual when the individual generates a first task-specific thought by thinking about a first task (e.g., by thinking thought 9) to obtain a first detected brain-related signal. The method may include transmitting the first detected brain-related signal to a processing unit. The method may include the processing unit applying a mathematical algorithm or model to detect a corresponding brain-related signal when the individual generates a thought. The method may include associating the first detected brain-related signal with a first task-specific input command associated with a second task (e.g., input command 18), the second task being different from the first task (e.g., thought 9 includes a task different from the task that input command 18 is configured to perform). The first task-specific thought may not be associated with the associating step. The method may include assigning the second task to the first task-specific command instruction without association with the first task. The method may include assigning a third task to a first task-specific command instruction, unrelated to the first task and the second task. The method may include compiling the first task-specific thought, the first detected brain-related signal, and the first task-specific input command into an electronic database. The method may include monitoring the individual for the first detected brain-related signal and, upon detecting the first detected brain-related signal, electronically transmitting the first task-specific input command to a control system. The first task-specific thought may be, for example, for a physical task, a non-physical task, or both. The generated thought may be, for example, a single thought or a complex thought. A complex thought may be two or more non-concurrent thoughts, two or more simultaneous thoughts, and / or a sequence of two or more simultaneous thoughts. Any operations in this exemplary method may be performed in any combination and in any order.

[0113] As another example, a method of using module 10 according to one embodiment may include measuring brain-related signals of an individual when the individual has a first thought to obtain a first detected brain-related signal. The method may include transmitting the first detected brain-related signal to a processing unit. The method may include the processing unit applying a mathematical algorithm or model to detect a corresponding brain-related signal when the individual generates a thought. The method may include generating a first command signal based on the first detected brain-related signal. The method may include assigning a first task to the first command signal independent of the first thought. The method may include decoupling the first thought from the first detected electrical brain activity. The method may include reassigning a second task to the first command signal independent of the first thought and the first task. The method may include compiling the first thought, the first detected brain-related signal, and the first command signal into an electronic database. The method can include monitoring the individual for a first detected brain-related signal and, upon detecting the first detected brain-related signal, electronically transmitting a first input command to a control system. The first thought can include, for example, a thought of a real or imagined muscle contraction, a real or imagined memory, or both, or an abstract thought. The first thought can be, for example, a single thought or multiple thoughts. Any of the operations in this exemplary method can be performed in any combination and in any order.

[0114] As another example, a method of using module 10 according to one embodiment can include measuring electrical activity of an individual's brain tissue to obtain first detected electrical brain activity when the individual has a first thought. The method can include transmitting the first detected electrical brain activity to a processing unit. The method can include the processing unit applying a mathematical algorithm or model to detect brain-related signals corresponding to when the individual generates a thought. The method can include generating a first command signal based on the first detected electrical brain activity. The method can include assigning a first task and a second task to the first command signal. The first task can be associated with a first device, and the second task can be associated with a second device. The first task can be associated with a first application on the first device, and the second task can be associated with a second application on the first device. The method can include assigning the first task to the first command signal regardless of the first thought. The method can include assigning a second task to the first command signal regardless of the first thought. The method can include compiling the first thought, the first sensed electrical brain activity, and the first command signal into an electronic database. The method can include monitoring the individual for the first sensed electrical brain activity and electronically transmitting the first command signal to a control system upon detecting the first sensed electrical brain activity. Any of the operations in this exemplary method can be performed in any combination and in any order.

[0115] As another example, a method of using the module 10 according to one embodiment can include measuring neural-related signals from an individual to obtain a first detected neural signal when the individual generates a non-task-related thought. The method can include transmitting the first detected neural signal to a processing unit. The method can include the processing unit applying a mathematical algorithm or model to detect a corresponding brain-related signal when the individual generates a non-task-related thought. The method can include associating the non-task-related thought and the first detected neural signal with a first input command. The method can include compiling the non-task-related thought, the first detected neural signal, and the first input command in an electronic database. The method can include monitoring the individual for the first detected neural signal and, upon detecting the first detected neural signal, electronically transmitting the first input command to a control system. The neural-related signal can be a brain-related signal. The neural-related signal can be measured from neural tissue in the individual's brain. Any of the operations in this exemplary method can be performed in any combination and in any order.

[0116] As another example, a method of using module 10 according to one embodiment can include measuring an individual's neural-related signals to obtain a first detected neural-related signal when the individual generates a first task-specific thought by thinking about a first task. The method can include transmitting the first detected neural-related signal to a processing unit. The method can include the processing unit applying a mathematical algorithm or model to detect corresponding brain-related signals when the individual generates a thought. The method can also include associating the first detected neural-related signal with a first task-specific input command associated with a second task, the second task being different from the first task, thereby providing a user with a mechanism for controlling multiple tasks with different task-specific inputs with a single user-generated thought. The method can also include compiling the task-non-related thoughts, the first detected neural signal, the first input command, and the corresponding task into an electronic database. The method may include utilizing a memory of an electronic database to automatically group non-task-related thoughts, detected brain-related signals, and one or more combinations of N inputs based on the task, the brain-related signals, or the thoughts, and automatically map control functions for automatic system configuration for use. The neural-related signals may be neural-related signals of brain tissue. Any of the operations in this exemplary method may be performed in any combination and in any order.

[0117] Module 10 may perform any combination of any of the methods and may perform any operation of any of the methods disclosed herein.

[0118] 8 illustrates a method 100 according to one embodiment for controlling a device (e.g., a personal electronic device, an IoT device, a mobile object, etc.), a software application (e.g., an end application 12), or a combination thereof, using detected changes in a subject's neural-related signals. In some embodiments, the neural-related signals may be the subject's electroencephalogram or other type of synchronized electrical brain activity.

[0119] The neural-related signals may include one or more neural oscillations of the subject, including a beta frequency range or band (approximately 12 Hz to 30 Hz), an alpha frequency range or band (approximately 7 Hz to 12 Hz), a gamma frequency range or band (approximately 30 Hz to 140 Hz, more specifically, 60 Hz to 80 Hz), a delta frequency range or band (approximately 0.1 Hz to 3 Hz), a theta frequency range or band (approximately 4 Hz to 7 Hz), or a combination thereof. The neural-related signals may also include neural oscillations in a mu band (approximately 7.5 Hz to 12.5 Hz), a sensorimotor rhythm (SMR) band (approximately 12.5 Hz to 15.5 Hz), or a combination thereof.

[0120] As described in the preceding sections, the subject's neural-related signals may be monitored or measured using module 10 or its components. For example, the neural interface 14, the telemetry unit 22, the host device 16, or a combination thereof may be used to monitor or measure the neural-related signals.

[0121] In some embodiments, the neural interface 14 can be an intravascular device (e.g., an expandable and collapsible stent) implanted within the subject's body. In certain embodiments, neural-related signals can be monitored or measured using electrodes of the neural interface 14 implanted within the subject's body. For example, neural-related signals can be monitored or measured using electrodes of an implantable intravascular device (e.g., electrodes coupled to a stent).

[0122] As previously described, the intravascular device can be placed within the brain of the subject. For example, the intravascular device can be placed within at least one of the frontal cortex, motor cortex, and sensory cortex of the subject. The intravascular device can also be placed in other regions of the brain of the subject.

[0123] The method 100 may include, in operation 102, detecting a decrease in the strength of a neural-related signal of the subject from a baseline level. For example, detecting a decrease in the strength of the neural-related signal may include detecting a decrease in the power (e.g., microvolts squared (μV) per Hz) of at least one neural oscillation (e.g., neural oscillation at a beta band frequency) of the subject. 2 / Hz), decibels (dBs), mean t-score, mean z-score, etc.

[0124] In some embodiments, the baseline level can be defined as the average intensity or mean intensity over a predetermined time period (e.g., the last few seconds or minutes). In these and other embodiments, the baseline level can vary or be continuously adjusted and set. In other embodiments, the baseline level can be a predefined or predetermined level. For example, the baseline level can be determined based on a time period, an activity or behavior performed by the subject, or a combination thereof.

[0125] A reduction in the intensity of a neural-related signal can refer to a statistically significant (e.g., greater than two standard deviations (SD)) reduction in the intensity of the neural-related signal relative to a baseline level. This statistically significant reduction in the intensity of the neural-related signal can also be referred to as desynchronization or desynchronization of the neural-related signal.

[0126] For example, if the neural-related signal being monitored or measured is a beta band oscillation, the method 100 can include detecting a statistically significant decrease or reduction in the power of the beta band oscillation relative to a baseline beta band power level. More specifically, this statistically significant decrease in the power of the beta band oscillation can be referred to as beta desynchronization.

[0127] The method 100 may further include detecting a subsequent increase in the intensity of the nerve-related signal above a baseline level after the reduction in actuation 104. For example, the method 100 may include detecting a statistically significant (e.g., more than 2 SD) increase in the intensity of the nerve-related signal above the baseline level. In some embodiments, this statistically significant increase in the intensity of the nerve-related signal may be referred to as a rebound of the nerve-related signal.

[0128] For example, if the neural-related signal being monitored or measured is a beta band oscillation, the method 100 can include detecting a statistically significant increase or rise in the power of the beta band oscillation relative to a baseline beta band power level. More specifically, this statistically significant increase in the power of the beta band oscillation can be referred to as a beta rebound.

[0129] In certain embodiments, electrodes coupled to the neural interface 14 can be used to continuously monitor power in a selected number of neural frequency bands (e.g., beta band, gamma band, etc.) across selected channels, and the power measurements can be filtered at predetermined intervals (e.g., every 100 milliseconds or 100 ms) and fed to a machine learning classifier. The machine learning classifier can then compare the power to baseline levels in that particular neural frequency band and classify the power into a discrete state or event, such as: (1) a desynchronization ("desync") event; (2) a rebound event; or (3) a quiescent or non-event.

[0130] The change in intensity can be detected using the neural interface 14 (e.g., via electrodes of an intravascular device implanted in the brain) and one or more processors in the telemetry unit 22, the host device 16, or a combination thereof.

[0131] The method 100 may further include transmitting an input command 18 to the device or software upon or following detection of an increase in the strength of the nerve-related signal in operation 106. In some embodiments, the input command 18 may be transmitted upon or following detection of an increase in the strength of the nerve-related signal, but before completion of the recoil of the signal.

[0132] The input commands 18 can be transmitted using one or more processors in the telemetry unit 22, the host device 16, or a combination thereof. As previously described, the input commands 18 can be transmitted to one or more end applications (e.g., application software) running on a peripheral or personal computing device, such as a laptop, desktop computer, smartphone, or tablet computer. When the input commands 18 are transmitted to a software program, the input commands 18 can be transmitted via one or more software application programming interfaces (APIs). In these and other embodiments, the input commands 18 can be transmitted to an IoT device, a mobile object (e.g., a power wheelchair), or other type of peripheral or personal computing device to control such device or vehicle. Furthermore, the input commands 18 can also be transmitted to one or more end applications (e.g., software) running on such a peripheral or personal computing device or vehicle.

[0133] In some embodiments, the reduction in the intensity of the neural-related signal may be caused by the subject recalling or generating a task-related thought and holding the task-related thought for a period of time. In these embodiments, the subsequent increase in the intensity of the neural-related signal (e.g., a rebound in the signal) may be caused by the subject mentally releasing the task-related thought. Also in these embodiments, the input command 18 may be a command sent to a device or software to accomplish at least a portion of a task associated with the task-related thought.

[0134] For example, a method for controlling a power wheelchair may include a step in which a subject generates and holds a thought to move the power wheelchair forward. Module 10 may detect a decrease in the strength of the subject's neural-related signals (e.g., desynchronization of beta oscillations) when the subject holds the thought to move the power wheelchair forward. Module 10 may then detect an increase in the strength of the subject's neural-related signals (e.g., rebound of beta oscillations) when the subject releases the thought to move the power wheelchair forward. Module 10 may then transmit an input command 18 to the power wheelchair to move the power wheelchair forward upon detecting the increase in the strength of the subject's neural-related signals. As will be appreciated by those skilled in the art, this method may be extended to cover any number of task-related thoughts and to cover the control of other devices, vehicles, or software not specifically mentioned in the previous example.

[0135] In other embodiments, the reduction in the intensity of the neural-related signal may be caused by the subject recalling or generating a non-task-related thought and holding the non-task-related thought for a period of time. In these embodiments, the subsequent increase in the intensity of the neural-related signal may be caused by the subject mentally releasing the non-task-related thought. Also, in these embodiments, the input command 18 may be a command sent to a device or software to accomplish at least a portion of a task that is not associated with a non-task-related thought.

[0136] For example, another method of controlling a power wheelchair may include a subject generating and holding a thought related to the subject's bodily function, such as contracting a muscle. The thought related to the subject's bodily function may be considered a non-task-related thought because it is not related to the task of controlling the power wheelchair. Module 10 may detect a decrease in the strength of the subject's neural-related signals (e.g., desynchronization of beta oscillations) when the subject holds the thought of contracting the muscle. Module 10 may then detect an increase in the strength of the subject's neural-related signals (e.g., a rebound of beta oscillations) when the subject releases the thought of contracting the muscle. Module 10 may then transmit an input command 18 to the power wheelchair to move the power wheelchair forward. As one skilled in the art would understand, this method may be extended to cover any number of non-task-related thoughts, as well as to cover the control of other devices, vehicles, or software not specifically mentioned in the previous example.

[0137] Method 100 may further include an additional operation 108 of providing visual feedback, auditory feedback, tactile feedback, feedback in the form of neurostimulation, or a combination thereof, to the subject after transmitting input command 18 to the device or software. The feedback may inform the subject that input command 18 was successfully transmitted or that input command 18 is being executed. In other embodiments, the feedback may inform the subject that signal desynchronization or signal rebound has been detected.

[0138] In some embodiments, visual feedback may consist of written text displayed via the display of the host device 16. In other embodiments, visual feedback may consist of one or more lights illuminating on the telemetry unit 22, the host device 16, or a combination thereof. Auditory feedback may consist of one or more sounds or audible alerts generated by the telemetry unit 22 or the host device 16. In other embodiments, auditory feedback may consist of computer-generated or pre-recorded audio messages played by the telemetry unit 22 or the host device 16. Tactile feedback may consist of one or more sensors or electronic components configured to provide physically perceptible feedback to the subject in the form of vibration, movement, or other forces applied to the subject's body or appendages. In some embodiments, tactile feedback may be applied to the subject through the telemetry unit 22, an additional wearable unit, a seat, structure, or platform supporting the subject, or a combination thereof. Feedback in the form of neural stimulation may be achieved by transmitting electrical impulses through electrodes implanted within the subject's body. For example, the neurostimulation feedback may include sending electrical impulses to the subject's brain via electrodes of the neural interface 14 implanted within the subject's brain. In other embodiments, the neurostimulation feedback may include non-invasive stimulation, such as stimulating the subject with transcranial direct current stimulation (tDCS), transcranial magnetic stimulation (TMS), transcranial alternating current stimulation (tACS), transcranial pulsed current stimulation (tPCS), transcranial random noise stimulation (tRNS), or combinations thereof.

[0139] Figure 9 is a spectrogram illustrating how a subject's beta band or beta frequency neural oscillations desynchronize (or decrease) followed by a rebound (or increase) of beta band neural oscillations. More specifically, the spectrogram shows a decrease in the power of beta band oscillations below the baseline power level, followed by an increase in power above the baseline power level. In this spectrogram, power is expressed as mean t-scores. Power can also be expressed in decibels (dB), z-scores, or μV. 2 It can also be expressed in / Hz.

[0140] Desynchronization of neural signals can occur when a subject recalls or generates a thought (e.g., a task-related thought, a task-irrelevant thought) and holds that thought for a period of time. Rebound of neural signals can occur when a subject mentally releases the thought.

[0141] 9 also illustrates that input commands 18 can be sent following or upon detection of signal rebound. The input commands 18 are sent before the signal rebound is complete. As described in more detail in the following section, the duration of the desynchronization can play a role in determining which input command(s) 18 are sent to the device or software program.

[0142] 10 illustrates another method 200 for controlling a device (e.g., a personal electronic device, an IoT device, a mobile object, etc.) or a software program (e.g., an end application 12) using detected changes in a subject's neural-related signal. The method 200 may include, at operation 202, detecting a decrease in the intensity of the subject's neural-related signal below a baseline level. For example, detecting a decrease in the intensity of the neural-related signal may include detecting a decrease in the power of at least one neural oscillation in the subject.

[0143] The baseline level can be defined as the average intensity or mean intensity over a period of time. The baseline level can vary or can be continuously adjusted and set. In other embodiments, the baseline level can be a predefined or predetermined level. A reduction in the intensity of a neural-related signal can refer to a statistically significant reduction in the intensity of the neural-related signal relative to the baseline level. In some embodiments, this statistically significant decrease in the power of beta-band oscillations can be referred to as desynchronization or desynchronization of the neural-related signal.

[0144] The method 200 may further include detecting an increase in the intensity of the nerve-related signal above a baseline level after the reduction in actuation 204. For example, the method 100 may include detecting a statistically significant increase in the intensity of the nerve-related signal above the baseline level. In some embodiments, the increase in the intensity of the nerve-related signal may be referred to as a rebound of the nerve-related signal.

[0145] As in the previous section, the neural-related signals may be electroencephalograms or other types of synchronized electrical brain activity of the subject. The neural-related signals may include one or more neural oscillations of the subject, including neural oscillations in the beta frequency range or band, the alpha frequency range or band, the gamma frequency range or band, the delta frequency range or band, the theta frequency range or band, or a combination thereof. The neural-related signals may also include neural oscillations in the Mu band, the SMR band, or a combination thereof.

[0146] The subject's neural-related signals can be monitored or measured using module 10 or its components. For example, the neural-related signals can be monitored or measured using neural interface 14, telemetry unit 22, host device 16, or a combination thereof.

[0147] The neural interface 14 may be an intravascular device (e.g., an expandable stent) that is placed in the subject's brain. In certain embodiments, neural-related signals may be monitored or measured using electrodes of the neural interface 14 implanted in the subject's brain. For example, neural-related signals may be monitored or measured using electrodes of a stent implanted in the subject's brain.

[0148] The method 200 may further include determining a duration of the reduction in intensity of the neural-related signal in operation 206. For example, if the neural-related signal is a beta band oscillation, operation 206 may include determining a duration of desynchronization of the beta band oscillation.

[0149] As described in more detail in the following sections, in some embodiments, electrodes coupled to the neural interface 14 can be used to continuously monitor power in a selected number of neural frequency bands (e.g., beta band, gamma band, etc.) across selected channels, filtering the power measurements at predetermined intervals (e.g., every 100 milliseconds) and providing them to a machine learning classifier. The machine learning classifier can then compare the power to baseline levels in that particular neural frequency band to classify the power into a discrete state or event, such as: (1) a desynchronization (“desync”) event; (2) a rebound event; or (3) a quiescent or non-event. In these embodiments, determining the duration of signal desynchronization can include counting the number of consecutive desynchronization events preceding a rebound event.

[0150] In other embodiments, determining the duration of the reduction in strength of the neural-related signal may include sending a first signal to telemetry unit 22, host device 16, or other device functioning as part of module 10 when a reduction in strength of the neural-related signal is first detected, and sending a second signal to telemetry unit 22, host device 16, or other device functioning as part of module 10 when the reduction in strength of the neural-related signal stops or a signal rebound is detected. Telemetry unit 22, host device 16, or other device functioning as part of module 10 can then determine the duration by calculating the elapsed time between the two signals.

[0151] The method 200 may further include, at operation 208, selecting an input command 18 from the plurality of conditional input commands based on the duration. Selecting the input command 18 from the plurality of conditional input commands may further include comparing the duration to one or more temporal thresholds associated with the conditional input commands, and selecting the input command 18 based on whether the duration exceeds or does not meet the one or more temporal thresholds.

[0152] For example, two conditional input commands can have associated time thresholds such as: Command 1: 300 ms ≤ duration < 1000 ms (i.e., between 3 and 9 consecutive desync events). Command 2: 1000 ms ≤ duration (i.e., 10 or more consecutive desync events)

[0153] The temporal threshold can range from 100 milliseconds to 30,000 milliseconds (or 30 seconds). While ranges are provided, they are contemplated by the present disclosure, and one of ordinary skill in the art would understand that any subrange of the disclosed range is also permissible. For example, the range of 100 milliseconds to 30,000 milliseconds can include 100 milliseconds to 500 milliseconds, 100 milliseconds to 1,000 milliseconds, 100 milliseconds to 10,000 milliseconds, 1,000 milliseconds to 10,000 milliseconds, or any other subrange within the range. In alternative embodiments, the temporal threshold can be in a range greater than 30,000 milliseconds, such as 100 milliseconds to 50,000 milliseconds, 60,000 milliseconds, or 100,000 milliseconds.

[0154] Furthermore, the plurality of conditional input commands can consist of two conditional input commands to ten or more conditional input commands. Each conditional input command can be associated with one or more temporal thresholds. For example, if there are two conditional input commands, the two conditional input commands can be associated with the same temporal threshold. In this example, an input command can be selected based on whether the duration meets / exceeds the temporal threshold or does not meet the temporal threshold.

[0155] As another example, three conditional input commands can be associated with the following temporal thresholds: Command 1 (e.g., Open Software Application #1): 100 ms ≤ duration < 1000 ms Command 2 (e.g., Open Software Application #2): 1000 ms ≤ duration < 2000 ms Command 3 (e.g., Open Software Application #3): Duration ≤ 2000 ms

[0156] In some embodiments, a reduction in the intensity of the neural-related signal can be caused by the subject recalling and holding a thought (e.g., a task-related thought or a task-unrelated thought). Additionally, an increase in the intensity of the neural-related signal can also be caused by the same subject mentally releasing the thought. The duration of the reduction in the intensity of the neural-related signal can be linked to the amount of time the thought (e.g., a task-related thought or a task-unrelated thought) is held before the subject subsequently mentally releases the thought.

[0157] As previously mentioned, the thoughts may be task-related or non-task-related thoughts. The subject may recall and hold the task-related thoughts in order to send input commands 18 to the device to accomplish at least a portion of the task associated with the task-related thoughts. In some embodiments, the length of time the subject holds the task-related thoughts may determine which input command is selected from a plurality of conditional input commands, all of which may be intended to accomplish at least a portion of the task associated with the task-related thoughts.

[0158] The subject may also recall and hold a non-task-related thought in order to send an input command to the device to accomplish at least a portion of the task not associated with the non-task-related thought. In some embodiments, the length of time the subject holds a task-related thought may determine which input command is selected from a plurality of conditional input commands, all of which may be aimed at accomplishing at least a portion of the task associated with the task-related thought.

[0159] Method 200 may further include an additional or optional operation 210 of providing the subject with visual feedback, auditory feedback, tactile feedback, feedback in the form of neurostimulation, or a combination thereof, regarding the selected input command 18. The feedback may inform the subject of the selected input command 18 and may also provide the subject with the option to modify the input command 18 by selecting a different input command 18 or to cancel the selected input command 18.

[0160] Method 200 may further include transmitting the selected input command 18 to a device or software at operation 212. The input command 18 may be transmitted upon or after the subject confirms the selected input command 18, or the input command 18 may be transmitted without such confirmation.

[0161] The input commands 18 can be transmitted using one or more processors in the telemetry unit 22, the host device 16, or a combination thereof. As previously described, the input commands 18 can be transmitted to one or more end applications (e.g., application software) running on a peripheral or personal computing device, such as a laptop, desktop computer, smartphone, or tablet computer. When the input commands 18 are transmitted to a software program, the input commands 18 can be transmitted via one or more software application programming interfaces (APIs). In these and other embodiments, the input commands 18 can be transmitted to an IoT device, a mobile object (e.g., a power wheelchair), or other type of peripheral or personal computing device to control such device or vehicle. Furthermore, the input commands 18 can also be transmitted to one or more end applications (e.g., software) running on such a peripheral or personal computing device or vehicle.

[0162] Method 200, or variations thereof, may be used to control a subject's power wheelchair when the subject generates and holds a thought to move the power wheelchair forward for approximately two seconds. Module 10 may detect a decrease in the intensity of the subject's neural-related signals that lasts for approximately two seconds. Module 10 may then detect a subsequent increase in the intensity of the subject's neural-related signals (e.g., a rebound in beta oscillations) when the subject subsequently releases the thought to move the power wheelchair forward. Module 10 may then select an input command 18 from a plurality of conditional input commands based on the approximately two-second duration. In this case, input command 18 may be a command to the power wheelchair to move the power wheelchair forward two meters. Other conditional input commands may include a command to move the power wheelchair forward one meter (with a de-sync duration of one second or less) or three meters (with a de-sync duration of three seconds or more). Module 10 may then transmit input command 18 to the power wheelchair, causing the power wheelchair to move forward two meters. As will be appreciated by those skilled in the art, this method can be extended to cover the thinking associated with any number of tasks, and to cover the control of other devices, vehicles, or software not specifically mentioned in the previous examples.

[0163] Method 200, or variations thereof, can also be used by a subject to control the subject's power wheelchair when the subject generates and holds for approximately two seconds a thought related to the subject's bodily function (e.g., contracting the subject's muscles). Thoughts related to the subject's bodily function are not related to the task of controlling the subject's power wheelchair and can therefore be considered non-task-related thoughts. Module 10 can detect a decrease in the strength of the subject's neural-related signals that lasts for approximately two seconds. Module 10 can then select an input command 18 from a plurality of conditional input commands based on the approximately two-second duration. In this case, input command 18 can be a command to the power wheelchair to move the power wheelchair forward two meters. Other conditional input commands can be commands to move the power wheelchair forward one meter (with a de-sink time of one second or less, e.g., caused by the subject generating and holding a thought to contract a muscle for one second or less) or three meters (with a de-sink time of three seconds or more, e.g., caused by the subject generating and holding a thought to contract a muscle for three seconds or more). The module 10 can then send an input command 18 to the power chair to move it forward by 2 meters.

[0164] As will be appreciated by those skilled in the art, this method can be extended to cover any number of non-task related thoughts, as well as to cover the control of other devices, vehicles, or software not specifically mentioned in the previous examples.

[0165] 11 illustrates a system or another embodiment of module 10 that includes neural interface 14 and at least one device 300 or apparatus that executes various software layers configured to process and classify neural-related signals and select input commands 18 based on the processed and classified data. In some embodiments, device 300 can be either telemetry unit 22, host device 16, or a combination thereof. In these and other embodiments, device 300 (e.g., telemetry unit 22) can be implanted within the subject's body, such as in the chest region or in the arm of the subject.

[0166] In other embodiments, device 300 may refer to a processing unit or controller embedded within neural interface 14 or coupled to neural interface 14 implanted within a subject's brain. One or more processors of device 300 may be programmed to execute software instructions that make up various software layers.

[0167] 11, the software layers can be comprised of a pre-processing layer 302, a classification layer 304, and a temporal click logic layer 306. The pre-processing layer 302, the classification layer 304, and the temporal click logic layer 306 can be part of a multi-tier software architecture.

[0168] The preprocessing layer 302 may be comprised of multiple software filters configured to filter and smooth the raw signals obtained from the neural interface 14. The subject's neural-related signals may be continuously monitored across selected channels using electrodes of the neural interface 14 (e.g., a stent implanted in the subject's brain). The neural-related signals may be sampled every 100 milliseconds, or 100-millisecond "chunks" or bins of the raw signals may be passed to the preprocessing layer 302 for processing and smoothing. As previously mentioned, the monitored neural-related signals may be one or more neural frequency bands of the subject (e.g., beta-band oscillations, gamma-band oscillations, etc.), and the intensity of the neural-related signals may be the power of such neural frequency bands.

[0169] For example, data corresponding to 100 millisecond bins of raw neural-related signals obtained from three separate channels of the neural interface 14 can first be passed to a preprocessing layer 302. The preprocessing layer 302 can then apply (1) a threshold filter for threshold-based truncation and ratification rejection, (2) a notch filter for 50 Hz notch filtering, (3) a bandpass filter for 4-30 Hz Butterworth bandpass filtering, (4) a wavelet artifact removal filter for wavelet-based artifact removal, (5) a multitaper spectral decomposition filter for multitaper spectral decomposition, and (6) a boxcar smoothing filter for temporal boxcar smoothing. The filtered data is then provided to a classification layer 304.

[0170] The classification layer 304 is comprised of a machine learning classifier configured to classify the resulting data segments or bins into a desynchronization event or state (also referred to as a "key down" classified event), a rebound event or state (also referred to as a "key up" classified event), or a rest event or state. The machine learning classifier may be a pre-trained classifier.

[0171] In some embodiments, the machine learning classifier may utilize a supervised learning model, such as a support vector machine (SVM). As a more specific example, the machine learning classifier may be a pre-trained SVM. In other embodiments, the machine learning classifier may be a Gaussian mixture model classifier, a naive Bayes classifier, or other machine learning classifier.

[0172] The classified events or conditions are then provided to the temporal click logic layer 306, which may select an input command 18 based on the number of events / conditions and conditions or thresholds stored as part of the temporal click logic layer 306. For example, the temporal click logic layer 306 may select one input command to open a first software application (e.g., the subject's Gmail® application) when the temporal click logic layer 306 detects between three and nine consecutive desync events followed by a reaction event. Alternatively, the temporal click logic layer 306 may select another input command to open a second software application (e.g., the subject's WhatsApp® application) when the temporal click logic layer 306 detects between ten or more consecutive desync events followed by a reaction event.

[0173] FIG. 12A illustrates an example of a spectrogram 400 in which a subject briefly holds a thought. The thought may be a task-related thought (e.g., pressing a mouse cursor to select a software application) or a task-unrelated thought (e.g., contracting the subject's hamstrings). In this example, the neural-related signal may be the subject's beta-band neural oscillations. As shown in FIG. 12A, when the subject recalls and holds a thought, the power of the subject's beta-band neural oscillations may decrease below the baseline beta-band power level.

[0174] As long as the subject holds a thought, the classification layer 304 (see FIG. 11) will classify the beta band neural oscillations as being in a desynchronization state. More specifically, as long as the subject holds a thought, the classification layer 304 will classify time segments (e.g., 100-millisecond "bins") of the beta band signal as consecutive desynchronization events. If the subject holds a thought for approximately 400 milliseconds, this roughly corresponds to four consecutive desynchronization events, with each desynchronization event being approximately 100 milliseconds long.

[0175] 12A further illustrates that when a subject mentally releases a thought, the power of the subject's beta band neural oscillations can increase above the baseline beta band power level. When this release occurs, the classification layer 304 will classify this time segment of the beta band signal as a rebound event.

[0176] Once the temporal click logic layer 306 detects a rebound event, the number of consecutive desync events preceding the rebound event will be counted and this total will be compared to one or more temporal thresholds associated with the particular conditional input command.

[0177] In this example, four consecutive desync events (corresponding to the subject's thought retention for approximately 400 milliseconds) fall within a short-term range from three consecutive desync events (approximately 300 milliseconds) to nine consecutive desync events (approximately 900 milliseconds). As a result, a first input command associated with this short-term range can be selected. The first input command can be a command to open a first software application, such as the subject's Gmail® application, running on a device in communication with module 10. As shown in FIG. 12A, the input command can be sent to the device immediately after detecting the reaction event.

[0178] FIG. 12B illustrates another example spectrogram 402 in which a subject holds a thought for a longer period of time. As shown in FIG. 12B, the subject can hold this thought (e.g., a task-related or non-task-related thought) for approximately 1000 milliseconds or 1 second. Similar to FIG. 12A, when a subject recalls and holds a thought, the power of the subject's beta-band neural oscillations can decrease below the baseline beta-band power level. As can be seen in FIG. 12B, holding a thought for approximately 1000 milliseconds roughly corresponds to 10 consecutive desynchronization events, with each desynchronization event set to approximately 100 milliseconds.

[0179] When a subject mentally disengages a thought, the power of the subject's beta band neural oscillations can increase above the baseline beta band power level, and when this disengagement occurs, the classification layer 304 will classify this time segment of the beta band signal as a rebound event.

[0180] In this example, 10 consecutive desync events (corresponding to the subject's thought retention for approximately 1000 milliseconds) fall within a prolonged period of 10 or more consecutive desync events (x≧1000 milliseconds). As a result, a second input command associated with this prolonged period can be selected. The second input command can be a command to open a second software application, such as the subject's WhatsApp® application, running on a device in communication with module 10. As shown in FIG. 12B, the input command can be sent to the device immediately after detecting the recoil event.

[0181] While the preceding examples have described successive desynchronization events, it is contemplated by the present disclosure that for neural frequency bands other than beta band frequencies, successive events other than desynchronization events (e.g., increases in the strength of neural-related signals) can also be used to select an input command.

[0182] 13 illustrates another method 500 of using detected changes in a subject's neural-related signal to control a device (e.g., a personal electronic device, an IoT device, a mobile object, etc.), a software application (e.g., an end application 12), or a combination thereof. The method 500 may include, at operation 502, detecting a first change in the subject's neural-related signal. The method 500 may further include, at operation 504, detecting a second change in the subject's neural-related signal subsequent to the first change.

[0183] In one embodiment, the first change in the neural-related signal may be a decrease in the intensity of the neural-related signal below a baseline signal level, and the second change in the neural-related signal may be an increase in the intensity of the neural-related signal above the baseline signal level. For example, the first change in the neural-related signal may be a decrease in the power of the subject's neural oscillations, and the second change in the neural-related signal may be an increase in the power of the neural oscillations.

[0184] In this embodiment, a first change in the neural-related signal may occur when the subject generates and holds a thought, such as a task-related thought or a task-unrelated thought, and a second change in the neural-related signal may occur when the subject mentally releases the thought.

[0185] In an alternative embodiment, the first change in the neural-related signal may be an increase in the intensity of the neural-related signal above a baseline signal level, and the second change in the neural-related signal may be a decrease or a decrease in the intensity of the neural-related signal below the baseline signal level. For example, the first change in the neural-related signal may be an increase in the power of the subject's neural oscillations, and the second change in the neural-related signal may be a decrease or a decrease in the power of the neural oscillations. More specifically, the first change in the neural-related signal may be an increase in the power of gamma-band oscillations above a baseline gamma-band power level, and the second change in the neural-related signal may be a decrease in the power of gamma-band oscillations below the baseline gamma-band power level. In this embodiment, the first change in the neural-related signal (i.e., an increase in the power of gamma-band oscillations) may occur when the subject generates and holds a thought, such as a task-related thought or a task-unrelated thought. The second change in the neural-related signal (a decrease in the power of gamma-band oscillations) may occur when the subject mentally releases the thought.

[0186] In further embodiments, the first change in the neural-related signal can be an increase in the intensity of the subject's neural-related signal caused by the subject mentally releasing a first thought (e.g., a task-related or non-task-related thought). In this embodiment, the second change in the neural-related signal can be a decrease in the intensity of the neural-related signal below the baseline signal level caused by the subject generating and holding a second or subsequent thought (e.g., another task-related or non-task-related thought). The first thought, the second thought, or a combination thereof can be a thought related to the subject's bodily function, such as controlling a muscle group. The input command 18 can be transmitted when the subject generates the second thought or thereafter.

[0187] The change in intensity can be detected using the neural interface 14 (e.g., via electrodes of an intravascular device implanted in the brain) and one or more processors in the telemetry unit 22, the host device 16, or a combination thereof.

[0188] Method 500 may further include determining a duration of the first change in the neural-related signal at operation 506. For example, if the neural-related signal is a neural oscillation of the subject, operation 506 may include determining a duration of a change in power of the neural oscillation.

[0189] In some embodiments, the duration of the first change can be determined by calculating the elapsed time between the onset of the first change and the onset of the second change in the neural-related signal, e.g., the duration can be increased if the subject holds a thought (e.g., a task-related thought or a task-unrelated thought) for a longer period of time.

[0190] In other embodiments, the duration of the first change can be determined by feeding samples or time segments of the subject's neural-related signal into a machine learning classifier (e.g., machine learning classifier 308 of FIG. 11 ), which can classify the signal sample or signal bin as being in one of several predefined states (e.g., a desynchronized state, a rebound state, or a quiescent state).

[0191] The method 500 may further include selecting an input command 18 from the plurality of conditional input commands based on the duration in operation 508. Selecting the input command 18 from the plurality of conditional input commands may further include comparing the duration to one or more temporal thresholds associated with the conditional input commands, and selecting the input command 18 based on whether the duration exceeds or does not meet the one or more temporal thresholds.

[0192] Method 500 may further include an optional operation 510 of providing visual feedback, auditory feedback, tactile feedback, feedback in the form of neurostimulation, or a combination thereof, to the subject regarding the selected input command 18. For example, providing visual feedback, auditory feedback, tactile feedback, neurostimulation feedback, or a combination thereof may provide the subject with an opportunity to confirm the selected input command 18. In other embodiments, feedback may be provided after sending the input command 18 to the device or software to inform the subject that the input command 18 has been sent or is in the process of being sent or executed.

[0193] Method 500 may further include transmitting the actuated input command 18 to a device or software at operation 512. In some embodiments, the input command 18 may be transmitted immediately after detecting a second change in the subject's neural-related signal.

[0194] The input commands 18 can be transmitted using one or more processors in the telemetry unit 22, the host device 16, or a combination thereof. As previously described, the input commands 18 can be transmitted to one or more end applications (e.g., application software) running on a peripheral or personal computing device, such as a laptop, desktop computer, smartphone, or tablet computer. When the input commands 18 are transmitted to a software program, the input commands 18 can be transmitted via one or more software application programming interfaces (APIs). In these and other embodiments, the input commands 18 can be transmitted to an IoT device, a mobile object (e.g., a power wheelchair), or other type of peripheral or personal computing device to control such device or vehicle. Furthermore, the input commands 18 can also be transmitted to one or more end applications (e.g., software) running on such a peripheral or personal computing device or vehicle.

[0195] One technical problem faced by the applicant is how to enable patients with motor impairments (including those with severe motor limitations, such as locked-in patients) to control devices or software applications when they may only be able to control their thoughts and / or specific muscle groups. One solution discovered by the applicant involves detecting a first change (e.g., a decrease) in the strength of a subject's neural-related signal (e.g., neural oscillations or electroencephalograms) below a baseline level, detecting a second change (e.g., an increase) in the strength of the neural-related signal above the baseline level, and sending an input command to a device upon or after the detection of the second change in the neural-related signal. These changes can be detected using a neural interface implanted in the subject's brain. This allows the subject to control the device or software application by generating thoughts (e.g., task-related or task-unrelated thoughts) and mentally disengaging those thoughts.

[0196] Another technical challenge faced by the applicant is which of multiple neural-related signals of a subject to monitor when a reliable and reproducible signal is needed to affect such control. One solution discovered by the applicant is to use the subject's neural oscillations, including neural oscillations in the beta band (approximately 12 Hz to 30 Hz), gamma frequency range or gamma band (approximately 30 Hz to 140 Hz, more specifically 60 Hz to 80 Hz), alpha frequency range or alpha band (approximately 7 Hz to 12 Hz), delta frequency range or delta band (approximately 0.1 Hz to 3 Hz), theta frequency range or theta band (approximately 4 Hz to 7 Hz), or a combination thereof. Furthermore, the neural-related signals may further include neural oscillations in the Mu band (approximately 7.5 Hz to 12.5 Hz), sensorimotor rhythm (SMR) band (approximately 12.5 Hz to 15.5 Hz), or a combination thereof.

[0197] Another technical challenge faced by the applicant is how to enable mobility-impaired patients (including those with severe mobility limitations, such as homebound patients) to quickly and accurately control multiple devices and software applications. One solution discovered by the applicant involves selecting an input command from multiple conditional input commands based on the duration of a change in the subject's neural-related signal (e.g., a decrease in the intensity of the neural-related signal). For example, the duration of the change in the neural-related signal can be calculated by using a machine learning classifier to classify neural-related events (e.g., desynchronization events and rebound events) and comparing the number of such events with a predetermined threshold associated with the conditional input command. This allows the subject to select from different commands by holding a certain thought (e.g., a task-related thought or a task-unrelated thought) for a certain period of time and mentally releasing the thought once the threshold is exceeded.

[0198] FIG. 14 illustrates changes in the power of beta band (e.g., 12 Hz to 30 Hz) and gamma band (e.g., 60 Hz to 80 Hz) frequencies when a subject generates, holds, and then releases thoughts about moving the subject's left and right ankles. As shown in FIG. 14, the power or intensity of beta band neural oscillations can decrease when the subject generates and holds a thought, and then increase when the subject releases the thought. FIG. 14 further illustrates that the power or intensity of the subject's gamma band neural oscillations can increase when the subject generates and holds a thought, and then decrease when the subject releases the thought. For example, these thoughts can be related to thoughts of moving the subject's left and right ankles.

[0199] Although multiple embodiments have been described, those skilled in the art will appreciate that various changes and modifications can be made to the present disclosure without departing from the spirit and scope of the embodiments. The elements of the systems, devices, apparatus, and methods shown in connection with any embodiment are exemplary for a particular embodiment and can be used in combination with other embodiments within the present disclosure, or in other ways. For example, the steps of any method depicted in the drawings or described in this disclosure do not require the particular order or sequential order shown or described to achieve the desired results. In addition, other step operations may be provided, or steps or operations may be deleted or omitted from a described method or process, to achieve the desired results. Furthermore, any component or part of any apparatus or system described in or illustrated in the present disclosure may be removed, deleted, or omitted to achieve the desired results. Additionally, certain components or parts of systems, devices, or apparatuses illustrated or described herein have been omitted for the sake of brevity and clarity.

[0200] Accordingly, other embodiments are within the scope of the following claims, and the specification and / or drawings may be regarded in an illustrative rather than a restrictive sense.

[0201] Each of the individual variations or embodiments described and illustrated herein has individual components and elements that can be readily separated or combined with the elements of any other variation or embodiment. Modifications may be made to adapt a particular situation, material, composition of matter, process, process act(s), or process step(s) to the objective, spirit, or scope of the present invention.

[0202] Methods recited herein may carry out the recited events in any order which is logically possible, and in the order recited. Furthermore, additional steps or acts may be provided or steps or acts may be omitted in order to achieve desired results.

[0203] Furthermore, when a range of values ​​is specified, all intervening values ​​between the upper and lower limits of that range, and any other stated or intervening values ​​within that stated range, are intended to be encompassed within the scope of the invention. Additionally, any element of an aspect of the invention can be defined and claimed independently or in combination with any one or more elements described herein. For example, a description of a range of 1 to 5 should be considered to disclose subranges of 1 to 3, 1 to 4, 2 to 4, 2 to 5, 3 to 5, etc., as well as individual numbers within that range, e.g., 1.5, 2.5, etc., and whole or partial increments therebetween.

[0204] All pre-existing subject matter (e.g., publications, patents, patent applications) referred to herein is incorporated herein in its entirety, except to the extent that such subject matter may conflict with the subject matter of the present invention, in which case the present disclosure shall take precedence. The referenced items are provided solely for their disclosure prior to the filing date of the present application. Nothing herein should be construed as an admission that the present invention is not entitled to antedate such material by virtue of prior invention.

[0205] Reference to a singular item includes the possibility of a plural of the same item. More specifically, as used in this specification and the appended claims, the singular forms "a," "an," "said," and "the" include plural references unless the context clearly dictates otherwise. It should be further noted that the claims may be drafted to exclude any element. Accordingly, this statement is intended to serve as a prerequisite for using exclusive terms such as "solely" and "only" in connection with the recitation of claim elements, or for using "negative" limitations. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0206] The phrase "at least one," when modifying multiple items or components (or an enumerated list of items or components), means any combination of one or more of those items or components. For example, the phrase "at least one of A, B, and C" means (i) A; (ii) B; (iii) C; (iv) A, B, and C; (v) A and B; (vi) B and C; or (vii) A and C.

[0207] In understanding the scope of the present disclosure, the term "comprise" and its derivatives, as used herein, are intended to be open-ended, specifying the presence of stated features, elements, components, groups, integers, and / or steps, but not excluding the presence of other, unstated features, elements, components, groups, integers, and / or steps. The same applies to phrases of similar meaning, such as "comprise," "have," and their derivatives. Furthermore, the terms "part," "section," "portion," "member," "element," and "component," when used in the singular, can refer to both one part or multiple parts. As used herein, the directional terms "front, rear, above, below, vertical, horizontal, downward, transverse, and longitudinal," and any other similar directional terms, refer to the location of a device or apparatus or the direction of a device or apparatus that is translated or moved.

[0208] Finally, terms of degree, such as "substantially," "about," and "approximately," as used herein, refer to a stated value or to a stated value and a reasonable amount of deviation from the stated value (e.g., deviations of up to ±0.1%, ±1%, ±5%, or ±10%, where such variations are appropriate) such that the end result is not appreciably or substantially changed. For example, "about 1.0 cm" can be interpreted to mean "1.0 cm" or "0.9 cm to 1.1 cm." When terms of degree, such as "about" or "approximately," are used in connection with numbers or values ​​that are part of a range, the terms can be used to adjust the minimum and maximum numbers or values.

[0209] The present disclosure is not intended to be limited in scope to the particular forms defined, but is intended to cover alternatives, modifications, and equivalents of the variations or embodiments described herein. Moreover, the scope of the present disclosure fully encompasses other variations or embodiments that may become obvious to those skilled in the art in light of the present disclosure.

Claims

1. measuring or monitoring neural-related signals of the subject using a neural interface; providing the measured neural-related signals to a machine learning classifier; classifying the neural-related signals into one or more events using the machine learning classifier, wherein the one or more events include at least one of a desynchronization event, a rebound event, or a rest event; selecting an input command to be sent to the device based on the event classified by the machine learning classifier; A method for controlling a device, including:

2. 10. The method of claim 1, wherein selecting an input command to send to the device based on the events classified by the machine learning classifier further comprises selecting the input command based on at least one of a sequence of events or a number of events.

3. The method of claim 2 , wherein the sequence of events is one or more desynchronizing events followed by a recoil event.

4. The method of claim 2 , wherein the sequence of events is a reactionary event followed by one or more desynchronizing events.

5. 10. The method of claim 1, wherein the desynchronization event is a decrease in the strength of a neural-related signal below a baseline level.

6. 10. The method of claim 1, wherein the rebound event is an increase in intensity of a neural-related signal above a baseline level following a desynchronization event.

7. The method of claim 1 , further comprising filtering the measured neural-related signals before providing the neural-related signals to the machine learning classifier.

8. The method of claim 1 , wherein the machine learning classifier is a pre-trained classifier.

9. detecting one or more desynchronization events based on neural-related signals of the subject measured using the neural interface; detecting a reactionary event based on the neural-related signals measured by the neural interface; determining a duration of at least one said desynchronization event; selecting an input command to be sent to the device based on the duration of the desynchronization event; transmitting the input command to the device upon or after detecting the reaction event; A method for controlling a device, including:

10. 10. The method of claim 9, wherein the desynchronization event is a decrease in the strength of the neural-related signal below a baseline level.

11. The method of claim 10 , wherein the decrease in the strength of the neural-related signal is a decrease in the power of neural oscillations of the subject.

12. The method of claim 11 , wherein the power of the neural oscillations is a power spectral density.

13. 10. The method of claim 9, wherein the one or more desynchronizing events are caused by the subject recalling and holding task-related or task-unrelated thoughts.

14. 10. The method of claim 9, wherein the reaction event is caused by the subject mentally releasing a task-related or task-unrelated thought.

15. 10. The method of claim 9, wherein the device is at least one of a personal computing device, an Internet of Things (IoT) device, and a mobile vehicle.

16. 10. The method of claim 9, further comprising filtering the neural-related signals using one or more software filters.

17. 17. The method of claim 16, further comprising feeding the filtered neural-related signals to a machine learning classifier to detect the one or more desynchronization events and the rebound events.

18. The method of claim 17 , wherein the machine learning classifier is a pre-trained classifier.

19. detecting an increase in intensity of a nerve-related signal of the subject above a measured baseline level, the nerve-related signal being a nerve oscillation of the subject, and detecting the increase in intensity of the nerve-related signal comprising detecting an increase in power of the nerve oscillation above a baseline oscillation power level; detecting, following the increase, a decrease in the strength of the neural-related signal below the baseline level; sending an input command to the device upon detecting a decrease in the intensity of the neural-related signal following the increase; A method for controlling a device, including:

20. 20. The method of claim 19, wherein detecting a decrease in the strength of the neural-related signal comprises detecting a decrease in power spectral density.

Images