Systems and methods for gene regulation using neural signals
Patent Information
- Application Number
- JP2021567924
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-06-28
- Filing Date
- 2020-05-14
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-05-14
AI Technical Summary
Existing brain-computer interfaces (BCIs) require users to perform task-related or task-irrelevant mental tasks to control preset target tasks, limiting their versatility and flexibility in controlling various end applications.
A method and system that utilizes neural-related signals, allowing users to independently control multiple end applications by associating task-unrelated thoughts with input commands, using a universal switch module that maps neural signals to input commands for various devices and software.
Enables users to control multiple applications using the same thought as a universal switch, enhancing versatility and flexibility in interacting with electronic devices and software without the need for task-specific mental tasks.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0004]
[0001] The present disclosure relates to methods of using neuro-related signals. More particularly, the present disclosure relates to methods of using neural signals as a universal switch.
Background Art
[0002] Today, in brain-computer interfaces (BCIs), users are asked to perform a mental task related to a given target task (e.g., try to move the cursor if the target task is to move the cursor), or to perform a mental task not related to the given target task (e.g., try to move the hand to move the cursor to the right) to perform the given target task. Further, in today's BCIs, researchers can only utilize thoughts (e.g., mental tasks related to the task or mental tasks not related to the task) to control pre-set target tasks. The present disclosure describes novel methods and systems that prepare for and enable BCIs users to utilize thoughts not related to a given task to independently control various end applications including software and devices.
Summary of the Invention
Problems to be Solved by the Invention
[0003] A control system and method using neuro-related signals are disclosed, including a universal switch and its method of use.
Means for Solving the Problems
[0004] Methods for preparing a human being to interface with electronic devices and software are disclosed. For example, a method is disclosed that includes measuring the human's neural-related signals when the human being generates thoughts unrelated to a first task to obtain a first detected neural signal. This method may include transmitting the first detected neural signal to a processing unit. This method may include associating the thoughts unrelated to the first task and the first detected neural signal with a first input command. This method may include compiling the thoughts unrelated to the first task, the first detected neural signal, and the first input command into an electronic database.
[0005] Methods for controlling a first device and a second device are disclosed. For example, a method is disclosed that includes measuring human neural-related signals when a person generates thoughts unrelated to a task to obtain detected neural signals. This method may include transmitting the detected neural signals to a processor. This method may include the processor associating the detected neural signals with a first device input command and a second device input command. When associating the detected neural signals with a first device input command and a second device input command, this method may include electrically transmitting the first device input command to the first device or electrically transmitting the second device input command to the second device.
[0006] Disclosed are methods for preparing a human being to interface with a first device and a second device. For example, a method is disclosed that includes measuring the human's brain-associated signals when the human being generates task-specific thoughts by contemplating a first task, thereby obtaining detected brain-associated signals. This method may include transmitting the detected brain-associated signals to a processing unit. This method may include the processing unit associating the detected brain-associated signals with a first device input command associated with a first device task. The first device task is different from the first task. This method may also include the processing unit associating the detected brain-associated signals with a second device input command associated with a second device task. The second device task is different from the first device task and the first task. This method may include, when associating detected brain-related signals with a first device input command and a second device input command, electrically transmitting the first device input command to a first device to perform a first device task associated with the first device input command, or electrically transmitting the second device input command to a second device to perform a second device task associated with the second device input command. [Brief explanation of the drawing]
[0007] [Figure 1A] Figure 1A illustrates a universal switch module in one embodiment. [Figure 1B] Figure 1B illustrates a universal switch module in one aspect of Figure 1A when the patient is thinking. [Figure 1C] Figure 1C illustrates a user interface in one embodiment of the host device of the universal switch module shown in Figures 1A and 1B. [Figure 2A] Figures 2A to 2D show a universal switch model in one mode of communication with an end application. [Figure 2B] Figures 2A to 2D show a universal switch model in one mode of communication with an end application. [Figure 2C] Figures 2A to 2D show a universal switch model in one mode of communication with an end application. [Figure 2D] Figures 2A to 2D show a universal switch model in one mode of communication with an end application. [Figure 3] Figure 3 shows a wireless universal switch module in one mode of communication with an end application. [Figure 4] Figure 4 illustrates one embodiment of a universal switch module used to record patient nerve-related signals. [Figure 5] Figure 5 illustrates a method used in one embodiment of the universal switch module shown in Figures 1A to 1C. [Figure 6] Figure 6 illustrates a method used in one embodiment of the universal switch module shown in Figures 1A to 1C. [Figure 7] Figure 7 illustrates a method used in one embodiment of the universal switch module shown in Figures 1A to 1C. [Modes for carrying out the invention]
[0008] The drawings shown and described are illustrative embodiments and are not limiting. Similar reference numerals indicate elements that are identical overall or functionally equivalent.
[0009] Universal switch modules, universal switches, and methods for using them are disclosed. For example, Figures 1A to 1C illustrate a universal switch module 10 in one embodiment that can be used for a patient 8 (e.g., a BCI user) to control one or more end applications 12 by thinking 9. Module 10 may comprise a neural interface 14 and a host device 16. Module 10 (e.g., host device 16) can communicate with one or more end applications 12 by at least one of wired and wireless means. The neural interface 14 may be a biomedium signal detector (e.g., an electrical conductor, a biochemical sensor), the host device 16 may be a computer (e.g., a laptop, a smartphone), and the end application 12 may be any electronic device or software. The neural interface 14 may monitor neural-related signals 17 of the biomedium via one or more sensors. The processor of module 10 can analyze the detected neural-related signal 17 to determine whether the detected neural-related signal 17 is associated with a thought 9 assigned to an input command 18 of an end application 12. Once a thought 9 assigned to an input command 18 is detected by the neural interface 14 and associated with the input command 18 by the processor, the input command 18 can be transmitted (e.g., via the processor, control unit, or transceiver) to the end application 12 to which it is associated. A thought 9 can be assigned to the input of a command 18 of multiple end applications 12. This allows module 10 to advantageously enable the patient 8 to independently control multiple end applications 12, e.g., a first end application and a second end application, with a single thought (e.g., thought 9), and thought 9 can be used to control the first and second applications at different times and / or simultaneously.In this way, module 10 can function as a universal switch module that can control multiple end applications 12 (e.g., software and devices) using the same thought 9. Thought 9 can be a universal switch that can be assigned to any input command 18 of any end application 12 (e.g., to an input command 18 of a first end application and to an input command 18 of a second end application). The first end application can be a first device or first software. The second end application can be a second device or second software.
[0010] When patient 8 contemplates thought 9, the input command 18 associated with thought 9 can be transmitted by module 10 (e.g., via a processor, control unit, or transceiver) to the corresponding end application 12. For example, if thought 9 is assigned to an input command 18 of a first end application, when patient 8 contemplates thought 9, the input command 18 of the first end application can be transmitted to the first end application. Similarly, if thought 9 is assigned to an input command 18 of a second end application, when patient 8 contemplates thought 9, the input command 18 of the second end application can be transmitted to the second end application. Thus, thought 9 can interface with or control multiple end applications 12, functioning like a universal button (e.g., thought 9) on a universal controller (e.g., the patient's brain). Any number of thoughts 9 can be used as switches. The number of thoughts 9 used as switches can correspond, for example, to the number of controls (e.g., input commands 18) required or desired to control the end applications 12.
[0011] Taking a video game controller as an example, the patient's thought 9 can be assigned to any individual button on the controller, any combination of buttons, and any directional movement (e.g., on a joystick, a directional pad, or other control pad), thereby allowing the patient 8 to play any game on any video game system using thought 9, with or without the presence of a conventional physical controller. A video game system is just one example of an end application 12. Module 10 allows thought 9 to be assigned to input commands 18 of any end application 12, so that it can be mapped to the control of any software or device. This allows module 10 to organize the patient's thought 9 into a group of assignable switches that are essentially universal, but whose execution is specified once assigned to an input command 18. Additional examples of end applications 12 include mobility devices (e.g., vehicles, wheelchairs, wheelchair lifts), prosthetics (e.g., artificial arms, artificial legs), telephones (e.g., smartphones), smart appliances, smart home systems, etc.
[0012] The neural interface 14 can detect neural-related signals 17, including those associated with thought 9 and those not associated with thought 9. For example, the neural interface 14 may have one or more sensors that can detect (also called acquire, detect, record, measure) neural-related signals 17, including those generated by the patient's biomedium when the patient 8 contemplates thought 9, and those generated by the patient's biomedium not associated with thought 9 (e.g., forming a patient that responds to stimuli not associated with thought 9). The sensors of the neural interface 14 can record signals from the patient's biomedium and / or stimulate the biomedium. The biomedium may be, for example, nerve tissue, vascular tissue, blood, bone, muscle, cerebrospinal fluid, or any combination thereof. The sensors may be, for example, electrodes, which may be any electrical conductor for detecting the electrical activity of the biomedium. The sensors may be, for example, biochemical sensors. The neural interface 14 may have a single type of sensor (e.g., electrodes only) or multiple types of sensors (e.g., one or more electrodes and one or more biochemical sensors).
[0013] The neural-related signal can be any signal detectable from a biomedium (e.g., electrical, biochemical), any one or more elements extracted from the detected neural-related signal (e.g., via a computer processor), or both, where the extracted elements can be, or include, characteristic information about the patient's thoughts 9 so that different thoughts 9 can be distinguished from one another. Alternatively, the neural-related signal can be an electrical signal, any signal caused by an electrical signal (e.g., a biochemical signal), any one or more elements extracted from the detected neural-related signal (e.g., via a computer processor), or any combination thereof. The neural-related signal can be a neural signal such as an electroencephalogram (EEG). If the biomedium is within the patient's skull, the neural-related signal can be, for example, a brain signal (e.g., detected from brain tissue) resulting from or caused by the patient 8 thinking about thoughts 9. Thus, the neural-related signal can be a brain-related signal such as an electrical signal from any one or more parts of the patient's brain (e.g., motor cortex, sensory cortex). If the biomedium is located outside the patient's skull, the neural signals can be electrical signals associated with muscle contractions (e.g., of parts of the body such as eyelids, eyes, nose, ears, fingers, arms, toes, legs) resulting from or triggered by the patient 8 thinking of a thought 9. The thought 9 (e.g., movement of a body part, memory, task) that the patient 8 thinks of when the neural signals are detected from brain tissue may be the same as or different from the thought 9 that the patient 8 thinks of when the neural signals are detected from non-brain tissue. The neural interface 14 can be located inside the patient's brain, outside the patient's brain, or both.
[0014] Module 10 may include one or more neural interfaces 14, for example, including neural interfaces in increments of one within this range (e.g., one neural interface, two neural interfaces, 10 neural interfaces), and each neural interface 14 may have one or more sensors (e.g., electrodes) configured to detect nerve-related signals (e.g., nerve signals). The location of the neural interface 14 may be selected to optimize the recording of nerve-related signals, for example, by selecting the location where the signal is strongest, where interference from noise is minimized, where trauma to patient 8 resulting from implantation or engagement of the neural interface 14 to patient 8 (e.g., by surgery) is minimized, or any combination thereof. For example, the neural interface 14 may be a brain-machine interface such as an intravascular device (e.g., a stent) having one or more electrodes for detecting electrical activity of the brain. If multiple neural interfaces 14 are used, the neural interfaces 14 may be the same or different from one another. For example, when two neural interfaces 14 are used, both neural interfaces 14 can be intravascular devices having electrodes (e.g., expandable stents having electrodes), or one of the two neural interfaces 14 can be an intravascular device having electrodes, and the other of the two neural interfaces 14 can be a device having sensors, which is different from the intravascular device having electrodes.
[0015] Figures 1A and 1B further show that module 10 may include a telemetry unit 22 configured to communicate with a neural interface 14, and a communication conduit 24 (e.g., a wire) to facilitate communication between the neural interface 14 and the telemetry unit 22. The host device 16 may be configured to communicate with the telemetry unit 22 via wired and / or wireless communication. The host device 16 can communicate with the telemetry unit 22 via wired and / or wireless communication.
[0016] Figures 1A and 1B further show that the remote measurement unit 22 can include an internal remote measurement unit 22a and an external remote measurement unit 22b. The internal remote measurement unit 22a can communicate with the external remote measurement unit 22b either wired or wirelessly. For example, the external remote measurement unit 22b can be wirelessly connected to the internal remote measurement unit 22a across the patient's skin. The internal remote measurement unit 22a can communicate with the nerve interface 14 either wirelessly or wired, and the nerve interface 14 can be electrically connected to the internal remote measurement unit 22a via a communication conduit 24. The communication conduit 24 can be, for example, a wire such as a stent lead.
[0017] The module 10 can have a processor (also referred to as a processing unit) that can analyze and decode nerve-related signals detected by the nerve interface 14. The processor can be a computer processor (e.g., a microprocessor). The processor can apply a mathematical algorithm or model to detect corresponding nerve-related signals when the patient 8 generates thoughts 9. For example, once a nerve-related signal 17 is detected by the nerve interface 14, the processor can apply a mathematical algorithm or mathematical model to detect, decode, and / or classify the detected nerve-related signal 17. As another example, once a nerve-related signal 17 is detected by the nerve interface 14, the processor can apply a mathematical algorithm or mathematical model to detect, decode, and / or classify the information of the detected nerve-related signal 17. Once the nerve-related signal 17 detected by the nerve interface 14 is processed by the processor, the processor can associate the processed information (e.g., the detected, decoded, and / or classified nerve-related signal 17, and / or the detected, decoded, and / or classified information of the detected nerve-related signal 17) with the input command 18 of the end application 12.
[0018] The neural interface 14, the host device 16, and / or the telemetry unit 22 may have a processor. Alternatively, the neural interface 14, the host device 16, and / or the telemetry unit 22 may have a processor (e.g., the processor described above). For example, the host device 16 can analyze and decode the neural-related signals 17 detected by the neural interface 14 via the processor. The neural interface 14 can communicate with the host device 16 by wire or wireless, and the host device 16 can communicate with the end application 12 by wire or wireless. Alternatively, the neural interface 14 can communicate with the telemetry unit 22 by wire or wireless, the telemetry unit 22 can communicate with the host device 16 by wire or wireless, and the host device 16 can communicate with the end application 12 by wire or wireless. Data can be passed from the neural interface 14 to the telemetry unit 22, from the telemetry unit 22 to the host device 16, from the host device 16 to one or more end applications 12, or in any combination thereof, for example, to detect a thought 9 and trigger an input command 18. Alternatively, data can be passed in reverse order, for example, from one or more end applications 12 to the host device 16, from the host device 16 to the telemetry unit 22, from the telemetry unit 22 to the neural interface 14, or in any combination thereof, for example, to stimulate a biomedium via one or more sensors. The data can be data collected or processed by a processor, for example, including neural-related signals and / or features extracted therefrom. If the data is flowing, for example, from the processor to the sensors, the data may include a stimulus command, so that when the stimulus command is processed by the neural interface 14, the sensors of the neural interface can stimulate the biomedium.
[0019] Figures 1A and 1B further show that when patient 8 visualizes thought 9, the patient's biologic medium (e.g., biologic medium within the skull, biologic medium outside the skull, or both) can generate neural - related signals 17 detectable by neural interface 14. The sensors of neural interface 14 can detect neural - related signals 17 associated with thought 9 when patient 8 visualizes thought 9. The neural - related signals 17 associated with thought 9, features extracted from these neural - related signals 17, or both are assigned or associated with any input command 18 for any of the end - applications 12 controllable by universal - switch module 10. Thereby, each of the detectable neural - related signals 17 and / or their extracted features can advantageously function as a universal switch assignable to any input command 18 for any end - application 12. In this way, when thought 9 is detected by neural interface 14, the input command 18 associated with that thought 9 is triggered and the triggered input command 18 can be transmitted to the end - application 12 with which it is associated.
[0020] For example, when thought 9 is detected by the neural interface 14 (e.g., by a detected neural-related signal 17), the processor can analyze the detected neural-related signal 17 (e.g., detect, decode, classify, or any combination thereof) and associate the detected neural-related signal 17 and / or features extracted therefrom with the corresponding assigned input command 18. This allows the processor to determine whether thought 9 (e.g., at least one of the detected neural-related signal 17 and features extracted therefrom) is associated with one of the input commands 18. If it is determined that thought 9 is associated with an input command 18, the processor or control unit can activate (also called trigger) the input command 18. Once the input command 18 is triggered by module 10 (e.g., by the processor or control unit of the host device 16), the triggered input command 18 can be sent to its corresponding end application 12 so that the end application 12 (e.g., a smart home appliance such as a wheelchair, prosthetic arm, or coffee machine) can be controlled by the triggered input command 18. Once an end application 12 receives an input command 18 that triggers it, the end application 12 can execute one or more of the commands in the input command 18 (for example, move the wheelchair forward at 1 meter per second, pinch the thumb and index finger of the prosthetic hand together, turn on the smart coffee machine, etc.). In this way, once it is determined that a thought 9 (for example, a detected neural-related signal 17 and / or features extracted therefrom) is associated with an input command 18, the input command 18 can be sent to its corresponding end application 12.
[0021] The features to be extracted may be any component of the detected neuronal signal 17, and may include, for example, the voltage fluctuation pattern of the detected neuronal signal 17, the power fluctuation in a specific frequency band embedded within the detected neuronal signal 17, or both. For example, the neuronal signal 17 may have a range of vibrational frequencies corresponding to when the patient 8 contemplates a thought 9. A specific frequency band may contain specific information. For example, high-band frequencies (e.g., 65 Hz to 150 Hz) may contain information correlated with thoughts related to movement, and therefore features in this high-band frequency range can be used (e.g., extracted or identified from the detected neuronal signal 17) to classify and / or decode neuronal events (e.g., thoughts 9).
[0022] Thought 9 can function as a universal switch. Thought 9 can function as a universal switch (for example, as a thought), and Thought 9 can be assigned to any input command 18, and vice versa. Thought 9 can be assigned to or associated with any input command 18 of any end application 12 controllable by the universal switch module 10 by at least one of the detectable neural-associated signals 17 associated with it and the features that can be extracted therefrom. Patient 8 can activate a desired input command 18 by recalling Thought 9 associated with the input command 18 desired by Patient 8. For example, when Thought 9 (for example, a memory of the patient's 9th birthday party) assigned to a particular input command 18 (for example, move the wheelchair forward) is detected by the neural interface 14, a processor (for example, of the host device 16) can associate the neural-associated signals 17 associated with that Thought 9 (for example, a memory of the 9th birthday party) and at least one of the features extracted therefrom with the corresponding assigned input command 18 (for example, move the wheelchair forward). If a detected neuronal signal (e.g., and / or a feature extracted in association with it) is associated with an assigned input command 18, the host device 16 can transmit the input command 18 via a processor or control unit to the end application 12 to which the input command 18 is associated, thereby enabling the end application 12 to be controlled by the input command 18 triggered by the patient 8 recalling the thought 9.
[0023] If thought 9 is assigned to multiple end applications 12, and only one of the end applications 12 is active (e.g., powered on and / or running), the host device 16 can send the triggered input command 18 to the active end application 12. Alternatively, if thought 9 is assigned to multiple end applications 12, and some of the end applications 12 are active (e.g., powered on or running) and some are inactive (e.g., powered off or in standby mode), the host device 16 can send the triggered input command 18 to both the active and inactive end applications 12. The active end application 12 can execute the input command 18 when it receives it. An inactive end application 12 can execute an input command 18 when the inactive application 12 becomes active (for example, when it is powered on or starts running), or the input command 18 can be queued (for example, by module 16 or end application 12) so that it is executed when the inactive application 12 becomes active.As a further example, if thought 9 is assigned to multiple end applications 12, and two or more of the end applications 12, for example, a first end application and a second end application, are active (e.g., powered on and / or running), the host device 16 can send triggered input commands 18 associated with the first end application to the first end application, and triggered input commands 18 associated with the second end application to the second end application, or the module 10 can give patient 8 a choice of which triggered input commands 18 patient 8 wants to send (e.g., send only the triggered input commands 18 associated with the first end application, send only the triggered input commands 18 associated with the second end application, or send both triggered input commands 18).
[0024] Thought 9 can be any thought or combination of thoughts. For example, the thoughts 9 that patient 8 contemplates may be one thought, multiple thoughts, a sequence of multiple thoughts, multiple thoughts simultaneously, thoughts with different durations, thoughts with different frequencies, one or more thoughts in a sequence, one or more combinations of thoughts, or any combination thereof. Thought 9 may be task-related, non-task-related, or both. Task-related thoughts are related to the task intended by patient 8, and non-task-related thoughts are not related to the task intended by patient 8. For example, if thought 9 is for the first task, patient 8 may contemplate the first task in order to complete the second task (also called the intended task or target task) by using module 10, for example. The first task may be the same as or different from the second task. If the first task is the same as the second task, thought 9 can be a task-related thought. If the first task is different from the second task, thought 9 can be a non-task-related thought. For example, if the first task that patient 8 thinks of is moving a limb (e.g., arm, leg), and the second task is the same as the first task, that is, for example, moving a prosthetic limb (e.g., arm, leg), then thought 9 (e.g., thought of the first task) can be a thought related to the task. The prosthetic limb can be, for example, an end application 12 that patient 8 controls with thought 9. For example, as a thought related to the task, if the target task is to move a cursor, patient 8 can think of moving the cursor. On the other hand, if thought 9 is unrelated to the task and patient 8 thinks of moving their limbs (e.g., arm) as the first task, then the second task can be a task of any end application different from the first task, and thus the second task can be a task of any end application 12 different from the first task of moving the limbs (e.g., arm). For example, a thought unrelated to the task might be that, if the target task is to move the cursor to the right, patient 8 might think of moving a part of their body (e.g., their hand) to the right.This allows patient 8 to recall a first task (e.g., thinking 9) to accomplish any second task, where the second task may be the same as or different from the first task. The second task can be any task of any end application 12. For example, the second task can be any input command 18 of any end application 12. Thinking 9 (e.g., the first task) is assignable to any second task. Thinking 9 (e.g., the first task) is assignable to any second task. This allows patient 8 to recall the first task to trigger any input command 18 (e.g., any second task) of any end application 12. This allows the first task to function advantageously as a universal switch. Each thinking 9 can generate a neuronal signal (e.g., a detectable neuronal signal 17) that is detectable and repeatable by the neural interface 14. Each detectable neuronal signal and / or features extractable therefrom can be a switch. The switch can be activated (also called a trigger) when, for example, patient 8 thinks of thought 9 and a sensor detects that the switch has been activated, and / or when the processor determines that one or more extracted features exist from the detected neural-related signals. This switch can be a universal switch that can be assigned to and reassigned to any input command 18, for example, any set of input commands. The input commands 18 can be added to, deleted from, and / or modified from any set of input commands. For example, each end application 12 may have a set of input commands 18 associated with which the neural-related signal 17 of thought 9 can be assigned.
[0025] Some of thought 9 may be non-task-related thoughts (e.g., patient 8 moving their hand to move the cursor to the right), some of thought 9 may be task-related thoughts (e.g., patient 8 moving the cursor when the target task is to move the cursor), and some of thought 9 may be both non-task-related and task-related thoughts, or any combination thereof. If thought 9 is both non-task-related and task-related, thought 9 can be used as both a non-task-related thought (e.g., patient 8 moving their hand to move the cursor to the right) and a task-related thought (e.g., patient moving the cursor when the target task is to move the cursor), thereby thought 9 may be associated with multiple input commands 18, one or more of which may be task-related to thought 9, and one or more of which may be non-task-related to thought 9.
[0026] In this way, the thought 9 can be a universal switch assignable to any input command 18 of any end application 12, and each thought 9 can be assigned to one or more end applications 12. Module 10 allows each patient 8 to use their thought 9 like a button on a controller (e.g., a video game controller, any control interface) to favorably control any end application 12 of their choice. For example, a thought 9 can be assigned to each input command 18 of an end application 12, and the assigned input commands 18 can be used in any combination like buttons on a controller to control the end application 12. For example, if the end application 12 has four input commands 18 (for example, a first input command, a second input command, a third input command, and a fourth input command, like four buttons on a controller), a different thought 9 can be assigned to each of the four input commands 18 (for example, the first thought 9 can be assigned to the first input command 18, the second thought 9 to the second input command 18, the third thought 9 to the third input command 18, and the fourth thought 9 to the fourth input command 18), thereby allowing the patient 8 to use these four thoughts 9 to activate the four input commands 18 and any combination of them (for example, any order, number, frequency, and duration of the four input commands 18) to control the end application 12. For example, in the case of an end application 12 having four input commands 18, the four input commands 18 can be used to control the end application 12 using any combination of the four thoughts 9 assigned to the first, second, third, and fourth input commands 18, for example, the activation of each input command individually, multiple activations of each input command (e.g., two activations within 5 seconds, three activations within 10 seconds), combinations of multiple input commands 18 (e.g., the first and second input commands simultaneously or in series), or any combination thereof.Each individual thought 9, as well as each combination of thoughts 9, can function as a universal switch. Patient 8 can control multiple end applications 12 through the first, second, third, and fourth thoughts 9. For example, the first thought 9 can be assigned to the first input command 18 of the first end application 12, the first thought 9 can be assigned to the first input command 18 of the second end application 12, the second thought 9 can be assigned to the second input command 18 of the first end application 12, the second thought 9 can be assigned to the second input command 18 of the second end application 12, the third thought 9 can be assigned to the third input command 18 of the first end application 12, the third thought 9 can be assigned to the third input command 18 of the second end application 12, the fourth thought 9 can be assigned to the fourth input command 18 of the first end application 12, the fourth thought 9 can be assigned to the fourth input command 18 of the second end application 12, or any combination thereof. For example, the first thought 9 can be assigned to the first input command 18 of the first end application 12 and the first input command 18 of the second end application 12; the second thought 9 can be assigned to the second input command 18 of the first end application 12 and the second input command 18 of the second end application 12; the third thought 9 can be assigned to the third input command 18 of the first end application 12 and the third input command 18 of the second end application 12; the fourth thought 9 can be assigned to the fourth input command 18 of the first end application 12 and the fourth input command 18 of the second end application 12; or any combination thereof. The first, second, third, and fourth thoughts 9 can be assigned to any application 12 (for example, the first and second end applications).A thought may be assigned to only one application 12, while another thought may be assigned to multiple applications 12. Even if a thought 9 is assigned to only one application 12, it can be assigned to multiple applications 12 so that patient 8 can utilize the universal applicability of thought 9 (for example, assigned to only one end application 12) as needed or desired. Alternatively, all thoughts 9 may be assigned to multiple end applications 12.
[0027] The function of each input command 18 or combination of input commands for the end application 12 can be defined by the patient 8. Alternatively, the function of each input command 18 or combination of input commands for the end application 12 can be defined by the end application 12, thereby enabling a third party to connect and assign (also called mappable) the input commands 18 of that end application to a set or subset of the patient's repetitive thoughts 9. This makes third-party programs more accessible to each patient 8, tailored to their different requests, needs, and abilities. Module 10 can advantageously be an application programming interface (API) that a third party can interface with, thereby enabling the patient 8 to assign and reassign the patient 8's thoughts 9 to various input commands 18, where each input command 18 can be activated by the patient 8 recalling the thoughts 9 that are assigned to the input command 18 that the patient 8 wishes to activate, as described herein.
[0028] A patient's thoughts 9 can be assigned to an input command 18 of the end application 12 via a person (e.g., the patient or another person), a computer, or both. For example, a patient's thoughts 9 (e.g., a detectable neural-related signal and / or extractable feature associated with thought 9) can be assigned to an input command 18 by patient 8, assigned by a computer algorithm (e.g., based on the signal intensity of the detectable neural-related signal associated with thought 9), modified by patient 8 (e.g., reassigned), modified by an algorithm (e.g., based on the relative signal intensity of a switch or the availability of a new repeatable thought 9), or any combination thereof. The input command 18 and / or the feature associated with input command 18 may, but do not have to be, associated with the thoughts 9 associated with activating the input command 18. For example, Figures 1A to 1C show, in an exemplary embodiment, a non-specific or universal, mode-switching program (e.g., an application programming interface (API)) that can be connected by a third party to assign or reassign a thought 9 (e.g., detectable neural-related signals and / or extractable features associated with the thought 9) to various input commands 18. By assigning the input commands 18 to which the thought 9 is assigned, or vice versa, the patient 8 can use the same thought 9 for various input commands 18 in the same or different end application 12. Similarly, by reassigning the input commands 18 to which the thought 9 is assigned, or vice versa, the patient 8 can use the same thought 9 for various input commands 18 in the same or different end application 12.For example, a thought 9 assigned to an input command 18 that causes a prosthetic arm (e.g., a first end application) to open can be assigned to another input command 18 that causes a cursor (e.g., a second end application) on a computer to do something (e.g., any function associated with a cursor associated with a computer mouse or touchpad, including cursor movement such as left-click and right-click, and selection using the cursor).
[0029] Figures 1A to 1C further illustrate that the patient 8's thought 9 can be assigned to multiple end applications 12 so that the patient 8 can switch between multiple end applications 12 without having to reassign input commands 18 each time the patient 8 uses a different end application 12. For example, thought 9 can be assigned to multiple end applications 12 simultaneously (for example, it can be assigned to both the first and second end applications, and the process of assigning thought 9 to both the first and second end applications can occur simultaneously, but does not necessarily have to). This allows the patient's thought 9 to favorably control any end application 12, including, for example, external gaming devices and various home appliances and devices (e.g., any smart device or system including light switches, appliances, locks, thermostats, security systems, garage doors, windows, shades, etc.). As a result, the neural interface 14 can detect task-related neural signals 17 (e.g., brain signals) for functions associated with input commands 18 of the end application 12, where the end application 12 can be any electronic device or software, including a device located either inside or outside the patient's body. As an alternative example, the neural interface 14 can detect task-related neural signals 17 (e.g., brain signals) for functions associated with input commands 18 of the end application 12, where the end application 12 can be any electronic device or software, including a device located either inside or outside the patient's body. As a further alternative example, the neural interface 14 can detect task-related thoughts, task-unrelated thoughts, or neural signals 17 (e.g., brain signals) associated with both task-related and task-unrelated thoughts.
[0030] Some of thought 9 may be non-task-related thoughts (e.g., patient 8 moving their hand to move the cursor to the right), some of thought 9 may be task-related thoughts (e.g., patient 8 moving the cursor when the target task is to move the cursor), and some of thought 9 may be both non-task-related and task-related thoughts, or any combination thereof. If thought 9 is both non-task-related and task-related, thought 9 can be used as both a non-task-related thought (e.g., patient 8 moving their hand to move the cursor to the right) and a task-related thought (e.g., patient moving the cursor when the target task is to move the cursor), thereby allowing thought 9 to be associated with multiple input commands 18, one or more of which may be task-related to thought 9, and one or more of which may be non-task-related to thought 9. Alternatively, all of thought 9 may be non-task-related thoughts. Task-unrelated thoughts 9, and / or thoughts 9 used by patient 8 as task-unrelated thoughts (e.g., thoughts 9 assigned to input commands 18 unrelated to thought 9), enable patient 8 (e.g., BCI user) to independently control various end applications 12, including software and devices, by utilizing a given task-unrelated thought (e.g., thought 9).
[0031] Figures 1A to 1C show, for example, that patient 8 can think about thought 9 (e.g., whether or not they are asked to think about thought 9) and then rest. This task of thinking about thought 9 can generate detectable neural-related signals corresponding to the thought 9 that the patient was thinking about. The task of thinking about thought 9 and then resting can be performed only once, for example, when patient 8 thinks about thought 9 to control end application 12. Alternatively, the task of thinking about thought 9 can be repeated multiple times, for example, when patient 8 controls end application 12 by thinking about thought 9, or when the patient is being trained to control end application 12 using thought 9. If neural-related signals (e.g., brain-related signals) such as nerve signals are recorded, features can be extracted (e.g., spectral power / time-frequency domain) or identified from the signals themselves (e.g., time-domain signals). These features may contain characteristic information about thought 9 and can be used to identify thought 9, to distinguish multiple thoughts 9 from each other, or both. Alternatively, these features can be used to develop or train mathematical models or algorithms that can predict the type of thought that generated the neural signals, using machine learning methods or the like. Using at least one of these algorithms and models, it is possible to predict in real time what patient 8 is thinking and associate this prediction with any desired input command 18. The process of patient 8 thinking about the same thought 9 can be repeated, for example, until a prediction provided by at least one of the algorithms and models matches patient 8's thought 9. In this way, patient 8 can have each of the thoughts 9 used to control the end application 12 calibrated so that each of the thoughts 9 assigned to an input command 18 generates a repeatable neural-associated signal detectable by the neural interface 14.The algorithm can provide patient 8 with feedback 19 on whether the prediction matches the thought 9 that should actually be thought of, and this feedback can be visual, auditory, and / or tactile, allowing patient 8 to learn through trial and error. Using machine learning methods and mathematical algorithms, thoughts 9 can be classified based on at least one of the features extracted from the detected neural-related signals 17 and the identified features. For example, a training dataset in which patient 8 repeats rest and thought multiple times can be recorded, relevant features can be extracted from the neural-related signals 17 detected by the processor, and the parameters and hyperparameters of the mathematical model or mathematical algorithm used to distinguish between rest and thought can be optimized to predict real-time signals based on this data. Then, using the same mathematical model or mathematical algorithm tuned to predict real-time signals, module 10 can advantageously convert thoughts 9 into real-time universal switches.
[0032] Figure 1A further illustrates that the neural interface 14 can monitor a biomedium (e.g., the brain), such as electrical signals from the tissue being monitored (e.g., nerve tissue). Figure 1A further illustrates that the neural-related signals 17 can be brain-related signals. Brain-related signals can be, for example, electrical signals from any one or more parts of the patient's brain (e.g., motor cortex, sensory cortex, etc.). Alternatively, brain-related signals can be any signal detectable within the skull (e.g., electrical, biochemical), any one or more features extracted from the detected brain-related signals (e.g., via a computer processor), or both. Further alternatives include electrical signals, any signals resulting from electrical signals (e.g., biochemical signals), any one or more features extracted from the detected brain-related signals (e.g., via a computer processor), or any combination thereof.
[0033] Figure 1A further illustrates that the end application 12 is separate from module 10 but can communicate via wired or wireless means. Alternatively, module 10 (e.g., host device 16) may be permanently or detachably attached to or attachable to the end application 12. For example, host device 16 may be detachably docked with application 12 (e.g., a device with software that module 10 can communicate with). Host device 16 may have a port that can engage with application 12, or vice versa. The port may be a charging port, a data port, or both. For example, if the host device is a smartphone, the port may be a Lightning port®. In yet another example, host device 16 may be tethered to application 12, for example, by a cable. The cable may be a power cable, a data transfer cable, or both.
[0034] Figure 1B further shows that when patient 8 recalls thought 9, neural-related signal 17 can become a brain-related signal corresponding to thought 9. Figure 1B further illustrates that the host device 16 may have a processor (e.g., a microprocessor) that analyzes (e.g., detects, decodes, classifies, or any combination thereof) the neural-related signals 17 received from the neural interface 14, associates the neural-related signals 17 received from the neural interface 14 with their corresponding input commands 18, associates features extracted from the neural-related signals 17 themselves (e.g., spectral power / time-frequency domain) or identified features (e.g., time-domain signals) with their corresponding input commands 18, stores the neural-related signals 17 received from the neural interface 14, stores the signal analysis (e.g., features extracted from the neural-related signals 17 or features identified by the neural-related signals 17), stores the neural-related signals 17 associated with the input commands 18, stores the features extracted from the neural-related signals 17 or features identified by the neural-related signals 17 associated with the input commands 18, or any combination thereof.
[0035] Figure 1B further illustrates that the host device 16 may have memory. Data stored by the processor can be stored in local memory, on a server (e.g., the cloud), or both. Thoughts 9 and the data resulting from them (e.g., detected neural-related signals 17, extracted features, or both) can function as a reference library. For example, once thought 9 is calibrated, neural-related signals 17 associated with the calibrated thought and / or its signature (also called extracted) features can be stored. Thought 9 can be considered calibrated if, for example, the neural-related signals 17 and / or features extracted therefrom have repeatable signatures or features that are identifiable by the processor when the neural-related signals 17 are detected by the neural interface 14. Neural-related signals being monitored and detected in real time can then be compared in real time with this stored calibration data. Whenever one of the detected signals 17 and / or their extracted features matches a calibrated signal, a corresponding input command 18 associated with the calibrated signal can be sent to the corresponding end application 12. For example, Figures 1A and 1B show that a patient 8 can be trained to use module 10 by calibrating neurally related signals 17 associated with their thoughts 9 and storing those calibrations in a reference library. During training, feedback 19 can be provided to the patient 8.
[0036] Figure 1C further illustrates an exemplary user interface 20 of the host device 16. The user interface 20 can be a computer screen (e.g., a touchscreen, a non-touchscreen). Figure 1C shows an exemplary display of the user interface 20, including selectable systems 13, selectable input commands 18, and selectable end applications 12. The system 13 can be a group of one or more end applications 12. The system 13 can be added to or removed from the host device 16. The end applications 12 can be added to or removed from the host device 16. The end applications 12 can be added to or removed from the system 13. Each system 13 may have a corresponding set of input commands 18 that can be assigned to the corresponding set of end applications 12. As an alternative example, the user interface 20 may show input commands 18 for each of the activated end applications 12 (e.g., remote). As a further example, the user interface 20 can display input commands 18 for activated end applications (e.g., remote) and / or deactivated end applications 12 (e.g., stimulation sleeve, telephone, smart home device, wheelchair). This allows module 10 to control any end application 12. The user interface 20 makes it easy to assign thoughts 9 to various input commands 18 for multiple end applications 12. System grouping of end applications (e.g., system 1 and system 2) allows patient 8 to consolidate and organize end applications 12 using the user interface 20. Off-the-shelf systems 13 can be uploaded to the module, and / or patient 8 can create their own systems 13.For example, the first system may have all end applications 12 associated with mobility (e.g., wheelchairs, wheelchair lifts) used by the patient 8. Alternatively, the second system may have all end applications 12 associated with prosthetics used by the patient 8. In yet another example, the third system may have all end applications 12 associated with smart home appliances used by the patient 8. In yet another example, the fourth system may have all end applications 12 used by the patient 8, associated with software or devices used by the patient 8 for their occupation. The end applications 12 may be provided in one or more systems 13. For example, an end application 12 (e.g., a wheelchair) may be provided in both system 1 and / or system 2. Such organizational efficiency allows the patient 8 to easily manage the end applications 12. Module 10 may have one or more systems 13, for example, 1 to 1000 or more systems 13, which include systems 13 in increments of one within this range (e.g., 1 system, 2 systems, 10 systems, 100 systems, 500 systems, 1000 systems, 1005 systems, 2000 systems). For example, Figure 1C shows that module 10 may have a first system 13a (e.g., system 1) and a second system 13b (e.g., system 2). Also, Figure 1C shows that end applications 12 can be grouped into various systems 13, with each system having one or more end applications 12; however, as an alternative example, the user interface 20 does not have to group end applications into systems 13.
[0037] Figure 1C further illustrates that thought 9 can be assigned to an input command 18 using the host device 16. For example, thought 9, a neural-associated signal 17 associated with thought 9, an extracted feature of the neural-associated signal 17 associated with thought 9, or any combination thereof can be assigned to an input command 18 of the system 13. For example, this can be done by selecting an input command 18 (e.g., left arrow) and selecting from a drop-down menu that shows thought 9 and / or associated data (e.g., a neural-associated signal 17 associated with thought 9, an extracted feature of the neural-associated signal 17 associated with thought 9, or both) that can be assigned to the selected input command 18. Figure 1C further illustrates that when an input command 18 is triggered by thought 9 or associated data, feedback (e.g., visual, auditory, and / or tactile feedback) can be provided to the patient 8. Figure 1C further illustrates that one or more end applications 12 can be activated and deactivated within the system 13. An activated end application 12 may be in a powered-on state, a powered-off state, or a standby state. An activated end application 12 can receive triggered input commands 18. A deactivated end application 12 may be powered on, powered off, or in standby mode. In one example, a deactivated end application 12 is not controllable by patient 8's thoughts 9 unless the end application 12 is activated. Activating the end application 12 using the user interface 20 allows the end application 12 to be powered on. By deactivating the end application 12 using the user interface 20, the deactivated end application 12 can be powered off or the module 10 can be disconnected from the deactivated end application 12, preventing the processor from associating neural signals 17 with thoughts 9 assigned to the deactivated end application 12.For example, Figure 1C shows an exemplary system 1 having five end applications 12, the five end applications comprising five devices (e.g., remote, stimulator sleeve, telephone, smart home device, wheelchair), one of which (e.g., remote) is activated and the others are deactivated. Once "Start" is selected (e.g., via icon 20a), patient 8 can control the end application 12 of the system (e.g., system 1) that is activated (e.g., remotely) using input commands 18 associated with the end application 12 of system 1. Figure 1C further shows that any changes made using the user interface 20 can be saved using the save icon 20b, and any changes made using the user interface 20 can be canceled using the cancel icon 20c. Figure 1C further shows that the end applications 12 can be electronic devices.
[0038] Figures 1A to 1C show that multiple end applications 12 (e.g., multiple end devices) can be controlled using the same specific set of thoughts 9, thereby making module 10 a universal switch module. Module 10 advantageously allows a patient 8 (e.g., a BCI user) to independently control various end applications 12, including, for example, multiple software and devices, by utilizing thoughts (e.g., thoughts 9) that are not related to a given task. Module 10 can acquire neural-related signals (e.g., via a neural interface 14), decode the acquired neural-related signals (e.g., via a processor), associate the acquired neural-related signals 17 and / or features extracted from these signals (e.g., by the processor) with corresponding input commands 18 of one or more end applications 12, and thus control multiple end applications 12 (e.g., by module 10). Using module 10, thoughts 9 can be advantageously used to control multiple end applications 12. For example, module 10 can be used to control multiple end applications 12, where one end application 12 can be controlled at a time. Alternatively, module 10 can be used to control multiple end applications simultaneously. Thought 9 can be assigned to input commands 18 of multiple end applications 12. In this way, thought 9 can function as a universal digital switch, and module 10 can effectively reorganize the patient's motor cortex to represent a digital switch, where each of thought 9 can be a digital switch.These digital switches can be made into universal switches that a patient 8 can use to control multiple end applications 12, since each switch can be assigned (e.g., via module 10) to any input command 18 of multiple end applications 12 (e.g., an input command for the first end application and an input command for the second end application). Module 10 can, via a processor, determine between different thoughts 9 (e.g., between different switches).
[0039] Module 10 can interface with, for example, 1 to 1000 or more end applications 12, which include each increment of end applications 12 within this range (e.g., 1 end application, 2 end applications, 10 end applications, 100 end applications, 500 end applications, 1000 end applications, 1005 end applications, 2000 end applications). For example, Figure 1C shows that the first system 13a may have a first end application 12a (e.g., remote), a second end application 12b (e.g., stimulation sleeve), a third end application 12c (e.g., telephone), a fourth end application 12d (e.g., smart home device), and a fifth end application 12e (e.g., wheelchair).
[0040] Each end application may have, for example, 1 to 1000 or more input commands 18 that can be associated with patient 8's thoughts 9, or alternatively, 1 to 500 or more input commands 18 that can be associated with patient 8's thoughts 9, or further alternatively, 1 to 100 or more input commands 18 that can be associated with patient 8's thoughts 9, including input commands 18 within these ranges in increments of 1 (e.g., 1 input command, 2 input commands, 10 input commands, 100 input commands, 500 input commands, 1000 input commands, 1005 input commands, 2000 input commands), and any sub-ranges within these ranges (e.g., 1 to 25 or fewer input commands 18, 1 to 100 or fewer input commands 18, 25 to 1000 or fewer input commands 18), thereby allowing any number of input commands 18 to be triggered by patient 8's thoughts 9, where any number can be, for example, the number of input commands 18 to which patient 8's thoughts 9 are assigned. For example, Figure 1C shows an exemplary set of input commands 18 associated with one or more activated end applications 12 (e.g., first end application 12a), including a first end application first input command 18a (e.g., left arrow), a first end application second input command 18b (e.g., right arrow), and a first end application third input command 18c (e.g., input). Alternatively, Figure 1C shows an exemplary set of input commands 18 associated with one or more deactivated end applications 12 (e.g., second end application 12b), including a second end application first input command 18d (e.g., select output), where the second end application first input command 18d is not yet selected but can be any input command 18 of the second end application 12b. The first end application first input command 18a is also referred to as the first input command 18a of the first end application 12a. The second input command 18b of the first end application is also called the second input command 18b of the first end application 12a.The third input command 18c of the first end application is also called the third input command 18c of the first end application 12a. The first input command 18d of the second end application is also called the first input command 18d of the second end application 12b.
[0041] When patient 8 recalls thought 9, module 10 (e.g., via a processor) can associate at least one of the neurally associated signals 17 and features extracted therefrom that are associated with thought 9 with an input command 18 to which thought 9 is assigned, and the input command 18 associated with thought 9 can be transmitted by module 10 (e.g., via a processor, control unit, or transceiver) to their corresponding end applications 12. For example, if thought 9 is assigned to the first input command 18a of the first end application 18a, then when patient 8 recalls thought 9, the first input command 18a of the first end application 12a can be transmitted to the first end application 12a, and if thought 9 is assigned to the first input command 18d of the second end application 12b, then when patient 8 recalls thought 9, the first input command 18d of the second end application 12b can be transmitted to the second end application 12b. This allows one thought (e.g., thought 9) to interface with multiple end applications 12 (first and second end applications 12a, 12b) or to be used to control these multiple end applications 12. Any number of thoughts 9 can be used as switches. The number of thoughts 9 used as switches can correspond, for example, to the number of controls (e.g., input commands 18) required or desired to control the end applications 12. Thoughts 9 can be assigned to multiple end applications 12. For example, at least one of the neurally associated signals 17 associated with a first thought and the features extracted therefrom can be assigned to the first input command 18a of the first end application and to the first input command 18d of the second end application.Alternatively, at least one of the neural-associated signals 17 associated with a second thought and the features extracted therefrom can be assigned to a second input command 18a of the first end application and a first input command of the third end application. The first and second thoughts may be different. Multiple end applications 12 (e.g., first and second end applications 12a, 12b) can be operated independently of each other. When module 10 is used to control one end application (e.g., the first end application 12a), the first thought can be assigned to multiple input commands 18. For example, the first thought alone can activate the first input command, or the first and second thoughts together can activate a second input command different from the first input command. This allows the thought 9 to function as a universal switch even when only one end application 12 is controlled by module 10, because one thought can be combined with other thoughts to form an additional switch. Alternatively, one thought can be combined with another to form an additional universal switch to which multiple end applications 12 can be assigned to any input command 18 controllable by module 10 via the thought 9.
[0042] Figures 2A to 2D show that the neural interface 14 can be a stent 101. The stent 101 may have struts 108 and sensors 131 (e.g., electrodes). The stent 101 is foldable and expandable.
[0043] Figures 2A to 2D further illustrate that the stent 101 can be implanted in a blood vessel of the human brain, for example, a vessel crossing the superior sagittal sinus of a person. Figure 2A shows an exemplary module 10, and Figures 2B to 2D show three enlarged views of module 10 of Figure 2A. The stent 101 can be implanted, for example, via the jugular vein in the superior sagittal sinus (SSS) covering the primary motor cortex, and can passively record brain signals and / or stimulate tissue. The stent 101 can detect nerve-related signals 17 associated with thought 9 via a sensor 131, so that, for example, a person paralyzed due to neurological injury or disease can communicate, improve mobility, and potentially achieve independence by directly controlling the brain with assistive technologies such as end-applications 12. Figure 2C shows that a communication conduit 24 (e.g., a stent lead) can extend from the stent 101, pass through the wall of the jugular vein, and tunnel under the skin to the subclavian sac. In this way, the communication conduit 24 allows for easy communication between the stent 101 and the telemetry unit 22.
[0044] Figures 2A to 2D further show that the end application 12 can be a wheelchair.
[0045] Figure 3 shows that the neural interface 14 (e.g., a stent 101) can be a wireless sensor system 30 (e.g., without a telemetry unit 22) capable of wireless communication with a host device 16. Figure 3 shows a configuration in which a stent 101 in a blood vessel 104 above the motor cortex of patient 8 picks up nerve-related signals and relays this information to a wireless transmitter 32 mounted on the stent 101. The nerve-related signals recorded by the stent 101 can be wirelessly transmitted through the patient's skull to a wireless transceiver 34 (e.g., located in the head), which then decodes the acquired nerve-related signals and transmits them to the host device 16. Alternatively, the wireless transceiver 34 may be part of the host device 16.
[0046] Figure 3 shows that the end application 12 can be a prosthetic hand.
[0047] Figure 4 shows that a neural interface 14 (e.g., stent 101) can be used to record neuronal signals 17 from the brain, for example, from neurons in the superior sagittal sinus (SSS) or bifurcation cortical veins. This includes (a) implanting the neural interface 14 in a blood vessel 104 in the brain (e.g., superior sagittal sinus, bifurcation cortical veins), (b) recording neuronal signals, (c) generating data representing the recorded neuronal signals, and (d) transmitting the data to a host device 16 (e.g., with or without a telemetry unit 22).
[0048] U.S. Patent Application No. 16 / 054,657, filed on 3 August 2018, encompasses all systems, devices, and methods disclosed herein, and any combination of features and operations disclosed herein, and is disclosed in whole for all purposes. For example, neural interface 14 (e.g., stent 101) could be, for example, any of the stents (e.g., stent 101) disclosed in U.S. Patent Application No. 16 / 054,657, filed on 3 August 2018.
[0049] By using module 10, patient 8 can be prepared to interface with multiple end applications 12. By using module 10, patient 8 can perform multiple tasks using one type of electronic command, which is a function of thinking (e.g., thought 9) that is not related to a specific task. For example, using module 10, patient 8 can perform multiple tasks using thinking (e.g., thought 9) that is not related to a single task.
[0050] For example, Figure 5 shows a method 50 for preparing a human to interface with an electronic device or software (e.g., with an end application 12), having acts 52, 54, 56, and 58 in one embodiment. Figure 5 shows that method 50 may include, in act 52, measuring the human's neural-associated signals when the human generates thoughts unrelated to a first task to obtain a first detected neural signal. Method 50 may include, in act 54, transmitting the first detected neural signal to a processing unit. Method 50 may include, in act 56, associating the thoughts unrelated to the first task and the first detected neural signal with a first input command. Method 50 may include, in act 58, compiling the thoughts unrelated to the first task, the first detected neural signal, and the first input command into an electronic database.
[0051] As an alternative example, Figure 6 shows a method 60 for controlling a first device and a second device (e.g., first and second end applications 12a, 12b) having acts 62, 64, 66, and 68 in one embodiment. Figure 6 shows that method 60 may include, in act 62, measuring human neural-related signals when a person generates thoughts unrelated to the task and obtaining the detected neural signals. Method 60 may include, in act 64, transmitting the detected neural signals to a processor. Method 60 may include, in act 66, associating the detected neural signals with first device input commands and second device input commands via the processor. Method 60 may include, in act 68, electrically transmitting the first device input command to the first device or electrically transmitting the second device input command to the second device when associating the detected neural signals with first device input commands and second device input commands.
[0052] As an alternative example, Figure 7 shows a method 70 in one embodiment for preparing a human to interface with a first and second device (e.g., first and second end applications 12a, 12b) having acts 72, 74, 76, 78, and 80. Figure 7 shows that the method 70 may include, in act 72, measuring the human's brain-associated signals when the human generates task-specific thoughts by recalling a first task, and obtaining the detected brain-associated signals. The method may include, in act 74, transmitting the detected brain-associated signals to a processing unit. The method may include, in act 76, associating the detected brain-associated signals, via the processing unit, with a first device input command associated with a first device task. The first device task may be different from the first task. The method may include, in act 78, associating the detected brain-associated signals, via the processing unit, with a second device input command associated with a second device task. The second device task may be different from the first device task and the first task. In operation 80, when associating detected brain-related signals with a first device input command and a second device input command, this method may include electrically transmitting the first device input command to the first device to perform the first device task associated with the first device input command, or electrically transmitting the second device input command to the second device to perform the second device task associated with the second device input command.
[0053] As an alternative example, Figures 5 to 7 show modified methods for controlling multiple end applications 12 using a universal switch (e.g., Thinking 9).
[0054] As an alternative example, the operations shown in Figures 5 to 7 can be performed and repeated in any order and in any combination. Figures 5 to 7 do not limit this disclosure in any way to the illustrated methods or the specific operating sequences described. For example, the operations described in methods 50, 60, and 70 can be performed in any order, and one or more operations can be omitted or added.
[0055] As an alternative example, in one embodiment, a method using module 10 may include measuring a human brain-associated signal when the human generates a thought unrelated to the task (e.g., thought 9) to obtain a first detected brain-associated signal. This method may include transmitting the first detected brain-associated signal to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect the brain-associated signal corresponding to when the human generates thought 9. This method may include associating the unrelated thought and the first detected brain-associated signal with one or more N input commands 18. This method may include compiling the unrelated thought (e.g., thought 9), the first detected brain-associated signal, and the N input commands 18 into an electronic database. This method may include monitoring the human for the first detected brain-associated signal (e.g., using a neural interface) and, upon detection of the first detected brain-associated signal, electrically transmitting at least one of the N input commands 18 to a control system. The control system may be the control system for the end application 12. The N input commands 18 can be, for example, 1 to 100 input commands 18, including each increment of input commands 18 within this range. The N input commands can be assigned to Y end applications 12, and the Y end applications can be, for example, 1 to 100 end applications 12, including each increment of end applications 12 within this range. Alternatively, the Y end applications 12 can be, for example, 2 to 100 end applications 12, including each increment of end applications 12 within this range. The Y end applications 12 can include, for example, at least one of mouse cursor control, wheelchair control, and speller control.The N input commands 18 can be at least one of a binary input associated with a thought unrelated to the task, a stepped input associated with a thought unrelated to the task, and a continuous trajectory input associated with a thought unrelated to the task. This method may involve associating M detection values of a first detected brain-related signal with the N input commands 18, where M is a detection value between 1 and 10. For example, if M is one detection value, a thought unrelated to the task (e.g., thought 9) and the first detected brain-related signal can be associated with a first input command (e.g., first input command 18a). Alternatively, if M is two detection values, a thought unrelated to the task (e.g., thought 9) and the first detected brain-related signal can be associated with a second input command (e.g., first input command 18b). As yet another example, if M is three detection values, a thought unrelated to the task (e.g., thought 9) and the first detected brain-related signal can be associated with a third input command (e.g., third input command 18c). The first, second, and third input commands can be associated with one or more end applications 12. For example, the first input command can be an input command for the first end application, the second input command can be an input command for the second end application, and the third input command can be an input command for the third application, thereby allowing one thought 9 to control multiple end applications 12. Each of the M detection values of thought 9 can be assigned to multiple end applications, so that the last number of the M detection values (e.g., 1, 2, or 3 detection values) can function as a universal switch that can be assigned to any input command 18. The first, second, and third input commands can each be associated with different functions.The first, second, and third input commands can be associated with the same function, such that the first input command is associated with a first function parameter, the second input command with a second function parameter, and the third input command with a third function parameter. The first, second, and third parameters can be, for example, speed, volume, or both, in a stepped manner. Stepped speed can be associated with, for example, wheelchair movement, mouse cursor movement on a screen, or both. Stepped volume levels can be associated with, for example, the volume of a car sound system, computer volume, telephone volume, or a combination thereof. At least one of the N input commands 18 can be a click and hold command associated with a computer mouse. This method may include associating a combination of thoughts unrelated to the task (e.g., thought 9) with the N input commands 18. This method may include associating Z combinations of non-task-related thoughts with N input commands 18, where Z non-task-related thoughts can be thoughts related to 2 to 10 or more tasks, or more broadly, thoughts related to 1 to 1000 or more tasks, and include increments of one unit within these ranges. At least one of the Z non-task-related thoughts may be a non-task-related thought, and this non-task-related thought may be a first non-task-related thought. Thus, this method may include measuring a human brain-related signal when the human generates a second non-task-related thought to obtain a second detected brain-related signal, transmitting the second detected brain-related signal to a processing unit, and associating the second non-task-related thought and the second detected brain-related signal with N2 input commands, and if the combinations of the first and second detected brain-related signals are obtained sequentially or simultaneously, associating that combination with N3 input commands. A non-task-related thought may be a thought about moving the limbs of the body. The first detected brain-related signal can be at least one of the following: electrical activity of brain tissue or functional activity of brain tissue.Any operations in this exemplary method can be performed in any combination and in any order.
[0056] As an alternative example, one method of using module 10 may include measuring a person's brain-associated signals when the person generates a first task-specific thought by contemplating a first task (e.g., by contemplating thought 9) to obtain a first detected brain-associated signal. This method may include transmitting the first detected brain-associated signal to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect the corresponding brain-associated signals when the person generates a thought. This method may include associating the first detected brain-associated signal with a first task-specific input command (e.g., input command 18) associated with a second task, where the second task is different from the first task (e.g., thought 9 is a different task from the task to which input command 18 is configured to execute). The first task-specific thought may be unrelated to the association step. This method may include a step of assigning the second task to a first task-specific command instruction, independently of the first task. This method may include a step of reassigning a third task to a command instruction specific to the first task, independently of the first and second tasks. This method may include compiling the first task-specific thoughts, the first detected brain-related signals, and the first task-specific input commands into an electronic database. This method may include monitoring a person for the first detected brain-related signals and, upon detecting the first detected brain-related signals, electrically transmitting the first task-specific input command to a control system. The first task-specific thoughts may, for example, relate to a physical task, a non-physical task, or both. The thoughts generated may be, for example, a single thought or a composite thought. A composite thought may be two or more non-simultaneous thoughts, two or more simultaneous thoughts, and / or a sequence of two or more simultaneous thoughts. Any operations in this exemplary method may be performed in any combination and in any order.
[0057] As an alternative example, in one embodiment, a method using module 10 may include measuring human brain-related signals when a person has a first thought and obtaining a first detected brain-related signal. This method may include transmitting the first detected brain-related signal to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect the corresponding brain-related signals when a person generates a thought. This method may include generating a first command signal based on the first detected brain-related signal. This method may include assigning a first task to the first command signal, independently of the first thought. This method may include decoupling the first thought from the first detected electrical brain activity. This method may include reassigning a second task to the first command signal, independently of the first thought and the first task. This method may include compiling the first thought, the first detected brain-related signal, and the first command signal into an electronic database. This method may include monitoring a person for a first detected brain-related signal and, upon detection of the first detected brain-related signal, electrically transmitting a first input command to a control system. The first thought may include, for example, thoughts about actual or imaginary muscle contractions, actual or imaginary memories, or both, or any abstract thought. The first thought may be, for example, a single thought or a combination of thoughts. Any operations in this exemplary method may be performed in any combination and in any order.
[0058] As an alternative example, in one embodiment, a method using module 10 may include measuring the electrical activity of human brain tissue when a person has a first thought to obtain a first detected electrical brain activity. This method may include transmitting the first detected electrical brain activity to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect corresponding brain-related signals when a person generates a thought. This method may include generating a first command signal based on the first detected electrical brain activity. This method may include assigning a first task and a second task to the first command signal. The first task may be associated with a first device, and the second task may be associated with a second device. The first task may be associated with a first application of the first device, and the second task may be associated with a second application of the first device. This method may include assigning the first task to the first command signal independently of the first thought. This method may include assigning the second task to the first command signal independently of the first thought. This method may include compiling a first thought, first detected electrical brain activity, and first command signals into an electronic database. It may also include monitoring a person for first detected electrical brain activity and, upon detection of first detected electrical brain activity, electrically transmitting a first command signal to a control system. Any operations in this exemplary method can be performed in any combination and any order.
[0059] As an alternative example, in one embodiment, a method using module 10 may include measuring a human neural-related signal when the human generates a thought unrelated to the task to obtain a first detected neural signal. This method may include transmitting the first detected neural signal to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect a brain-related signal corresponding to when the human generates a thought unrelated to the task. This method may include associating the thought unrelated to the task and the first detected neural signal with a first input command. This method may include compiling the thought unrelated to the task, the first detected neural signal, and the first input command into an electronic database. This method may include monitoring the human for the first detected neural signal and, upon detection of the first detected neural signal, electrically transmitting the first input command to a control system. The neural-related signal may be a brain-related signal. The neural-related signal may be measured from neural tissue in the human brain. Any operations in this exemplary method may be performed in any combination and any order.
[0060] As an alternative example, in one embodiment, a method using module 10 may include measuring a human neural-related signal to obtain a first detected neural-related signal when a person generates a thought specific to the first task by contemplating the first task. This method may include transmitting the first detected neural-related signal to a processing unit. This method may include the processing unit applying a mathematical algorithm or mathematical model to detect the corresponding neural-related signal when a person generates a thought. This method may include associating the first detected neural-related signal with a first task-specific input command associated with a second task, where the second task is different from the first task, thereby providing the user with a mechanism to control multiple tasks with different task-specific inputs using a single thought generated by the user. This method may include compiling the non-task-related thoughts, the first detected neural signal, the first input command, and the corresponding task into an electronic database. This method may include using the memory of an electronic database to automatically group non-task-related thoughts, detected brain-related signals, and combinations of one or more N inputs based on the task, brain-related signals, or thoughts, and automatically mapping control functions for the automated setup of the system for use. Neural-related signals may be neural-related signals from brain tissue. Any operations in this exemplary method can be performed in any combination and any order.
[0061] Module 10 can perform any combination of any methods and any operation of any method disclosed herein.
[0062] The claims are not limited to the exemplary embodiments shown in the drawings, but may instead claim any element disclosed or contemplated throughout this disclosure. Elements described in the singular form herein may be plural (i.e., anything described as "one" may be plural). A species element of one personal element may have the characteristics or elements of other species elements of that personal element. Some elements may be omitted in the drawings for clarity. The configurations, elements or complete assemblies and methods and their elements for carrying out the above disclosure, as well as variations of embodiments of this disclosure, may be combined and modified in any combination, each combination expressly disclosed herein. All devices, apparatus, systems and methods described herein may be used for medical (e.g., diagnostic, therapeutic, rehabilitation, etc.) or non-medical purposes. "May" and "can" are interchangeable (e.g., "may" can be replaced with "can," and "can" can be replaced with "may"). Any disclosed range may include any subrange of the disclosed range; for example, a range of 1 to 10 units may include 2 to 10 units, 8 to 10 units, or any other subrange. Any phrase containing the "A and / or B" construction may mean (1) A alone, (2) B alone, (3) both A and B, or any combination of (1), (2), and (3), for example, (1) and (2), (1) and (3), (2) and (3), and (1), (2), and (3).For example, the phrase "Module 10 (e.g., host device 16) can communicate with one or more end applications 12 by wired and wireless means" in this disclosure may include: (1) Module 10 (e.g., host device 16) can communicate with one or more end applications 12 by wired means; (2) Module 10 (e.g., host device 16) can communicate with one or more end applications 12 wirelessly; (3) Module 10 (e.g., host device 16) can communicate with one or more end applications 12 by wired and wireless means; or any combination of (1), (2), and (3).
Claims
1. a nerve-related signal measuring step of measuring a nerve-related signal of the human when the human generates a thought associated with a muscle contraction and not related to the task to obtain a detected nerve signal; transmitting the sensed neural signals to a processing unit; associating the non-task-related thoughts and the detected neural signals with a universal switch in the processing unit, the universal switch being assigned to a first input command of an electronic device in the processing unit; and collecting the non-task-related thoughts, the detected neural signals, and the first input command into an electronic database, whereby the human controls the electronic device by producing non-task-related thoughts and electrically transmitting the first input command to the electronic device.
2. The method of claim 1 , wherein the first input command is an input command of a first end application.
3. The method of claim 2 , further comprising associating the non-task-related thoughts and the sensed neural signals with a second input command.
4. The method of claim 3 , wherein the second input command is an input command of a second end application.
5. 5. The method of claim 4, further comprising the step of controlling the first end application with the first input command upon detecting the detected neural signal.
6. 6. The method of claim 5, further comprising the step of controlling the second end application with the second input command upon detecting the detected neural signal.
7. 5. The method of claim 4, further comprising collecting the non-task-related thoughts, the sensed neural signals, and the second input command in the electronic database.
8. The method of claim 4 , wherein the sensed neural signals are sensed electrical brain activity.
9. The method of claim 4 , wherein measuring the human's nerve-related signals comprises measuring the human's nerve-related signals with an implanted intravascular device.
10. monitoring the human for the detected neural signals; upon detecting the detected neural signal, electrically transmitting the first input command to the first end application or the second end application; The method of claim 4 further comprising:
11. 11. The method of claim 10, further comprising: monitoring the human for the detected neural signal; and upon detecting the detected neural signal, electrically transmitting the first input command to the first end application and the second end application.
12. a nerve-related signal measuring step of measuring a nerve-related signal of the human when the human generates a thought associated with a muscle contraction and not related to the task to obtain a detected nerve signal; transmitting the detected neural signals to a processor; calibrating, via the processor, a universal switch that is assigned to an input command of a first device and that is assigned to an input command of a second device based on the sensed neural signal; collecting the non-task-related thoughts, the detected neural signals, the input commands of the first device, and the input commands of the second device in an electronic database, whereby the human can control the first device or the second device by generating non-task-related thoughts to cause the input commands of the first device to be electrically transmitted to the first device or the input commands of the second device to be electrically transmitted to the second device; A method of calibrating a neural signal as an electronic switch such that a human can individually and selectively control a first device and a second device, comprising:
13. The method of claim 12, wherein collecting the task-unrelated thoughts, the detected neural signals, the input commands of the first device, and the input commands of the second device in the electronic database enables the human to control the first device and the second device by generating task-unrelated thoughts that cause the input commands of the first device to be electrically transmitted to the first device and the input commands of the second device to be electrically transmitted to the second device.
14. The method of claim 12 , wherein the sensed neural signals are sensed electrical brain activity.
15. The method of claim 12 , wherein measuring the human's nerve-related signals comprises measuring the human's nerve-related signals with an implanted intravascular device.
