Systems and methods for augmented control using neural signals - Patents.com

Abstract

Systems and methods for brain-computer interfaces (BCIs) increase the number of degrees of freedom (DOFs) of one or more neural signals used for interaction with the BCI.

Description

[Technical field]

[0001] The present disclosure generally relates to systems and methods for increasing the number of degrees of freedom (DOF) when a signal is used to interact with a control system. For example, such a control system may include a brain-computer interface (BCI), where the degrees of freedom of one or more neural signals are increased when used to interact with the BCI. [Background technology]

[0002] In a traditional brain-computer interface (BCI), the BCI user generates intrinsic signals, exogenous signals, or a combination of signals to instruct the BCI. Intrinsic signals are typically signals generated internally by the human. Such intrinsic signals may include neural signals detected by sensors that measure electrical impulses that occur when a human produces a thought or moves a muscle (either through real or imagined movement in the case of a paralyzed human). Extrinsic signals include any signal measured or generated outside of the human that causes the human to take an action. For example, exogenous signals may include signals generated when a human triggers an external mechanism or electronic device (e.g., mouse click, screen touch / tap, keyboard click, voice command, etc.), signals received by inertial sensors that use inertia to detect physical movement of a human body part, etc. Signals are received using camera-type devices that detect the movement of a human body part (e.g., eye movement detectors, body movement detectors, etc.), sipping control, exhalation control (commonly used in wheelchairs), etc.

[0003] Many traditional BCI systems are limited because the signal generation is limited to one command to control the BCI system. In addition, many BCI control systems need to convert noise signals from humans into control signals. In many cases, traditional BCIs use one signal for one command or one degree of freedom. Therefore, in systems with fewer degrees of freedom (i.e., user-generated signals that can be used to generate multiple commands), multiple user-generated signals must be mapped to specific BCI commands. However, being able to predict different intentions of users to generate multiple user-generated signals (e.g., neural signals associated with left or right hand movements) based on spatial information is not trivial due to various mechanical, electrical, and physiological factors. This makes it a challenge for traditional BCI systems to provide reliable multi-degree-of-freedom control. As a result, many traditional BCI systems have reduced usability and reduced commercial viability of BCI systems that can assist potential users of BCI systems, especially severely disabled and partially paralyzed people who have few options in interacting with the world. Summary of the Invention [Problem to be solved by the invention]

[0004] Systems and methods of control using neural-related signals are disclosed, as are methods of using same. In embodiments in which the signal is a neural-related signal, such a signal may be any signal (e.g., electrical, biochemical) detectable from a biological medium, any one or more features extracted (e.g., via a computer processor) from a detected neural-related signal, or both, and the extracted features may be or include characteristic information about the patient's thoughts such that different thoughts can be distinguished from one another. Alternatively, the neural-related signal may be an electrical signal, any signal (e.g., biochemical signal) caused by an electrical signal, any one or more features extracted (e.g., via a computer processor) from a detected neural-related signal, or any combination thereof. The neural-related signal may be a neural signal, such as an electroencephalogram. In cases in which the biological medium is within the patient's skull, the neural-related signal may be, for example, a brain signal (e.g., detected from brain tissue) resulting from or resulting from the patient thinking a thought. Thus, the neural-related signal can be a brain-related signal, such as an electrical signal from any one or more portions of the patient's brain (e.g., motor cortex, sensory cortex). When the biological medium is outside the patient's skull, the neural-related signal can be, for example, an electrical signal associated with a muscle contraction (e.g., contraction of a body part, such as an eyelid, eye, nose, ear, finger, arm, toe, leg, etc.) that results from or is caused by the patient thinking a thought. A thought (e.g., a body part movement, memory, task) thought by the patient 8 when the neural-related signal is sensed from the patient's brain tissue can be the same as or different from a thought 9 thought by the patient 8 when the neural-related signal is sensed from non-brain tissue. The neural interface can be located inside the patient's brain, outside the brain, or both. [Means for solving the problem]

[0005] The methods and systems herein relate to interfacing humans and electronic devices. In one aspect, the linkage includes a brain-computer interface and the method includes providing a visual display to the human, the visual display including a timing indicator, an initial reference point, and a first identified cue point associated with a first command, the first identified cue point being spaced along the path a first distance from the initial reference point, the visual display configured to show the timing indicator moving along an entirety of the path starting at the initial reference point and terminating after a length of the path, the time of movement of the timing indicator over the first distance comprising a first duration; monitoring the human for a monitoring signal while displaying the visual display; establishing a first review portion of the monitoring signal starting from an initial time corresponding to when the timing indicator is at the initial reference point and ending after the first duration; evaluating the first review portion for a first evidence signal occurring within the first review portion; and issuing a first command to the brain-computer interface if the first evidence signal matches a first predetermined signal pattern.

[0006] In some aspects, the techniques described herein relate to a method, wherein the visual display further includes second identified cue points associated with a second command, the second identified cue points being spaced along the path a second distance from the initial reference point, the second distance being greater than the first distance, and a time of movement of the timing indicator over the second distance comprises a second duration, the method further comprising the steps of establishing a second review portion of the monitoring signal starting from the initial time and ending after the second duration, obtaining a second evidence signal occurring at the end of the second review portion, and issuing a second command to the brain-computer interface if the second evidence signal matches a second predetermined signal pattern.

[0007] Aspects of the systems and methods may include situations where the first and second predetermined signal patterns are similar, or alternatively, the first predetermined signal pattern may be different from the second predetermined signal pattern.

[0008] The systems and methods may also relate to a method of providing a visual display to a human that includes showing non-identified cue points spaced along a path from both an initial reference point and a first identified cue point.

[0009] The techniques described herein may also relate to a method further including associating a non-discriminating cue point with an add command.

[0010] Aspects of the system and method include a predetermined signal pattern compiled from one or more previously stored evidence signal patterns. Additionally, the method and system can include modifying the first predetermined signal pattern using a first evidence signal.

[0011] The techniques described herein may also relate to monitoring a human to obtain a monitoring signal by monitoring the human for a signal selected from the group consisting of an intrinsic neural signal from the human, an auditory signal from the human, a physical movement of a body part of the human, and a key selection by the human.

[0012] The signals described herein may comprise intrinsic neural signals, which are signals generated by neural implants within the human body configured to sense neural activity, such neural activity may include neural activity selected from the group consisting of positive thoughts, movement of a body part, and imagined movement of a body part.

[0013] In some embodiments, the technology described herein relates to a system for interfacing a human with an electronic device. For example, such interfacing can include control of a brain-computer interface, the system including an apparatus for monitoring the human and acquiring a monitoring signal over a predetermined period of time, a control system for recording the monitoring signal, and a display configured to provide a visual display to the human including a timing indicator, an initial reference point, and a first identified cue point associated with a first control command, the visual display indicating that the timing indicator moves along a path starting from the initial reference point and terminating after a length of the path, the movement of the timing indicator on the path occurring after a cycle time, and the first identified cue point being a first duration from the initial reference point to the first identified cue point. and a display spaced a first distance from the initial reference point along the path such that a time of travel of a timing indicator to a selected cue point corresponds to a time period determined by the human's input, the display being spaced a first distance from the initial reference point along the path such that a time period ...

[0014] In some aspects, the technology described herein relates to a system, wherein the display further includes second identified cue points associated with a second command, the second identified cue points spaced along the path a second distance from the initial reference point, the second distance being greater than the first distance, and a time of movement of the timing indicator over the second distance comprising a second duration, and the control system is configured to establish a second review portion of the monitoring signal starting from the initial reference point and ending after the second duration, obtain a second evidence signal occurring at the end of the second review portion, and issue a second command to the brain-computer interface if the second evidence signal matches a second predetermined signal pattern.

[0015] The subject matter disclosed herein is a novel method for producing a medicament for use in a medicament comprising the steps of: (a) administering to a subject a medicament a medicament for which the medicament has been administered; and (b) administering to a subject a medicament for which the medicament has been administered; U.S. Patent Application Publication No. 20200078195 published on March 12, 2020, U.S. Patent Application Publication No. 20190336748 published on November 7, 2019, U.S. Patent Application Publication No. 20200016396 published on January 16, 2020, U.S. Patent Application Publication No. 20210373665 published on December 2, 2021, U.S. Patent Application Publication No. 20210373665 published on November 4, 2021 U.S. Patent Application Publication No. 20210342004, published on May 13, 2021, U.S. Patent Application Publication No. 20210137542, published on November 25, 2021, and U.S. Patent Application Publication No. 20210365117, published on March 3, 2020, and U.S. Patent Application Publication No. 10575783, published on November 26, 2019. This disclosure is related to the following publications and patents, all of which are incorporated herein by reference in their entireties: U.S. Patent No. 1,141,584, issued on October 12, 2021; U.S. Patent No. 1,0729,530, issued on August 4, 2020; U.S. Patent No. 10,512,555, issued on December 24, 2019; and U.S. Patent No. 1,1093,038, issued on August 17, 2021. [Brief description of the drawings]

[0016] [Figure 1A] FIG. 1A is a diagram illustrating a human using an interface system described herein. [Figure 1B] FIG. 1B illustrates a configuration similar to that of FIG. 1A, except with a BCI driven by an exogenous signal. [Figure 2A]2A-2D are diagrams illustrating a human using an improved interface to interact with a control system such as a BCI. [Figure 2B] 2A-2D are diagrams illustrating a human using an improved interface to interact with a control system such as a BCI. [Figure 2C] 2A-2D are diagrams illustrating a human using an improved interface to interact with a control system such as a BCI. [Figure 2D] 2A-2D are diagrams illustrating a human using an improved interface to interact with a control system such as a BCI. [Diagram 3] FIG. 3 is a diagram illustrating an example of a method and system for interfacing a human with a control system, where a display shows a timing indicator moving on a path from an initial reference point, the path including a first identified cue point and a second identified cue point. [Figure 4A] 4A-4C show additional examples of displays having timing indicators that move along a changing path. [Figure 4B] 4A-4C show additional examples of displays having timing indicators that move along a changing path. [Figure 4C] 4A-4C show additional examples of displays having timing indicators that move along a changing path. [Figure 5A] 5A and 5B illustrate an additional embodiment of a system and method for interfacing a human with a control system. [Figure 5B] 5A and 5B illustrate an additional embodiment of a system and method for interfacing a human with a control system. [Figure 6A] 6A and 6B are diagrams illustrating a system in which a signal (eg, an intrinsic signal) contains a significant amount of noise. [Figure 6B] 6A and 6B are diagrams illustrating a system in which a signal (eg, an intrinsic signal) contains a significant amount of noise. [Figure 7A] 7A-7E illustrate another embodiment of an interface display having vector cursor control that is used to improve the ability of a paralyzed or severely motor-impaired individual to achieve robust and rapid multi-dimensional directional control of a cursor. [Figure 7B] 7A-7E illustrate another embodiment of an interface display having vector cursor control that is used to improve the ability of a paralyzed or severely motor-impaired individual to achieve robust and rapid multi-dimensional directional control of a cursor. [Figure 7C] 7A-7E illustrate another embodiment of an interface display having vector cursor control that is used to improve the ability of a paralyzed or severely motor-impaired individual to achieve robust and rapid multi-dimensional directional control of a cursor. [Figure 7D] 7A-7E illustrate another embodiment of an interface display having vector cursor control that is used to improve the ability of a paralyzed or severely motor-impaired individual to achieve robust and rapid multi-dimensional directional control of a cursor. [Figure 7E] 7A-7E illustrate another embodiment of an interface display having vector cursor control that is used to improve the ability of a paralyzed or severely motor-impaired individual to achieve robust and rapid multi-dimensional directional control of a cursor. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The drawings described are illustrative embodiments and are not intended to be limiting. Like reference numbers indicate identical or functionally equivalent elements throughout.

[0018] The present disclosure includes systems and methods for interfacing a human with a computer interface that controls one or more electronic devices. In one embodiment of such methods and systems, a human generates a signal to interact with an electronic system that controls one or more electronic devices. The signal may be an intrinsic or exogenous signal, as described herein. The systems and methods described herein increase the degrees of freedom associated with the signal, allowing the signal to be used to control or otherwise interact with a control system. Although the methods and systems described herein are described with respect to a BCI system, the methods and systems may be used with any electronic control system. In embodiments of the methods and systems, such electronic control systems are used to control any device, particularly any electronic device, mechanism with electronic control, and / or such device that is integrated with an electronic control system. The methods and systems described herein are also useful for controlling control systems that utilize noisy signal sources.

[0019] 1A is an illustrative diagram showing a human 2 using an interface system 100 as described herein. The illustrative diagram shows the use of the BCI system 100 with an improved interface display 110 to provide greater flexibility in using a single signal 20 to control one or more external devices 50.

[0020] FIG. 1A illustrates a human 2 with an implant 10 placed in the brain 4 (e.g., using the brain's blood vessels or directly in the brain tissue). The implant 10 senses electrical activity associated with brain activity. The BCI transmits the sensed electrical / brain activity via leads 12 to a control unit 14 that generates and / or transmits (wired or wirelessly) a signal 20 associated with the identified brain activity. In this embodiment, the signal is endogenous since the source of the signal is within the human's body. Any type of BCI can be used in conjunction with the improved interface disclosed herein. For example, further embodiments of the BCI can include a BCI system with external electrodes placed outside the human, electrodes implanted directly into the brain through the human's skull, and any type of combination of electrode placement configurations. Again, the disclosed methods and systems are not limited to BCI systems. Alternatively, the improved interface can be employed in any control system.

[0021] The system 100 includes a visual display 110 viewable by the human 2. As described below, the visual display 110 guides the human 2 to provide a signal 20 using a temporal pattern. Upon identifying the signal 20 and the temporal pattern, the BCI 100 issues a command 30 that can be delivered to one or more devices 50 coupled to the BCI 100. FIG. 1A further illustrates the devices 50, which may include human electronic devices 52 (e.g., a smart phone or electronic tablet), a mobility device 54 (e.g., an electronically controlled wheelchair), a computer 56, an electronic prosthesis (not shown), or other electronic devices. The visual display 110 may be separate from the device 50 or may be integrally incorporated into the device 50.

[0022] 1B illustrates a configuration similar to that of FIG 1A, but with a BCI driven by exogenous signals (i.e., an external device 30 generates the signals 22 used by the system 100). For example, the external device may consist of one or more of an external camera 32 (e.g., an eye or body motion tracking camera), a puff device 34, a keyboard or mechanical switch (36), a motion sensor 38, etc.

[0023] 2A-2D illustrate a human 2 using an improved interface to interact with a control system, such as a BCI. As shown, the human 2 is provided with a visual display 110 having a timing indicator 112 that moves along a path 114 that may include any number of switches or cue points 122, 124, 126, etc. As described below, the cue points 122, 124, 126 can provide visual indications to the human 2 to generate signals to execute commands of the control system.

[0024] In some embodiments of the interface, the timing indicator 112 repeats its movement on the path 114 after each cycle. In the example shown in FIG. 2A, the path 114 can be visible to the person 2 (e.g., a circle as shown). Alternatively, the timing indicator 112 can move along a path that is not displayed in a visible form on the display. FIG. 2A also illustrates the timing indicator 112 moving in a clockwise direction. However, in other embodiments, the timing indicator can move in a counterclockwise direction or alternately move after one or more cycles are completed. As described below, the path 114 can be continuous (e.g., a circle or any other closed shape) or can be discontinuous (e.g., a line or any other non-closed shape) as described below.

[0025] 2A-2D further illustrate a signal response graph 150 representing a signal generated by a human 2. As mentioned above, such monitoring signals may be either intrinsic, exogenous, or a combination thereof. In some embodiments, the signal response graph 150 is visually observable. However, the signal response graph 150 shown in FIGS. 2A-2D is intended to illustrate the use of temporal information with signal discrimination to increase the flexibility of the system. In this example, the signal response graph 150 shows signal magnitude 152 on the Y-axis and time 154 on the X-axis, with point 170 corresponding to the initial reference point 120 on the path 114 and points 172, 174 corresponding to cue points 122, 124, respectively.

[0026] FIG. 2A illustrates a timing indicator 112 at an initial reference point (120 shown in FIG. 2B) on a path 114. In this embodiment, a first identified cue point 124 is at the 3 o'clock position. This first identified cue point is associated with one or more commands to be delivered to the instrument (shown in FIGS. 1A and 1B). The first identified cue point is also spaced along the path a first distance from the initial reference point. As will be described below, this provides a temporal dimension. The visual display 110 shows the timing indicator 112 moving along the entirety of the path 114, beginning at the initial reference point 120 and ending after the length of the path. The movement of the timing indicator over the first distance constitutes a first duration that is analyzed by the system as will be described below.

[0027] As shown, the system is configured such that the first identified cue point 124 is visually identifiable to the human 2. In the diagram of FIG. 2A, the identified cue point 24 is shown as being cross-hatched or filled in. Additional markers 140 may be provided to make the identified cue point visible to the human. In contrast, the non-identified cue points 122 may remain unidentified or may be made apparent to the human 2 as not being identified cue points. In further aspects of the system and method, only the identified cue points are made visible and the non-identified cue points remain hidden. Obviously, the identified cue points may be provided in any number of forms, including but not limited to visual, auditory, electrical, tactile stimuli, and combinations thereof.

[0028] Also, for illustrative purposes only, FIG. 2A illustrates signal response graph 150 without showing the signal. FIG. 2B illustrates timing indicator 112 moving along path 114 toward identified cue point 124. Thus, signal response graph 150 shows monitored signal 18 (obtained by monitoring person 2), passing point 172 (corresponding to cue point 122), and approach point 174 (where display 110 indicates timing indicator 112 is approaching first identified cue point 124). Signal 18 is illustrated as a single line for illustrative purposes of this disclosure. In many systems, the monitored signal is noisy, as will be described below.

[0029] FIG. 2C illustrates an aspect where the timing indicator 112 crosses the first identified cue point 124, which instructs the human 2 to take an action. In the case of a BCI, as shown in FIG. 1A, such an action may include a thought generated by the patient 2 (e.g., a real or imagined muscle movement, a memory or task thought, etc.). In the case of an exogenous signal, as shown in FIG. 1B, the patient can take an action to initiate the signal (e.g., trigger an external device that generates a particular signal). As shown, the monitoring signal 18 changes at point 174, which corresponds to the time when the timing indicator 112 crosses the first identified cue point.

[0030] FIG. 2D illustrates the timing indicator 112 and associated evidence signal 24 passing through a first identified cue point 124. As discussed above, the evidence signal 24 not only comprises a unique profile, but also includes a temporal aspect in that it is spaced in time from a point 170 (corresponding to the initial reference point 120 on the path 114). The system then evaluates a portion of the monitored signal corresponding to the time that the timing indicator travels from the initial reference point 120 to (or just beyond) the first identified cue point 124. The system then evaluates that portion for evidence signal 24 occurring toward the end of this review portion. The system then compares this evidence signal 24 to predefined signal patterns, and if there is an acceptable match, the system can execute a command to any equipment associated with the first identified cue point. Note that the display 110 can continue to display the timing indicator 112 and continue to show it on the path 114 for the full cycle until the initial reference point 120 is reached. However, because the first identified cue point is the only cue point in this particular cycle, evaluation of signal 18 during that cycle stops.

[0031] FIG. 3 illustrates an example of a method and system for interfacing a human with a control system, where a display 110 shows a timing indicator 112 moving on a path 114 from an initial reference point 120, the path 114 including a first identified cue point 124 and a second identified cue point 130. In this example, three scenarios 60, 62, 64 are shown for issuing commands using the interface. As described herein, a human using the interface shown in the example of FIG. 3 can generate three different commands (command 1, command 2, command 3) using one signal generated by the human. For example, in the case of a BCI implanted in a human with little or no ability to move, the human can generate a thought to generate an electrical impulse, and this same thought can be used to issue one of three commands depending on the information on the display 110 and the timing of the thought. A human is informed that a distinct command is to be generated by issuing a signal at the first identified cue point 124, the second identified cue point 130, or at both identified cue points 124,130.

[0032] For example, in a first scenario 60, a human generates a signal at a first identified cue point 124, generating evidence signal 24. The system must wait until indicator 112 passes a second identified cue point 130, and since there is no additional signal, the system issues command 1. Similarly, in a second scenario 62, if the system observes evidence signal 26 at a time 180 corresponding to the second identified cue point 130, the system issues command 2. In a third scenario 64, the system identifies two evidence signals 24, 26 at the appropriate times 174, 180, generating command 3. As discussed above, the system compares evidence signals 24, 26 to predefined signal patterns to verify the human's intent to issue the appropriate command.

[0033] 4A-4C show additional examples of a display 110 having a timing indicator 112 that moves along a varying path 114, with multiple cue points 136 distributed along the path. As described herein, the outline of the path 114 can be hidden, so long as the timing indicator 112 follows its respective path. The initial reference point 120 can be arbitrary, so long as the signal is evaluated from the initial reference point 120 to the last identified cue point (the identified cue point is not shown in FIGS. 4A-4C). Additionally, the direction of the timing indicator 112 can be clockwise, counterclockwise, or change direction after each cycle. For example, in FIG. 4C, the path is a semicircular line, so the timing indicator 112 can reverse direction after moving along the path 114, or simply restart from the same initial reference point 120 after completing its movement on the path.

[0034] 5A and 5B illustrate an additional embodiment of a system and method for interfacing a human 2 with a control system. In these embodiments, an interface 110 includes two or more timing indicators 112, 113 that move along corresponding paths 114, 115. Each path 114, 115 includes any number of cue points with at least one cue point 124, 127 identified on each path 114, 115. However, each path 114, 115 is staggered such that the identified cue points 124, 127 may be selected by the user 2 at different times. In the example of FIG. 5A, both timing indicators 112, 113 start at the same time from corresponding initial reference points 120, 121. However, the cue points on path 115 are offset from path 114. Thus, the signal response graph 150 associated with path 114 has an offset time 174 from the signal response graph 151 associated with path 115. As shown, times 174,175 are offset relative to corresponding initial times 170,171.

[0035] 5B, paths 114, 115 are similar (e.g., the cue points are not staggered), but in this example, timing indicators 112, 114 begin at different times from corresponding initial reference points 120, 121. In the illustrated embodiment, timing indicator 113 lags timing indicator 112. Thus, signal response graph 151 associated with path 115 also lags signal response graph 150 associated with path 114.

[0036] 6A and 6B illustrate a system 100 in which the signal 20 (e.g., an intrinsic signal) contains a significant amount of noise. Ideally, when the patient generates the signal 20 at the appropriate time using the visual display 110, the system 100 compares the evidence signal 18 derived from the monitoring signal 20 and compares it to a predefined signal pattern 80, and if the evidence signal 18 sufficiently matches the predefined signal pattern (some margin of error allowed), the system 100 can ascertain the human's intent and issue an associated command by using any number of algorithms 70 to compare the signals.

[0037] In some BCI systems, the human generates signal patterns that include random noise that is associated with signals intentionally generated by the human 2. Factors that cause such noise include various mechanical, electrical, and physiological factors. To address this issue, the system 100 may include using one or more previous evidence signal patterns 18 to build and / or refine the predetermined signal pattern 80. As shown in FIG. 6B, during an initial setup of the system 100 or during a maintenance mode, the system may run multiple trials 90, each of which generates an evidence signal 18 and confirms the intent, and the system may then compile any number of evidence signals 18 to generate or modify the predetermined signal pattern.

[0038] Thus, the predetermined signal pattern is constructed from the pattern of the signal over many trials. Signal components of a noisy signal can be enhanced by averaging the trials. Signal "evidence" is accumulated over multiple trials. At each iteration as evidence is built, a mathematical model(s) can be used to predict the user's intent based on the evidence. Predictable signal characteristics occurring at specific cue points relative to a reference point can be modeled (e.g., to generate a template). The similarity between the template and the evidence can then be calculated to generate a metric. This metric can be passed to another mathematical model to determine what the user's intent was at the end of each trial window.

[0039] 7A-7E show another embodiment of an interface display 200 with a vector cursor control 210 used to improve the ability of a paralyzed or severely motor impaired human to achieve robust and fast multi-dimensional directional control of a cursor. The cursor control can be used with any device that has digital access (e.g., mouse, remote, spellers, vehicles, robotic prosthetics, hereafter, the example of mouse cursor control will be used for ease of understanding). As mentioned above, a human that can generate one discrete binary output via a brain-computer interface can use the vector cursor control 210. Furthermore, a human that has one-handed paralysis but can generate a reliable directional control signal via a modified joystick can combine the vector cursor 210 with an additional switch.

[0040] FIG. 7A illustrates a display 200 having a vector cursor 210, which consists of a cursor 212 and a directional vector indicator 214 that moves around the cursor 212. In the illustrated embodiment, the directional vector indicator 214 moves in a circular orbit 220 around the cursor. However, other additional patterns are within the scope of this disclosure. FIG. 7A illustrates a situation in which the vector cursor 210 is in a released configuration (e.g., the human controlling the vector cursor 210 has not triggered the system). FIG. 7A also illustrates three checkboxes 230, 232, 234 for illustrative purposes to show how a human might move the vector cursor 210 towards a desired area.

[0041] FIG. 7B illustrates a directional vector indicator 214 that moves as shown. Once the directional vector indicator 214 is in the desired position, the human activates a switch (as discussed above, the activation can be a mechanical switch or a neural signal). The switch analogy is utilized for scenarios where the user can only generate one binary output. A pressed switch state is one state of the binary output, and a lifted switch state is the other state of the binary output. The directional vector indicator 214 automatically rotates at a predefined speed around the cursor 212.

[0042] Once the switch is activated, Figure 7C illustrates a cursor 212 moving along the vector 240 that was established when the system was triggered (e.g., Figure 7B). As shown, the cursor 212 moves towards the selection box 230, and once the cursor is properly positioned (e.g., Figure 7D), the human releases the switch. Such release causes the vector cursor 210 to stop moving, and the directional vector indicator 214 continues to move around the cursor 212 in the path shown.

[0043] The vector cursor 210 can be coupled with various interaction mechanisms to generate actions at the point of the cursor 230 shown in Figures 7D and 7E. For example, when the cursor 212 is stationary or remains within a predefined radius for a predefined duration, an action occurs at the point of the cursor (e.g., left click, right click, double click, menu pop-up), as indicated by the checkmark 250. If there are additional discrete events that the user can generate, they can be used to perform one or more actions.

[0044] The claims are not limited to the exemplary embodiments shown in the drawings, but may instead claim any features disclosed or contemplated in the entire disclosure. Elements described herein as singular may be made plural (i.e., what is described as "one" may be made plural). Any species of a genus may have features or elements of other species of the genus. Some elements may be omitted from individual figures for clarity of illustration. The above-described structures, elements or complete assemblies, and methods and their elements for carrying out the present disclosure, as well as variations of the aspects of the present disclosure, may be combined and modified with each other in any combination, and each combination is expressly disclosed herein. All devices, apparatus, systems, and methods described herein may be used for medical purposes (e.g., diagnosis, treatment, or rehabilitation) or non-medical purposes. "May" and "can" are interchangeable (e.g., "may" can be replaced with "can" and "can" can be replaced with "may"). The disclosed ranges may include any subranges of the disclosed ranges. For example, the range of 1 to 10 units can include 2 to 10 units, 8 to 10 units, or any other subrange. A phrase containing the construction "A and / or B" can mean (1) A alone, (2) B alone, (3) A and B together, or any combination of (1), (2), and (3), such as (1) and (2), (1) and (3), (2) and (3), and (1), (2), and (3).For example, the sentence “the module 10 (e.g., the host device 16) can communicate wired and / or wirelessly with one or more end applications 12” in this disclosure may mean: (1) the module 10 (e.g., the host device 16) can communicate wired with one or more end applications 12; (2) the module 10 (e.g., the host device 16) can communicate wirelessly with one or more end applications 12; (3) the module 10 (e.g., the host device 16) can communicate wired and wirelessly with one or more end applications 12; or any combination of (1), (2), and (3) is possible.

Claims

1. 1. A method for interfacing a human with a brain-computer interface, comprising: providing a visual display to the human, the visual display including a timing indicator, an initial reference point, and a first identified cue point associated with a first command, the first identified cue point being spaced along a path a first distance from the initial reference point, the visual display configured to indicate that the timing indicator moves along the entire path starting from the initial reference point and terminating after a length of the path, and a time of movement of the timing indicator over the first distance comprising a first duration; monitoring the person for a monitoring signal while displaying the visual display; establishing a first review portion of the monitor signal beginning at an initial time corresponding to when the timing indicator is at the initial reference point and ending after the first time duration; evaluating the first review portion for first evidence signals occurring within the first review portion; and issuing the first command to the brain-computer interface if the first evidence signal matches a first predetermined signal pattern.

2. the visual display further includes second identified cue points associated with a second command, the second identified cue points being spaced along the path a second distance from the initial reference point, the second distance being greater than the first distance, and a time for movement of the timing indicator over the second distance comprising a second duration; establishing a second review portion of the monitor signal beginning at the initial time and ending after the second duration; obtaining a second evidence signal occurring at the end of the second review portion; 2. The method of claim 1, further comprising: issuing the second command to the brain-computer interface if the second evidence signal matches a second predetermined signal pattern.

3. The method of claim 2 , wherein the first predetermined signal pattern and the second predetermined signal pattern are similar.

4. The method of claim 2 , wherein the first predetermined signal pattern is different from the second predetermined signal pattern.

5. 2. The method of claim 1, wherein providing the visual display to the human includes showing non-identified cue points spaced along the path from both the initial reference point and the first identified cue point.

6. The method of claim 1 further comprising associating a non-discriminating cue point with an add command.

7. The method of claim 1 , wherein the first predetermined signal pattern is compiled from one or more previously stored evidence signal patterns.

8. The method of claim 1 , further comprising the step of using the first evidence signal to modify the first predetermined signal pattern.

9. 10. The method of claim 1, wherein monitoring the human to obtain the monitoring signal comprises monitoring the human for signals selected from the group consisting of intrinsic neural signals from the human, auditory signals from the human, physical movements of body parts of the human, and key selections by the human.

10. 10. The method of claim 9, wherein the intrinsic neural signals comprise signals generated by a neural implant within the human body configured to sense neural activity.

11. 11. The method of claim 10, wherein the neural activity comprises neural activity selected from the group consisting of positive thinking, movement of a body part, and imaginal movement of a body part.

12. The method of claim 1 , wherein the timing indicator moves continuously along the path on the visual display.

13. A system for human control of a brain-computer interface, comprising: a device for monitoring a human and acquiring monitoring signals over a predetermined period of time; a control system for recording the monitoring signals; a display configured to provide the human with a visual display including a timing indicator, an initial reference point, and a first identified cue point associated with a first control command, the visual display indicating that the timing indicator moves along a path starting at the initial reference point and terminating after a path length, the movement of the timing indicator on the path occurring after a cycle time, the first identified cue point being spaced a first distance from the initial reference point along the path such that a first duration comprises a time of movement of the timing indicator from the initial reference point to the first identified cue point; The control system includes: selecting an evidence signal from the monitor signal by selecting a portion of the monitor signal that begins when the timing indicator is at the initial reference point; evaluating the evidence signal for a first predetermined signal pattern occurring a first duration from a start of the evidence signal; 1. A system for a human to control a brain-computer interface, configured to generate a first confirmation signal to the brain-computer interface only if the first predetermined signal pattern is identified during evaluation of the evidence signal, the first confirmation signal confirming selection of the first control command by the human.

14. the visual display further includes second identified cue points associated with a second command, the second identified cue points being spaced along the path a second distance from the initial reference point, the second distance being greater than the first distance, and a time for movement of the timing indicator over the second distance comprising a second duration; The control system includes: establishing a second review portion of the monitor signal beginning at the initial reference point and ending after the second time duration; obtaining a second evidence signal occurring at the end of the second review portion; 14. The system of claim 13, configured to issue the second command to the brain-computer interface if the second evidence signal matches a second predetermined signal pattern.

15. The system of claim 13 , wherein the control system is configured to compile the first predetermined signal pattern from one or more previously stored evidence signal patterns.

16. 14. The system of claim 13, wherein the monitored signal comprises a signal selected from the group consisting of an intrinsic neural signal from the human, an auditory signal from the human, a physical movement of a body part of the human, and a key selection by the human.

17. 17. The system of claim 16, wherein the intrinsic neural signals comprise signals generated by a neural implant within the human body configured to sense neural activity.

18. 20. The system of claim 17, wherein the neural activity comprises neural activity selected from the group consisting of positive thinking, movement of a body part, and imaginal movement of a body part.

19. 14. The system of claim 13, wherein the display is configured such that the timing indicator moves continuously along the path on the visual display.

Images