Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium

Abstract

A rehabilitation training method and apparatus for unilateral spatial neglect, a device, and a storage medium. The method comprises: controlling multiple graphic symbols to flicker randomly at different flickering frequencies; collecting a first SSVEP signal when a user gazes; when it is determined that the user's attention is sufficiently focused, control at least two target graphic symbols to move in a specific movement direction and at a specific movement speed within the user's unilateral visual neglect space range; then acquiring a second SSVEP signal when the user gazes; and when it is determined that the user is focusing attention on completing a training task, control an electrical stimulator placed on the user's neck to send a transcutaneous electrical nerve stimulation signal. Thus, whether a subject's attention is sufficiently focused can be determined before training, and when it is determined that the subject is effectively gazing at the training content, an instruction is issued to provide an electrical stimulation signal, thereby forming a closed loop; the effectiveness of training can be ensured, the training effect can be improved, and popularization in patients with unilateral spatial neglect is facilitated.

Description

Unilateral space neglect rehabilitation training method and device, equipment and storage medium TECHNICAL FIELD

[0001] The application belongs to the technical field of brain-computer interface, and particularly relates to a unilateral space neglect rehabilitation training method and device based on a brain-computer interface, equipment and a storage medium. BACKGROUND

[0002] Unilateral space neglect (USN) is a common dysfunction after stroke, and patients often show that they cannot pay attention to the stimulation on the contralateral side of the lesion, and have problems such as visual, auditory and tactile neglect. Clinically, about 28.6% of stroke patients will have unilateral space neglect symptoms of different degrees, and the most common one is left visual neglect after right dominant hemisphere injury. Usually, the patient's vision, eye movement and visual field are normal, but due to attention disorder, the patient often "sees but does not see" the things on the contralateral side of the damaged brain area. USN is essentially a complex cognitive dysfunction, which not only affects the patient's spatial attention, but also seriously affects the patient's rehabilitation compliance and the recovery of other functions such as cognition and movement. At present, unilateral neglect has been listed as one of the independent risk factors for predicting the prognosis of stroke.

[0003] Brain-computer interface (BCI) technology is a kind of human-computer interaction technology that can establish a direct communication and control channel between the brain and the computer or other electronic devices, which can enhance the interaction between patients with motor dysfunction and the outside world, and is more and more widely used in the fields of neural engineering, rehabilitation and brain science. According to the difference of the way of obtaining electroencephalogram signal, BCI is divided into invasive and non-invasive, among which, based on steady-state visual evoked potentials (SSVEP) and motor imagination is the most widely used non-invasive BCI system at present.

[0004] The BCI system based on SSVEP usually determines the focus target through the frequency information obtained from the electroencephalogram signal induced by periodic visual stimulation. Motor imagination refers to the activation of a specific brain area of a person when the person imagines the movement of his limbs or muscles but there is no actual movement output. The BCI system based on motor imagination can read the subjective movement consciousness of the user, identify the specific electroencephalogram changes induced by different tasks to determine the movement intention of the user, and realize the control of the periphery from the central level.

[0005] The existing BCI system applied to USN rehabilitation training is mostly a BCI system based on motor imagery only, that is, whether the subject successfully imagines the set content is captured to execute the preset program to give feedback. The subject's attention and understanding are required very high, the training effect is poor, and the system cannot be popularized for patients with unilateral spatial neglect. SUMMARY

[0006] The purpose of the present application is to provide a unilateral spatial neglect rehabilitation training method and device, equipment and storage medium, which can ensure the effectiveness of the training, improve the training effect, and facilitate the popularization for patients with unilateral spatial neglect.

[0007] The first aspect of the present application discloses a unilateral spatial neglect rehabilitation training method, comprising:

[0008] controlling a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on the display;

[0009] collecting a first steady-state visual evoked potential signal of the user gazing at the display, and determining whether the user's attention is concentrated enough according to the first steady-state visual evoked potential signal;

[0010] when it is determined that the user's attention is concentrated enough, controlling at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of unilateral visual neglect of the user, wherein the specific moving direction is from the healthy side to the neglected side, and the target pattern symbol is any pattern symbol in the plurality of pattern symbols;

[0011] acquiring a second steady-state visual evoked potential signal when the user gazes at the target pattern symbol, and determining whether the user concentrates attention to complete the training task according to the second steady-state visual evoked potential signal;

[0012] when it is determined that the user concentrates attention to complete the training task, controlling an electric stimulator placed on the neck of the user to emit a transcutaneous nerve electric stimulation signal, wherein the electric stimulator is located on the neglected side of the user.

[0013] In some embodiments, before controlling at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of unilateral visual neglect of the user, the method further comprises:

[0014] acquiring the maximum displacement of the eyeball of the user during reading a single line of moving example text on the display;

[0015] determining a critical line of unilateral visual neglect of the user according to the maximum displacement, and determining a spatial range of unilateral visual neglect of the user according to the critical line.

[0016] In some embodiments, before the at least two target pattern symbols on the display are controlled to move in a specific moving direction and at a specific moving speed within the spatial range of the user's unilateral visual neglect, the method further comprises:

[0017] acquiring an average eye movement speed of the user's eyeball during reading a single-line moving example text on the display;

[0018] determining the specific moving speed according to the average eye movement speed.

[0019] In some embodiments, determining whether the user's attention is sufficiently concentrated according to the first steady-state visual evoked potential signal comprises:

[0020] decoding and classifying the first steady-state visual evoked potential signal to obtain a first classification label;

[0021] comparing the first classification label with a preset label to obtain a classification accuracy of the user;

[0022] when the classification accuracy reaches a specified proportion, determining that the user's attention is sufficiently concentrated.

[0023] In some embodiments, determining whether the user concentrates attention to complete a training task according to the second steady-state visual evoked potential signal comprises:

[0024] decoding and classifying the second steady-state visual evoked potential signal to obtain a second classification label;

[0025] when the second classification label is the same as a prompt label corresponding to the target pattern symbol, determining that the user concentrates attention to complete the training task.

[0026] The second aspect of the present application discloses a unilateral spatial neglect rehabilitation training device, comprising:

[0027] a test unit configured to control a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on a display;

[0028] a first acquisition unit configured to acquire a first steady-state visual evoked potential signal of the user's gaze on the display;

[0029] a first determination unit configured to determine whether the user's attention is sufficiently concentrated according to the first steady-state visual evoked potential signal;

[0030] a training unit configured to control at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of the user's unilateral visual neglect when it is determined that the user's attention is sufficiently concentrated, wherein the specific moving direction is from a healthy side to a neglected side, and the target pattern symbol is any of the plurality of pattern symbols.

[0031] a second acquisition unit, configured to acquire a second steady-state visual evoked potential signal when the user gazes at the target pattern symbol;

[0032] a second determination unit, configured to determine whether the user concentrates on the training task according to the second steady-state visual evoked potential signal;

[0033] an electrical stimulation unit, configured to control an electrical stimulator placed on the neck of the user to send a transcutaneous nerve electrical stimulation signal when it is determined that the user concentrates on the training task, wherein the electrical stimulator is located on the side ignored by the user.

[0034] In some embodiments, the device further comprises:

[0035] a first acquisition unit, configured to acquire a maximum displacement of the eyeball of the user when reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range ignored by the unilateral vision of the user;

[0036] a range determination unit, configured to determine a critical line ignored by the unilateral vision of the user according to the maximum displacement, and determine the spatial range ignored by the unilateral vision of the user according to the critical line.

[0037] In some embodiments, the device further comprises:

[0038] a second acquisition unit, configured to acquire an average saccadic velocity of the eyeball of the user when reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range ignored by the unilateral vision of the user;

[0039] a speed determination unit, configured to determine the specific moving speed according to the average saccadic velocity.

[0040] A third aspect of the present application discloses an electronic device, comprising a memory storing executable program codes and a processor coupled with the memory; the processor invokes the executable program codes stored in the memory, and is configured to execute the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.

[0041] A fourth aspect of the present application discloses a computer readable storage medium, which stores a computer program, wherein the computer program causes a computer to execute the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.

[0042] The beneficial effect of the present application is that by controlling the multiple positions of the multiple pattern symbols on the display to randomly flash at different flashing frequencies, the first steady-state visual evoked potential signal of the user's gaze on the display is collected to determine whether the user's attention is concentrated enough; when the user's attention is concentrated enough, at least two target pattern symbols on the display are controlled to move in a specific moving direction at a specific moving speed within the spatial range of the user's unilateral visual neglect; wherein the specific moving direction is from the healthy side to the neglected side, and the target pattern symbol is any pattern symbol in the multiple pattern symbols; then the second steady-state visual evoked potential signal of the user's gaze on the target pattern symbol is obtained to determine whether the user concentrates attention to complete the training task; when the user concentrates attention to complete the training task, the electric stimulator placed on the user's neck emits a transcutaneous nerve electric stimulation signal, wherein the electric stimulator is located on the side neglected by the user, so that it can be determined whether the subject's attention is concentrated enough before training, and after ensuring that the subject effectively gazes at the training content, an instruction is immediately given to emit a transcutaneous nerve electric stimulation signal to stimulate the user's neck, forming a closed loop, which can ensure the effectiveness of the training and improve the training effect, facilitating the popularization of the method for unilateral spatial neglect patients. BRIEF DESCRIPTION OF DRAWINGS

[0043] The drawings herein show specific examples of the technical solutions described in the present application and constitute part of the specification together with the specific embodiments, for explaining the technical solutions, principles and effects of the present application.

[0044] Unless specifically stated or defined otherwise, the same reference signs in different drawings represent the same or similar technical features, and different reference signs may also be used to represent the same or similar technical features.

[0045] Fig. 1 is a flowchart of a unilateral spatial neglect rehabilitation training method disclosed by an embodiment of the present application;

[0046] Fig. 2 is an architectural diagram of a unilateral spatial neglect rehabilitation training system disclosed by an embodiment of the present application;

[0047] Fig. 3 is a structural schematic diagram of a unilateral spatial neglect rehabilitation training device disclosed by an embodiment of the present application;

[0048] Fig. 4 is a structural schematic diagram of an electronic device disclosed by an embodiment of the present application.

[0049] Explanation of reference signs:

[0050] 301, test unit; 302, first acquisition unit; 303, first judgment unit; 304, training unit; 305, second acquisition unit; 306, second judgment unit; 307, electric stimulation unit; 401, memory; 402, processor. DETAILED DESCRIPTION

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. In the case of conflict between the present description and the technical and scientific terms as understood by those skilled in the art, the present description will control. All the technical and scientific terms used herein can have the same meaning as the purpose of implementing the technical solutions of the present application. The terms "first, second" used herein are only used to distinguish the names and do not represent the specific quantity or order. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0052] It should be noted that when an element is considered to be "fixed" to another element, it can be directly fixed to the other element or there can be a middle element; when an element is considered to be "connected" to another element, it can be directly connected to the other element or there can be a middle element; when an element is considered to be "mounted" to another element, it can be directly mounted to the other element or there can be a middle element. When an element is considered to be "provided" to another element, it can be directly provided to the other element or there can be a middle element.

[0053] Unless otherwise specified or defined, "the", "this" used herein refers to the technical features or technical contents mentioned or described before the corresponding position, which can be the same as or similar to the technical features or technical contents mentioned. In addition, the terms "include" and "have" used herein and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units not listed, or optionally includes other steps or units inherent to the process, method, product or device.

[0054] The embodiment of the present application discloses a unilateral space neglect rehabilitation training method, which can be realized by computer programming. The execution subject of the method can be an electronic device such as a computer, a notebook computer, a tablet computer, or a unilateral space neglect rehabilitation training device embedded in the electronic device, and the present application does not limit this. In order to facilitate the understanding of the present application, the specific embodiments of the present application will be described in more detail with reference to the drawings of the specification.

[0055] As shown in FIG. 1, the method includes the following steps 110-150:

[0056] 110, control a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on a display.

[0057] In the embodiment of the present application, a unilateral space neglect rehabilitation training system is provided, as shown in FIG. 2, which comprises a computer, an electroencephalogram device, an LED display screen and a transcutaneous nerve electrical stimulator, wherein the computer is in communication connection with the electroencephalogram device, the LED display screen and the transcutaneous nerve electrical stimulator respectively, the electroencephalogram device is arranged in a cap shape and can be worn on the head of a user, the LED display screen is arranged within the visual range of the user and is used for outputting a visual motion stimulus signal, and the transcutaneous nerve electrical stimulator comprises an electrode and is arranged on the trapezius muscle of the user on the side close to the visual neglect side of the user for outputting an electrical stimulus signal. The computer is embedded with a computer execution program for executing the unilateral space neglect rehabilitation training method provided by the present application.

[0058] 120, collect a first steady-state visual evoked potential signal of the user's gaze on the display, and determine whether the attention of the user is concentrated enough according to the first steady-state visual evoked potential signal.

[0059] In the embodiment of the present application, before the rehabilitation training is performed, it is necessary to determine whether the attention of the user is concentrated. Specifically, a plurality of pattern symbols (such as dots, triangular symbols, etc.) are arranged in a screen, different flashing frequencies are assigned to each pattern symbol, the positions of the pattern symbols are fixed, and in the process of controlling the plurality of positions of the pattern symbols on the display to randomly flash at different flashing frequencies, the pattern symbol at the position of each pattern symbol is randomly changed to red to prompt the user to concentrate attention on the pattern symbol and feel the flashing. In this way, after all the pattern symbols are prompted, the system automatically processes the collected first SSVEP signal and determines whether the attention of the user is concentrated enough according to the first SSVEP signal. Specifically, the determination of whether the attention of the user is concentrated enough can include the following steps S11-S13 which are not shown in the figure:

[0060] S11, decode and classify the first steady-state visual evoked potential signal to obtain a first classification label.

[0061] S12, compare the first classification label with a preset label to obtain a classification accuracy of the user.

[0062] S13, when the classification accuracy reaches a specified proportion, it is determined that the attention of the user is concentrated enough.

[0063] In the embodiment of the present application, the first SSVEP signal is decoded and classified, the obtained first classification label is compared with a preset label, and the classification accuracy of the user in the determination of whether the attention is concentrated is obtained. It is generally considered that the classification accuracy is greater than or equal to 80%, which proves that the attention of the user is concentrated enough, and the degree of concentration of the attention of the user can be trained subsequently. Otherwise, if the classification accuracy is less than 80%, it is indicated that the attention of the user is not concentrated enough, and the subsequent training cannot be performed, and the process is ended.

[0064] The specific SSVEP signal decoding method is as follows:

[0065] The filter bank canonical correlation analysis (FBCCA) decoding method is adopted, including filter bank analysis, canonical correlation analysis (CCA) processing and target recognition. First, the SSVEP signal is decomposed into N sub-band components using different band-pass filters . Among them, different sub-band components correspond to different harmonic frequencies of the SSVEP signal, and the number of sub-band components is the number of harmonics of the SSVEP signal. Secondly, according to the flicker frequency corresponding to each sub-band component, the sine and cosine reference signals of each sub-band component are calculated , and the correlation vector corresponding to each sub-band component is calculated . Among them represents the number, and the correlation vector is composed of correlation coefficients corresponding to the flicker frequency .

[0066] The relationship between the sine and cosine reference signals and the flicker frequency is:

[0067] ;

[0068] Among them indicates the number of harmonics, indicates the number of sampling points in the harmonic, and the number of sampling points = sampling frequency x sampling time. Generally, the sampling frequency is 1000 Hz, and the sampling time is set according to the experiment. The correlation vector of each sub-band component is composed of correlation coefficients

[0069] ;

[0070] Among them represents the correlation coefficient of and . The sum of the square of the correlation vector of each sub-band component and the corresponding weight coefficient constitutes the EEG signal feature corresponding to the overall SSVEP signal .

[0071] ;

[0072] Among them indicates the A sub-band component, a weight coefficient corresponding to a correlation coefficient of each sub-band component Can be expressed as:

[0073] ;

[0074] And Is a constant.

[0075] Finally, the electroencephalogram feature of the SSVEP signal Is a vector of one row and k columns, and k is the index of the target. The electroencephalogram feature is extracted After that, a two-class classification of the SSVEP electroencephalogram feature is realized by using an artificial neural network model in machine learning, that is, the electroencephalogram feature Is input into a pre-trained artificial neural network model, and a classification label (vector The value corresponding to the maximum value in the vector Is the classification label obtained by classification), and the flicker frequency corresponding to the classification label is the frequency of the target stimulus :

[0076] ;

[0077] 130. When it is determined that the user's attention is sufficiently concentrated, control at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range ignored by the user's unilateral vision.

[0078] Wherein, the specific moving direction is from the healthy side to the ignored side, that is, from the side not ignored by the user to the side ignored by the user; and the target pattern symbol is any pattern symbol in the plurality of pattern symbols.

[0079] Before step 130 is performed, the method further includes the following non-illustrated steps S21-S23:

[0080] S21. Obtain the maximum displacement and average eye movement speed of the eyeball during the user reading a single line of moving example text on the display.

[0081] Specifically, the video nystagmus electrograph can be used to measure the movement speed and maximum displacement of the eyeball when the user reads the example text. Wherein, the maximum displacement is measured to determine the critical line of the user's visual neglect, and when the maximum displacement of the user's eyeball is determined, the average movement speed of the eyeball from the start of movement to the critical line is calculated as the average eye movement speed according to the movement speed of the eyeball when the user reads the example text.

[0082] Generally, before the determination, the user's preset ignored side can be obtained, for example, if it is known that the user is left visual space ignored according to the clinical symptom response, then the user's preset ignored side can be obtained based on the human-computer interaction mode, for example, the left side, and the healthy side is the right side. During the determination, the single line moving example text moves to the direction from the healthy side to the ignored side. Specifically, during the test, the user sits, faces the display, and keeps the line of sight at the same level as the screen. The visual eye movement speed and displacement of the user reading the single line moving example text on the computer display screen are measured by using a video eye movement meter (Visual Eyes) to determine the critical line of the user's visual neglect. The vertical line on the display at the maximum displacement and perpendicular to the moving path of the single line moving example text is the critical line.

[0083] S22, determining the critical line of the user's unilateral visual neglect according to the maximum displacement, and determining the spatial range of the user's unilateral visual neglect according to the critical line.

[0084] The critical line divides the display vertically into two parts, and the part close to the user's preset ignored side is determined as the spatial range of the user's unilateral visual neglect. For example, if the user's preset ignored side is the left side, the critical line divides the display vertically into left and right parts, and the left part of the display is determined as the spatial range of the user's unilateral visual neglect.

[0085] S23, determining the specific moving speed according to the average eye movement speed.

[0086] In the embodiment of the present application, the determined average eye movement speed can be directly used as the specific moving speed of the visual stimulation symbol in the subsequent brain-computer interface training, or the average eye movement speed can be calculated according to a certain proportion to obtain the specific moving speed, for example, 80%, 90% or 110% of the average eye movement speed is taken as the specific moving speed.

[0087] Specifically, in step 130, the specific moving direction and the specific moving speed are used to control the movement of the at least two target pattern symbols on the display within the spatial range of the user's unilateral visual neglect. For example, the at least two target pattern symbols on the display are controlled to move uniformly from the healthy side to the ignored side within the spatial range, for example, at an eye movement (eye movement) speed of 30-120° / s.

[0088] In the embodiment of the present application, the design of the stimulation interface is completed by programming using MATLAB software. Specifically, the display simultaneously displays two pattern symbols with a diameter of 5 cm, which are arranged longitudinally on the critical line ignored by the user's vision, one of which is fixed, and the other moves uniformly from the healthy side to the ignored side. When the pattern symbol moves to the boundary of the display, it starts to circulate from the original point. The speed and range of the movement of the pattern symbol are set according to the average eye movement speed and the ignored spatial range of the user, and the longitudinal arrangement order of the two pattern symbols appears randomly.

[0089] 140. Acquire the second steady-state visual evoked potential signal when the user fixates on the target pattern symbol, and determine whether the user concentrates on the training task according to the second steady-state visual evoked potential signal.

[0090] The specific implementation of determining whether the user concentrates on the training task according to the second steady-state visual evoked potential signal is: decoding and classifying the second steady-state visual evoked potential signal to obtain a second classification label; when the second classification label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user concentrates on the training task.

[0091] The way of decoding and classifying the second steady-state visual evoked potential signal is the same as the way of decoding and classifying the first steady-state visual evoked potential signal, which is not repeated here.

[0092] 150. When it is determined that the user concentrates on the training task, control the electric stimulator placed on the user's neck to send a transcutaneous nerve electrical stimulation signal, wherein the electric stimulator is located on the ignored side of the user.

[0093] Specifically, before the BCI training starts, the user is ensured to be in a state of wakefulness, can receive test questions on the auditory or visual level, and the body is in a relaxed state, the eyes are straight at the display end, and the patient is required to move the eyeball to follow the bright spot as much as possible, and keep the head still. A relatively quiet test environment is selected to start the test task. First, the test instruction voice version is played, and at the same time, the user interaction interface "please fixate on the moving pattern symbol" is presented on the display end. After the playing of the voice instruction is finished, a 2s waiting time is set, and then the display appears the fixed and moving pattern symbol interface for 5s, so that the user fixates on the pattern symbol, fully experiences the target motion stimulation, and records the brain electrical signal of the user during the test by using the brain electrical signal recording device. The recorded brain electrical signal is transmitted to the computer end and the stimulation device end in real time. After the target pattern symbol selected by the user is determined by using the related algorithm, transcutaneous nerve electrical stimulation (TENS) is given to the neck of the ignored side, and somatosensory feedback is provided for the subject.

[0094] The user gazes at the moving pattern symbol on the computer screen, and the EEG signal recording device records the user's EEG signal during the test, and the relevant algorithm determines the user's attention to the target pattern symbol. In the hardware device part, the Synamps2 EEG recording system of Neuroscan Company is used for EEG signal acquisition and recording, and the 64-electrode cap included in the system meets the improved international 10-20 standard. A display with a resolution of 1920 × 1080 and a refresh rate of 60 Hz is used for the stimulation interface presentation. In addition, audio and video recording equipment are also required, and the audio or video recording equipment is kept on throughout the test, saving the audio or video files and recorded EEG signals.

[0095] In the programming and data transmission environment part, the display of the user interaction stimulation interface is coded by the Psychtoolbox psychological toolbox under MATLAB software, and the network environment is built by establishing a local area network connection between the stimulation computer and the acquisition device. The TCP / IP protocol is set to realize the real-time transmission of EEG data from the acquisition end to the stimulation device.

[0096] In the data acquisition and transmission process, the user wears the electrode cap, connects the electrode cap with the amplifier section of the EEG recording instrument, applies conductive paste to the corresponding electrode position to reduce the impedance to below 10kΩ and keep it stable, then displays the test stimulation interface, establishes the data transmission environment, and at the same time the data acquisition end starts to record the user's EEG data during the test task. The sampling rate is set to 1000 Hz during recording, and 50 Hz notch wave is used to remove power frequency interference.

[0097] Finally, feedback is given to the user according to whether the user completes the attention concentration task.

[0098] When the user can concentrate on the task and complete the gaze task, the computer recognizes the attention success signal according to the EEG signal, and sends a command to the TENS device to control the electric stimulator to send a transcutaneous nerve electric stimulation signal. The frequency of the transcutaneous nerve electric stimulation signal is set to 100 Hz, the pulse time is set to 100 us, and the average intensity is set to 0.5 uA / mm.

[0099] If the user cannot concentrate on the task and complete the training task, a voice prompt or manual guidance can be given. Finally, the number of times the user completes the attention tracking task and the user's personal information are presented on the interface to complete the test.

[0100] In summary, the embodiment of the present application converts the visual motor training method based on the SSVEP-BCI, which can be completed by only the user's gaze, can perceive the neglected visual space through the training of the user's visual tracking function, and can perceive the neglected body feeling through the somatosensory stimulation provided by the TENS. The stimulation is provided from the central and peripheral levels at the same time, forms a closed loop of neural rehabilitation, and ensures the effectiveness of the training.

[0101] The present application can guarantee the effectiveness of attention by decoding the user's attention based on the SSVEP and motor imagery-BCI, and can connect the visual motor stimulation technology and the TENS stimulation by using the BCI system to form a closed-loop training mode, integrate the active and passive attention, and train in two channels at the same time by the closed-loop BCI to improve the training effect.

[0102] As shown in FIG. 3, the embodiment of the present application discloses a unilateral spatial neglect rehabilitation training device, which comprises a test unit 301, a first acquisition unit 302, a first judgment unit 303, a training unit 304, a second acquisition unit 305, a second judgment unit 306, and an electric stimulation unit 307.

[0103] The test unit 301 is configured to control a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on a display.

[0104] The first acquisition unit 302 is configured to acquire a first steady-state visual evoked potential signal of the user's gaze on the display.

[0105] The first judgment unit 303 is configured to determine whether the user's attention is concentrated enough according to the first steady-state visual evoked potential signal.

[0106] The training unit 304 is configured to control at least two target pattern symbols on the display to move in a specific moving direction at a specific moving speed within the spatial range of the user's unilateral visual neglect when the first judgment unit 303 determines that the user's attention is concentrated enough, wherein the specific moving direction is from the healthy side to the neglected side, and the target pattern symbol is any pattern symbol in the plurality of pattern symbols.

[0107] The second acquisition unit 305 is configured to acquire a second steady-state visual evoked potential signal of the user's gaze on the target pattern symbol.

[0108] The second judgment unit 306 is configured to determine whether the user completes the training task by concentrating attention according to the second steady-state visual evoked potential signal.

[0109] The electric stimulation unit 307 is configured to control the transcutaneous nerve electric stimulator placed on the user's neck to emit a transcutaneous nerve electric stimulation signal when the second judgment unit 306 determines that the user completes the training task by concentrating attention, wherein the electric stimulator is located on the neglected side of the user.

[0110] As an optional implementation, the training device further comprises the following units not shown in the figure:

[0111] The first acquisition unit is configured to acquire the maximum displacement of the eyeball of the user in the process of reading the single-line moving example text on the display before the training unit 304 controls the at least two target pattern symbols on the display to move in the specific moving direction and at the specific moving speed within the spatial range of the unilateral visual neglect of the user.

[0112] The range determination unit is configured to determine the critical line of the unilateral visual neglect of the user according to the maximum displacement, and determine the spatial range of the unilateral visual neglect of the user according to the critical line.

[0113] As an optional implementation, the training device further comprises the following units not shown in the figure:

[0114] The second acquisition unit is configured to acquire the average saccadic velocity of the eyeball of the user in the process of reading the single-line moving example text on the display before the training unit 304 controls the at least two target pattern symbols on the display to move in the specific moving direction and at the specific moving speed within the spatial range of the unilateral visual neglect of the user.

[0115] The speed determination unit is configured to determine the specific moving speed according to the average saccadic velocity.

[0116] Further optionally, the first judgment unit 303 comprises the following sub-units not shown in the figure:

[0117] The first decoding sub-unit is configured to decode and classify the first steady-state visual evoked potential signal to obtain a first classification label.

[0118] The comparison sub-unit is configured to compare the first classification label with a preset label to obtain a classification accuracy of the user.

[0119] The first determination sub-unit is configured to determine that the attention of the user is concentrated enough when the classification accuracy reaches a specified proportion.

[0120] Further optionally, the second determination unit 306 comprises the following sub-units not shown in the figure:

[0121] The second decoding sub-unit is configured to decode and classify the second steady-state visual evoked potential signal to obtain a second classification label.

[0122] The second determination sub-unit is configured to determine that the user concentrates attention to complete the training task when the second classification label is the same as the prompt label corresponding to the target pattern symbol.

[0123] As shown in FIG. 4, an electronic device according to an embodiment of the present application includes a memory 401 storing executable program codes and a processor 402 coupled with the memory 401.

[0124] The processor 402 invokes the executable program codes stored in the memory 401 to execute the unilateral space neglect rehabilitation training method described in the above embodiments.

[0125] An embodiment of the present application also discloses a computer readable storage medium storing a computer program, wherein the computer program causes a computer to execute the unilateral space neglect rehabilitation training method described in the above embodiments.

[0126] The above embodiments are intended to exemplarily reproduce and deduce the technical solutions of the present application, and to completely describe the technical solutions, objects and effects of the present application, so as to make the public more thoroughly and comprehensively understand the disclosed content of the present application, and not to limit the protection scope of the present application.

[0127] The above embodiments are not based on an exhaustive enumeration of the present application, and there can be a plurality of other embodiments not listed. Any replacement and improvement made without violating the concept of the present application is within the protection scope of the present application.

Claims

1. A unilateral space neglect rehabilitation training method, characterized in that, The method comprises: controlling a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on a display; acquiring a first steady-state visual evoked potential signal of a user gazing at the display, and determining whether the user's attention is sufficiently concentrated according to the first steady-state visual evoked potential signal; when it is determined that the user's attention is sufficiently concentrated, controlling at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of unilateral visual neglect of the user; wherein the specific moving direction is from a healthy side to a neglected side, and the target pattern symbols are any of the plurality of pattern symbols; acquiring a second steady-state visual evoked potential signal of the user gazing at the target pattern symbols, and determining whether the user concentrates attention to complete a training task according to the second steady-state visual evoked potential signal; when it is determined that the user concentrates attention to complete the training task, controlling an electric stimulator placed on the neck of the user to send a transcutaneous nerve electric stimulation signal, wherein the electric stimulator is located on the neglected side of the user.

2. The unilateral spatial neglect rehabilitation training method according to claim 1, wherein, Before controlling the at least two target pattern symbols on the display to move in the specific moving direction and at the specific moving speed within the spatial range of unilateral visual neglect of the user, the method further comprises: acquiring a maximum displacement of an eyeball of the user during reading of a single line of moving example text on the display; determining a critical line of unilateral visual neglect of the user according to the maximum displacement, and determining the spatial range of unilateral visual neglect of the user according to the critical line.

3. The unilateral spatial neglect rehabilitation training method according to claim 2, wherein, Before controlling the at least two target pattern symbols on the display to move in the specific moving direction and at the specific moving speed within the spatial range of unilateral visual neglect of the user, the method further comprises: acquiring an average eye movement speed of the eyeball of the user during reading of the single line of moving example text on the display; determining the specific moving speed according to the average eye movement speed.

4. The unilateral spatial neglect rehabilitation training method of claim 1, wherein, The method of determining whether the user's attention is sufficiently concentrated according to the first steady-state visual evoked potential signal comprises: decoding and classifying the first steady-state visual evoked potential signal to obtain a first classification label; comparing the first classification label with a preset label to obtain a classification accuracy of the user; when the classification accuracy reaches a specified proportion, it is determined that the user's attention is sufficiently concentrated.

5. The unilateral spatial neglect rehabilitation training method according to any one of claims 1 to 4, wherein, The method of determining whether the user concentrates attention to complete the training task according to the second steady-state visual evoked potential signal comprises: decoding and classifying the second steady-state visual evoked potential signal to obtain a second classification label; when the second classification label is the same as a prompt label corresponding to the target pattern symbol, it is determined that the user concentrates attention to complete the training task.

6. A unilateral spatial neglect rehabilitation training device, characterized in that, The method comprises: a test unit configured to control a plurality of pattern symbols to randomly flash at different flashing frequencies at a plurality of positions on a display; a first acquisition unit configured to acquire a first steady-state visual evoked potential signal of a user gazing at the display; a first determination unit configured to determine whether the user's attention is sufficiently concentrated according to the first steady-state visual evoked potential signal; The training unit is configured to control at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of the user's unilateral visual neglect when it is determined that the user's attention is sufficiently concentrated, wherein the specific moving direction is from the healthy side to the neglected side, and the target pattern symbols are any of the plurality of pattern symbols. The second acquisition unit is configured to acquire a second steady-state visual evoked potential signal when the user gazes at the target pattern symbol. The second judgment unit is configured to determine whether the user concentrates on the training task according to the second steady-state visual evoked potential signal. The electrical stimulation unit is configured to control an electrical stimulator placed on the user's neck to send a transcutaneous nerve electrical stimulation signal when it is determined that the user concentrates on the training task, wherein the electrical stimulator is located on the neglected side of the user.

7. The unilateral spatial neglect rehabilitation training apparatus as claimed in claim 6, characterized in that, Further comprising: The first acquisition unit is configured to acquire a maximum displacement of the eyeball during the user reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of the user's unilateral visual neglect. The range determination unit is configured to determine a critical line of the user's unilateral visual neglect according to the maximum displacement, and determine the spatial range of the user's unilateral visual neglect according to the critical line.

8. The unilateral spatial neglect rehabilitation training apparatus as claimed in claim 7, characterized in that, Further comprising: The second acquisition unit is configured to acquire an average saccade velocity of the eyeball during the user reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move in a specific moving direction and at a specific moving speed within a spatial range of the user's unilateral visual neglect. The speed determination unit is configured to determine the specific moving speed according to the average saccade velocity.

9. An electronic device, comprising: The memory stores executable program codes, and the processor is coupled to the memory; the processor invokes the executable program codes stored in the memory to execute the unilateral spatial neglect rehabilitation training method according to any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, wherein the computer program causes a computer to execute the unilateral spatial neglect rehabilitation training method according to any one of claims 1 to 5.

Images