Motor learning support system and motor learning support method

Abstract

To improve the learning effectiveness for learners of rehabilitation and activities of daily living. [Solution] The system includes an electroencephalogram (EEG) detection unit 2 that detects EEG signals indicating the brainwaves of the learner's undamaged side of the brain, a determination unit 32 that determines whether the strength of motor recall in the learner's damaged side of the brain is above a predetermined value based on the EEG signals, a stimulus application unit 4 that provides a stimulus to the learner as feedback based on the determination result of the determination unit 32, and a selection unit 34 that selects a stimulus application unit based on the ERN and / or Pe that appear when the learner's damaged side of the brain is stimulated.

Description

Technical Field

[0001] The present invention relates to a motor learning support system in the brain and a motor learning support method.

Background Art

[0002] Conventionally, as a functional recovery training for a body part with sensorimotor disorder, a method of passively repeating the movement of the target part by the intervention of medical experts such as physical therapists and occupational therapists has been adopted. In this method, it is important to operate in accordance with the timing of the intentional motor control command in the brain of the subject and to execute while enhancing body awareness.

[0003] In recent years, in order to operate in accordance with the timing and accuracy of voluntary movements based on the intentional motor control command in the brain of the subject, as shown in Patent Documents 1 and 2, a power spectrum is calculated from the brain waves of a motor learning learner (hereinafter referred to as a learner) who is the subject of intervention, and a system that determines motor imagery using the power spectrum and gives a stimulus to the learner as feedback has been considered. As a result of motor imagery, by giving a stimulus as feedback, the learner can feel body awareness such as a sense of agency and a sense of body ownership.

[0004] Here, examples of the stimulus given to the learner as feedback include visual stimuli, somatosensory stimuli, auditory stimuli, etc. A visual stimulus is, for example, one that displays the movement imagined by a video. A somatosensory stimulus is, for example, one that forcibly executes the movement imagined by applying an electrical stimulus to a predetermined skin or muscle. An auditory stimulus is, for example, one that generates a sound related to the movement to be imagined or a sound with a different frequency that can distinguish between when to be imagined and when not to be imagined.

Prior Art Documents

Patent Documents

[0006] However, the strength of bodily awareness generated by the applied stimulus varies from person to person. For example, some people feel a strong sense of bodily awareness in response to somatosensory feedback such as electrical stimulation, while others feel a strong sense of bodily awareness in response to visual feedback. In this case, applying a stimulus that elicits a strong sense of bodily awareness can reduce the discrepancy in information within the brain's comparison and matching system (comparator model) and improve learning effectiveness compared to applying other types of stimuli.

[0007] Therefore, the main objective of the present invention is to identify types of stimuli that are easily perceived by learners based on brainwaves in response to various stimuli applied during motor recall, and to improve the learning effect of neurorehabilitation and interventions for daily living activities by utilizing these types of stimuli. [Means for solving the problem]

[0008] In other words, the motor learning support system according to the present invention is characterized by comprising: an electroencephalogram detection unit that detects electroencephalogram signals indicating the brainwaves of a learner; a determination unit that determines the strength of the learner's motor recall based on the electroencephalogram signals; a stimulus application unit that provides a stimulus to the learner as feedback based on the determination result of the determination unit; and a selection unit that selects the stimulus application unit based on the error-related negative potential (ERN) and / or error positive potential (Pe) that appear when a stimulus is applied to the learner.

[0009] With such a motor learning support system, the stimulus application unit is selected based on the ERN and / or Pe that appear when a stimulus is applied to the learner. This allows for the use of stimulus types that are more likely to create a sense of agency and other bodily cognition in the learner, thereby improving the learning effect.

[0010] In terms of the specific implementation of the selection unit, it is desirable that the selection unit selects the stimulus application unit based on the ERN and / or Pe when the learner is given at least one stimulus from somatosensory stimulation, visual stimulation, auditory stimulation, olfactory stimulation and / or gustatory stimulation.

[0011] As for specific implementations of the selection unit, it is conceivable that the selection unit selects the stimulation unit based on ERN, Pe, or the ratio of ERN to Pe.

[0012] The aforementioned learner is undergoing rehabilitation, and the training support system of the present invention is intended to support the learner's rehabilitation.

[0013] The learner is engaged in practicing daily living activities, and the training support system of the present invention is intended to support the learner in practicing these daily living activities.

[0014] Furthermore, the motor learning support method according to the present invention is characterized by detecting an electroencephalogram (EEG) signal indicating the learner's brainwaves, determining the strength of the learner's motor recall based on the EEG signal, providing a stimulus to the learner as feedback via a stimulus-providing unit based on the determination result, and selecting the stimulus-providing unit based on the ERN and / or Pe that appear when the learner is stimulated.

[0015] Furthermore, the motor learning support method according to the present invention is characterized by detecting electroencephalogram (EEG) signals that appear in the learner when a plurality of different stimuli are given to the learner, and selecting an intervention tool to apply to the learner based on the ERN and / or Pe of the detected EEG signals. [Effects of the Invention]

[0016] According to the present invention configured as described above, it is possible to optimize the stimulation application unit that applies stimulation as feedback to the learner, and it is possible to improve the learning effect for learners in rehabilitation and daily living activities.

Brief Description of the Drawings

[0017] [Figure 1] It is a schematic diagram showing the basic configuration of a movement learning support system in rehabilitation according to an embodiment of the present invention. [Figure 2] It is a schematic diagram showing the characteristic configuration of the movement learning support system of the embodiment. [Figure 3] It is a diagram showing ERN and Pe. [Figure 4] It is a flowchart showing the movement learning support method of the embodiment.

Modes for Carrying Out the Invention

[0018] Hereinafter, a movement learning support system according to an embodiment of the present invention will be described with reference to the drawings. Note that, for any of the figures shown below, for the sake of clarity, they are schematically drawn with appropriate omissions or exaggerations. The same reference numerals are given to the same components, and the description thereof will be omitted as appropriate.

[0019] <Basic Configuration of Movement Learning Support System 100> The movement learning support system 100 of the present embodiment supports the rehabilitation of learners. As shown in FIG. 1, it includes an electroencephalogram detection unit 2 that detects an electroencephalogram signal indicating the electroencephalogram of the learner, a signal processing unit 3 that processes the electroencephalogram signal, and a stimulation application unit 4 that applies stimulation as feedback to the learner.

[0020] The electroencephalogram detection unit 2 is attached to the scalp of the learner and detects an electroencephalogram signal indicating the electroencephalogram of the learner. Specifically, the electroencephalogram detection unit 2 detects a slight potential difference from an electroencephalogram sensor attached to the head or an electroencephalogram sensor of a headset worn on the head, and detects an electroencephalogram signal that is a temporal change in this potential difference.

[0021] The electroencephalogram signal detected by the electroencephalogram detection unit 2 is processed by the signal processing unit 3. This signal processing unit 3 includes a power spectrum calculation unit 31, a determination unit 32, and a feedback control unit 33.

[0022] The power spectrum calculation unit 31 calculates the power spectrum during motor imagery using the electroencephalogram signal detected by the electroencephalogram detection unit 2.

[0023] This power spectrum calculation unit 31 extracts, in time series, which frequency bands' power spectra are included and how much by performing frequency analysis on the electroencephalogram signal. Specifically, the power spectrum calculation unit 31 analyzes how much power spectra of frequencies in at least the α-wave band (8 - 13 Hz), β-wave band (13 - 30 Hz), and γ-wave band (30 - 70 Hz) are included.

[0024] The determination unit 32 determines the strength of the learner's motor imagery based on the electroencephalogram signal detected by the electroencephalogram detection unit 2. The determination unit 32 in this embodiment determines the strength of the learner's motor imagery based on the power spectra of frequencies in the α-wave band (8 - 13 Hz), β-wave band (13 - 30 Hz), and γ-wave band (30 - 70 Hz) calculated by the power spectrum calculation unit 31, and determines whether the strength of the motor imagery is greater than or equal to a predetermined value.

[0025] Specifically, the determination unit 32 determines the strength of the learner's motor recall based on the maximum change in the ratio of the power spectrum in the alpha wave band to the power spectrum in the beta wave band or gamma wave band (here, log(α / β) and / or log(α / γ)). Note that the maximum change in log(α / β) and log(α / γ) is the maximum change based on the ratio of the power spectrum in the alpha wave band to the power spectrum in the beta wave band or gamma wave band (here, log(α0 / β0) and log(α0 / γ0)) obtained from the electroencephalogram signal when the learner is not imagining anything.

[0026] More specifically, the determination unit 32 has thresholds set for determining the strength of motor recall in multiple stages, such as motor recall (weak), motor recall (medium), and motor recall (strong), based on the maximum change in log(α / β) and / or log(α / γ). The strength of the learner's motor recall is determined by comparing it with these multi-stage thresholds.

[0027] The feedback control unit 33 controls the stimulus delivery unit 4 based on the determination result from the determination unit 32. Specifically, the feedback control unit 33 controls the stimulus delivery unit 4 based on the determination result from the determination unit 32 to provide the learner with a stimulus of an intensity corresponding to the strength of the motor recall that the learner was able to perform, thereby matching the amount of motor recall in the brain with the amount of feedback. If the determination result is motor recall (weak), the feedback control unit 33 provides the learner with a stimulus of an intensity corresponding to motor recall (weak), and if the determination result is motor recall (strong), it provides the learner with a stimulus of an intensity corresponding to motor recall (strong).

[0028] The stimulus delivery unit 4 is controlled by the feedback control unit 33 to provide stimuli to the learner as feedback. This stimulus delivery unit 4 can provide multiple types of stimuli to the learner.

[0029] Examples of the stimulus-providing unit 4 in this embodiment include a somatosensory stimulus-providing unit 41 that provides somatosensory stimuli to the learner, a visual stimulus-providing unit 42 that provides visual stimuli to the learner, an auditory stimulus-providing unit 43 that provides auditory stimuli to the learner, an olfactory stimulus-providing unit 44 that provides olfactory stimuli to the learner, or a gustatory stimulus-providing unit 45 that provides gustatory stimuli to the learner.

[0030] The somatosensory stimulation unit 41, for example, applies electrical stimulation to a predetermined skin or muscle to force the recalled movement to be performed. Alternatively, the somatosensory stimulation unit 41 may also provide the learner with touch, pressure, warmth, cold, pain, or vibration sensations. The visual stimulation unit 42, for example, displays the recalled movement as an image using a display or the like. The auditory stimulation unit 43, for example, generates sounds related to the recalled movement. The olfactory stimulation unit 44, for example, generates odors related to the recalled movement. The gustatory stimulation unit 45, for example, generates tastes related to the recalled movement.

[0031] <Features and Configuration of Motor Learning Support System 100> Furthermore, as shown in Figure 2, the motor learning support system 100 of this embodiment includes a selection unit 34 that selects a stimulus application unit 4 based on the ERN and / or Pe (see Figure 3) that appear when a stimulus is applied to the learner. The electroencephalogram (EEG) detection unit that detects the ERN and / or Pe may be the EEG detection unit 2 described above, or it may be another EEG detection unit 5.

[0032] The selection unit 34 selects the stimulus application unit 4 based on the ERN and / or Pe obtained when the learner is given at least one stimulus from somatosensory stimulation, visual stimulation, auditory stimulation, olfactory stimulation, and / or gustatory stimulation. The selection unit 34 may be implemented by the functions of the signal processing unit 3, or it may be configured using a separate computer.

[0033] For example, when somatosensory stimuli, visual stimuli, auditory stimuli, olfactory stimuli, and gustatory stimuli are applied to the learner during motor recall, the magnitude of the ERN for each stimulus is measured. The selection unit 34 then selects the stimulus application unit 4 with the smallest ERN based on the magnitude of the ERN for each stimulus.

[0034] Furthermore, when somatosensory stimuli, visual stimuli, auditory stimuli, olfactory stimuli, and / or gustatory stimuli are applied to the learner during motor recall, the magnitude of Pe for each stimulus is measured. The selection unit 34 then selects the stimulus application unit 4 with the largest Pe based on the magnitude of Pe for each stimulus.

[0035] Furthermore, when somatosensory stimuli, visual stimuli, auditory stimuli, olfactory stimuli, and / or gustatory stimuli are applied to the learner during motor recall, the magnitudes of ERN and Pe for each stimulus are measured. The selection unit 34 then selects the stimulus application unit 4 with the smallest ERN / Pe ratio (e.g., ERN / Pe) based on the magnitude of the ERN / Pe ratio for each stimulus.

[0036] <Methods for supporting motor learning> Next, a method for supporting motor learning using the motor learning support system 100 of this embodiment will be described with reference to Figure 4.

[0037] (1) Selection step of the stimulant The system detects electroencephalogram (EEG) signals that appear in the learner when they are given multiple different stimuli, and selects an intervention tool (in this case, the stimulus application unit 4) to apply to the learner based on the ERN and / or Pe of the detected EEG signals.

[0038] Specifically, one stimulus-providing unit 4 is selected as the means of providing feedback, and rehabilitation (pre-learning) is performed using this stimulus-providing unit 4.

[0039] In this pre-learning phase, electroencephalogram (EEG) signals representing the learner's brainwaves are detected, the strength of the learner's motor recall is determined based on the EEG signals, and a stimulus is provided to the learner as feedback by the selected stimulus application unit 4 based on the determination result. The ERN and / or Pe that appear when the learner is stimulated by this stimulus application unit 4 are then measured.

[0040] The above pre-learning is performed for each stimulus-delivering unit 4, and based on the ERN and / or Pe measured in each pre-learning, the selection unit 34 selects the stimulus-delivering unit 4 that is most suitable for the learner. The selection of the stimulus-delivering unit 4 that is most suitable for the learner may be performed automatically by the selection unit 34, or it may be performed by the learner or an instructor such as a physical therapist or occupational therapist by comparing the ERN and / or Pe measured in each pre-learning.

[0041] (2) Normal learning steps Rehabilitation (main learning) is performed using the specific stimulus delivery unit 4 selected in step (1) above. In this main learning, electroencephalogram (EEG) signals indicating the learner's brainwaves are detected, the strength of the learner's motor recall is determined based on the EEG signals, and based on the determination result, the learner is given a stimulus as feedback by the specific stimulus delivery unit 4. Note that it is not necessary to perform step (1) stimulus selection before every normal learning step; step (1) stimulus selection may be performed periodically to select the specific stimulus delivery unit 4.

[0042] <Effects of this embodiment> According to the motor learning support system 100 of this embodiment configured in this way, the stimulus application unit 4 is selected based on the ERN and / or Pe that appear when a stimulus is applied to the learner. Therefore, it is possible to utilize stimulus types that are more likely to create a sense of agency and other bodily cognition for the learner, thereby improving the learning effect.

[0043] <Other Embodiments> However, the present invention is not limited to the embodiments described above.

[0044] For example, the motor learning support system 100 can be applied not only to rehabilitation, but also to daily living activity training, skills training, and vocational training.

[0045] In this case, the determination unit 32 can determine the strength of motor recall for the injured limb by comparing the electroencephalogram (EEG) signal from the non-injured side of the learner's brain detected by the EEG detection unit 2 with the EEG signal from the injured side of the learner's brain when motor recall occurs. The EEG signals from the non-injured side of the learner's brain when motor recall occurs and the EEG signals at rest are acquired in advance and stored in the determination unit 32.

[0046] Specifically, the determination unit 32 may compare the maximum change in log(α / β) and / or log(α / γ) obtained from the electroencephalogram (EEG) signals of the injured side of the learner's brain with the maximum change in log(α / β) and / or log(α / γ) obtained from the EEG signals of the injured side of the learner's brain to determine the strength of the learner's motor recall.

[0047] More specifically, the determination unit 32 determines the strength of the learner's motor recall based on the ratio of the maximum change in log(α / β) and / or log(α / γ) in the injured side of the learner's brain to the maximum change in log(α / β) and / or log(α / γ) in the uninjured side of the learner's brain.

[0048] The feedback control unit 33 then controls the stimulus application unit 4 based on the determination result from the determination unit 32, thereby providing the learner with a stimulus of an intensity corresponding to the strength of motor recall that could be performed in the injured side of the learner's brain, and matching the amount of motor recall in the brain with the amount of feedback.

[0049] Furthermore, it goes without saying that the present invention is not limited to the embodiments described above, and various modifications are possible without departing from its spirit. [Explanation of symbols]

[0050] 100...Motor Learning Support System 2 ···Electroencephalogram detection unit 3. Signal Processing Unit 31 ···Power spectrum calculation unit 32...judgment section 33 ···Feedback Control Unit 34...Selection section 4. Stimulation section 41 ···Somatosensory stimulation unit 42...Visual stimulation unit 43...Auditory stimulation unit 44 ···Olfactory stimulation unit 45 ···Taste stimulation part

Claims

1. An electroencephalogram (EEG) detection unit that detects EEG signals representing the learner's brainwaves, A determination unit that determines the strength of the learner's motor recall based on the electroencephalogram signal, A stimulus provision unit provides a stimulus to the learner as feedback based on the judgment result of the judgment unit, A motor learning support system comprising: a selection unit that selects the stimulus application unit based on the error-related negative potential (hereinafter referred to as ERN) and / or error-positive potential (hereinafter referred to as Pe) that appear when the learner is stimulated.

2. The motor learning support system according to claim 1, wherein the selection unit selects the stimulus application unit based on the ERN and / or Pe when the learner is given at least one stimulus from somatosensory stimulation, visual stimulation, auditory stimulation, olfactory stimulation and / or gustatory stimulation.

3. The motor learning support system according to claim 1 or 2, wherein the selection unit selects the stimulus application unit based on ERN, Pe, or the ratio of ERN to Pe.

4. The motor learning support system according to claim 1 or 2, wherein the learner performs rehabilitation and supports the rehabilitation of the learner.

5. The motor learning support system according to claim 1 or 2, wherein the learner performs daily living activities practice and the system supports the learner's daily living activities practice.

6. Detecting electroencephalogram (EEG) signals that indicate the learner's brainwaves, Based on the electroencephalogram signals, the strength of the learner's motor recall is determined. A motor learning support method comprising: providing a stimulus to the learner as feedback via a stimulus-providing unit based on the judgment result; and selecting the stimulus-providing unit based on the ERN and / or Pe that appear when the learner is given a stimulus.

7. When a learner is given multiple different stimuli, the electroencephalogram (EEG) signals that appear in the learner are detected. A motor learning support method that selects a training tool to apply to the learner based on the ERN and / or Pe of the detected electroencephalogram signal.

Images