Brain wave induction system, non-verbal communication system, brain wave induction program, and non-verbal communication program

Abstract

The present invention relates to a technology for inducing brain waves, and a communication technology using brain waves.　The present invention addresses the problem of providing a system for inducing brain waves of a user while suppressing effects due to the state of the user.　The present invention solves the aforementioned problem by means of a brain wave induction system (10X) comprising: an image setting unit (21) that sets a moving body illusion image in an image (IM) and sets a flashing frequency for the image; and a display (30) that displays the image.

Description

Brain wave induction system, non-verbal communication system, brain wave induction program, non-verbal communication program

[0001] The present invention relates to a technique for inducing brain waves and a communication technique using brain waves.

[0002] Measurement of brain waves evoked by specific stimuli is used in neuroscience research and to assess brain function, neurological disorders, and the effects of treatments.

[0003] In the field of neurofeedback, brainwave measurements are used to encourage self-control of the brain, improve mental health and cognitive function, and as neurorehabilitation and motor function training.

[0004] In terms of communication means, severely physically disabled people who can no longer use physical switches (switches, etc.) or gaze input switches (eye movements) are eagerly awaiting a device that uses brain waves to communicate their intentions.

[0005] Regardless of whether or not a person has a disability, future technologies such as non-verbal communication, conveying intentions through brain waves, remotely controlling robots, and self-driving mobility are in demand.

[0006] In response to such social demands, various systems have been devised, such as those shown in Patent Documents 1 to 4.

[0007] JP 2013-4006 A JP 2013-117957 A International Publication No. 2019 / 073603 Patent No. 7124090 A

[0008] However, with conventional systems, there are individual differences in the transmission of nerve meridians in the brain, so there are cases where a strong brain wave is induced and cases where a response is weak.

[0009] Therefore, an object of the present invention is to provide a system for inducing a user's brain waves while suppressing the influence of the user's condition.

[0010] An electroencephalogram elicitation system according to one embodiment of the present invention includes an image setting unit that sets a motion illusion image as an image and sets a blinking frequency of the image, and a display that displays the image.

[0011] In this configuration, by using a motion illusion image, the motor nerves of the brain of the viewer (user HM) can be stimulated more effectively than by using a simple two-dimensional image, and brain waves can be induced more effectively.

[0012] According to the present invention, brain waves can be effectively induced.

[0013] FIG. 1 is a diagram showing an example of the physical configuration of a non-verbal communication system according to a first embodiment. FIG. 2 is a diagram showing an example of functional blocks of the non-verbal communication system according to the first embodiment. FIG. 3 is a diagram showing a first example of an image to be displayed. FIG. 4(A) is a graph showing EEG signal levels when a motion illusion image is used, and FIG. 4(B) is a graph showing EEG signal levels when a motion illusion image is not used. FIG. 5 is a table showing the correct answer rate of the results of the selection of options using a simple image and a motion illusion image. FIG. 6 is a diagram showing a second example of an image to be displayed. FIGS. 7(A) and 7(B) are diagrams showing a third example of an image to be displayed. FIG. 8 is a diagram showing a fourth example of an image to be displayed. FIG. 9 is a diagram showing an example of an image that creates an illusion of being drawn in. FIG. 10 is a diagram showing an example of the physical configuration of an electroencephalogram elicitation system. FIG. 11 is a diagram showing an example of the physical configuration when the electroencephalogram elicitation system is applied to neurorehabilitation. FIG. 12 is a flowchart showing an example of a non-verbal communication method according to the first embodiment. FIG. 13 is a diagram showing an example of functional blocks of a non-verbal communication system according to a second embodiment. Fig. 14 is a diagram showing an example of functional blocks of a non-verbal communication system according to a third embodiment. Fig. 15 is a diagram showing an example of functional blocks of a non-verbal communication system according to a fourth embodiment. Fig. 16 is a diagram showing an example of functional blocks of a non-verbal communication system according to a fifth embodiment.

[0014] First Embodiment A non-verbal communication system according to a first embodiment of the present invention will be described with reference to the drawings.

[0015] (Physical Configuration) FIG. 1 is a diagram showing an example of the physical configuration of a non-verbal communication system according to the first embodiment.

[0016] 1, the non-verbal communication system 10 includes a processing unit 20, a display unit 30, and an electroencephalogram (EEG) detection unit 40. The processing unit 20 is configured, for example, by a personal computer. The display unit 30 is configured, for example, by a liquid crystal display. The electroencephalogram detection unit 40 is configured, for example, by an electroencephalogram sensor that detects electroencephalograms.

[0017] The brain wave detecting device 40 is attached to the head of the user HM using a headband or the like. The display 30 is disposed within the visual field of the user.

[0018] The arithmetic processing device 20 may be configured as a cloud server connected via a network, a portable information communication terminal such as a smartphone, etc. The display device 30 may be smart glasses worn by the user HM, etc.

[0019] The arithmetic processing device 20 and the display device 30 are connected in a wired manner, for example, via a communication cable. The arithmetic processing device 20 and the brain wave detecting device 40 are connected in a wired manner, for example, via a communication cable. Note that communication between the arithmetic processing device 20 and the display device 30 and communication between the arithmetic processing device 20 and the brain wave detecting device 40 may be wireless.

[0020] (Functional Configuration) FIG. 2 is a diagram showing an example of functional blocks of the non-verbal communication system according to the first embodiment.

[0021] 2 , the non-verbal communication system 10 includes a processing device 20, a display 30, and an electroencephalogram (EEG) detection device 40. The processing device 20 is configured with a PC, a CPU, etc., and includes an image setting unit 21, a signal processing unit 22, a frequency component detection unit 23, and a determination unit 24. The signal processing unit 22 includes an amplifier 221 and a filter 222. Note that the image setting unit 21 may be configured as a device (PC, CPU, GPU, etc.) separate from the processing device 20.

[0022] The electroencephalogram elicitation system is configured by the image setting unit 21 and the display device 30. That is, the electroencephalogram elicitation system includes an image setting unit that sets a motion illusion image as an image and sets the blinking frequency of the image, and a display device that displays the image.

[0023] More specifically, the image setting unit 21 sets a plurality of options and a plurality of images corresponding to each of the plurality of options. The image setting unit 21 also sets a different blinking frequency (a plurality of blinking frequencies) for each of the plurality of options.

[0024] The image setting unit 21 outputs a plurality of options, a plurality of images, and a plurality of blinking frequencies to the display 30 in association with each option.

[0025] The display 30 displays a plurality of options and a plurality of images. At this time, the display 30 displays the images corresponding to the plurality of options by flashing them at a flashing frequency associated with each of the options.

[0026] 3 is a diagram showing a first example of an image to be displayed. For example, in the case of FIG. 3, the first option CT1 of the multiple options is "YES" and the second option CT2 is "NO." The first option CT1 is associated with an image IM1, and the second option CT2 is associated with an image IM2.

[0027] Images IM1 and IM2 are displayed side by side on the display screen of the display device 30. Images IM1 and IM2 are both set as motion illusion images and are the same image. For example, in the example of FIG. 3, images IM1 and IM2 are motion illusion images that use circles. Motion illusion images will be described in detail later.

[0028] The text image of the first option CT1 (the text image of "YES") is displayed adjacent to the image IM1. The text image of the second option CT2 (the text image of "NO") is displayed adjacent to the image IM2.

[0029] The image IM1 is displayed blinking at a blinking frequency ff1, and the image IM2 is displayed blinking at a blinking frequency ff2. The blinking frequencies ff1 and ff2 are set to different frequencies.

[0030] When the user HM (see FIG. 1) looks at the display screen of the display device 30, if he / she wants to answer the first option CT1 (YES), he / she will react strongly to the image IM1, and if he / she wants to answer the second option CT2 (NO), he / she will react strongly to the image IM2.

[0031] At this time, the user HM generates brain waves with strong frequency components corresponding to the flashing frequency of the image to which he or she reacts strongly. For example, if the user HM wants to answer YES and reacts strongly to image IM1, the user HM's brain waves will generate strong frequency components that are the same as the flashing frequency ff1. On the other hand, if the user HM wants to answer NO and reacts strongly to image IM2, the user HM's brain waves will generate strong frequency components that are the same as the flashing frequency ff2.

[0032] 2, the brain wave detection device 40 detects brain waves of a user viewing a plurality of images (images IM1, IM2) displayed on the display 30, and generates an brain wave signal. The brain wave signal is generated as an electrical signal.

[0033] More specifically, the brain wave detection device 40 generates an electroencephalogram signal of a steady state visual evoked potential (SSVEP).

[0034] A steady-state visual evoked potential is an electroencephalogram (EEG) signal that is synchronized with a specific visual stimulus, such as an EEG signal in which a frequency component of frequency f is strongly generated when a visual stimulus of frequency f is received. The EEG signal of a steady-state visual evoked potential is a continuous wave with a waveform that is continuous on the time axis.

[0035] The brain wave detecting device 40 outputs the brain wave signal to the signal processing unit 22 of the arithmetic processing device 20 .

[0036] An amplifier 221 in the signal processing unit 22 amplifies the EEG signal. A filter 222 in the signal processing unit 22 suppresses noise contained in the amplified EEG signal. The signal processing unit 22 outputs the amplified and filtered EEG signal to the frequency component detection unit 23. The signal processing unit 22 can be omitted, but since EEG signals are usually weak signals, it is preferable not to omit it.

[0037] The connection order of the amplifier 221 and the filter 222 is not limited to this. That is, the filter 222 may be connected to the input side of the amplifier 221. The amplifier 221 may also be provided in the brain wave detection device 40.

[0038] The frequency component detection unit 23 detects the frequency components of the EEG signal. For example, the frequency component detection unit 23 performs FFT processing on the time waveform EEG signal to detect the frequency components of the EEG signal. Note that the frequency component detection unit 23 may detect the frequency components of the EEG signal by detecting the phase of the time waveform EEG signal.

[0039] The frequency component detector 23 extracts a peak frequency from the result of detecting the frequency components of the electroencephalogram signal, and outputs the peak frequency to the determiner 24.

[0040] The determining unit 24 receives input of a plurality of options and a blinking frequency for each of the plurality of options from the image setting unit 21 .

[0041] The determination unit 24 determines the option based on the frequency component (peak frequency). More specifically, the determination unit 24 compares the peak frequency with a plurality of blinking frequencies. The determination unit 24 selects an option associated with a blinking frequency that is approximately the same as the peak frequency.

[0042] Through such processing, the arithmetic processing device 20 determines the option selected by the user HM based on the electroencephalogram signal.

[0043] In such a non-verbal communication system 10, the image setting unit 21 sets a dynamic illusion image as the image.

[0044] A motion illusion image is a two-dimensional image that creates the illusion of three-dimensional movement in the brain. In other words, a motion illusion image is a two-dimensional image that does not change on display, but when viewed and perceived by the brain, creates the illusion of three-dimensional (3D) movement. More specifically, a motion illusion image is a type of optical illusion image that creates the illusion of three-dimensional movement in the brain, even if it does not blink.

[0045] By using a motion illusion image, the motor nerves of the brain of the viewer (user HM) can be stimulated more effectively than by using a simple two-dimensional image, and brain waves can be induced more effectively.

[0046] 4A is a graph showing the EEG signal level when a motion illusion image is used, and FIG. 4B is a graph showing the EEG signal level when a motion illusion image is not used. A case where a motion illusion image is not used is, for example, when a simple two-dimensional image is used.

[0047] As shown in Figures 4A and 4B, by using the motion illusion image, the signal level of the specific frequency fp of the electroencephalogram becomes much higher than the signal levels of other frequencies. In other words, by using the motion illusion image, a peak occurs at the specific frequency fp.

[0048] In this way, the use of the motion illusion image can promote the induction of brain waves in the user, and therefore the brain wave induction system can effectively induce brain waves in the user.

[0049] This allows the user HM's intentions to be accurately reflected in electroencephalograms. Therefore, even for users HM whose electroencephalograms are not induced by simple images and who are unable to communicate using a BMI (Brain Machine Interface), communication via electroencephalograms can be made easier. In other words, the non-verbal communication system 10 can suppress the influence of the user HM's state and accurately detect the user HM's intentions. Therefore, non-verbal communication such as BMI can be more reliably realized.

[0050] Figure 5 is a table showing the percentage of correct answers for the simple images and the motion illusion images. Figure 5 shows the results of an experiment conducted on multiple people.

[0051] Among the participants, there was one who performed the experiment multiple times (for example, four times) using simple images and had a 0% correct answer rate, but by using the motion illusion images, this person with a 0% correct answer rate was able to achieve a correct answer rate of approximately 100%. Also, for one person who performed the experiment multiple times (for example, four times) using simple images and had a correct answer rate of 50%, by using the motion illusion images, the correct answer rate increased to approximately 100%. Furthermore, the results of the experiment on multiple participants showed that people with low correct answer rates when using simple images had a higher correct answer rate when using the motion illusion images.

[0052] For example, as shown in Figure 5, when using simple images, the overall correct answer rate for the choice judgment results is 70%-80%, but by using motion illusion images, the overall correct answer rate increases to 95%-100%.

[0053] Therefore, the non-verbal communication system 10 can detect the user's intention with high accuracy, and the user HM can more reliably realize non-verbal communication.

[0054] (Second Example of Image) FIG. 6 is a diagram showing a second example of an image to be displayed.

[0055] 6, the image IM2x is a motion illusion image using a rectangle. In this case, the image setting unit 21 sets different motion illusion images for each of the multiple options.

[0056] Specifically, as shown in FIG. 6, an image IM1 corresponding to the first option CT1 and an image IM2x corresponding to the second option CT2 are different images.

[0057] The multiple images IM1, IM2x corresponding to the multiple options CT1, CT2 are different, so the user HM can distinguish between them based on the shape of the images. This allows the non-verbal communication system 10 to encourage the user HM to focus more on the selected image, and to more accurately determine the user's intention.

[0058] It should be noted that the non-verbal communication system 10 may vary the colors of the images in addition to varying the shapes of the images.

[0059] For example, if the choices are "I want to drink water" and "I want to drink tea," a light blue motion illusion image and a brown motion illusion image are used. Also, a light blue motion illusion image in the shape of a glass cup and a brown motion illusion image in the shape of a teacup are used.

[0060] This allows the user HM to focus more on the selection he or she wants to make than if the same graphic were used, and brain waves are more likely to be induced. As a result, the non-verbal communication system 10 can more accurately determine the intention of the user HM.

[0061] (Third Example of Image) FIGS. 7A and 7B are diagrams showing a third example of an image to be displayed.

[0062] 7A and 7B, the image changes over time. In this case, the image setting unit 21 changes the motion illusion image over time.

[0063] 7A, for example, the image setting unit 21 alternately sets a motion illusion image to be displayed steadily and an image in which another image is superimposed on the motion illusion image over time, and displays these on the display 30. Specifically, assuming that time passes in the order of times t1, t2, t3, and t4, the image setting unit 21 sets and displays the motion illusion image to be displayed steadily at times t1 and t3, and sets and displays an image in which another image is superimposed on the motion illusion image to be displayed steadily at times t2 and t4.

[0064] 7B, for example, the image setting unit 21 changes the type of motion illusion image over time. That is, the image setting unit 21 alternately sets multiple types of motion illusion images with different shapes over time and displays them on the display 30. Specifically, assuming that time passes in the order of times t1, t2, t3, and t4, the image setting unit 21 sets and displays circular motion illusion images at times t1 and t3. The image setting unit 21 sets and displays rectangular motion illusion images at times t2 and t4.

[0065] This makes it easier for the user HM to perceive the motion illusion image as moving. Therefore, the non-verbal communication system 10 encourages the user HM to focus more closely. The movement of the image stimulates the user HM's motor nerves, making it easier for the user HM to produce the desired brain waves. As a result, the non-verbal communication system 10 can more accurately determine the user HM's intentions.

[0066] (Fourth Example of Image) Fig. 8 is a diagram showing a fourth example of an image to be displayed. In the fourth example shown in Fig. 7, the size of the image changes over time. The image setting unit 21 changes the size of the motion illusion image over time.

[0067] 8, for example, the image setting unit 21 alternately sets large motion illusion images and small motion illusion images over time, and displays them on the display 30. Specifically, assuming that time passes in the order of times t1, t2, t3, and t4, the image setting unit 21 sets and displays large motion illusion images at times t1 and t3, and sets and displays small motion illusion images at times t2 and t4.

[0068] This makes it easier for the user HM to perceive the motion illusion image as moving. Therefore, the non-verbal communication system 10 encourages the user HM to focus more closely, and the user HM's motor nerves are stimulated by the moving image, making it easier for the user HM to produce the desired brain waves. As a result, the non-verbal communication system 10 can more accurately determine the user HM's intentions.

[0069] (Fifth Example of Image) The image setting unit 21 sets the motion illusion image to a shape that corresponds to the action that the user wants to perform by selection.

[0070] For example, when it is desired to select whether to turn the lighting on or off, the image setting unit 21 sets a moving object illusion image that gives the illusion of light to correspond to ON, and a moving object illusion image that gives the illusion of disappearing to correspond to OFF.

[0071] When the user wants to select whether to turn on or off the air conditioner, the image setting unit 21 sets a moving body illusion image that gives the illusion of wind blowing out to correspond to ON, and sets a moving body illusion image that gives the illusion of wind dying down to correspond to OFF.

[0072] This allows the user HM to more easily become aware of the action he or she wants to take and to more easily produce the desired brain waves, thereby enabling the non-verbal communication system 10 to more accurately determine the intention of the user HM.

[0073] (Sixth Example of Image) The image setting unit 21 sets, as the motion illusion image, an image that gives the illusion of being sucked into the image. For example, the image setting unit 21 sets, as the motion illusion image, an image that gives the illusion of being sucked into a cave or tunnel.

[0074] Fig. 9 is a diagram showing an example of an image that gives the illusion of being sucked in. As shown in Fig. 9, for example, an image IMs that gives the illusion of being sucked in is an image in which the line width becomes thicker as it approaches the center and the background becomes darker as it approaches the center.

[0075] This stimulates the user HM's motor nerves more. Therefore, the non-verbal communication system 10 encourages the user HM to pay more attention to the image, and the user HM's motor nerves are stimulated by the moving image, making it easier for the user HM to produce desired brain waves. As a result, the non-verbal communication system 10 can more accurately determine the user HM's intentions.

[0076] In the above explanation, the non-verbal communication system 10 was used as an example, but the moving body illusion image can be used primarily for the purpose of inducing brain waves.

[0077] 10 is a diagram showing an example of the physical configuration of an electroencephalogram (EEG) elicitation system 10X. The electroencephalogram elicitation system 10X includes a processing device 20X, a display 30, and an electroencephalogram detection device 40. The processing device 20X includes the image setting unit 21 in the processing device 20 described above, and other functional units can be omitted as appropriate.

[0078] The image setting unit 21 sets a motion illusion image for the image and sets a blinking frequency for the image. The image setting unit 21 outputs the set motion illusion image and blinking frequency to the display 30.

[0079] The display device 30 displays the set motion illusion image at the set blinking frequency, thereby displaying a single image IM on the screen.

[0080] The display of the motion illusion image on the display device 30 induces brain waves in the user HM. This allows the brain wave induction system 10X to induce brain waves in the user HM and improve the response rate. Furthermore, the brain wave induction system 10X can use the following specific frequencies to enable the user HM to reach a specific condition more quickly.

[0081] Preferably, the arithmetic processing device 20 includes a training execution unit that repeatedly displays the image IM, which is a motion illusion image. This allows the user HM to be trained in recognizing the image IM, and the user HM's brainwaves are repeatedly induced. Therefore, the brainwave induction system 10X can promote the induction of brainwaves in the user HM.

[0082] (Example of Frequency) The image setting unit 21 sets the blinking frequency (blinking frequency ff) to the frequency of spontaneous electroencephalograms. For example, the image setting unit 21 sets the blinking frequency to a frequency of spontaneous electroencephalograms (α waves, β waves, θ waves, δ waves, γ waves, etc.) that corresponds to a desired mental state.

[0083] As a result, the EEG induction system 10X can accurately determine the intentions of the user HM, and can also realize mental training, health care for preventing illness (such as measures against depression), and Alzheimer's prevention.

[0084] Specifically, for example, the frequency of delta waves is 3.0 Hz or less, and can provide an unconscious state and a deep sleep state.

[0085] Theta waves have a frequency of 3.0 Hz to 8.0 Hz and can induce a deep state of relaxation, a state of near-sleep, or a light sleep state. This allows the non-verbal communication system 10 to induce a meditative state for the user HM, improve memory and inspiration, and enhance learning effectiveness.

[0086] The frequency of alpha waves is 8.0 Hz-13.0 Hz, which can induce a state of relaxation and concentration. As a result, the brainwave induction system 10X can provide the user HM with stress relief, brain activation, and improved immunity.

[0087] Beta waves have a frequency of 13.0 Hz or higher and can provide a state of tension, wakefulness, and daily life. This allows the brainwave induction system 10X to provide the user HM with a state of tension amplification.

[0088] Furthermore, by setting the flashing frequency to approximately 5 Hz, the brainwave induction system 10X can provide a meditative state to the user HM.

[0089] Furthermore, the frequency of gamma waves is 31 Hz or higher, or 20 Hz to 50 Hz, and can activate higher mental activity than meditation. This allows the EEG induction system 10X to be used, for example, to prevent Alzheimer's disease.

[0090] When the blinking frequency (blinking frequency ff) is set to the frequency of spontaneous electroencephalograms, the effect of blinking at the frequency of spontaneous electroencephalograms can be obtained by using images other than the motion illusion image.

[0091] Such an electroencephalogram induction system can be applied to, for example, neurorehabilitation.

[0092] FIG. 11 is a diagram showing an example of a physical configuration when the electroencephalogram elicitation system is applied to neurorehabilitation.

[0093] When the electroencephalogram induction system 10X is used for neurorehabilitation, the display device 30 is attached to the part of the body to be rehabilitated. For example, in the case of FIG. 11 , when rehabilitating the hand (arm) HD, the display device 30 is attached to the hand HD.

[0094] In this state, an image IM consisting of a motion illusion image is displayed on the display 30. When the user HM looks at this image IM, brain waves that move the hand HD are induced. This allows the brain wave induction system 10X to improve the response rate of the user HM and improve the efficiency of rehabilitation.

[0095] In this case, by providing a training execution unit, the brain wave induction system 10X can train the user HM to more easily generate brain waves that move the hand HD, thereby enabling the brain wave induction system 10X to achieve a higher rehabilitation effect.

[0096] The number of options is not limited to two, but may be three or more. The non-verbal communication system 10 may detect the surrounding environment of the user HM and change the options and the motion illusion image based on the environment (indoors, outdoors, type of room, time of day, etc.).

[0097] This allows the nonverbal communication system 10 to set options and motion illusion images according to the current state of the user HM. This makes it easier for the user HM to produce brain waves for making a selection. As a result, the nonverbal communication system 10 can more accurately determine the intention of the user HM according to the current state of the user HM.

[0098] (Nonverbal Communication Method) Fig. 12 is a flowchart showing an example of a nonverbal communication method according to the first embodiment. Note that, hereinafter, the processes executed by each functional unit of the arithmetic processing device 20 will be collectively described as the processes in the arithmetic processing device 20. The arithmetic processing device 20 is composed of a PC, a CPU, etc., and a storage medium that stores a program describing the processes to be executed by each functional unit. Then, the PC, CPU, etc. execute the program, thereby realizing the processes executed by the arithmetic processing device 20 shown in Fig. 12.

[0099] The arithmetic processing unit 20 sets a plurality of options, a motion illusion image for each of the plurality of options, and a blinking frequency for each of the plurality of options (S11). The arithmetic processing unit 20 sets a different blinking frequency for each of the plurality of options.

[0100] The display 30 blinks the multiple options and the multiple motion illusion images (S12).

[0101] The brain wave detecting device 40 detects the brain waves of the user who views the displayed images, and generates an brain wave signal (S13).

[0102] The calculation processing unit 20 detects the frequency components of the electroencephalogram signal (S14).

[0103] The calculation processing unit 20 determines the options based on the frequency components (S15).

[0104] Second Embodiment A non-verbal communication system according to a second embodiment of the present invention will be described with reference to the drawings. Fig. 13 is a diagram showing an example of functional blocks of the non-verbal communication system according to the second embodiment.

[0105] 13, the nonverbal communication system 10A according to the second embodiment differs from the nonverbal communication system 10 according to the first embodiment in the configuration of the arithmetic processing device 20A. The arithmetic processing device 20A differs from the arithmetic processing device 20 according to the first embodiment in that it includes a training execution unit 25. The other configuration of the nonverbal communication system 10A is the same as that of the nonverbal communication system 10, and a description of similar parts will be omitted.

[0106] The arithmetic processing device 20A includes a training execution unit 25. The training execution unit 25 repeatedly causes the image setting unit 21 to set a plurality of options and a plurality of images, and the determination unit 24 to make a determination. In this way, the training execution unit 25 executes training for the user HM in image recognition.

[0107] The brain has plasticity, so by training, the user HM can more easily produce desired brain waves.

[0108] At this time, the training execution unit 25 can use different images for each user HM and select the one that gives the best response for training.

[0109] For example, the training execution unit 25 prepares a plurality of types of images and causes the image setting unit 21 to sequentially set different types of images at the beginning of training. The training execution unit 25 refers to the judgment results for each image and selects an image that elicits a good response from the user HM. The training execution unit 25 then performs training using the selected images. This allows for more reliable recognition by the user HM and further shortens the training effect.

[0110] Furthermore, the training execution unit 25 intentionally places an image that stimulates the imagination (an image that produces a poor response) close to the image for each user HM. This allows the training execution unit 25 to increase the concentration of the user HM and shorten the training effect.

[0111] [Third Embodiment] A non-verbal communication system according to a third embodiment of the present invention will be described with reference to the drawings. Fig. 14 is a diagram showing an example of functional blocks of the non-verbal communication system according to the third embodiment.

[0112] 14, the nonverbal communication system 10B according to the third embodiment differs from the nonverbal communication system 10 according to the first embodiment in that it includes a gaze detection device 50 and in the configuration of a processing device 20B. The processing device 20B differs from the processing device 20 according to the first embodiment in that it includes an object determination unit 26 and an option setting unit 27. The other configuration of the nonverbal communication system 10B is the same as that of the nonverbal communication system 10, and a description of similar parts will be omitted.

[0113] The gaze detection device 50 detects the gaze of the user HM. The gaze detection device 50 is configured, for example, with an eye tracking sensor worn by the user HM. The gaze detection device 50 outputs the detected gaze to the object determination unit 26 of the arithmetic processing device 20.

[0114] The object determination unit 26 determines the object and type of object at the point of gaze based on the gaze detected by the gaze detection device 50 and the situation around the user HM. The situation around the user HM can be understood, for example, from the position information of the user HM or by capturing an image of the user HM's surroundings and analyzing the image. The object determination unit 26 outputs the determined object to the option setting unit 27.

[0115] The option setting unit 27 sets a plurality of options based on the determination result by the object determination unit 26. More specifically, the option setting unit 27 identifies the type of object determined by the object determination unit 26, and sets a plurality of options corresponding to the type of object. The option setting unit 27 outputs the set plurality of options to the image setting unit 21.

[0116] The image setting unit 21 uses a plurality of options set by the option setting unit 27 .

[0117] This allows the non-verbal communication system 10B to automatically set options that are appropriate for the current situation of the user HM.

[0118] For example, the non-verbal communication system 10B can be applied to autonomous driving. More specifically, the non-verbal communication system 10B can apply the above configuration and processing when determining driving behaviors, etc., that correspond to environmental changes during autonomous driving. For example, the non-verbal communication system 10B acquires the distance to an intersection or the distance to an object from a distance measuring device such as Lidar. The non-verbal communication system 10B sets and displays multiple options depending on environmental changes during autonomous driving, such as the number of meters remaining before entering the intersection or whether an object is approaching soon. When the user HM selects multiple options, the vehicle in which the user HM is riding performs autonomous driving according to the options. This allows the user HM to select an action suitable for autonomous driving using brain waves.

[0119] [Fourth Embodiment] A non-verbal communication system according to a fourth embodiment of the present invention will be described with reference to the drawings. Fig. 15 is a diagram showing an example of functional blocks of the non-verbal communication system according to the fourth embodiment.

[0120] 15 , the non-verbal communication system 10C according to the fourth embodiment differs from the non-verbal communication system 10B according to the third embodiment in that it includes an augmented reality space display device 60 and in the configuration of a processing device 20C. The processing device 20C differs from the processing device 20B according to the third embodiment in that it includes an augmented reality space setting unit 28. The other configuration of the non-verbal communication system 10C is the same as that of the non-verbal communication system 10B, and a description of similar parts will be omitted.

[0121] The augmented reality space setting unit 28 sets an augmented reality space around the user HM. The augmented reality space setting unit 28 outputs an image of the set augmented reality space to the augmented reality space display device 60.

[0122] The augmented reality space display device 60 displays an image of the augmented reality space. The augmented reality space display device 60 includes a display 30C on which a plurality of options and a plurality of motion illusion images are displayed.

[0123] The gaze detection device 50 detects the gaze in the image in the augmented reality space.

[0124] As a result, when the user HM sees an object in the augmented reality space, the non-verbal communication system 10C can set a plurality of options corresponding to the object.

[0125] Fifth Embodiment A non-verbal communication system according to a fifth embodiment of the present invention will be described with reference to the drawings. Fig. 16 is a diagram showing an example of functional blocks of the non-verbal communication system according to the fifth embodiment.

[0126] 16 , the nonverbal communication system 10D according to the fifth embodiment differs from the nonverbal communication system 10B according to the third embodiment in that it includes an object detection device 70. The other components of the nonverbal communication system 10D are the same as those of the nonverbal communication system 10B, and a description of the same components will be omitted. The arithmetic processing device 20D of the nonverbal communication system 10D has the same configuration as the arithmetic processing device 20B according to the third embodiment.

[0127] The object detection device 70 detects objects and types of objects around the user HM. The objects are not limited to structures, but may also be people. The objects may also be objects displayed in front of the user HM (such as a round table device or a person). The object detection device 70 selects the type of the detected object and outputs it to the option setting unit 27.

[0128] The option setting unit 27 sets a plurality of options according to the type of object detected by the object detection device 70. The option setting unit 27 outputs the set plurality of options to the image setting unit 21. The image setting unit 21 uses the plurality of options set by the option setting unit 27.

[0129] This allows the non-verbal communication system 10D to automatically set options that are appropriate for the current situation of the user HM.

[0130] For example, the non-verbal communication system 10D can be applied to selecting an application on a personal computer or smartphone, operating a remote robot displayed on a screen, and communicating with other people.

[0131] Specifically, in communication with other people, the non-verbal communication system 10D detects people from images of people in front of the user or people in remote locations captured by a camera, and sets multiple options for greetings and responses to the other person's greetings in a greeting menu selection.

[0132] The non-verbal communication system 10D can automatically set options that are appropriate for the current situation of the user HM, and can carry out non-verbal communication easily and accurately.

[0133] The above-described configuration can also be applied to self-care. For example, the arithmetic processing device 20D assigns and stores what the user HM wants to do to objects around the user HM. For example, the user HM may want to call someone, ask for assistance, etc. This allows the non-verbal communication system 10D to appropriately set multiple options for self-care.

[0134] In addition, in each of the above-described embodiments, a plurality of options and a plurality of images are used. However, a single image may be used, and whether the user HM is "gazing" at the image or not may be determined based on the frequency components of the electroencephalogram signal. For example, if the user HM is "gazing," a frequency component identical to the flashing frequency is detected in the electroencephalogram signal, whereas if the user HM is "not gazing," a frequency component identical to the flashing frequency is not detected in the electroencephalogram signal. Utilizing this, the non-verbal communication system can determine the intention of the user HM.

[0135] In this case, for example, the non-verbal communication system includes a display that displays an image, an EEG detection device that detects the brain waves of a user HM who views the displayed image and generates an EEG signal, and an arithmetic processing device that determines the user's intention based on the EEG signal.

[0136] In this configuration, the arithmetic processing device includes an image setting unit, a frequency component detection unit, and a determination unit. The image setting unit sets a motion illusion image as an image and sets a blinking frequency of the image. The frequency component detection unit detects frequency components of the electroencephalogram signal. The determination unit determines the intention based on the frequency components.

[0137] Furthermore, the configurations and processes of the above-described embodiments can be combined as appropriate, and effects according to the combination can be achieved.

[0138] <1> An electroencephalogram induction system comprising: an image setting unit that sets a motion illusion image as an image and sets a blinking frequency of the image; and a display device that displays the image.

[0139] <2> The electroencephalogram elicitation system according to <1>, wherein the image setting unit changes the motion illusion image over time.

[0140] <3> The electroencephalogram elicitation system according to <2>, wherein the image setting unit changes the size of the motion illusion image over time.

[0141] <4> The electroencephalogram elicitation system according to <2> or <3>, wherein the image setting unit changes the type of the motion illusion image over time.

[0142] <5> The electroencephalogram elicitation system according to any one of <1> to <4>, wherein the image setting unit sets, as the motion illusion image, an image that gives a sensation of being drawn into the image.

[0143] <6> The electroencephalogram elicitation system according to any one of <1> to <5>, wherein the image setting unit sets the flickering frequency to a frequency of spontaneous electroencephalograms.

[0144] <7> The electroencephalogram elicitation system described in any one of <1> to <6>, wherein the electroencephalogram signal is an electroencephalogram signal of a steady-state visual evoked potential.

[0145] <8> The electroencephalogram induction system described in any one of <1> to <7>, wherein the arithmetic processing device includes a training execution unit that trains the user to recognize the image by repeating the setting of the image by the image setting unit.

[0146] <9> A non-verbal communication system comprising: a display that displays an image; an electroencephalogram (EEG) detection device that detects the electroencephalograms of a user who views the displayed image and generates an EEG signal; and a processing device that determines the intention of the user based on the EEG signal, wherein the processing device comprises: an image setting unit that sets a motion illusion image in the image and sets a blinking frequency of the image; a frequency component detection unit that detects frequency components of the EEG signal; and a determination unit that determines the intention based on the frequency components.

[0147] <10> The non-verbal communication system described in <9>, wherein the image setting unit sets a plurality of options and a plurality of images, sets motion illusion images to the plurality of images, and sets a different flashing frequency for each of the plurality of options; the display unit displays the plurality of options and the plurality of images; and the determination unit determines the intention by determining the option based on the frequency component.

[0148] <11> The non-verbal communication system according to <10>, wherein the image setting unit changes the motion illusion image for each of the plurality of options.

[0149] <12> The non-verbal communication system according to any one of <9> to <11>, wherein the image setting unit sets the motion illusion image to a shape corresponding to the action to be performed by the selection.

[0150] <13> The non-verbal communication system according to <8>, further comprising: a gaze detection device that detects the gaze of the user; wherein the arithmetic processing device comprises: an object determination unit that determines an object in front of the gaze; and an option setting unit that sets the plurality of options based on a determination result by the object determination unit.

[0151] <14> The non-verbal communication system according to <13>, wherein the arithmetic processing device includes an option setting unit that sets the plurality of options according to the type of the object determined by the object determination unit, and the image setting unit uses the plurality of options set by the option setting unit.

[0152] <15> The non-verbal communication system described in <13>, wherein the arithmetic processing device includes an augmented reality space setting unit that sets an augmented reality space around the user, and an augmented reality space display device that displays an image of the augmented reality space, and the gaze detection device detects the gaze in the image of the augmented reality space.

[0153] <16> The non-verbal communication system according to <8>, further comprising an object detection device that detects objects around the user, wherein the image setting unit sets the plurality of options and the plurality of images based on a detection result of the object detection device.

[0154] <17> The non-verbal communication system according to <16>, wherein the arithmetic processing device includes an option setting unit that sets the plurality of options depending on the type of the object detected by the object detection device, and the image setting unit uses the plurality of options set by the option setting unit.

[0155] 10, 10A, 10B, 10C, 10D: Non-verbal communication system 10X: Brain wave induction system 20, 20A, 20B, 20C, 20D: Processing device 21: Image setting unit 22: Signal processing unit 23: Frequency component detection unit 24: Determination unit 25: Training execution unit 26: Object determination unit 27: Option setting unit 28: Augmented reality space setting unit 30, 30C: Display 40: Brain wave detection device 50: Gaze detection device 60: Augmented reality space display device 70: Object detection device 221: Amplifier 222: Filter

Claims

1. An electroencephalogram induction system comprising: an image setting unit that sets a motion illusion image as an image and sets the blinking frequency of said image; and a display device that displays said image.

2. The electroencephalogram induction system according to claim 1, wherein the image setting section changes the motion illusion image over time.

3. The electroencephalogram induction system according to claim 2, wherein the image setting section changes the size of the motion illusion image over time.

4. The electroencephalogram induction system according to claim 2 or 3, wherein the image setting section changes the type of the motion illusion image over time.

5. The electroencephalogram induction system according to any one of claims 1 to 4, wherein the image setting unit sets, as the motion illusion image, an image that gives a sensation of being drawn into the image.

6. The electroencephalogram inducing system according to any one of claims 1 to 5, wherein the image setting unit sets the blinking frequency to a frequency of spontaneous electroencephalograms.

7. The electroencephalogram induction system according to any one of claims 1 to 6, wherein the electroencephalogram signal is an electroencephalogram signal of a steady-state visual evoked potential.

8. The electroencephalogram induction system according to any one of claims 1 to 7, wherein the arithmetic processing device is provided with a training execution unit that trains the user in recognizing the image by repeating the setting of the image by the image setting unit.

9. A non-verbal communication system comprising: a display for displaying an image; an electroencephalogram detection device for detecting the electroencephalogram of a user viewing the displayed image and generating an electroencephalogram signal; and a processing unit for determining the intention of the user based on the electroencephalogram signal, wherein the processing unit comprises: an image setting unit for setting a motion illusion image in the image and setting the blinking frequency of the image; a frequency component detection unit for detecting frequency components of the electroencephalogram signal; and a determination unit for determining the intention based on the frequency components.

10. The non-verbal communication system of claim 9, wherein the image setting unit sets a plurality of options and a plurality of images, sets motion illusion images to the plurality of images, and sets a different blinking frequency for each of the plurality of options; the display unit displays the plurality of options and the plurality of images; and the judgment unit judges the intention by judging the option based on the frequency components.

11. The non-verbal communication system according to claim 10, wherein the image setting unit changes the motion illusion image for each of the plurality of options.

12. A non-verbal communication system according to any one of claims 9 to 11, wherein the image setting unit sets the motion illusion image to a shape corresponding to an action to be performed by the user through the selection.

13. A non-verbal communication system as described in claim 8, further comprising a gaze detection device that detects the user's gaze, wherein the arithmetic processing device further comprises: an object determination unit that determines an object in front of the gaze; and an option setting unit that sets the multiple options based on a determination result by the object determination unit.

14. The non-verbal communication system of claim 13, wherein the arithmetic processing device includes an option setting unit that sets the multiple options according to the type of object determined by the object determination unit, and the image setting unit uses the multiple options set by the option setting unit.

15. The non-verbal communication system described in claim 13, wherein the arithmetic processing device includes an augmented reality space setting unit that sets an augmented reality space around the user, and an augmented reality space display device that displays an image of the augmented reality space, and the gaze detection device detects the gaze in the image of the augmented reality space.

16. The non-verbal communication system according to claim 8, further comprising an object detection device that detects objects around the user, and wherein the image setting unit sets the multiple options and the multiple images based on the detection results of the object detection device.

17. The non-verbal communication system described in claim 16, wherein the arithmetic processing device includes an option setting unit that sets the multiple options according to the type of object detected by the object detection device, and the image setting unit uses the multiple options set by the option setting unit.

18. An electroencephalogram induction program that causes a processor to execute the steps of: setting a motion illusion image as an image; setting the blinking frequency of said image; and displaying said image.

19. A non-verbal communication program that causes a processor to execute the steps of: setting a motion illusion image in an image and setting a flashing frequency of the image; displaying the image; detecting brain waves of a user who views the displayed image and generating an brainwave signal; and judging the intention of the user based on the brainwave signal, wherein the step of judging the intention of the user includes the steps of detecting frequency components of the brainwave signal, and judging the intention based on the frequency components.

20. A non-verbal communication program comprising: said image setting step setting a plurality of options and a plurality of images, setting motion illusion images to the plurality of images, and setting a different blinking frequency for each of the plurality of options; said displaying step displaying the plurality of options and the plurality of images; and said judging step judging the intention by judging the option based on the frequency component.

Images