Personalized mental state regulation system and method based on brainwave music
By collecting and mapping brainwave signals to generate personalized brainwave music, the problem of lack of personalized emotion regulation in existing technologies has been solved, and personalized mental state regulation effects have been achieved.
Patent Information
- Application Number
- CN201911179106.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-27
- Publication Date
- 2026-02-06
- Estimated Expiration
- 2039-11-27
AI Technical Summary
Existing systems and methods for regulating emotions through music lack personalization and cannot be tailored to individual differences, resulting in poor emotional regulation effects.
By collecting the brainwave signals of the subjects, personalized brainwave music is generated. The period, frequency, amplitude and average power of the brainwave signals are mapped to the duration, pitch and intensity of the brainwave music to generate stereo brainwave music. This is combined with a mental state assessment module for personalized emotion regulation.
It achieves the generation of personalized brainwave music based on individual brainwave characteristics, which can regulate the mental state of subjects in a short time and avoid the effect of emotion regulation due to different individual sensitivities to conventional music, thus having good targeting.
Smart Images

Figure CN110947075B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of mental state adjustment, more particularly, to a personalized mental state adjustment system and method based on brainwave music. BACKGROUND
[0002] With the increasing pace of life, people's life pressure is increasing, and people pay more and more attention to mental health. Common emotional regulation methods in daily life include video regulation, music regulation, transcranial stimulation, etc.
[0003] The device for transcranial stimulation regulation is relatively expensive and the operation is relatively complex. The effect of mental state regulation by video stimulation is good, but it also needs a device to play the video. Music is a common method for emotional regulation. Psychologists believe that music can regulate the function of the human brain cortex, make the human body secrete beneficial hormones and acetylcholine and other substances, improve the activity of biological enzymes in the body, regulate blood circulation and activate nerve cells, and make the body function tend to be regular, thereby promoting metabolism and increasing the ability to resist stress and disease.
[0004] The existing music emotion regulation system and method mainly selects some existing music to regulate people's emotions according to people's mental state. However, music can induce physiological arousal, but it rarely directly causes specific external reactions of individuals. The final emotional performance of individuals still depends on the overall cognition of music, that is, the emotion is the integrated interpretation result of individuals to the combined music of different harmonies, rhythms, melodies and timbres. However, due to individual differences, everyone's feelings and understanding of music are different. Therefore, the existing music for emotional regulation is not strong in pertinence, and cannot achieve personalized emotional regulation. SUMMARY
[0005] In order to overcome the shortcomings and deficiencies in the prior art, one object of the present application is to provide a personalized mental state adjustment system based on brainwave music, which uses brainwave music generated by itself to regulate emotions, can avoid the influence of different individual sensitivities to regular music on the emotional regulation effect, has good pertinence to subjects, and can achieve personalized emotional regulation. Another object of the present application is to provide a mental state adjustment method for the above-mentioned personalized mental state adjustment system, which can avoid the influence of different individual sensitivities to regular music on the emotional regulation effect, has good pertinence to subjects, and can achieve personalized emotional regulation.
[0006] In order to achieve the above-mentioned objects, the present application is realized by the following technical scheme: a personalized mental state adjustment system based on brainwave music, characterized by comprising:
[0007] An electroencephalogram acquisition module for acquiring the electroencephalogram signals of the subject, and amplifying and filtering the electroencephalogram signals;
[0008] An electroencephalogram music generation module for mapping the electroencephalogram signals into brainwave music, storing the brainwave music and marking corresponding emotional tags, and generating a personal emotional music library;
[0009] A mental state assessment module for analyzing the electroencephalogram signals and obtaining the mental state assessment results of the subject;
[0010] A mental state adjustment module for generating a play control instruction or a stop play instruction according to the mental state assessment results;
[0011] A brainwave music play module for playing the corresponding brainwave music from the personal emotional music library according to the play control instruction, or stopping the brainwave music play according to the stop play instruction;
[0012] The electroencephalogram acquisition module is signal-connected with the electroencephalogram music generation module and the mental state assessment module; the mental state assessment module, the mental state adjustment module and the brainwave music play module are signal-connected in sequence; the brainwave music play module is bidirectionally signal-connected with the electroencephalogram music generation module; and the mental state assessment module is signal-connected with the electroencephalogram music generation module.
[0013] The adjustment principle of the present application is that the electroencephalogram signals are bioelectric signals generated when neurons transmit information; are ion exchange signals generated when the pyramidal cell synapses in the cerebral cortex are active; and are comprehensive representations of the electrical activities of the human brain neurons. The electroencephalogram signals and music have similarities in signal form, and they are both results of brain function activities, and both follow certain common scientific laws, so the electroencephalogram signals can be converted into brainwave music. In a state of tension, stress and fatigue, the brain will generate beta waves; in a state of consciousness and relaxation, the brain will generate alpha waves; in a state of interrupted consciousness and deep relaxation, the brain will generate theta waves; and in a state of deep sleep, the brain will generate delta waves. The electroencephalogram signals can bring a person into different states of consciousness in a short time, by synchronizing the frequencies (Alpha, Beta, Theta and Delta) in the electroencephalogram signals with the brain of the subject, so as to make the brain enter the corresponding state. Music has a strong effect of regulating human emotions, and can affect the types and frequency bands of the electroencephalogram signals, and through resonance, affect the mental state of the subject.
[0014] The mental state adjusting system of the present application firstly collects the brain wave signals of the subjects under different emotions, and maps the brain wave signals into brain wave music corresponding to the emotions to generate a personal emotional music library; when it is necessary to adjust the mental state, the brain wave music generated by the brain wave of the subject is used for emotional adjustment; the emotional adjustment effect can be avoided due to different sensitivities of individuals to conventional music, the subject has good pertinence, and individualized emotional adjustment can be realized.
[0015] Preferably, in the brain wave music generation module, the mapping of the brain wave signals into brain wave music refers to: extracting the period, frequency, amplitude and average power of the left and right brain wave signals within a set time, and mapping the left and right brain wave signals into left and right brain wave music respectively; the period or frequency of the brain wave signals is mapped into the length of the brain wave music, and the amplitude and average power of the brain wave signals are mapped into the pitch and intensity of the brain wave music respectively; the left and right brain wave music is generated by using music synthesis software; and the left and right brain wave music is integrated to form double-channel stereo brain wave music.
[0016] The period of the brain wave signal refers to the time interval between two adjacent troughs or peaks, and the unit is ms. The frequency of the brain wave signal refers to the number of times that the same period of brain wave signal appears in 1 second, and the unit is Hz or cycle / second. The period or frequency of the brain wave signal is mapped into the length of the brain wave music, and the speed of the music rhythm is used to represent the different frequencies of the brain wave signal.
[0017] The amplitude of the brain wave signal refers to the magnitude of the fluctuation of the brain wave signal. The rhythm of the brain wave signal changes with the different activity states of the cerebral cortex; when the brain activity is less, the electrical activity of many neurons in the cerebral cortex tends to be consistent, resulting in a lower frequency and higher amplitude rhythm, which is called synchronization; when the brain activity is more intense, the electrical activity of neurons is not very consistent, resulting in a high frequency and low amplitude rhythm, which is called desynchronization. The pitch and frequency of music are in logarithmic relationship, the range of the pitch is called the tonal range, and the music with higher tonal range is more cheerful and bright, while the music with lower tonal range is more deep and stable. The amplitude and pitch are similar, so the amplitude of the brain wave signal is mapped into the pitch of the brain wave music, and the pitch is used to reflect the intensity of the neuron activity of the brain.
[0018] The average power of the brain wave signal is the energy characteristic of the brain wave signal, which reflects the energy distribution of the brain wave signal, and the intensity of the music reflects the energy size of the sound source, so the average power of the brain wave signal is mapped into the intensity of the brain wave music, and the intensity is used to emphasize the intense neuron activity.
[0019] In summary, the period / frequency, amplitude and average power of the brain wave signal are mapped to the length, pitch and intensity of the brain wave music, respectively. Different brain wave music with different speed, brightness and intensity can be generated according to the period / frequency, amplitude and average power of the brain wave signal, and then the mental state of the subject can be adjusted by using the brain wave music.
[0020] In order to make the brain wave music more stereoscopic and audible, two brain wave signals of two channels are generated by using symmetrical electrodes of left and right hemispheres, and then the brain wave music of one channel is raised by an octave at the original pitch, so as to divide the two-channel brain wave music into bass and treble, and then set left and right sound channels to obtain stereophonic brain wave music.
[0021] Preferably, the mental state evaluation module divides the brain wave signal into several brain wave fragments with a time period T, extracts the time domain features and frequency domain features of each brain wave fragment, and classifies the emotions by a classifier to evaluate the mental state of the subject and obtain the mental state evaluation result.
[0022] Preferably, the time domain features include mean, median, variance and peak value; the frequency domain features include power spectrum and differential entropy; and the classifier is any one of SVM classifier, random forest classifier and width learning system classifier.
[0023] Preferably, in the mental state adjustment module, the target emotion of the subject is set, and the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playing instruction is generated; otherwise, a playing control instruction of playing the brain wave music of the target emotion is generated.
[0024] Preferably, it further comprises:
[0025] a terminal module for storing and displaying the brain wave signal and the mental state evaluation result;
[0026] The brain wave acquisition module and the mental state evaluation module are respectively signal connected with the terminal module.
[0027] Preferably, the terminal module is signal connected with the cloud platform through wireless communication mode; so as to realize data management and storage.
[0028] The mental state adjustment method of the above-mentioned personalized mental state adjustment system based on brain wave music, characterized in that: comprising a personal emotional music library construction stage and a mental state adjustment stage;
[0029] The personal emotional music library construction stage comprises the following steps:
[0030] S1, wearing the device with the brain wave acquisition module on the head of the subject; S2, collecting the brain wave signal of the subject by the brain wave acquisition module;
[0031] In S2, a plurality of stimulating emotions are set, and a plurality of stimulating videos corresponding to the stimulating emotions and an initial evaluation model are initialized; the subject is played with the stimulating videos corresponding to the stimulating emotions in sequence, while the brain wave signal of the subject is collected by the brain wave acquisition module, and the brain wave signal is amplified and filtered, and then the amplified and filtered brain wave signal is transmitted to the mental state evaluation module and the brain wave music generation module.
[0032] In S3, the mental state evaluation module fine-tunes the evaluation model by using the collected brain wave signal to obtain an emotion label; the brain wave music generation module maps the brain wave signal into brain wave music, stores the brain wave music and marks the corresponding emotion label, and constructs a personal emotion music library.
[0033] The mental state adjustment phase includes the following steps:
[0034] In L1, the device with the brain wave acquisition module is worn on the head of the subject.
[0035] In L2, the brain wave signal of the subject is collected in real time by the brain wave acquisition module, and the brain wave signal is amplified and filtered, and then the amplified and filtered brain wave signal is transmitted to the mental state evaluation module.
[0036] In L3, the mental state evaluation module analyzes the brain wave signal to evaluate the mental state of the subject and obtains a mental state evaluation result; the mental state evaluation result is sent to the mental state adjustment module.
[0037] In L4, the mental state adjustment module generates a play control instruction or a stop play instruction according to the mental state evaluation result, and sends it to the brain wave music playing module.
[0038] In L5, the brain wave music playing module plays the corresponding brain wave music from the personal emotion music library according to the play control instruction to adjust the emotion of the subject, or the brain wave music playing module stops playing the brain wave music according to the stop play instruction to complete the mental state adjustment.
[0039] Preferably, in L3, the analysis method of the mental state evaluation module for the brain wave signal is that the mental state evaluation module divides the brain wave signal by time T to obtain a plurality of brain wave fragments, then extracts the time domain features and frequency domain features of each brain wave fragment, and classifies the emotions by using a classifier to evaluate the mental state of the subject and obtain a mental state evaluation result.
[0040] Preferably, in the L4 step, in the mental state adjustment module, a target emotion of the subject is set; the mental state evaluation result is compared with the target emotion; if the mental state evaluation result is the same as the target emotion, a stop playing instruction is generated; otherwise, a playing control instruction of playing the brain wave music of the target emotion is generated.
[0041] In the L5 step, the brain wave music playing module plays the brain wave music with the target emotion according to the playing control instruction, so as to adjust the emotion of the subject.
[0042] Compared with the prior art, the present application has the following advantages and beneficial effects:
[0043] 1. In the present application, the electroencephalogram signals of the subject under different emotions are collected first, and the electroencephalogram signals are mapped into the brain wave music of the corresponding emotion to generate a personal emotion music library; when the mental state needs to be adjusted, the brain wave music generated by the electroencephalogram of the subject is used for emotion adjustment; the different sensitivities of individuals to conventional music can be avoided to affect the emotion adjustment effect, the subject has good pertinence, and the personalized emotion adjustment can be realized.
[0044] 2. In the present application, the brain wave music with different speeds, different happy and bright degrees and different intensities can be generated according to the period / frequency, amplitude and average power of the electroencephalogram signals, and then the mental state of the subject is adjusted by using the brain wave music. BRIEF DESCRIPTION OF DRAWINGS
[0045] Figure 1 is a structural block diagram of the mental state adjustment system of the present application;
[0046] Figure 2 is a principle block diagram of the electroencephalogram collection module in the mental state adjustment system of the present application;
[0047] Figure 3 is a principle block diagram of the brain wave music generation module in the mental state adjustment system of the present application;
[0048] Figure 4 is a principle block diagram of the mental state evaluation module in the mental state adjustment system of the present application;
[0049] Figure 5 is a principle block diagram of the mental state adjustment module in the mental state adjustment system of the present application;
[0050] Figure 6 is a principle block diagram of the brain wave music playing module in the mental state adjustment system of the present application;
[0051] Figure 7 is a structural block diagram of the mental state adjustment system of the present application. DETAILED DESCRIPTION
[0052] The application will be described in further detail below with reference to the drawings and specific embodiments.
[0053] Embodiment one
[0054] The embodiment is a personalized mental state adjustment system based on brain wave music, which has the structure as shown in the figure, comprising: Figures 1 to 6
[0055] An electroencephalogram acquisition module for collecting the electroencephalogram signals of the subject and amplifying and filtering the electroencephalogram signals;
[0056] A brain wave music generation module for mapping the electroencephalogram signals into brain wave music, storing and marking the brain wave music with corresponding emotional tags, and generating a personal emotional music library;
[0057] A mental state evaluation module for analyzing the electroencephalogram signals and obtaining the mental state evaluation results of the subject;
[0058] A mental state adjustment module for generating a play control instruction or a stop play instruction according to the mental state evaluation results;
[0059] A brain wave music play module for playing the corresponding brain wave music from the personal emotional music library according to the play control instruction, or stopping the brain wave music play according to the stop play instruction.
[0060] The electroencephalogram acquisition module is signal connected with the brain wave music generation module and the mental state evaluation module; the mental state evaluation module, the mental state adjustment module and the brain wave music play module are sequentially signal connected; the brain wave music play module is bidirectionally signal connected with the brain wave music generation module; the mental state evaluation module is signal connected with the brain wave music generation module.
[0061] The adjusting principle of the present application is that the brain wave signal is a bioelectric signal generated when neurons transmit information; is an electric wave signal generated by ion exchange when the pyramidal cell synapse in the cerebral cortex is active; and is a comprehensive embodiment of the electrical activity of the human brain neuron group. The brain wave signal and music have similarity in signal form, and they are both the result of brain function activity, and both follow certain common scientific laws, so the brain wave signal can be converted into brain wave music. In a state of tension, stress and fatigue, the brain will generate beta waves; in a state of consciousness and relaxation, the brain will generate alpha waves; in a state of interrupted consciousness and deep relaxation, the brain will generate theta waves; and in a state of deep sleep, the brain will generate delta waves. The brain wave signal can bring a person into different states of consciousness in a short time, and by synchronizing the frequency (Alpha, Beta, Theta and Delta) in the brain wave signal with the brain of the subject, the brain can enter the corresponding state. Music has a strong effect on regulating human emotions, and can affect the type and frequency band of the brain wave, and through resonance, it can affect the mental state of the subject.
[0062] The mental state adjusting method of the above-mentioned personalized mental state adjusting system based on brain wave music comprises a personal emotional music library construction stage and a mental state adjusting stage.
[0063] The personal emotional music library construction stage comprises the following steps:
[0064] S1, wearing a device with a brain wave acquisition module on the head of the subject;
[0065] S2, setting a plurality of stimulating emotions, and a plurality of stimulating videos corresponding to the stimulating emotions and an initial evaluation model; playing the stimulating videos corresponding to the stimulating emotions to the subject in sequence, while the brain wave acquisition module acquires the brain wave signal of the subject, and amplifies and filters the brain wave signal, and then transmits the amplified and filtered brain wave signal to the mental state evaluation module and the brain wave music generation module;
[0066] S3, the mental state evaluation module fine-tunes the evaluation model by using the acquired brain wave signal to obtain an emotional label; the brain wave music generation module maps the brain wave signal to brain wave music, stores the brain wave music and marks the corresponding emotional label, and constructs a personal emotional music library;
[0067] The mental state adjusting stage comprises the following steps:
[0068] L1, wearing a device with a brain wave acquisition module on the head of the subject;
[0069] In L2, the brain wave signal of the subject is collected in real time by the brain wave collection module, and the brain wave signal is amplified and filtered, and then the amplified and filtered brain wave signal is transmitted to the mental state evaluation module;
[0070] In L3, the mental state evaluation module analyzes the brain wave signal to evaluate the mental state of the subject and obtain a mental state evaluation result, and sends the mental state evaluation result to the mental state adjustment module.
[0071] In L4, the mental state adjustment module generates a play control instruction or a stop play instruction according to the mental state evaluation result, and sends the play control instruction or the stop play instruction to the brain wave music play module.
[0072] In L5, the brain wave music play module plays the corresponding brain wave music from the personal emotional music library according to the play control instruction to regulate the emotion of the subject, or the brain wave music play module stops playing the brain wave music according to the stop play instruction to complete the mental state adjustment.
[0073] The mental state adjustment system of the application first collects the brain wave signals of the subject under different emotions, maps the brain wave signals into brain wave music corresponding to the emotions, and generates a personal emotional music library.
[0074] As shown in Figure 2 , the brain wave collection module is used to collect the brain wave signals of the subject, and amplify and filter the brain wave signals. The brain wave collection module can be a wearable device such as a brain wave collection headband, a helmet, or a hat. The brain wave collection module can be controlled and processed by an STM32 chip. First, the wearable device is worn on the head of the subject to make the electrodes stably contact the scalp surface of the subject. Then, the lead selection is performed to collect the multi-lead brain wave signals. The collected brain wave signals are pre-amplified to obtain relatively strong signals. Finally, the brain wave signals are output after post-amplification and filtering operations.
[0075] As shown in Figure 3 , in the brain wave music generation module, the brain wave signals are mapped into brain wave music, which means that the period, frequency, amplitude, and average power of the left and right brain wave signals within a set time are extracted, and the left and right brain wave signals are mapped into left and right brain wave music, respectively. The period or frequency of the brain wave signal is mapped into the length of the brain wave music, and the amplitude and average power of the brain wave signal are mapped into the pitch and intensity of the brain wave music, respectively. The left and right brain wave music is generated by using a music synthesis software. The left and right brain wave music is integrated to form a double-channel stereo brain wave music.
[0076] The brainwave signals of the left and right hemispheres are obtained by extracting signals from the symmetrical electrodes of the left and right hemispheres.
[0077] The period of an electroencephalogram (EEG) signal refers to the time interval between two adjacent troughs or peaks, measured in milliseconds (ms). The frequency of an EEG signal refers to the number of times an EEG signal with the same period repeats within one second, measured in Hz or periods per second. The period or frequency of an EEG signal can be mapped to the duration of a note in brainwave music, using the tempo of the music to represent different frequencies of the EEG signal.
[0078] The amplitude of an electroencephalogram (EEG) signal refers to the magnitude of the fluctuations in the EEG signal. The rhythm of EEG signals varies depending on the activity state of the cerebral cortex. When brain activity is low, the electrical activity of many neurons in the cerebral cortex tends to be synchronized, resulting in a low-frequency, high-amplitude rhythm, known as synchronization. When brain activity is high, the electrical activity of neurons is less synchronized, resulting in a high-frequency, low-amplitude rhythm, known as desynchronization. Musical pitch and frequency have a logarithmic relationship; the range of pitch is called the pitch range. Music with a higher pitch range is more cheerful and bright, while music with a lower pitch range is more deep and stable. Utilizing the similarity between amplitude and pitch, the amplitude of EEG signals can be mapped to the pitch of brainwave music, using pitch to reflect the intensity of neuronal activity in the brain.
[0079] The average power of brainwave signals is an energy characteristic of brainwave signals, reflecting the energy distribution of brainwave signals. The intensity of music reflects the energy of the sound source. Therefore, the average power of brainwave signals can be mapped to the intensity of brainwave music, using the intensity to emphasize more intense neuronal activity.
[0080] In summary, the period / frequency, amplitude, and average power of brainwave signals are mapped to the duration, pitch, and intensity of brainwave music, respectively. Based on the period / frequency, amplitude, and average power of brainwave signals, brainwave music of different tempos, levels of cheerfulness and brightness, and intensities can be generated, thereby allowing for targeted regulation of the mental state of subjects using brainwave music.
[0081] To make the brainwave music more three-dimensional and audible, two channels of brainwave signals from symmetrical electrodes in the left and right hemispheres are used to generate two segments of brainwave music. Then, the brainwave music from one of the channels is raised by an octave from its original pitch to separate the two channels of brainwave music into low and high frequencies. Then, the left and right channels are set separately to obtain stereo brainwave music.
[0082] like Figure 4 As shown, the mental state assessment module divides the EEG signal into several EEG fragments with a time period of T. Then, it extracts the time-domain and frequency-domain features of each EEG fragment and classifies emotions through a classifier to assess the subject's mental state and obtain the mental state assessment result.
[0083] The time domain features include mean, median, variance and peak value; the frequency domain features include power spectrum and differential entropy; and the classifier refers to any one of an SVM classifier, a random forest classifier and a width learning system classifier.
[0084] As shown in the mental state adjustment module, the target emotion of the subject is set, and the mental state evaluation result is compared with the target emotion: if the mental state evaluation result is the same as the target emotion, a stop playing instruction is generated; otherwise, a playing control instruction of playing the target emotion brainwave music is generated. Figure 5
[0085] As shown in the brainwave music playing module, the corresponding brainwave music is selected from the personal emotional music library according to the playing control instruction generated by the mental state adjustment module, and is played out through a loudspeaker or earphones or bone conduction earphones, so as to adjust the emotional state of the subject. Figure 6
[0086] The following takes the construction of adjusting positive emotion as an example for illustration:
[0087] The personal emotional music library construction stage: a personal emotional music library with a positive emotion label is constructed;
[0088] The mental state adjustment stage: the target emotion of the subject in the mental state adjustment module is set to positive emotion; when the mental state evaluation result is not positive emotion, for example, negative emotion or calm emotion, the mental state adjustment module generates a playing control instruction of playing positive emotion brainwave music; the brainwave music playing module randomly selects positive emotion brainwave music from the personal emotional music library for playing until the mental state evaluation result becomes positive emotion, then the mental state adjustment module generates a stop playing instruction, and the brainwave music playing module stops playing music.
[0089] The constructed personal emotional music library and the emotion adjustment classification can be defined according to actual conditions, such as constructing an emotional music library in a relaxed state to relieve emotions such as anxiety, and constructing an emotional music library in a tired state to assist in treating insomnia, etc.
[0090] The following takes the test to verify the effect of the mental state adjustment system and method of the embodiment:
[0091] The test takes relieving sad emotion as an example. The subjects are 10 college students without systematic music training, and the test starts after signing the informed consent form.
[0092] First, build a personal emotional music library for each subject. Each subject wears a brain wave collection cap, and 3 positive video clips are played to the subject, each video clip is about 4 minutes long, after watching each video, the subject fills out the emotional self-rating scale, and rests for one minute, then watches the next video. The subject's brain waves are collected during the video viewing process, and the mental state assessment system assesses the mental state based on the brain waves, then selects samples with consistent emotional self-rating scale results and mental state assessment results to generate brain wave music, ensuring the accuracy of the emotional brain wave music. The positive emotional personal emotional music library is thus constructed.
[0093] Then conduct a mental state adjustment test. Each subject wears a brain wave collection cap, and a sad video clip is played to the subject, the video clip is about 4 minutes long, after watching each video, the subject fills out the emotional self-rating scale. If the result of the emotional self-rating scale shows sad emotion, it is considered that the subject is in a sad state, then the subject's brain waves are collected for assessment and adjustment. The mental state assessment module detects that the mental state at this time is sad, and sends the result to the mental state adjustment module, the mental state adjustment module generates an instruction to play positive emotional brain wave music, and sends it to the brain wave music playing module, the brain wave music playing module selects positive emotional brain wave music from the current subject's personal emotional music library for playing. After listening to the brain wave music for a period of time, the mental state assessment module shows that the current emotion is calm, and after listening to the brain wave music for a period of time, the mental state assessment module shows that the current emotion is positive. At this time, the mental state adjustment module sends a stop playing instruction to the brain wave music playing module to stop playing music.
[0094] This test can show that the system is effective in adjusting emotions and can effectively adjust the mental state of the subject.
[0095] Embodiment Two
[0096] The difference between this embodiment and Embodiment One is that, as shown in Figure 7 The mental state adjustment system further includes a terminal module for storing and displaying the brain wave signals and the mental state assessment results, and the brain wave collection module and the mental state assessment module are signal connected with the terminal module. The terminal module can be a mobile APP or a PC terminal. The collected brain wave signals and the mental state assessment results can be sent to the mobile APP or the PC terminal for display in real time. The terminal module is signal connected with the cloud platform through wireless communication mode; to realize data management and storage. The rest of the structure of this embodiment is the same as that of Embodiment One.
[0097] The above embodiments are the preferred embodiments of the present application, but the embodiments of the present application are not limited to the above embodiments, and any changes, modifications, substitutions, combinations, simplifications, etc. made without departing from the spirit and principles of the present application should be equivalent replacement manners and should be included in the protection scope of the present application.
Claims
1. A personalized mental state regulation system based on brainwave music, characterized in that: include: An EEG acquisition module used to collect brainwave signals from subjects and amplify and filter the brainwave signals; A brainwave music generation module is used to map brainwave signals into brainwave music, store the brainwave music and mark it with corresponding emotion tags to generate a personal emotion music library. The mental state assessment module is used to analyze brainwave signals and obtain the assessment results of the subject's mental state. A mental state adjustment module used to generate playback control commands or stop playback commands based on mental state assessment results; And a brainwave music playback module for retrieving and playing corresponding brainwave music from a personal emotional music library according to playback control instructions, or for stopping brainwave music playback according to stop playback instructions; The EEG acquisition module is connected to the brainwave music generation module and the mental state assessment module respectively; the mental state assessment module, the mental state regulation module, and the brainwave music playback module are connected in sequence; the brainwave music playback module and the brainwave music generation module are connected bidirectionally; the mental state assessment module and the brainwave music generation module are connected in sequence. In the brainwave music generation module, mapping brainwave signals to brainwave music refers to: extracting the period, frequency, amplitude, and average power of the left and right brainwave signals within a set time period, and mapping the left and right brainwave signals to left and right brainwave music respectively; mapping the period or frequency of the brainwave signal to the duration of the brainwave music, and mapping the amplitude and average power of the brainwave signal to the pitch and intensity of the brainwave music respectively; and generating left and right brainwave music using music synthesis software. Integrate left and right brainwave music to form dual-channel stereo brainwave music; The personalized mental state regulation system includes a mental state regulation method, which includes a personal emotional music library construction phase. The construction phase of the personal emotion music library includes the following steps: Step S1: The device with the EEG acquisition module is worn on the subject's head. Step S2: Set several stimulating emotions, as well as the corresponding stimulating videos and initial assessment models for each stimulating emotion; play the stimulating videos corresponding to each stimulating emotion to the subject in sequence, while the EEG acquisition module collects the subject's EEG signals, amplifies and filters the EEG signals, and then transmits the amplified and filtered EEG signals to the mental state assessment module and the brainwave music generation module. In step S3, the mental state assessment module uses the collected EEG signals to fine-tune the assessment model to obtain emotion labels; the brainwave music generation module maps the EEG signals into brainwave music, stores the brainwave music and marks it with the corresponding emotion labels to build a personal emotion music library. The mental state regulation method also includes a mental state regulation stage; The mental state adjustment phase includes the following steps: In step L1, the device with an EEG acquisition module is worn on the subject's head. In step L2, the EEG acquisition module collects the subject's brainwave signals in real time, amplifies and filters the brainwave signals, and then transmits the amplified and filtered brainwave signals to the mental state assessment module. In step L3, the mental state assessment module analyzes the brainwave signals to assess the subject's mental state and obtain the mental state assessment results; the mental state assessment results are then sent to the mental state regulation module. In step L4, the mental state adjustment module generates playback control instructions or stop playback instructions based on the mental state assessment results and sends them to the brainwave music playback module. In step L5, the brainwave music playback module retrieves corresponding brainwave music from the personal emotional music library according to the playback control command to play it, thereby regulating the subject's emotions; or the brainwave music playback module stops playing brainwave music according to the stop playback command, thus completing the regulation of mental state.
2. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: The mental state assessment module divides the EEG signal into time fragments with a time period of T to obtain several EEG fragments. Then, it extracts the time domain and frequency domain features of each EEG fragment, classifies emotions through a classifier, and thus assesses the subject's mental state to obtain the mental state assessment result.
3. The personalized mental state regulation system based on brainwave music according to claim 2, characterized in that: The time-domain features include mean, median, variance, and peak value; the frequency-domain features include power spectrum and differential entropy; the classifier refers to any one of SVM classifier, random forest classifier, and wide learning system classifier.
4. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: In the mental state regulation module, a target emotion is set for the subject, and the mental state assessment result is compared with the target emotion: if the mental state assessment result is the same as the target emotion, a stop playback command is generated; otherwise, a playback control command is generated to play brainwave music of the target emotion.
5. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: Also includes: A terminal module used to store and display brainwave signals and mental state assessment results; The EEG acquisition module and the mental state assessment module are respectively connected to the terminal module via signal transmission.
6. The personalized mental state regulation system based on brainwave music according to claim 5, characterized in that: The terminal module is connected to the cloud platform via wireless communication.
7. The personalized mental state regulation system based on brainwave music according to claim 1, characterized in that: In step L4, in the mental state adjustment module, the target emotion of the subject is set; the mental state assessment result is compared with the target emotion: if the mental state assessment result is the same as the target emotion, a stop playback instruction is generated; otherwise, a playback control instruction to play the target emotion brainwave music is generated. In step L5, the brainwave music playback module retrieves brainwave music with the target emotion tag from the personal emotion music library according to the playback control command, and plays it to regulate the subject's emotions.
Citation Information
Patent Citations
Music brain electricity analytical method
CN101015451A
Brain wave music generation method
CN102999701A
Method for increasing deep sleep time based on personalized pink noises
CN103071226A
Personalized healing sounds database
CN103313748A
Device and method for adjusting driver emotional state through different affective characteristic music
CN104548309A