Brainwave audio processing method, device and system
By analyzing the user's EEG signal characteristics, and automatically selecting or creating matching audio from the personal brain wave audio library, the problem of lack of targeted selection of brain wave audio by users in the existing technology is solved, and the targeted and efficient application effect is improved .
Patent Information
- Application Number
- CN202110492520.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-06
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-05-06
AI Technical Summary
In existing brain-wave audio applications, users lack targetedness when selecting brain-wave audio, resulting in limited application effects and unable to automatically select appropriate audio based on the user's personalized EEG characteristics.
By obtaining the user's EEG signal, performing feature analysis, selecting matching audio from the personal brainwave audio library based on the user's EEG characteristics for playback, and creating or converting audio when necessary to meet the user's preferences.
It realizes automatic selection of brainwave audio based on the user's personalized EEG characteristics, improving selection efficiency and matching, and ensuring targeted and personalized playback effects.
Smart Images

Figure CN113220122B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of brain wave audio technology, and in particular to a brain wave audio processing method, device and system. Background Art
[0002] As the pace of life accelerates and life pressure increases, more and more attention is paid to physical and mental health. Audio, as a way to adjust the state of the scene, is accepted by more and more people.
[0003] Since brainwave audio contains physiological information of the brain, it is more effective than traditional audio. It has an increasingly wider audience in areas such as sleep aid or mood regulation, and devices and applications powered by brainwave audio have emerged. During the application process, the interface of the brainwave audio application displays information of multiple brainwave audios in a passive shelf manner, and users can select brainwave audio to play from the brainwave audio displayed in the passive shelf manner. The interface of the traditional brainwave audio application is similar to the interface of the traditional music playback application, which displays fixed brainwave audio in a passive shelf manner.
[0004] These brainwave audios are not targeted at users, and users can only make choices based on their subjective audio-visual experience during the selection process of brainwave audios, which limits the application effect of the selected brainwave audios. Summary of the invention
[0005] The purpose of the present invention is to provide a brain wave audio processing method, device and system to address the deficiencies in the above-mentioned prior art, so as to solve the problem that the current selection of brain wave audio is not targeted, which affects the application effect of brain wave audio.
[0006] To achieve the above purpose, the technical solution adopted by the embodiment of the present invention is as follows:
[0007] In a first aspect, an embodiment of the present invention provides a method for processing brainwave audio, comprising:
[0008] Acquire a first electroencephalogram signal collected by an electroencephalogram device;
[0009] Performing feature analysis on the first EEG signal to obtain a first EEG feature;
[0010] According to the first EEG feature, selecting an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played, wherein the personal EEG audio library includes: at least one EEG audio that matches the historical EEG signal of the user;
[0011] Play the brainwave audio to be played.
[0012] Optionally, before selecting, according to the first EEG feature, an EEG audio matching the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played, the method further includes:
[0013] In response to the audition and playback operation of the preset brain wave audio, a second brain wave signal collected by the brain wave device is acquired;
[0014] Performing feature analysis on the second EEG signal to obtain a second EEG feature;
[0015] determining, based on the second EEG feature, whether the user's preference for the preset EEG audio meets a preset preference condition;
[0016] If the preference degree meets the preset preference condition, the personal brainwave audio library is created according to the preset brainwave audio.
[0017] Optionally, creating the personal brainwave audio library according to the preset brainwave audio includes:
[0018] According to the classification label of the preset brainwave audio, determine, from a preset brainwave audio library, a brainwave audio with the same classification label as the preset brainwave audio as an associated brainwave audio corresponding to the preset brainwave audio;
[0019] The personal brainwave audio library is created according to the preset brainwave audio and the associated brainwave audio.
[0020] Optionally, determining, based on the second EEG feature, whether the user's preference for the preset EEG audio satisfies a preset preference condition includes:
[0021] Determining a characteristic difference between the first EEG characteristic and a characteristic of a preset reference EEG signal;
[0022] According to the feature difference value and a plurality of preset feature difference value ranges of preference degrees, determining the preference degree corresponding to the feature difference value range to which the feature difference value belongs as the target preference degree;
[0023] Determining whether the target preference is greater than or equal to a preset preference threshold;
[0024] If the target preference is greater than or equal to the preference threshold, determining that the user's preference for the preset brain wave audio satisfies the preset preference condition;
[0025] If the target preference is less than the preference threshold, it is determined that the user's preference for the preset brain wave audio does not satisfy the preset preference condition.
[0026] Optionally, selecting, according to the first EEG feature, an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played includes:
[0027] According to the band to which the EEG frequency in the first EEG feature belongs, a brainwave audio with the same band is determined from the personal brainwave audio library as the brainwave audio to be played.
[0028] Optionally, selecting, according to the first EEG feature, an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played includes:
[0029] performing emotion recognition on the user according to the first EEG feature to obtain the emotion type of the user;
[0030] According to the emotion type, the brainwave audio with the audio tag corresponding to the emotion type is determined from the personal brainwave audio library as the brainwave audio to be played.
[0031] Optionally, the method further includes:
[0032] In response to the input brain wave audio conversion operation, obtaining a third brain wave signal of the user collected by the brain wave device;
[0033] Performing feature analysis on the third EEG signal to obtain a third EEG feature;
[0034] According to the third EEG feature, a preset brainwave audio algorithm is used to generate target brainwave audio and add it to the personal brainwave audio library.
[0035] Optionally, the brainwave audio conversion operation includes: preset audio information;
[0036] The method of generating target brain wave audio by using a preset brain wave audio algorithm according to the third brain wave feature includes:
[0037] According to the third EEG feature, the preset audio is converted into the target EEG audio using the EEG audio algorithm.
[0038] In a second aspect, an embodiment of the present application further provides a brainwave audio processing device, comprising: a memory and a processor, wherein the memory stores a computer program executable by the processor, and when the processor executes the computer program, any brainwave audio processing method provided in the first aspect is implemented.
[0039] In a third aspect, an embodiment of the present application further provides a brain wave audio processing system, comprising: a server device, a client device and an electroencephalogram device; the server device can be communicatively connected with the client device, and the client device is communicatively connected with the electroencephalogram device;
[0040] Wherein, the EEG device is used to collect EEG signals;
[0041] The server device is used to store brainwave audio;
[0042] The client device is used to process brain wave audio based on the brain wave signal collected from the brain wave device to implement any brain wave audio processing method provided in the first aspect above.
[0043] The beneficial effects of this application are:
[0044] In the brainwave audio processing method, device and system provided by the present application, the first brainwave signal collected by the brainwave device can be feature analyzed to obtain the first brainwave feature. According to the first brainwave feature, the brainwave audio matching the first brainwave feature is selected from the personal brainwave audio library of the user monitored by the brainwave device as the brainwave audio to be played, and the audio to be played is played, wherein the personal brainwave audio library includes: at least one brainwave audio matching the historical brainwave signal of the user. In this method, since the brainwave audio to be played can be automatically selected according to the brainwave feature of the collected brainwave signal, compared with the traditional solution of selecting brainwave audio from the brainwave audio displayed on the passive shelf, the brainwave audio selected by this method is more matched with the current brainwave feature of the user, and is more targeted to the monitored user; and, since this method selects brainwave audio from the user's personal brainwave audio library, rather than screening brainwave audio from the traditional entire brainwave audio library, the selection efficiency of the brainwave audio is higher, and the selected brainwave audio has a better matching degree with the brainwave feature, thereby effectively ensuring the application effect of playing brainwave audio. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.
[0046] Figure 1 A schematic diagram of a scenario of a brain wave audio processing system provided in an embodiment of the present application;
[0047] Figure 2 A schematic diagram of a flow chart of a method for processing brainwave audio provided in an embodiment of the present application;
[0048] Figure 3 A method flow for selecting brain wave audio in a brain wave audio processing method provided in an embodiment of the present application Figure 1 ;
[0049] Figure 4 A method flow for selecting brain wave audio in a brain wave audio processing method provided in an embodiment of the present application Figure 2 ;
[0050] Figure 5 A method flow for creating a personal brainwave audio library in a brainwave audio processing method provided in an embodiment of the present application Figure 1 ;
[0051] Figure 6 A method flow for creating a personal brainwave audio library in a brainwave audio processing method provided in an embodiment of the present application Figure 2 ;
[0052] Figure 7 A flow chart of a method for determining the audiovisual preference of brainwave audio in a brainwave audio processing method provided in an embodiment of the present application;
[0053] Figure 8 A flowchart of a method for adjusting playback based on EEG signals in a brain wave audio processing method provided in an embodiment of the present application;
[0054] Fig. 9 A flow chart of a method for converting brain wave audio in a brain wave audio processing method provided in an embodiment of the present application;
[0055] Fig.10 A schematic diagram of a brain wave audio processing device provided in an embodiment of the present application;
[0056] Fig.11 A schematic diagram of a brain wave audio processing device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0057] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments.
[0058] It should be noted that the terms used in the embodiments provided in this application are only for describing specific embodiments, and are not intended to limit the present disclosure. The words "one", "one (kind)" and "the" used herein should also include the meanings of "multiple" and "multiple", unless the context clearly indicates otherwise. In addition, the terms "including", "comprising" and the like used herein indicate the presence of the features, steps, operations and / or parts, but do not exclude the presence or addition of one or more other features, steps, operations or parts.
[0059] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having the meaning consistent with the context of each embodiment described below, and should not be interpreted in an idealized or overly rigid manner.
[0060] In order to facilitate the understanding of the solutions provided by the following embodiments of the present application, before describing the technical solutions provided by the present application, the terms involved in the present application are explained as follows:
[0061] EEG equipment: also known as brain-computer interface, EEG monitoring equipment, EEG acquisition equipment, EEG sensors, brain wave equipment, EEG terminals and other equipment that can collect EEG signals. It realizes the communication channel between the brain and external devices, so that information can be sent and equipment can be controlled between the two.
[0062] Signal preprocessing: Since EEG signals are very weak, generally between 0μV and 75μV, EEG signals are interfered by some internal and external factors during the acquisition process, resulting in various noises. Such noises are called artifacts, such as electrooculography, electrocardiography, and electromyography. In addition, other unknown interference sources may also affect the acquisition of EEG, such as spatial electromagnetic distribution, equipment noise interference, external electromagnetic activity interference, etc. Therefore, when EEG signals are acquired, they need to be preprocessed to eliminate the interference of the above artifacts while ensuring that the original EEG signals do not lose important information.
[0063] EEG pattern recognition: Feature extraction of EEG signals after signal preprocessing is a key step in pattern recognition or classification, and the feature extraction results are directly related to the accuracy of the classification results to be performed next. Due to the non-stationary, nonlinear and highly random characteristics of EEG signals, feature extraction is a relatively difficult operation. Currently, the more common feature extraction methods include four categories: time domain analysis, frequency domain analysis, time-frequency domain analysis and nonlinear dynamics analysis.
[0064] After extracting characteristic parameters from EEG signals using feature extraction methods, it is necessary to use a suitable classification algorithm to process the extracted characteristic parameter set, so as to achieve the purpose of sleep staging or emotion recognition. In the field of machine learning, there are two traditional learning methods, namely supervised learning and unsupervised learning. Among them, supervised learning includes neural networks, support vector machines, decision trees, etc. These algorithms are all trained by "learning" a set of input sample data and its corresponding output labels in advance to train a classifier, and then use it to predict the unlabeled sample data to be input to obtain its corresponding classification label. In other words, the above classification algorithm can be a pre-trained classifier or classification model. For the pre-trained classifier or classification model, the goal of its training process is to improve the overall classification accuracy of the data set, and seek to minimize the difference between the same type of data after classification and maximize the difference between different types of data. In this way, it can be ensured that after classifying the EEG features based on the trained classifier or classification model, the respective labels obtained are more accurate.
[0065] Brainwave audio: Different from conventional audio, brainwave audio is a synthetic audio. The waveform of brainwave audio contains harmonics less than 20HZ that cannot be heard by human ears, which will induce the brain to enter a state of relaxation and then regulate people's emotions. The frequency band of brainwave audio, also known as the frequency band, can usually be at least one of the α band, β band, θ band and δ band. When the band of a person's EEG signal is the α band, the person is conscious but the body is relaxed. Because in this state, the energy consumption of the body and mind is the least, and the energy required by the brain is relatively high, the operation will be faster and smoother, the inspiration and intuition will be sharp, and the brain activity will be lively. Modern science actively advocates that α waves are the best brainwave state for people to learn and think, and this is the reason.
[0066] Before describing the brainwave audio processing method provided in the embodiment of the present application, an example of a brainwave audio processing system to which the brainwave audio processing method is applied is first described. Figure 1 This is a schematic diagram of a brainwave audio processing system provided in an embodiment of the present application. Figure 1 As shown, the brainwave audio processing system includes: a server device 11, a client device 12 and an electroencephalogram device 13. Among them, the server device 11 can be connected to the client device 12 for communication, and the client device 12 can be connected to the electroencephalogram device 13 for communication. Of course, whether it is the communication connection between the server device 11 and the client device 12, or the communication connection between the client device 12 and the electroencephalogram device 13, it can be a wireless communication connection or a wired communication connection.
[0067] The EEG device 13 is used to collect EEG signals. It can be a wearable device, such as a head-mounted EEG device, which can be integrated with an audio playback device such as headphones to collect EEG signals and play brain wave audio. The EEG device 13 can be provided with EEG electrodes. After the user wears the EEG device 13, its EEG electrodes can act on the user's head to collect the user's EEG signals, and the collected EEG signals are fed back to the client device 12. Figure 1 The EEG device 13 in the figure takes an EEG device that integrates audio playback and EEG signal acquisition functions as an example. In actual applications, the EEG device 13 that collects EEG signals and the audio playback device may also be different devices, which are respectively connected to the client device 12 through their respective interfaces.
[0068] The server device 11 is a server or other computer device of the server application of brainwave audio, which can be used to store brainwave audio. For example, the server device 11 can store a large amount of synthesized brainwave audio such as brainwave music in the form of a web page (WEB) or an application (APP) at the foreground, and divide it into multiple categories of brainwave audio according to preset classification rules for user browsing. The server device 11 can be operated by the administrator in the background to upload brainwave audio and manage operations.
[0069] The client application of the brainwave audio can be a web page or an APP. The user can log in through the web page of the client application or the login page of the application program, and search for brainwave audio under each category. When the user searches for the brainwave audio of interest, the payment module can be called to perform the payment operation for the selected brainwave audio, and the brainwave audio is downloaded to the local of the client device 12.
[0070] The client device 12 is a device that has a client application for brainwave audio installed and running, which can be a mobile terminal such as a smart phone, a tablet computer, etc., which can be used to collect brainwave signals from the brainwave device and process brainwave audio based on the brainwave signals to implement any of the brainwave audio processing methods described below.
[0071] The brainwave audio processing methods provided in the following embodiments of the present application may be implemented by the client device 12 . The brainwave audio processing methods provided in the present application are illustrated by multiple examples as follows.
[0072] Figure 2 A flowchart of the brainwave audio processing method provided in an embodiment of the present application. Figure 2 As shown, the brainwave audio processing method may include:
[0073] S201, obtaining a first electroencephalogram signal collected by an electroencephalogram device.
[0074] In a possible implementation, the first EEG signal collected by the EEG device can be obtained when it is detected that the user is wearing the EEG device; or the first EEG signal collected by the EEG device can be obtained after a preset time interval when it is detected that the user is wearing the device; or the first EEG signal collected by the EEG device can be obtained when it is detected that the user is wearing the EEG device and the user inputs an operation to automatically play brainwave audio through the operation interface of the brainwave audio application on the client device.
[0075] Of course, the first EEG signal collected by the EEG device may also be acquired when other conditions are detected.
[0076] S202: Perform feature analysis on the first EEG signal to obtain a first EEG feature.
[0077] In a possible implementation, a preset feature extraction method may be used to perform feature analysis on the first EEG signal to obtain a first EEG feature. The feature extraction method may be, for example, a time domain analysis method, a frequency domain analysis method, or any of a time-frequency domain analysis method. The first EEG feature may be a feature that characterizes the EEG state of the user before playing the EEG audio.
[0078] Optionally, before the first EEG signal is subjected to feature analysis, the first EEG signal may be subjected to artifact processing to remove low-frequency artifact data such as electrooculogram, electrocardiogram and electromyography in the first EEG signal. For example, a preset low-pass filter may be used to filter the first EEG signal to remove artifact data above a preset frequency value. The preset frequency value may be, for example, 40 Hz. The above-mentioned artifact processing may also be referred to as preprocessing of EEG signals.
[0079] After performing artifact processing on the first EEG signal, feature analysis is performed on the first EEG signal after artifact processing, which can ensure that the obtained first EEG feature is more accurate and avoid interference from artifact data.
[0080] S203: According to the first EEG feature, select an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played.
[0081] The personal brain wave audio library includes: at least one brain wave audio that matches the historical EEG signal of the user.
[0082] The user monitored by the EEG device is the user wearing the EEG device. The brainwave audio application running on the client device, i.e., the client application of the brainwave audio, may have a personal brainwave audio module. For each user using the brainwave audio application, each personal brainwave audio library may be set through the personal brainwave audio module.
[0083] The brainwave audio in each user's personal brainwave audio library may include: at least one brainwave audio that matches the historical brainwave signal of each user. The historical brainwave signal may be a brainwave signal acquired before the first brainwave signal is acquired. In the personal brainwave audio library, the brainwave audio that matches the historical brainwave signal may include, for example: a brainwave audio generated based on the historical brainwave signal, and / or a brainwave audio selected from a preset brainwave audio library based on the historical brainwave signal.
[0084] In a specific implementation, based on the first EEG feature, a brainwave audio whose similarity with the first EEG feature meets a preset feature similarity condition can be selected from the user's personal brainwave audio library, that is, the brainwave audio matching the first EEG feature.
[0085] After the brainwave audio that matches the first brainwave feature is selected, the selected brainwave audio can be determined as the brainwave audio to be played.
[0086] S204, playing the brain wave audio to be played.
[0087] When the brainwave audio to be played is determined, the brainwave audio to be played can be transmitted to an audio playback device connected to the client device, such as headphones, to play the brainwave audio. The selected audio can be used to help the monitored user sleep or regulate his emotions.
[0088] The brainwave audio processing method provided in this embodiment can perform feature analysis on the first brainwave signal collected by the brainwave device to obtain the first brainwave feature. According to the first brainwave feature, the brainwave audio matching the first brainwave feature is selected from the personal brainwave audio library of the user monitored by the brainwave device as the brainwave audio to be played, and the audio to be played is played, wherein the personal brainwave audio library includes: at least one brainwave audio matching the historical brainwave signal of the user. The method provided in this embodiment can automatically select the brainwave audio to be played according to the brainwave feature of the collected brainwave signal. Compared with the traditional solution of selecting brainwave audio from the brainwave audio displayed on the passive shelf, the brainwave audio selected by this method is more matched with the current brainwave feature of the user and more targeted to the monitored user; and because the method selects brainwave audio from the user's personal brainwave audio library, rather than screening brainwave audio from the traditional entire brainwave audio library, the selection efficiency of the brainwave audio is higher, and the selected brainwave audio has a better matching degree with the brainwave feature, thereby effectively ensuring the application effect of playing brainwave audio.
[0089] Based on the above-mentioned brain wave audio processing method, the embodiment of the present application also adopts an implementation method of selecting brain wave audio to be played, which is illustrated as follows. In this implementation method, the brain wave audio can be selected according to the frequency band to which the brain wave frequency in the first brain wave feature belongs. Figure 3 A method flow for selecting brain wave audio in a brain wave audio processing method provided in an embodiment of the present application Figure 1 .like Figure 3 As shown, in S203 shown above, according to the first EEG feature, selecting an EEG audio matching the first EEG feature from the personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played may include:
[0090] S301, determining the band to which the EEG frequency in the first EEG feature belongs.
[0091] The first EEG feature obtained by feature analysis may include: EEG frequency. Therefore, in the implementation method, the EEG frequency may be compared with the frequency ranges of multiple preset EEG bands to determine the band to which the EEG frequency belongs. The multiple EEG bands may include: δ band, θ band, α band and β band, wherein the frequency range of δ band is 1Hz-3Hz, the frequency range of θ band is 4Hz-7Hz, the frequency range of α band is 8Hz-13Hz, and the frequency range of β band is 14Hz-30Hz.
[0092] The band to which the EEG frequency belongs may be one of four frequency bands.
[0093] S302: According to the band to which the EEG frequency in the first EEG feature belongs, determine from the personal EEG audio library an EEG audio with the same band as the EEG audio to be played.
[0094] Each brainwave audio in the personal brainwave audio library may contain an audio segment of at least one of the above-mentioned brainwave bands. Therefore, for each brainwave audio in the personal brainwave audio, the bands of each audio end in each brainwave audio can be predetermined to obtain the bands included in each brainwave audio, thereby constructing a corresponding relationship between each brainwave audio and the bands in the personal brainwave audio library. The bands corresponding to each brainwave audio may include: the bands of each audio segment in each brainwave audio
[0095] Then, in a possible implementation, based on the band to which the EEG frequency belongs and the correspondence between each brainwave audio and the band in the personal brainwave audio library, the brainwave audio with the same band can be determined from the personal brainwave audio library as the brainwave audio to be played.
[0096] There can be at least one brainwave audio with the same band. If there are multiple brainwave audios, one brainwave audio can be randomly selected from the multiple brainwave audios or other selection methods can be used to select one brainwave audio as the brainwave audio to be played; or all of the multiple brainwave audios can be used as the brainwave audios to be played, and during the playback process, they can be played according to the preset arrangement order.
[0097] The method provided in this embodiment can intelligently select brainwave audio with the same band as the brainwave audio to be played from the personal brainwave audio library according to the band to which the brainwave frequency in the first brainwave feature belongs, thereby ensuring that the screened brainwave audio to be played is more matched with the user's brainwave frequency band, thereby ensuring the application effect of playing the brainwave audio.
[0098] Based on the above-mentioned brain wave audio processing method, the embodiment of the present application also adopts another implementation method of selecting the brain wave audio to be played, which is illustrated as follows. In this other implementation method, the user's emotion recognition can be performed according to the first EEG feature, and the brain wave audio is selected according to the emotion recognition result. Figure 4 A method flow for selecting brain wave audio in a brain wave audio processing method provided in an embodiment of the present application Figure 2 .like Figure 4 As shown, in S203 shown above, according to the first EEG feature, selecting an EEG audio matching the first EEG feature from the personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played may include:
[0099] S401. Perform emotion recognition on the user according to the first EEG feature to obtain the emotion type of the user.
[0100] For example, based on the first EEG feature, a preset emotion recognition model can be used to perform emotion recognition on the user to obtain the user's emotion type. The emotion recognition model can be a classification model trained in advance using EEG features of sample EEG signals of preset multiple emotion types.
[0101] Of course, in other examples, other algorithms can be used to identify the user's emotions based on the first EEG feature. For example, the fluctuations of the first EEG feature within a preset time and the characteristic fluctuations of multiple preset emotions can be compared, and the user's emotion type can be determined based on the comparison results.
[0102] S402: According to the emotion type, determine from the personal brain wave audio library the brain wave audio having the audio tag corresponding to the emotion type as the brain wave audio to be played.
[0103] In a possible implementation, the audio tag corresponding to the emotion type can be determined based on the emotion type and a preset mapping relationship table between the emotion type and the audio tag, and then the brainwave audio having the brainwave audio can be determined from the personal brainwave audio library as the brainwave audio to be played.
[0104] The audio tag corresponding to the emotion type may include: at least one tag that can represent the emotion. For example, if the emotion type is "excited", it can be determined that the tag corresponding to the emotion type includes: "excited", "happy", "cheerful", "happy" and other at least one field tag.
[0105] Whether it is each brainwave audio in a personal brainwave audio library or each brainwave audio in the entire preset brainwave audio library, it can have at least one type of audio tag, which can at least include: an audio tag for characterizing an emotional state. The audio tag corresponding to the emotion type determined in this embodiment is the audio tag characterizing the emotional state, which can also be called an emotion tag or other similar expressions, and the embodiments of the present application are not limited to this.
[0106] The method provided in this embodiment can identify the user's emotions through the first EEG feature to obtain the user's emotion type, and based on the emotion type, intelligently select the brainwave audio with the audio tag corresponding to the emotion type from the personal brainwave audio library as the brainwave audio to be played, thereby realizing the intelligent selection of brainwave audio based on the first EEG feature, which can ensure that the screened brainwave audio to be played is more matched with the user's brainwave frequency band, thereby effectively ensuring the application effect of playing the brainwave audio.
[0107] Based on any of the above-mentioned brain wave audio processing methods, the embodiments of the present application also provide some possible implementation methods for creating a personal brain wave audio library through some examples. Figure 5 A method flow for creating a personal brainwave audio library in a brainwave audio processing method provided in an embodiment of the present application Figure 1 ,like Figure 5 As shown, before the method selects the brainwave audio matching the first brainwave feature from the personal brainwave audio library of the user monitored by the brainwave device as the brainwave audio to be played according to the first brainwave feature in the above S203, the method may further include:
[0108] S501. In response to a trial listening and playing operation on a preset brain wave audio, a second brain wave signal collected by the brain wave device is obtained.
[0109] The interface of the brainwave audio application on the client device may display multiple brainwave audios in a preset brainwave audio library for the user to select a brainwave audio. When the user browses the brainwave audios displayed on the interface of the brainwave audio application and finds a brainwave audio of interest, the user may input a trial listening and playing operation for the brainwave audio. In other words, the preset brainwave audio is the brainwave audio selected by the user from the multiple brainwave audios in the preset brainwave audio library.
[0110] On the interface of the brainwave audio application, the multiple brainwave audios in the preset brainwave audio library can be displayed in the form of groups, that is, multiple brainwave audio sets are displayed on the interface, and each brainwave audio set has at least one brainwave audio. Each brainwave audio set also has a corresponding classification label. Therefore, before displaying the multiple brainwave audio sets, the multiple brainwave audios can be divided into multiple brainwave audio sets according to the preset audio classification rules.
[0111] The preset audio classification rule may be, for example, the function of the brainwave audio or the timbre of the brainwave audio. The function of the brainwave audio may be, for example, "deep relaxation", "energized", "improved memory", "improved intelligence", "efficient sleep", "headache relief", "vertigo prevention", "smoking cessation assistance", "excitement and positivity", etc.
[0112] The classification label of each brain wave audio set can be, for example, at least one label such as a label of its corresponding functional role and a label of its corresponding emotional state.
[0113] When the user inputs an audition and playback operation for the preset brain wave audio on the interface, the preset brain wave audio can be played in response to the audition and playback operation, and the second brain wave signal collected by the brain wave device during the user's audition of the preset brain wave audio is obtained. The second brain wave signal is the brain wave feedback of the user during the audition of the preset brain wave audio.
[0114] It should be noted that the playback of the preset brain wave audio may be the playback of the audition portion of the preset brain wave audio, such as the prelude audio or the middle audio of the preset brain wave audio.
[0115] S502: Perform feature analysis on the second EEG signal to obtain a second EEG feature.
[0116] The second EEG feature may be a feature that characterizes the EEG fluctuation of the user.
[0117] It should be noted that, in the process of obtaining the second EEG feature, the second EEG signal may also be first subjected to artifact processing to remove artifact data such as electrooculogram, electrocardiogram and electromyography in the second EEG signal, and then feature extraction is performed on the second EEG signal after the artifact data is removed to obtain the second EEG feature. The specific implementation of artifact processing can refer to the description of artifact processing of the first EEG feature in the above embodiment, which will not be repeated here.
[0118] S503: Determine, based on the second EEG feature, whether the user's preference for the preset EEG audio meets a preset preference condition.
[0119] After obtaining the second EEG feature, the EEG fluctuations of the user when listening to the preset EEG audio can be determined based on the second EEG feature, and the user's preference for the preset EEG audio can be determined based on the EEG fluctuations, and then by judging whether the preference is greater than or equal to a preset preference threshold, it is determined whether the preference meets the preset preference condition. The user's preference for the preset EEG audio calculated based on the EEG wave band and the preference threshold are both in the form of numerical values to represent the corresponding preferences.
[0120] S504: If the preference degree meets the preset preference condition, the personal brain wave audio library is created according to the preset brain wave audio.
[0121] In a possible implementation process, when it is determined that the user's preference for the preset brainwave audio meets the preset preference conditions, the preset brainwave audio can be added to the brainwave audio library created for the user to obtain the user's personal brainwave audio library; or, based on the preset brainwave audio, brainwave audio whose correlation with the preset brainwave audio meets the preset correlation conditions can be screened from the preset brainwave audio library, thereby adding the preset brainwave audio and the brainwave audio screened from the preset brainwave audio library to the brainwave audio library created for the user to obtain the user's personal brainwave audio library.
[0122] The brainwave audio processing method provided in this embodiment can obtain the second EEG signal of the user when listening to the preset brainwave audio, and perform feature analysis to obtain the second EEG feature. According to the second EEG feature, it is determined whether the user's preference for the preset brainwave audio meets the preset preference condition. If the preference meets the preset preference condition, a personal brainwave audio library is created according to the preset brainwave audio, thereby realizing a personalized customized brainwave audio service.
[0123] In the above Figure 5 Based on this, the embodiment of the present application also provides an implementation example of creating personal brainwave audio. Figure 6 A method flow for creating a personal brainwave audio library in a brainwave audio processing method provided in an embodiment of the present application Figure 2 ,like Figure 6 As shown, the method creates the personal brain wave audio library according to the preset brain wave audio in the above S504, which may include:
[0124] S601. According to the classification label of the preset brain wave audio, determine, from a preset brain wave audio library, a brain wave audio having the same classification label as the preset brain wave audio as an associated brain wave audio corresponding to the preset brain wave audio.
[0125] In the interface of the brainwave audio application, brainwave audio is displayed in the form of groups, that is, each brainwave audio has the brainwave audio set it is in. Therefore, the classification label of the preset brainwave audio is the classification label corresponding to the brainwave audio set where the preset brainwave audio is located, so as to indicate that the brainwave audios in the brainwave audio set where the preset brainwave audio is located are of the same type of brainwave audio.
[0126] Then, in a specific implementation, based on the classification label of the preset brainwave audio, the brainwave audio with the same classification label as the preset brainwave audio can be determined from the preset brainwave audio library, that is, other brainwave audios in the same brainwave audio set as the preset brainwave audio can be used as the associated brainwave audio corresponding to the preset brainwave audio.
[0127] S602: Create the personal brainwave audio library according to the preset brainwave audio and the associated brainwave audio.
[0128] In a specific implementation, for example, the preset brain wave audio and the associated brain wave audio can be added to the brain wave audio library created for the user to obtain the user's personal brain wave audio library.
[0129] The brainwave audio processing method provided in this embodiment includes associated brainwave audios with the same classification label in addition to preset brainwave audios that the user has listened to and whose preference meets preset preference conditions. The personal brainwave audio library is created for the user based on the preset brainwave audios and the associated brainwave audios. When the user listens and watches a small amount of brainwave audios, the associated brainwave audios can be intelligently selected based on the audio-visual results, which not only enriches the brainwave audios in the personal brainwave audio library, but also ensures the targeted association between the brainwave audios and the user, and at the same time realizes the personalized intelligent creation of brainwave audios in the personal brainwave audio library.
[0130] In the above Figure 5 Based on this, the embodiment of the present application also provides an implementation example of creating personal brainwave audio. Figure 7 A flowchart of a method for determining the audiovisual preference of brainwave audio in a brainwave audio processing method provided in an embodiment of the present application, such as Figure 7 As shown, the method in the above S503 determines whether the user's preference for the preset brain wave audio meets the preset preference condition according to the second brain wave feature, which may include:
[0131] S701, determining a feature difference between the first EEG feature and a feature of a preset reference EEG signal.
[0132] In one implementation, the preset reference EEG signal may be an EEG signal within a first time period, and the second EEG signal may be an EEG signal within a second time period when the user auditioned the preset brain wave audio, that is, an EEG signal of the current audition time period. The reference EEG signal may be, for example, an EEG signal within the first time period when the user began to audition the preset brain wave audio. The second time period is a time period after the first time period.
[0133] For example, during the feature analysis process, a preset feature calculation method can be used to calculate the first EEG feature to obtain the feature parameters of the first EEG feature, such as calculating the mean or variance of the EEG feature in the second time period. The feature of the second EEG signal can be extracted from the benchmark EEG signal, and the preset feature calculation method can be used to calculate the feature parameters of the benchmark EEG feature.
[0134] If the calculated characteristic parameter of the first EEG feature is the mean of the EEG feature, then the corresponding characteristic parameter corresponding to the feature of the benchmark EEG signal is also the mean of the EEG feature; if the calculated characteristic parameter of the first EEG feature is the variance of the EEG feature, then the corresponding characteristic parameter corresponding to the feature of the benchmark EEG signal is also the variance of the EEG feature.
[0135] In a specific implementation process, the feature difference may be obtained by comparing the first EEG feature with the feature of the preset reference EEG signal.
[0136] S702: According to the feature difference value and a plurality of preset feature difference value ranges of preference degrees, determine the preference degree corresponding to the feature difference value range to which the feature difference value belongs as the target preference degree.
[0137] The preset characteristic difference value ranges of the plurality of preference levels may be characteristic difference value ranges of the user at a plurality of different preference levels obtained in advance through a large amount of experimental data.
[0138] The preset characteristic difference value ranges of the plurality of preference degrees can be stored in a mapping relationship table between the preference degree and the characteristic difference value range. In the specific implementation process, the characteristic difference value can be queried in the mapping relationship table according to the characteristic difference value to determine the characteristic difference value range to which the characteristic difference value belongs, and then the preference degree corresponding to the characteristic difference value range to which the characteristic difference value belongs is determined as the target preference degree.
[0139] Different degrees of preference can be represented by different preference values or different preference level values.
[0140] S703: Determine whether the target preference is greater than or equal to a preset preference threshold.
[0141] The preset likeness threshold may also be a preset likeness value, or a preset likeness level threshold.
[0142] Specifically, the target preference degree may be compared with the preset preference degree threshold to determine whether the target preference degree is greater than or equal to the preset preference degree threshold.
[0143] S704: If the target preference is greater than or equal to the preference threshold, it is determined that the user's preference for the preset brain wave audio satisfies the preset preference condition.
[0144] S705: If the target preference is less than the preference threshold, it is determined that the user's preference for the preset brain wave audio does not satisfy the preset preference condition.
[0145] In the brainwave audio processing method provided in this embodiment, the user's preference for the preset brainwave audio can be determined by the characteristic difference between the EEG characteristics and the characteristics of the preset reference EEG signal, and then it can be determined whether the preset preference conditions are met, thereby ensuring the accuracy of determining the preference based on the EEG signal, thereby ensuring that the screening of brainwave audio determined based on the preference is more accurate, and effectively ensuring the personalized customization service of the personal brainwave audio library.
[0146] Optionally, based on the brainwave audio processing method provided in any of the above embodiments, the embodiment of the present application may also provide a service implementation method for transposing brainwave audio based on user needs. Figure 8 This is a flow chart of a method for converting brainwave audio in a brainwave audio processing method provided in an embodiment of the present application. Figure 8 As shown, the method may also include:
[0147] S801. In response to an input brain wave audio conversion operation, a third brain wave signal of the user collected by the brain wave device is obtained.
[0148] In the solution provided by this embodiment, the brainwave audio application may also have a personal brainwave music production module. The user may input the brainwave audio conversion operation through the trigger control corresponding to the brainwave audio conversion function on the interface of the brainwave audio application.
[0149] For example, in one implementation, if it is determined based on the second EEG feature that the user's preference for the preset brainwave audio does not meet the preset preference condition, and when the user auditioned other brainwave audio in the preset pair of brainwave audio library, the user's preference for other brainwave audio also does not meet the preset preference condition, a prompt can be given through the interface to instruct the user to convert the brainwave audio through the brainwave audio conversion function. That is, if the number of brainwave audio that the user has auditioned and does not meet the preset preference condition reaches the preset number threshold, there is no need to audition to find brainwave audio that meets the user's preference condition, and the user can be reminded through the interface prompt to convert the brainwave audio through the brainwave audio function, or continue to try the brainwave audio.
[0150] In another implementation, the user can actively initiate the conversion of brainwave audio through the trigger control corresponding to the brainwave audio conversion function on the interface of the brainwave audio application.
[0151] In a specific implementation, after receiving the brainwave audio conversion operation input by the user, the resource information required for the conversion service can be determined according to the user's level, and the payment module can be called to perform the payment operation.
[0152] After the payment operation is completed, the third EEG signal can be obtained.
[0153] S802: Perform feature analysis on the third EEG signal to obtain third EEG features.
[0154] The specific implementation of the feature analysis of the third EEG signal can refer to the above-mentioned feature analysis of each EEG signal, which will not be repeated here.
[0155] S803. According to the third EEG feature, a preset brainwave audio algorithm is used to generate target brainwave audio, and the target brainwave audio is added to the personal brainwave audio library.
[0156] In one implementation, after acquiring the third EEG signal, the client device may perform feature analysis to obtain the third EEG feature, and then execute S803 to convert the EEG audio to obtain the target EEG audio.
[0157] In another implementation, after obtaining the third EEG signal, the client device may transmit the third EEG signal to the server, and the server may perform feature analysis to obtain the third EEG feature, and then convert the EEG audio to obtain the target EEG audio. In this implementation, after obtaining the target EEG audio, the server may feed it back to the client device.
[0158] In another implementation, after obtaining the third EEG signal, the client device may perform feature analysis to obtain the third EEG feature, transmit the third EEG feature to the server, and the server converts the brainwave audio based on the third EEG feature to obtain the target brainwave audio. Similarly, in this implementation, after obtaining the target brainwave audio, the server may feed it back to the client device.
[0159] The brainwave audio algorithm may be a brainwave audio conversion algorithm based on EEG features, or a brainwave audio conversion algorithm based on EEG features and preset audio.
[0160] If the brainwave audio algorithm is a brainwave audio conversion algorithm based on EEG features, the third EEG feature can be determined, and the third EEG feature can be mapped using a preset brainwave audio mapping rule to obtain a target audio element, which then generates a target brainwave audio.
[0161] If the brainwave audio algorithm is a brainwave audio conversion algorithm based on EEG features and preset audio, the brainwave audio conversion operation includes: information of the preset audio, then according to the third EEG feature, the brainwave audio algorithm is used to convert the preset audio into the target brainwave audio. In the specific implementation process, for example, according to the third EEG feature, the element information of the preset audio, such as the frequency, is adjusted to obtain the target brainwave audio.
[0162] The brainwave audio processing method provided in this embodiment can also obtain a third EEG signal based on a brainwave audio conversion operation, and convert the brainwave audio based on a third EEG feature of the third EEG signal using a preset brainwave audio algorithm to obtain the target brainwave audio, thereby realizing a personalized customized service for converting brainwave audio according to user needs.
[0163] Optionally, based on the brain wave audio processing method shown in any of the above embodiments, the embodiment of the present application also provides an implementation example of automatic playback adjustment based on EEG signals during the process of playing brain wave audio. Fig. 9 This is a flow chart of a method for adjusting playback based on EEG signals in a brain wave audio processing method provided in an embodiment of the present application. Fig. 9 As shown, the method may also include:
[0164] S901. During the playback of the brain wave audio, a fourth brain wave signal of the user collected by the brain wave device is obtained according to a preset cycle.
[0165] In this embodiment, the playing process of the brain wave audio refers to the playing process of the brain wave audio selected based on the first brain wave feature, rather than the audio-visual playing process of the brain wave audio. That is, the fourth brain wave signal is the user's brain wave feedback during the playing process of the brain wave audio selected to be played.
[0166] During the playback of the brain wave audio, the user's brain wave state may change. Therefore, during the playback process, the fourth brain wave signal needs to be obtained according to a preset period.
[0167] S902: Perform feature analysis on the fourth EEG signal to obtain a fourth EEG feature.
[0168] The fourth EEG feature may be a feature characterizing the EEG state of the user during the process of playing the EEG audio.
[0169] It should be noted that, in the process of obtaining the fourth EEG feature, the fourth EEG signal may also be first subjected to artifact processing to remove artifact data such as electrooculogram, electrocardiogram and electromyography in the fourth EEG signal, and then feature extraction is performed on the fourth EEG signal after the artifact data is removed to obtain the fourth EEG feature. The specific implementation of artifact processing can refer to the description of artifact processing of the first EEG feature in the above embodiment, which will not be repeated here.
[0170] S903: Adjust the playing of the brain wave audio according to the fourth brain wave characteristic.
[0171] For example, in one implementation, the volume of the played brainwave audio can be adjusted or the playing of the played brainwave audio can be turned off according to the fourth brainwave characteristic.
[0172] In another implementation, the brainwave audio corresponding to the fourth EEG feature can be re-determined based on the fourth EEG feature, and the played brainwave audio can be adjusted to the brainwave audio corresponding to the fourth EEG feature. The specific implementation of re-determining the brainwave audio corresponding to the fourth EEG feature can be similar to the implementation process of determining the brainwave audio to be played by the first EEG feature, and the specific reference is made to the above, and this application will not repeat it again.
[0173] The brainwave audio processing method provided in this embodiment, on the basis of determining the brainwave audio to be played based on the first EEG feature, can also automatically adjust the playback of the played brainwave audio based on the fourth EEG feature of the collected fourth EEG signal during the brainwave audio process, without the need for manual playback adjustment, thereby realizing intelligent automatic playback adjustment based on EEG signals.
[0174] The following describes the apparatus, device, storage medium, etc. used to execute the brainwave audio processing method provided by the present application. The specific implementation process and technical effects are described above and will not be repeated below.
[0175] Fig.10 A schematic diagram of a brain wave audio processing device provided in an embodiment of the present application is shown in FIG. Fig.10 As shown, the brainwave audio processing device 1000 may include:
[0176] The acquisition module 1001 is used to acquire a first EEG signal collected by an EEG device.
[0177] The feature analysis module 1002 is used to perform feature analysis on the first EEG signal to obtain a first EEG feature.
[0178] The selection module 1003 is used to select, according to the first EEG feature, an EEG audio that matches the first EEG feature as the EEG audio to be played from a personal EEG audio library of the user monitored by the EEG device, wherein the personal EEG audio library includes at least one EEG audio that matches the user's historical EEG signal.
[0179] The playing module 1004 is used to play the brain wave audio to be played.
[0180] Optionally, the acquisition module 1001 is further used to respond to the audition and playback operation of the preset brain wave audio to acquire the second brain wave signal collected by the brain wave device.
[0181] The feature analysis module 1002 is further used to perform feature analysis on the second EEG signal to obtain a second EEG feature.
[0182] The brainwave audio processing device 1000 may further include:
[0183] A judgment module, used to determine whether the user's preference for the preset brain wave audio meets a preset preference condition according to the second brain wave feature;
[0184] A creation module is used to create a personal brain wave audio library according to the preset brain wave audio if the preference degree meets the preset preference condition.
[0185] Optionally, a creation module is specifically used to determine, from a preset brainwave audio library, brainwave audio with the same classification label as the preset brainwave audio as the associated brainwave audio corresponding to the preset brainwave audio based on the classification label of the preset brainwave audio; and to create a personal brainwave audio library based on the preset brainwave audio and the associated brainwave audio.
[0186] Optionally, the judgment module is specifically used to determine the characteristic difference between the first EEG feature and the characteristic of the preset baseline EEG signal; determine the preference corresponding to the characteristic difference range to which the characteristic difference belongs as the target preference based on the characteristic difference and the characteristic difference range of multiple preset preference levels; judge whether the target preference is greater than or equal to a preset preference threshold; if the target preference is greater than or equal to the preference threshold, determine that the user's preference for the preset brain wave audio meets the preset preference condition; if the target preference is less than the preference threshold, determine that the user's preference for the preset brain wave audio does not meet the preset preference condition.
[0187] Optionally, the selection module 1003 is specifically configured to determine, according to the band to which the EEG frequency in the first EEG feature belongs, an EEG audio with the same band from a personal EEG audio library as the EEG audio to be played.
[0188] Optionally, the selection module 1003 is specifically used to perform emotion recognition on the user according to the first EEG feature to obtain the user's emotion type; according to the emotion type, determine the brainwave audio with the audio tag corresponding to the emotion type from the personal brainwave audio library as the brainwave audio to be played.
[0189] Optionally, the acquisition module 1001 is further used to respond to the input brain wave audio conversion operation and acquire the third brain wave signal of the user collected by the brain wave device.
[0190] The feature analysis module 1002 is further used to perform feature analysis on the third EEG signal to obtain a third EEG feature.
[0191] The brainwave audio processing device 1000 may further include:
[0192] The audio generation module is used to generate target brain wave audio according to the third EEG feature and adopt a preset brain wave audio algorithm, and add it to the personal brain wave audio library.
[0193] Optionally, the brainwave audio conversion operation includes: information of preset audio;
[0194] The audio generation module is specifically used to convert the preset audio into the target brain wave audio according to the third brain wave feature by using the brain wave audio algorithm.
[0195] Optionally, the acquisition module 1001 is further used to acquire a fourth EEG signal of the user collected by the EEG device according to a preset period during the playback of the EEG audio.
[0196] The feature analysis module 1002 is further used to perform feature analysis on the fourth EEG signal to obtain a fourth EEG feature.
[0197] The brainwave audio processing device 1000 may further include:
[0198] The adjustment module is used to adjust the playing of the brain wave audio according to the fourth brain wave characteristic.
[0199] Optionally, the adjustment module is specifically used to adjust the playback volume of the played brain wave audio, or turn off the playback of the played brain wave audio according to the fourth brain wave characteristic, or adjust the played brain wave audio to the brain wave audio corresponding to the fourth brain wave characteristic.
[0200] The above-mentioned device is used to execute the method provided by the aforementioned embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0201] The above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital singnal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0202] Fig.11 A schematic diagram of a brainwave audio processing device provided in an embodiment of the present application. The brainwave audio processing device can be integrated into a device or a chip of a device. The device can be a terminal device with brainwave audio processing function, such as a smart phone, a tablet computer, etc.
[0203] The brain wave audio processing device 1100 includes: a memory 1101 and a processor 1102. The memory 1101 and the processor 1102 are connected via a bus.
[0204] The memory 1101 is used to store programs, and the processor 1102 calls the programs stored in the memory 1101 to execute the above method embodiment. The specific implementation method and technical effect are similar and will not be repeated here.
[0205] Optionally, the present invention also provides a program product, such as a computer-readable storage medium, comprising a program, which is used to execute the above method embodiment when executed by a processor.
[0206] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0207] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0208] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0209] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated: ROM), random access memory (English: Random Access Memory, abbreviated: RAM), disk or optical disk and other media that can store program codes.
[0210] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for processing brainwave audio, characterized in that: include: Acquire a first electroencephalogram signal collected by an electroencephalogram device; Performing feature analysis on the first EEG signal to obtain a first EEG feature; According to the first EEG feature, selecting an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played, wherein the personal EEG audio library includes: at least one EEG audio that matches a historical EEG signal of the user; Playing the brainwave audio to be played; Before selecting, according to the first EEG feature, an EEG audio matching the first EEG feature from a personal EEG audio library of a user monitored by the EEG device as the EEG audio to be played, the method further includes: In response to a trial listening and playing operation for a preset brain wave audio, a second brain wave signal collected by the brain wave device is acquired, wherein the preset brain wave audio is a brain wave audio selected by the user from a plurality of brain wave audios in a preset brain wave audio library; Performing feature analysis on the second EEG signal to obtain a second EEG feature; determining, based on the second EEG feature, whether the user's preference for the preset EEG audio meets a preset preference condition; If the preference degree satisfies the preset preference condition, then according to the classification label of the preset brainwave audio, from the preset brainwave audio library, determine the brainwave audio with the same classification label as the preset brainwave audio as the associated brainwave audio corresponding to the preset brainwave audio; Adding the preset brainwave audio and the associated brainwave audio to the brainwave audio library created for the user to obtain the personal brainwave audio library; If the preference does not satisfy the preset preference condition, and the user's preference for other brainwave audio in the preset brainwave audio library also does not satisfy the preset preference condition, a prompt is given through the interface to instruct the user to convert the brainwave audio through the brainwave audio conversion function; In response to the input brain wave audio conversion operation, a third brain wave signal of the user collected by the brain wave device is obtained; the brain wave audio conversion operation includes: information of preset audio; Performing feature analysis on the third EEG signal to obtain a third EEG feature; According to the third EEG feature, a preset brainwave audio algorithm is used to adjust the element information of the preset audio to obtain the target brainwave audio, and add it to the personal brainwave audio library.
2. The method according to claim 1, characterized in that: The determining, based on the second EEG feature, whether the user's preference for the preset EEG audio meets a preset preference condition includes: Determining a characteristic difference between the first EEG characteristic and a characteristic of a preset reference EEG signal; According to the feature difference value and a plurality of preset feature difference value ranges of preference degrees, determining the preference degree corresponding to the feature difference value range to which the feature difference value belongs as the target preference degree; Determining whether the target preference is greater than or equal to a preset preference threshold; If the target preference is greater than or equal to the preference threshold, determining that the user's preference for the preset brain wave audio satisfies the preset preference condition; If the target preference is less than the preference threshold, it is determined that the user's preference for the preset brain wave audio does not satisfy the preset preference condition.
3. The method according to claim 1, characterized in that The step of selecting, according to the first EEG feature, an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played includes: According to the band to which the EEG frequency in the first EEG feature belongs, a brainwave audio with the same band is determined from the personal brainwave audio library as the brainwave audio to be played.
4. The method according to claim 1, characterized in that: The step of selecting, according to the first EEG feature, an EEG audio that matches the first EEG feature from a personal EEG audio library of the user monitored by the EEG device as the EEG audio to be played includes: performing emotion recognition on the user according to the first EEG feature to obtain the emotion type of the user; According to the emotion type, the brainwave audio with the audio tag corresponding to the emotion type is determined from the personal brainwave audio library as the brainwave audio to be played.
5. A brainwave audio processing device, characterized in that: include: A memory and a processor, wherein the memory stores a computer program executable by the processor, and when the processor executes the computer program, the brain wave audio processing method according to any one of claims 1 to 4 is implemented.
6. A brain wave audio processing system, characterized in that: include: Server devices, client devices and EEG devices; The server device can be communicatively connected with the client device, and the client device can be communicatively connected with the EEG device; Wherein, the EEG device is used to collect EEG signals; The server device is used to store brainwave audio; The client device is used to process the brain wave audio based on the brain wave signal collected from the brain wave device, so as to implement the brain wave audio processing method described in any one of claims 1-4 above.
