Physiological state prediction model training method and sample data generation and prediction method

By obtaining the target EEG signal sample data and performing auxiliary training based on prior characteristics, and further training combined with the original EEG signal sample data, the problem of low accuracy in predicting physiological status of EEG signal in the existing technology is solved, and significantly improved Prediction accuracy and model generalization ability.

CN118965065APending Publication Date: 2024-11-15KINGFAR INTERNATIONAL INC

Patent Information

Application Number
CN202411009785.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-11-23
Filing Date
2024-07-25
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In the prior art, the accuracy of electroencephalogram signals for predicting physiological states is not high, the prediction effect is not good, and it is difficult to effectively reflect the physiological state of the human body.

Method used

By obtaining the target EEG signal sample data, assisted training based on the prior characteristics of EEG signal, a physiological state prediction model is obtained, and further trained based on the original EEG signal sample data to improve the prediction accuracy of the model.

Benefits of technology

It significantly improves the accuracy and generalization ability of physiological state prediction models, enhances the ability to identify motor imagination and emotional states, and improves the prediction effect of the model.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118965065A_ABST
    Figure CN118965065A_ABST
Patent Text Reader

Abstract

The invention discloses a training method of a physiological state prediction model and a sample data generation and prediction method. The training method of the physiological state prediction model comprises the steps that target electroencephalogram signal sample data are obtained, the target electroencephalogram signal sample data are determined based on electroencephalogram signal prior characteristics, and the electroencephalogram signal prior characteristics are obtained based on original electroencephalogram signal sample data; based on the target electroencephalogram signal sample data, performing auxiliary training on a to-be-trained physiological state prediction model to obtain a physiological state auxiliary prediction model; and training the physiological state auxiliary prediction model based on the original electroencephalogram signal sample data to obtain a trained physiological state prediction model. The prediction accuracy of the physiological state prediction model is improved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Related Applications

[0002] This invention claims priority to the Chinese invention patent with application number 202311576945.3, application date November 23, 2023, and invention name “Training method, sample data generation and prediction method for physiological state prediction model”. Technical Field

[0003] The present invention relates to the field of deep learning technology, and in particular to a training method, sample data generation and prediction method for a physiological state prediction model. Background Art

[0004] EEG signals are a type of nonlinear signal generated by the brain that can be used to control the physiological state of the human body. EEG signals contain information that can reflect the physiological state of the human body, so it is feasible to obtain the physiological state of the human body by processing EEG signals. Brain-computer interface (BCI) is a communication channel established between the brain and external devices. It uses neural activity signals as control signals to achieve direct communication with a computer. EEG signals can be collected based on the brain-computer interface. In order to determine the physiological state of the human body under the control of EEG signals, related technologies can predict the physiological state of the human body based on EEG signals, but the accuracy of physiological state prediction in related technologies is not high, and the prediction effect is not good. Summary of the invention

[0005] The embodiments of the present application aim to solve at least one of the technical problems in the related art to a certain extent. To this end, the purpose of the embodiments of the present application is to propose a training method for a physiological state prediction model, a method for generating EEG signal sample data, a physiological state prediction method, a device, an electronic device, a storage medium and a program product.

[0006] An embodiment of the present application provides a method for training a physiological state prediction model, the method comprising: obtaining target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on original EEG signal sample data; based on the target EEG signal sample data, performing auxiliary training on a physiological state prediction model to be trained to obtain an auxiliary physiological state prediction model; based on the original EEG signal sample data, training the auxiliary physiological state prediction model to obtain a trained physiological state prediction model.

[0007] Exemplarily, the acquiring target EEG signal sample data includes: processing the original EEG signal sample data to obtain the EEG signal prior features; and constructing first target EEG signal sample data according to the EEG signal prior features.

[0008] Exemplarily, the acquiring of target EEG signal sample data includes: processing the original EEG signal sample data to obtain the EEG signal prior features; and merging the original EEG signal sample data and the EEG signal prior features to obtain second target EEG signal sample data.

[0009] Exemplarily, the processing of the original EEG signal sample data to obtain the EEG signal prior feature includes: processing the original EEG signal sample data according to a preset feature index to obtain a feature value corresponding to the preset feature index as the EEG signal prior feature.

[0010] Exemplarily, based on the target EEG signal sample data, auxiliary training is performed on the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model, including: inputting the first target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtaining a first sub-classification prediction result characterizing the physiological state; based on the first sub-classification prediction result, reversely adjusting the model parameters of the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model.

[0011] Exemplarily, the first sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state.

[0012] Exemplarily, based on the target EEG signal sample data, auxiliary training is performed on the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model, including: inputting the second target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtaining a second detailed classification prediction result and a first coarse classification prediction result that characterize the physiological state; based on the second detailed classification prediction result and the first coarse classification prediction result, reversely adjusting the model parameters of the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model.

[0013] Exemplarily, the second detailed classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; the first coarse classification prediction result includes at least one of the following: movement imagination state, emotional state.

[0014] Exemplarily, the physiological state auxiliary prediction model is trained based on the original EEG signal sample data to obtain the trained physiological state prediction model, including: inputting the original EEG signal sample data into the physiological state auxiliary prediction model for prediction to obtain a second coarse classification prediction result characterizing the physiological state; based on the second coarse classification prediction result, reversely adjusting the model parameters of the physiological state auxiliary prediction model to obtain the trained physiological state prediction model.

[0015] Exemplarily, the second coarse classification prediction result includes at least one of the following: motor imagery state, emotional state.

[0016] Exemplarily, the original EEG signal sample data includes at least one of the following: EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state.

[0017] Exemplarily, the preset characteristic indicator is obtained in the following manner: determine multiple groups of characteristic indicators to be verified from multiple candidate characteristic indicators, wherein each group of characteristic indicators to be verified includes at least one candidate characteristic indicator; verify the multiple groups of characteristic indicators to be verified respectively to obtain verification results corresponding to each group of characteristic indicators to be verified, wherein the verification results characterize the prediction accuracy of the physiological state prediction model used for indicator verification based on the characteristic values ​​corresponding to each group of characteristic indicators to be verified for physiological state prediction; based on the verification results, select at least one group from the multiple groups of characteristic indicators to be verified as the preset characteristic indicator.

[0018] Exemplarily, the physiological state prediction model to be trained or the physiological state auxiliary prediction model includes: a temporal convolution layer, used to extract first time feature data of the target EEG signal sample data or the original EEG signal sample data in the time dimension; a spatial convolution layer, used to extract spatial feature data of the first time feature data in the spatial dimension; a separable convolution layer, used to extract second time feature data of the spatial feature data in the time dimension, and perform feature fusion on the second time feature data.

[0019] Another embodiment of the present application provides a method for generating EEG signal sample data, the method comprising: processing the original EEG signal sample data to obtain EEG signal prior features; generating target EEG signal sample data based on the EEG signal prior features, wherein the target EEG signal sample data is used to assist in training a physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model, and the original EEG signal sample data is used to train the physiological state auxiliary prediction model to obtain a trained physiological state prediction model.

[0020] Exemplarily, generating target EEG signal sample data based on the EEG signal prior features includes at least one of the following: constructing first target EEG signal sample data according to the EEG signal prior features; merging the original EEG signal sample data and the EEG signal prior features to obtain second target EEG signal sample data.

[0021] Another embodiment of the present application provides a physiological state prediction method, which includes: obtaining original EEG signal data; inputting the original EEG signal data into a trained physiological state prediction model for prediction to obtain a prediction result of the physiological state, wherein the trained physiological state prediction model is trained based on the above-mentioned physiological state prediction model training method.

[0022] Another embodiment of the present application provides a physiological state prediction method, the method comprising: obtaining original EEG signal data; inputting the original EEG signal data into a trained physiological state prediction model for prediction to obtain a prediction result of the physiological state, wherein the trained physiological state prediction model comprises at least one of a trained first physiological state prediction model and a trained second physiological state prediction model, the trained first physiological state prediction model is obtained by training based on first target EEG signal sample data, the trained second physiological state prediction model is obtained by training based on second target EEG signal sample data, the first target EEG signal sample data is constructed based on EEG signal prior features, the EEG signal prior features are obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior features.

[0023] Exemplarily, the trained first physiological state prediction model is trained according to the following steps: based on the first target EEG signal sample data, auxiliary training is performed on the first physiological state prediction model to be trained to obtain a first physiological state auxiliary prediction model; based on the original EEG signal sample data, the first physiological state auxiliary prediction model is trained to obtain the trained first physiological state prediction model.

[0024] Exemplarily, the trained second physiological state prediction model is trained according to the following steps: based on the second target EEG signal sample data, auxiliary training is performed on the second physiological state prediction model to be trained to obtain a second physiological state auxiliary prediction model; based on the original EEG signal sample data, the second physiological state auxiliary prediction model is trained to obtain the trained second physiological state prediction model.

[0025] Another embodiment of the present application provides a training device for a physiological state prediction model, the device comprising: a first acquisition module, a first training module and a second training module. The first acquisition module is used to acquire target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on the original EEG signal sample data; the first training module is used to perform auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data to obtain a physiological state auxiliary prediction model; the second training module is used to train the physiological state auxiliary prediction model based on the original EEG signal sample data to obtain a trained physiological state prediction model.

[0026] Another embodiment of the present application provides a device for generating EEG signal sample data, the device comprising: a processing module and a generating module. The processing module is used to process the original EEG signal sample data to obtain the prior features of the EEG signal; the generating module is used to generate the target EEG signal sample data based on the prior features of the EEG signal, wherein the target EEG signal sample data is used to assist in training the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model, and the original EEG signal sample data is used to train the physiological state auxiliary prediction model to obtain the trained physiological state prediction model.

[0027] Another embodiment of the present application provides a physiological state prediction device, the device comprising: a second acquisition module and a first prediction module. The second acquisition module is used to acquire original EEG signal data; the first prediction module is used to input the original EEG signal data into a trained physiological state prediction model for prediction to obtain a prediction result of the physiological state, wherein the trained physiological state prediction model is trained based on the training device of the above-mentioned physiological state prediction model.

[0028] Another embodiment of the present application provides a physiological state prediction device, the device comprising: a third acquisition module and a second prediction module. The third acquisition module is used to acquire original EEG signal data; the second prediction module is used to input the original EEG signal data into a trained physiological state prediction model for prediction to obtain a prediction result of the physiological state, wherein the trained physiological state prediction model comprises at least one of a trained first physiological state prediction model and a trained second physiological state prediction model, the trained first physiological state prediction model is obtained by training based on first target EEG signal sample data, the trained second physiological state prediction model is obtained by training based on second target EEG signal sample data, the first target EEG signal sample data is constructed based on EEG signal prior features, the EEG signal prior features are obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior features.

[0029] Another embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method described in any one of the above embodiments are implemented.

[0030] Another embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

[0031] Another embodiment of the present application provides a computer program product, which includes instructions. When the instructions are executed by a processor of a computer device, the computer device can perform the steps of the method described in any of the above embodiments.

[0032] In the above implementation, the EEG signal prior features are obtained based on the original EEG signal sample data, and the target EEG signal sample data is obtained based on the EEG signal prior features. Since the target EEG signal sample data contains prior information, the physiological state prediction model to be trained is assisted in training based on the target EEG signal sample data, thereby improving the prediction accuracy of the model. After the physiological state auxiliary prediction model is obtained through training, the physiological state auxiliary prediction model is further trained based on the original EEG signal sample data to obtain a trained physiological state prediction model, thereby further improving the prediction accuracy of the model. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A schematic diagram of the system architecture provided for the implementation of this application;

[0034] Figure 2 A schematic diagram of a flow chart of a method for generating EEG signal sample data provided in an embodiment of the present application;

[0035] Figure 3 A schematic diagram of a flow chart of a method for training a physiological state prediction model provided in an embodiment of the present application;

[0036] Figure 4 A schematic diagram of a physiological state prediction model provided in an embodiment of the present application;

[0037] Figure 5 A schematic diagram of a physiological state prediction method provided in an embodiment of the present application;

[0038] Figure 6 A schematic diagram of a flow chart of another physiological state prediction method provided in an embodiment of the present application;

[0039] Figure 7 A schematic diagram of a device for generating EEG signal sample data provided in an embodiment of the present application;

[0040] Figure 8 A schematic diagram of a training device for a physiological state prediction model provided in an embodiment of the present application;

[0041] Fig. 9 A schematic diagram of a physiological state prediction device provided in an embodiment of the present application;

[0042] Fig.10 A schematic diagram of another physiological state prediction device provided in an embodiment of the present application;

[0043] Fig.11 A block diagram of an electronic device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0044] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0045] In some examples, in order to determine the physiological state of the human body under the control of EEG signals, a physiological state prediction model can be used to predict the physiological state of the human body based on EEG signals. EEG signals can be obtained based on electroencephalograms (EEGs). Physiological state prediction models include, for example, deep learning models. Specifically, an end-to-end deep learning model can be used to predict physiological states. Although end-to-end deep learning models can automatically learn some features with better distinguishability, they often fit to some non-important features, causing the model to collapse locally to some bad features, making the model's prediction accuracy for physiological states not high and the prediction effect poor.

[0046] In view of this, the embodiments of the present application provide an optimized method for generating EEG signal sample data, a method for training a physiological state prediction model, and a physiological state prediction method. Figure 1 The system architecture shown can be used to implement at least one of a method for generating EEG signal sample data, a method for training a physiological state prediction model, and a method for predicting a physiological state.

[0047] like Figure 1 As shown, the system architecture 100 includes an execution device 110, a training device 120, a database 130, a client device 140, a data storage system 150, a data acquisition device 160, and a sample data generation device 170. The execution device 110 includes a computing module 111 and an I / O interface 112, and the computing module 111 stores a trained physiological state prediction model 101.

[0048] The data acquisition device 160 is used to acquire original EEG signal sample data and store it in the database 130 .

[0049] The sample data generating device 170 performs data processing based on the original EEG signal sample data stored in the database 130 to obtain a priori features of the EEG signal, and generates target EEG signal sample data based on the a priori features of the EEG signal.

[0050] The training device 120 stores the physiological state prediction model to be trained. The training device 120 performs auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data. The general training method adopts the deep learning method, in which auxiliary learning, transfer learning, reinforcement learning, and popular learning are some network branches added in the training stage (i.e., the training stage), which can better complete the training model task in the neural network model. The auxiliary training mentioned in this application adopts the auxiliary learning training method, and the physiological state auxiliary prediction model can be obtained after the auxiliary training. The training device 120 also trains the physiological state auxiliary prediction model based on the original EEG signal sample data stored in the database 130 to obtain the trained physiological state prediction model 101. The trained physiological state prediction model 101 obtained by the training device 120 can be applied to different systems or devices, for example, to the execution device 110.

[0051] The execution device 110 is provided with an I / O interface 112, through which data is exchanged with external devices, such as the client device 140. The user can input raw EEG signal data to the I / O interface 112 through the client device 140, and the raw EEG signal data can be collected by the data acquisition device 160 and stored in the database 130, and then input to the execution device 110 after confirmation or corresponding processing by the user. In addition, the user can also input instructions to the I / O interface 112 through the client device 140 to instruct the execution device 110 to perform data processing operations.

[0052] The execution device 110 may call data, codes, etc. in the data storage system 150 , and may also store data, instructions, etc. in the data storage system 150 .

[0053] The calculation module 111 stores the trained physiological state prediction model 101 , and the calculation module 111 uses the trained physiological state prediction model 101 to predict the physiological state based on the input original EEG signal data.

[0054] The prior feature data mentioned in this application is obtained based on the original EEG signal sample data, that is, in general, the prior features can be extracted from the original EEG signal samples.

[0055] Next, the I / O interface 112 may return the prediction result to the client device 140 to provide it to the user.

[0056] exist Figure 1In the case shown, the user can manually specify the original EEG signal data to be input into the execution device 110, for example, by performing an input operation in the interface provided by the I / O interface 112. In another case, the client device 140 can automatically input the original EEG signal data into the I / O interface 112, for example, the client device 140 automatically inputs the original EEG signal data after obtaining the user's authorization, and the user can set the corresponding authority in the client device 140. The user can view the prediction results of the physiological state output by the execution device 110 in the client device 140, and the specific presentation form can be a specific method such as display, sound, action, etc. The client device 140 can also store the prediction results of the predicted physiological state in the database 130.

[0057] It is worth noting that Figure 1 This is only a schematic diagram of a system architecture provided by an embodiment of the present application. The positional relationship between the devices, components, modules, etc. shown in the figure does not constitute any limitation. For example, in Figure 1 In the embodiment, the data storage system 150 is an external memory relative to the execution device 110. In other cases, the data storage system 150 may also be placed in the execution device 110.

[0058] Figure 2 A flowchart of a method for generating EEG signal sample data provided in an embodiment of the present application.

[0059] like Figure 2 As shown, the method 200 for generating EEG signal sample data provided in an embodiment of the present application includes, for example, steps S210 - S220 .

[0060] Step S210, processing the original EEG signal sample data to obtain EEG signal prior features.

[0061] For example, the original EEG signal sample data can be EEG signal data collected based on a brain-computer interface, or can be data obtained after preprocessing the collected EEG signal data. Preprocessing includes bandpass filtering the collected EEG signal data, removing redundant data, etc. Bandpass filtering the collected EEG signal data includes removing information with too high or too low frequency in the EEG signal data.

[0062] For example, the EEG signal prior features are prior knowledge for the original EEG signal sample data, and the EEG signal prior features usually include important information or information with high discrimination in the original EEG signal sample data. Adding prior knowledge during model training can optimize the performance of the model, reduce the difficulty of model training, and improve the generalization ability of the model during training.

[0063] Step S220, generating target EEG signal sample data based on the EEG signal priori features.

[0064] Exemplarily, the target EEG signal sample data is used to assist in training the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model. The physiological state prediction model to be trained includes, for example, a deep learning model, specifically a convolutional neural network (CNN) model or other models based on the convolutional neural network model.

[0065] After the physiological state auxiliary prediction model is trained, the physiological state auxiliary prediction model can be further trained based on the original EEG signal sample data to obtain a trained physiological state prediction model. The trained physiological state prediction model can be used to predict the physiological state, which includes the motor imagery state, the emotional state, and the like.

[0066] In an embodiment of the present application, an EEG signal prior feature is obtained based on the original EEG signal sample data, and target EEG signal sample data is generated based on the EEG signal prior feature. Since the target EEG signal sample data contains prior information, auxiliary training of the physiological state prediction model to be trained based on the target EEG signal sample data can improve the prediction accuracy of the model. After the physiological state auxiliary prediction model is obtained by training, the physiological state auxiliary prediction model is further trained based on the original EEG signal sample data to obtain a trained physiological state prediction model, which further improves the prediction accuracy of the model. It can be seen that adding EEG signal prior features for auxiliary training when training the model can optimize the performance of the model, reduce the training difficulty of the model, improve the generalization ability of the model, and improve the prediction accuracy of the model.

[0067] Next, the process of generating target EEG signal sample data based on EEG signal prior features will be further described. The target EEG signal sample data includes first target EEG signal sample data and second target EEG signal sample data.

[0068] In one example, first target EEG signal sample data can be constructed based on EEG signal prior features. For example, the EEG signal prior features can be directly used as the first target EEG signal sample data. Or when the data format of the first target EEG signal sample data is predefined as a preset data format, the EEG signal prior features can be disassembled or transformed according to the preset data format to construct the first target EEG signal sample data. It can be understood that directly constructing the first target EEG signal sample data for auxiliary training models based on EEG signal prior features allows the model to focus on prior knowledge that is conducive to classification, thereby improving the physiological state auxiliary prediction model's ability to process important information in a targeted manner.

[0069] In another example, the original EEG signal sample data and the EEG signal prior features can be combined and processed to obtain the second target EEG signal sample data. For example, the original EEG signal sample data and the EEG signal prior features can be data-decomposed and fused to obtain the second target EEG signal sample data. Or the original EEG signal sample data and the EEG signal prior features can be data-spliced ​​to obtain the second target EEG signal sample data. For example, when the original EEG signal sample data is vector or matrix data, the EEG signal prior features can be spliced ​​in a specific position of the vector or matrix data, and the specific position includes the head position, the tail position, and any position in the middle. In some cases, the specific position preferably the tail position can improve the training effect of the model and the prediction accuracy of the model. It can be understood that the original EEG signal sample data and the EEG signal prior features are combined to obtain the second target EEG signal sample data for auxiliary training of the model, so that the model pays attention to the prior knowledge while taking into account the original data, thereby improving the generalization of the physiological state auxiliary prediction model.

[0070] Figure 3 A flowchart of a method for training a physiological state prediction model provided in an embodiment of the present application.

[0071] like Figure 3 As shown, the training method 300 of the physiological state prediction model provided in the embodiment of the present application includes, for example, steps S310-S330.

[0072] Step S310, obtaining target EEG signal sample data.

[0073] Exemplarily, the target EEG signal sample data is determined based on the EEG signal prior features, and the EEG signal prior features are obtained based on the original EEG signal sample data.

[0074] Step S320: Based on the target EEG signal sample data, auxiliary training is performed on the physiological state prediction model to be trained to obtain an auxiliary physiological state prediction model.

[0075] Step S330: training the physiological state auxiliary prediction model based on the original EEG signal sample data to obtain a trained physiological state prediction model.

[0076] It can be understood that the embodiments of the present application obtain EEG signal prior features based on the original EEG signal sample data, and obtain target EEG signal sample data based on the EEG signal prior features. Since the target EEG signal sample data contains prior information, the physiological state prediction model to be trained is auxiliary trained based on the target EEG signal sample data, thereby improving the prediction accuracy of the model. After the physiological state auxiliary prediction model is trained, the physiological state auxiliary prediction model is further trained based on the original EEG signal sample data to obtain a trained physiological state prediction model, thereby further improving the prediction accuracy of the model. In addition, the embodiments of the present application can directly use the original EEG signal sample data as the input of the model, thereby avoiding the tedious process of preprocessing the sample data and the process of manually selecting features, thereby saving time and labor costs.

[0077] The embodiment of the present application trains the model twice based on the auxiliary learning method. The model is trained based on the auxiliary learning method, so that the model can learn more detailed classification weights, and at the same time, the model pays more attention to features that are conducive to classification. During the first training, the physiological state auxiliary prediction model is first obtained based on the target EEG signal sample data with prior knowledge. The first training enables the model to learn the ability to predict the physiological state based on prior knowledge. After obtaining the physiological state auxiliary prediction model, the physiological state auxiliary prediction model is directly migrated for the second training. During the second training, the physiological state auxiliary prediction model is trained based on the original EEG signal sample data. Since the physiological state auxiliary prediction model has undergone the first training, the relevant parameters of the model can be fine-tuned during the second training, which can further improve the prediction accuracy of the model while improving the training efficiency.

[0078] Next, the process of obtaining target EEG signal sample data will be further described. The target EEG signal sample data includes first target EEG signal sample data and second target EEG signal sample data.

[0079] In one example, the original EEG signal sample data can be processed to obtain EEG signal prior features, and then the first target EEG signal sample data can be constructed based on the EEG signal prior features. For example, the EEG signal prior features can be directly used as the first target EEG signal sample data, or the EEG signal prior features can be disassembled or transformed according to a predefined preset data format to construct the first target EEG signal sample data. For details, please refer to the above description, which will not be repeated here. It can be understood that the first target EEG signal sample data for auxiliary training model is constructed directly based on the EEG signal prior features and the model is trained, so that the model focuses on prior knowledge that is conducive to classification, and improves the physiological state auxiliary prediction model's ability to process important information in a targeted manner.

[0080] In another example, the original EEG signal sample data can be processed to obtain EEG signal prior features, and then the original EEG signal sample data and the EEG signal prior features are merged to obtain second target EEG signal sample data. For example, the original EEG signal sample data and the EEG signal prior features can be decomposed and fused to obtain the second target EEG signal sample data, or the original EEG signal sample data and the EEG signal prior features can be spliced ​​to obtain the second target EEG signal sample data. For details, please refer to the above description, which will not be repeated here. It can be understood that the original EEG signal sample data and the EEG signal prior features are merged to obtain the second target EEG signal sample data for auxiliary training model and model training is performed, so that the model pays attention to the prior knowledge while taking into account the original data, thereby improving the generalization of the physiological state auxiliary prediction model. The original EEG signal sample data and the EEG signal prior features are spliced ​​to train a classification model with a set number of labels (for example, the prior features pre-set labels include four left hand, right hand, happy, sad, and the corresponding classification of the original EEG signal samples includes two labels: motor imagery and emotion). After data splicing, the six-classification training model can be deeply trained. Labels are marked and classified when collecting physiological signals. They can be marked with 0, 1, 2, 3, 4, 5, etc. to correspond to different physiological states.

[0081] In another embodiment of the present application, appropriate EEG signal prior features may be determined by feature engineering to perform model training.

[0082] For example, the original EEG signal sample data can be processed according to a preset characteristic index to obtain a characteristic value corresponding to the preset characteristic index, and the characteristic value corresponding to the preset characteristic index is used as a priori feature of the EEG signal.

[0083] The preset characteristic index may include, for example, (δ+θ+α+β) total energy, δ wave absolute energy, θ wave absolute energy, α wave absolute energy, β wave absolute energy, Renyi entropy, wavelet transform, wavelet absolute mean, Fourier transform average coefficient, minimum index, maximum index, average index, variance index, standard deviation index, differential median index, spectrum maximum peak index, etc. The preset characteristic index can be set according to the actual situation, and examples are not given one by one here. Taking the preset characteristic index as the minimum index as an example, the original EEG signal sample data is processed to obtain the minimum value of the original EEG signal sample data, and the minimum value is the characteristic value corresponding to the minimum index. Taking the preset characteristic index as the spectrum maximum peak index as an example, the original EEG signal sample data is converted from the time domain to the frequency domain to obtain the spectrum, and the spectrum maximum peak is calculated as the characteristic value corresponding to the spectrum maximum peak index. Then, the minimum value and the spectrum maximum peak are used as the prior features of the EEG signal.

[0084] Exemplarily, suitable preset feature indicators can be determined by feature engineering. For example, multiple groups of feature indicators to be verified are determined from multiple candidate feature indicators, and each group of feature indicators to be verified includes at least one candidate feature indicator. Multiple candidate feature indicators include, for example, a minimum value indicator, a maximum value indicator, an average value indicator, a variance indicator, a standard deviation indicator, a differential median indicator, a spectrum maximum peak indicator, and the like. Taking the first group of feature indicators to be verified including 10 feature indicators such as a minimum value indicator, a maximum value indicator, and an average value indicator as an example, similarly, the second group of feature indicators to be verified includes 10 feature indicators such as an average value indicator, a variance indicator, and a standard deviation indicator, and the third group of feature indicators to be verified includes 10 feature indicators such as a standard deviation indicator, a differential median indicator, and a spectrum maximum peak indicator.

[0085] After obtaining multiple groups of feature indicators to be verified, the multiple groups of feature indicators to be verified are verified respectively to obtain verification results corresponding to each group of feature indicators to be verified, and the verification results represent the prediction accuracy of the physiological state prediction model used for indicator verification based on the feature values ​​corresponding to each group of feature indicators to be verified. The physiological state prediction model used for indicator verification may include the physiological state prediction model to be trained, the physiological state auxiliary prediction model, the trained physiological state prediction model, or other physiological state prediction models.

[0086] Then, based on the verification results, at least one group corresponding to a high model prediction accuracy is selected from multiple groups of feature indicators to be verified, preferably a group corresponding to the highest model prediction accuracy, and the feature indicators included in the selected group of feature indicators to be verified are used as preset feature indicators. The indicator verification process can be completed before model training. After the preset feature indicators are obtained through the indicator verification process, the original EEG signal sample data is processed based on the preset feature indicators to obtain the EEG signal prior features. Alternatively, the indicator verification process can also be carried out simultaneously during the model training process. For example, multiple model trainings can be carried out, and each model training is based on the EEG signal prior features obtained by different preset feature indicators. Finally, at least one group of feature indicators to be verified with the best training effect is used as the preset feature indicators.

[0087] Next, the training process of the physiological state prediction model to be predicted and the physiological state auxiliary prediction model will be further explained.

[0088] Regarding the training process of the physiological state prediction model to be predicted, in one example, when the first target EEG signal sample data is obtained based on the prior features of the EEG signal, when training the physiological state prediction model to be trained, the first target EEG signal sample data can be input into the physiological state prediction model to be trained for prediction to obtain a first sub-classification prediction result characterizing the physiological state. Then, based on the first sub-classification prediction result, the model parameters of the physiological state prediction model to be trained are reversely adjusted to obtain a physiological state auxiliary prediction model. For example, the first target EEG signal sample data includes a first sample label, and based on the loss value between the first sub-classification prediction result and the first sample label, the model parameters of the physiological state prediction model to be trained can be reversely adjusted to obtain a physiological state auxiliary prediction model.

[0089] Exemplarily, the first target EEG signal sample data is used to control the physiological state, and the physiological state includes the physiological state of large categories such as motor imagination state and emotional state. The motor imagination state can also be subdivided into small categories such as left-hand movement state and right-hand movement state. The emotional state can also be subdivided into small categories such as happy state and sad state. The first target EEG signal sample data is used to control hand movements and emotions, and hand movements include left-hand movements and right-hand movements. Emotions include happiness and sadness. Therefore, the motor imagination state and emotional state can be predicted based on the first target EEG signal sample data. It can be understood that in addition to the motor imagination state and emotional state, the physiological state can also be set according to actual needs. Other physiological states; in addition to the left-hand movement state and the right-hand movement state, other motor imagination states can also be set according to actual needs; in addition to the happy state and the sad state, the emotional state can also be set according to actual needs. Other emotional states.

[0090] The physiological state prediction model to be trained is, for example, a four-classification model, which is used to predict the physiological state based on the first target EEG signal sample data to obtain a first sub-classification prediction result. The first sub-classification prediction result includes, for example, the left hand movement state, the right hand movement state, the happy state, and the sad state, and specifically can output the probability of the left hand movement state, the probability of the right hand movement state, the probability of the happy state, and the probability of the sad state.

[0091] In another example, in the training process of the physiological state prediction model to be predicted, when the original EEG signal sample data and the EEG signal prior features are combined to obtain the second target EEG signal sample data, when training the physiological state prediction model to be trained, the second target EEG signal sample data is input into the physiological state prediction model to be trained for prediction, and the second detailed classification prediction result and the first coarse classification prediction result that characterize the physiological state are obtained. Then, based on the second detailed classification prediction result and the first coarse classification prediction result, the model parameters of the physiological state prediction model to be trained are reversely adjusted to obtain the physiological state auxiliary prediction model. For example, the second target EEG signal sample data includes a second sample label, and based on the loss value between the second detailed classification prediction result and the first coarse classification prediction result and the second sample label, the model parameters of the physiological state prediction model to be trained can be reversely adjusted to obtain the physiological state auxiliary prediction model.

[0092] Exemplarily, the physiological state prediction model to be trained is, for example, a six-classification model, which is used to perform physiological state prediction based on the second target EEG signal sample data to obtain a second detailed classification prediction result and a first rough classification prediction result. The second detailed classification prediction result includes, for example, the left hand movement state, the right hand movement state, the happy state, and the sad state. The first rough classification prediction result includes the motor imagination state and the emotional state. Specifically, the probability of the left hand movement state, the probability of the right hand movement state, the probability of the happy state, the probability of the sad state, the probability of the motor imagination state, and the probability of the emotional state can be output.

[0093] In the training process of the physiological state auxiliary prediction model, after the physiological state auxiliary prediction model is obtained through auxiliary training, the original EEG signal sample data is further input into the physiological state auxiliary prediction model for prediction to obtain a second rough classification prediction result that characterizes the physiological state. Then, based on the second rough classification prediction result, the model parameters of the physiological state auxiliary prediction model are reversely adjusted to obtain a trained physiological state prediction model. For example, the original EEG signal sample data includes a third sample label, and the model parameters of the physiological state auxiliary prediction model can be reversely adjusted based on the loss value between the second rough classification prediction result and the third sample label to obtain a trained physiological state prediction model.

[0094] Exemplarily, the original EEG signal sample data includes, for example, EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state. The physiological state auxiliary prediction model obtained by training based on the first target EEG signal sample data is, for example, a four-classification model, and the physiological state auxiliary prediction model obtained by training based on the second target EEG signal sample data is, for example, a six-classification model. The physiological state auxiliary prediction model has the ability to process EEG signal data for controlling the occurrence of the left hand movement state, the right hand movement state, the happy state, and the sad state. When performing the second model training, the four-classification or six-classification physiological state auxiliary prediction model can be set as a two-classification model for outputting two classification results. The two-classification physiological state auxiliary prediction model is used to predict the physiological state based on the original EEG signal sample data to obtain a second rough classification prediction result. The second rough classification prediction result includes, for example, a motor imagery state and an emotional state, and specifically can output the probability of the motor imagery state and the probability of the emotional state.

[0095] It can be understood that the EEG signal prior features contain important information or information with high discrimination, so it is more accurate for predicting small categories of physiological states. After the first target EEG signal sample data is obtained based on the EEG signal prior features, the first target EEG signal sample data is used to train a physiological state auxiliary prediction model for fine classification of physiological states, which can improve the model's fine classification prediction accuracy. After obtaining the physiological state auxiliary prediction model for fine classification, on this basis, a physiological state prediction model for coarse classification of physiological states is trained based on the original EEG signal sample data, and coarse classification is performed on the basis of fine classification, thereby improving the accuracy of coarse classification.

[0096] It can be understood that after the original EEG signal sample data and the EEG signal prior features are merged to obtain the second target EEG signal sample data, the second target EEG signal sample data is used to train a physiological state auxiliary prediction model for simultaneous fine classification and coarse classification, and coarse classification is taken into account on the basis of fine classification, so that the model has both relatively accurate fine classification capabilities and preliminary coarse classification capabilities. On this basis, the physiological state prediction model for coarse classification is further trained based on the original EEG signal sample data, so as to further enhance the model's coarse classification capability and improve the model's coarse classification accuracy.

[0097] It can be understood that the embodiments of the present application propose a method of inputting prior knowledge into the model for training, and it is feasible to combine prior knowledge with original EEG signal sample data and input the model, which further proves that model training based on auxiliary learning is feasible and the trained model has good prediction effect. The model trained with the assistance of prior features of EEG signals has good classification effect in identifying motor imagery state and emotional state.

[0098] In order to facilitate understanding of the training process of the physiological state prediction model of this application, Figure 4 Take the physiological state prediction model as a convolutional neural network model as an example. It can be understood that Figure 4 The model structure shown and the examples of data size or data dimension given below for ease of understanding are for reference only. This application does not impose specific limitations on the model structure and data size or data dimension.

[0099] Figure 4 A schematic diagram of a physiological state prediction model provided in an embodiment of the present application.

[0100] like Figure 4 As shown, the physiological state prediction model 400 can be a physiological state prediction model to be trained or a physiological state auxiliary prediction model. Compared with other models that can usually only be applied to the physiological state prediction of a single brain-computer interface (Brain Computer Interface, BCI) paradigm, the physiological state prediction model 400 of the embodiment of the present application can be applied to the physiological state prediction of multiple BCI paradigms. The BCI paradigm represents a method of conducting data acquisition experiments based on a brain-computer interface, such as collecting the EEG signal process corresponding to the motor imagination state as one paradigm, and collecting the EEG signal process corresponding to the emotional state as another paradigm. The physiological state prediction model 400 includes at least a temporal convolution layer 420, a spatial convolution layer 430, and a separable convolution layer 440 connected in sequence. Of course, the physiological state prediction model 400 can also include an input layer 410 and an output layer 450.

[0101] In the case where the physiological state prediction model 400 is a physiological state prediction model to be trained, the temporal convolution layer 420 is used to extract the first time feature data of the target EEG signal sample data (including the first target EEG signal sample data and the second target EEG signal sample data) in the time dimension. In the case where the physiological state prediction model 400 is a physiological state auxiliary prediction model, the temporal convolution layer 420 is used to extract the first time feature data of the original EEG signal sample data in the time dimension. The spatial convolution layer 430 is used to extract the spatial feature data of the first time feature data in the spatial dimension. The separable convolution layer 440 is used to extract the second time feature data of the spatial feature data in the time dimension, and to perform feature fusion on the second time feature data.

[0102] The following is an example process of model training.

[0103] First, the EEG signals of the subjects can be collected multiple times under different physiological states to obtain original EEG signal sample data. For example, an original EEG signal sample data can be collected in one experiment. An original EEG signal sample data can include EEG signal data corresponding to the left hand action state, the right hand action state, the happy state, and the sad state. The collected data can also be preprocessed and the preprocessed data can be used as the original EEG signal sample data. The preprocessing includes bandpass filtering of the collected EEG signal data, removing redundant data, and other processing.

[0104] Then, based on the original EEG signal sample data, an EEG signal prior feature is obtained, and based on the EEG signal prior feature, a target EEG signal sample data (including the first target EEG signal sample data and the second target EEG signal sample data) is obtained. The target EEG signal sample data can be divided into a training set, a validation set, and a test set. For example, a target EEG signal sample data includes 10 seconds of EEG signal data collected, and the 10 seconds of EEG signal data is divided into three data sets, and the three data sets include 8 seconds of data, 1 second of data, and 1 second of data, respectively. The 8 seconds of data are used as a training set, and the 1 second of data are used as a validation set to verify whether the model is overfitting or underfitting, and the other 1 second of data are used as a test set to test the prediction accuracy of the trained model. The physiological state prediction model 400 of the embodiment of the present application includes a compact deep learning model. After the model is trained based on a training set of target EEG signal sample data (including first target EEG signal sample data and second target EEG signal sample data) or original EEG signal sample data, the trained model is used to classify the validation set and the test set, so that the model can accurately classify the physiological state.

[0105] During the model training process, the original EEG signal sample data is taken as an example with a data size of [22,990]. Taking the second target EEG signal sample data as an example, the original EEG signal sample data and the EEG signal prior features are merged and processed, and the data size of the obtained second target EEG signal sample data is, for example, [22,1000], where 22 represents the number of channels, and the number of channels is the number of electrodes used to collect the original EEG signal sample data. Each channel collects 990 data points within 10 seconds, for example.

[0106] First, the second target EEG signal sample data is input into the model through the input layer 410 .

[0107] Secondly, feature extraction is performed on the second target EEG signal sample data through the time convolution layer 420. For example, feature extraction is performed through a convolution kernel with a data size of [1,64] and then F1 filters (not shown in the figure) are passed to extract F1 time dimension information to obtain the first time feature data with a data size of [F1,22,1000] in the time dimension, where F1 is a preset integer value.

[0108] Then, the first time feature data is input into the spatial convolution layer 430 for feature extraction. The spatial convolution layer 430 performs spatial feature extraction through a convolution kernel with a data size of [22,1], and then connects to D*F1 spatial filters (not shown in the figure) to extract spatial dimension information. The data size of the extracted spatial feature data is, for example, [D*F1,1,1000], where D is a preset integer value.

[0109] Next, the spatial feature data is input into the separable convolution layer 440 to learn the temporal features of each channel respectively and to fuse or integrate the data of multiple channels. The separable convolution layer 440, for example, includes a temporal convolution kernel with a data size of [1,16] and a common convolution kernel with a data size of [1,1]. The temporal convolution kernel with a data size of [1,16] can be used to extract features from the spatial feature data to obtain second temporal feature data for each channel, and the common convolution kernel with a data size of [1,1] can be used to perform feature fusion on the second temporal feature data of multiple channels to achieve fusion or integration of the feature data of multiple channels to obtain channel fusion feature data for multiple channels.

[0110] Finally, the feature data output by the separable convolution layer 440 is transmitted to the output layer 450, and the prediction result of the physiological state is output through the output layer 450. The output layer 450 may include a fully connected layer, and the learned deep features are classified through the fully connected layer to predict the current physiological state.

[0111] It can be understood that the physiological state prediction model extracts temporal features, spatial features, and channel fusion features through temporal convolution layers, spatial convolution layers, and separable convolution layers, thereby improving the diversity of features and making the extracted features contain deep and important information, thereby improving the prediction accuracy of the physiological state prediction model.

[0112] Through the embodiments of the present application, the physiological state prediction model learns the weights of the motor imagery state and the emotional state, and classifies the physiological state through the fully connected layer. Based on the auxiliary learning method, the model is trained on more refined small categories such as left hand movement state, right hand movement state, happy state, sad state, etc., and then it is more accurate and reliable to identify the large category of motor imagery state and emotional state.

[0113] Figure 5 A schematic diagram of the flow chart of the physiological state prediction method provided in the embodiment of the present application.

[0114] like Figure 5 As shown, the physiological state prediction method 500 provided in the embodiment of the present application includes, for example, steps S510 - S520 .

[0115] Step S510, obtaining original EEG signal data.

[0116] Step S520: input the original EEG signal data into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state.

[0117] Among them, the trained physiological state prediction model can be trained by the training method of the physiological state prediction model mentioned above, which will not be repeated here. The predicted results of the predicted physiological state include, for example, motor imagery state and emotional state, and specifically can be the probability of motor imagery state and the probability of emotional state. The trained physiological state prediction model is trained based on the prior knowledge of EEG signals. Therefore, the trained physiological state prediction model is used to predict the physiological state based on the original EEG signal data, so that the accuracy of the prediction result is higher.

[0118] Figure 6 A schematic flow chart of another physiological state prediction method provided in an embodiment of the present application.

[0119] like Figure 6 As shown, another physiological state prediction method 600 provided in an embodiment of the present application includes, for example, steps S610 - S620 .

[0120] Step S610, obtaining original EEG signal data.

[0121] Step S620: input the original EEG signal data into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state.

[0122] The trained physiological state prediction model includes at least one of a trained first physiological state prediction model and a trained second physiological state prediction model. For example, one of the trained first physiological state prediction model and the trained second physiological state prediction model with high prediction accuracy can be selected to predict the original EEG signal data.

[0123] The trained first physiological state prediction model is obtained by training based on the first target EEG signal sample data, and the trained second physiological state prediction model is obtained by training based on the second target EEG signal sample data. The first target EEG signal sample data is constructed based on the EEG signal prior features, which are obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior features.

[0124] Exemplarily, the trained first physiological state prediction model is obtained by training according to the following steps: based on the first target EEG signal sample data, the first physiological state prediction model to be trained is auxiliary trained to obtain the first physiological state auxiliary prediction model; based on the original EEG signal sample data, the first physiological state auxiliary prediction model is trained to obtain the trained first physiological state prediction model. The training process of the model can refer to the above content and will not be repeated here.

[0125] Exemplarily, the trained second physiological state prediction model is obtained by training according to the following steps: based on the second target EEG signal sample data, the second physiological state prediction model to be trained is auxiliary trained to obtain the second physiological state auxiliary prediction model; based on the original EEG signal sample data, the second physiological state auxiliary prediction model is trained to obtain the trained second physiological state prediction model. The training process of the model can refer to the above content and will not be repeated here.

[0126] Figure 7 A schematic diagram of a device for generating EEG signal sample data provided in an embodiment of the present application.

[0127] like Figure 7 As shown, the device 700 for generating EEG signal sample data provided in an embodiment of the present application includes: a processing module 710 and a generating module 720 .

[0128] Exemplarily, the processing module 710 is used to process original EEG signal sample data to obtain EEG signal prior features.

[0129] Exemplarily, the generation module 720 is used to generate target EEG signal sample data based on prior features of the EEG signal, wherein the target EEG signal sample data is used to assist in training the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model, and the original EEG signal sample data is used to train the physiological state auxiliary prediction model to obtain the trained physiological state prediction model.

[0130] Exemplarily, the generation module 720 is used to perform at least one of the following: constructing first target EEG signal sample data according to the EEG signal prior features; merging the original EEG signal sample data and the EEG signal prior features to obtain second target EEG signal sample data.

[0131] Exemplarily, the processing module 710 is specifically used to: process the original EEG signal sample data according to a preset characteristic index, and obtain a characteristic value corresponding to the preset characteristic index as a priori feature of the EEG signal.

[0132] Exemplarily, the device 700 for generating EEG signal sample data also includes: a first model training module, used to input the first target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a first sub-classification prediction result representing the physiological state; based on the first sub-classification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0133] Exemplarily, the first sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state.

[0134] Exemplarily, the first model training module is also used to: input the second target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a second sub-classification prediction result and a first coarse classification prediction result that characterize the physiological state; based on the second sub-classification prediction result and the first coarse classification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0135] Exemplarily, the second detailed classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; the first coarse classification prediction result includes at least one of the following: movement imagination state, emotional state.

[0136] Exemplarily, the first model training module is also used to: input the original EEG signal sample data into the physiological state auxiliary prediction model for prediction to obtain a second coarse classification prediction result that characterizes the physiological state; based on the second coarse classification prediction result, reversely adjust the model parameters of the physiological state auxiliary prediction model to obtain a trained physiological state prediction model.

[0137] Exemplarily, the second coarse classification prediction result includes at least one of the following: motor imagery state, emotional state.

[0138] Exemplarily, the original EEG signal sample data includes at least one of the following: EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state.

[0139] Exemplarily, the processing module 710 is also used to: determine multiple groups of feature indicators to be verified from multiple candidate feature indicators, wherein each group of feature indicators to be verified includes at least one candidate feature indicator; verify the multiple groups of feature indicators to be verified respectively to obtain verification results corresponding to each group of feature indicators to be verified, wherein the verification results characterize the prediction accuracy of the physiological state prediction model used for indicator verification based on the characteristic values ​​corresponding to each group of feature indicators to be verified for physiological state prediction; based on the verification results, select at least one group from the multiple groups of feature indicators to be verified as a preset feature indicator.

[0140] Exemplarily, the physiological state prediction model or physiological state auxiliary prediction model to be trained includes: a temporal convolution layer, used to extract first time feature data of the target EEG signal sample data or the original EEG signal sample data in the time dimension; a spatial convolution layer, used to extract spatial feature data of the first time feature data in the spatial dimension; a separable convolution layer, used to extract second time feature data of the spatial feature data in the time dimension, and to perform feature fusion on the second time feature data.

[0141] It can be understood that the specific implementation process of the device 700 for generating the EEG signal sample data can refer to the implementation process of the method for generating the EEG signal sample data described above, which will not be described in detail here.

[0142] Figure 8 A schematic diagram of a training device for a physiological state prediction model provided in an embodiment of the present application.

[0143] like Figure 8 As shown, the training device 800 for the physiological state prediction model provided in the embodiment of the present application includes: a first acquisition module 810, a first training module 820 and a second training module 830.

[0144] Exemplarily, the first acquisition module 810 is used to acquire target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on original EEG signal sample data.

[0145] Exemplarily, the first training module 820 is used to perform auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data to obtain the physiological state auxiliary prediction model.

[0146] Exemplarily, the second training module 830 is used to train the physiological state auxiliary prediction model based on the original EEG signal sample data to obtain a trained physiological state prediction model.

[0147] Exemplarily, the first acquisition module 810 is specifically used to: process the original EEG signal sample data to obtain the EEG signal prior features; and construct the first target EEG signal sample data according to the EEG signal prior features.

[0148] Exemplarily, the first acquisition module 810 is specifically used to: process the original EEG signal sample data to obtain the EEG signal prior features; and merge the original EEG signal sample data and the EEG signal prior features to obtain the second target EEG signal sample data.

[0149] Exemplarily, processing the original EEG signal sample data to obtain the EEG signal prior features includes: processing the original EEG signal sample data according to preset feature indicators to obtain feature values ​​corresponding to the preset feature indicators as the EEG signal prior features.

[0150] Exemplarily, the first training module 820 is specifically used to: input the first target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a first sub-classification prediction result representing the physiological state; based on the first sub-classification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0151] Exemplarily, the first sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state.

[0152] Exemplarily, the first training module 820 is specifically used to: input the second target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a second sub-classification prediction result and a first coarse classification prediction result that characterize the physiological state; based on the second sub-classification prediction result and the first coarse classification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0153] Exemplarily, the second detailed classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; the first coarse classification prediction result includes at least one of the following: movement imagination state, emotional state.

[0154] Exemplarily, the second training module 830 is specifically used to: input the original EEG signal sample data into the physiological state auxiliary prediction model for prediction to obtain a second coarse classification prediction result that characterizes the physiological state; based on the second coarse classification prediction result, reversely adjust the model parameters of the physiological state auxiliary prediction model to obtain a trained physiological state prediction model.

[0155] Exemplarily, the second coarse classification prediction result includes at least one of the following: motor imagery state, emotional state.

[0156] Exemplarily, the original EEG signal sample data includes at least one of the following: EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state.

[0157] Exemplarily, the preset characteristic indicators are obtained in the following manner: determining multiple groups of characteristic indicators to be verified from multiple candidate characteristic indicators, wherein each group of characteristic indicators to be verified includes at least one candidate characteristic indicator; verifying the multiple groups of characteristic indicators to be verified respectively to obtain verification results corresponding to each group of characteristic indicators to be verified, wherein the verification results characterize the prediction accuracy of the physiological state prediction model used for indicator verification based on the characteristic values ​​corresponding to each group of characteristic indicators to be verified for physiological state prediction; based on the verification results, selecting at least one group from the multiple groups of characteristic indicators to be verified as the preset characteristic indicator.

[0158] Exemplarily, the physiological state prediction model or physiological state auxiliary prediction model to be trained includes: a temporal convolution layer, used to extract first time feature data of the target EEG signal sample data or the original EEG signal sample data in the time dimension; a spatial convolution layer, used to extract spatial feature data of the first time feature data in the spatial dimension; a separable convolution layer, used to extract second time feature data of the spatial feature data in the time dimension, and to perform feature fusion on the second time feature data.

[0159] It can be understood that the specific implementation process of the training device 800 for the physiological state prediction model can refer to the implementation process of the training method for the physiological state prediction model mentioned above, and will not be repeated here.

[0160] Fig. 9 A schematic diagram of a physiological state prediction device provided in an embodiment of the present application.

[0161] like Fig. 9 As shown, the physiological state prediction device 900 provided in the embodiment of the present application includes: a second acquisition module 910 and a first prediction module 920.

[0162] Exemplarily, the second acquisition module 910 is used to acquire original EEG signal data.

[0163] Exemplarily, the first prediction module 920 is used to input the original EEG signal data into a trained physiological state prediction model for prediction, so as to obtain a prediction result of the physiological state.

[0164] Exemplarily, the physiological state prediction device 900 also includes a second model training module, which is specifically used to: obtain target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on the original EEG signal sample data; based on the target EEG signal sample data, perform auxiliary training on the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model; based on the original EEG signal sample data, perform training on the physiological state auxiliary prediction model to obtain a trained physiological state prediction model.

[0165] Exemplarily, the physiological state prediction device 900 also includes a first sample acquisition module, which is used to: process the original EEG signal sample data to obtain EEG signal prior features; and construct first target EEG signal sample data according to the EEG signal prior features.

[0166] Exemplarily, the first sample acquisition module is further used to: process the original EEG signal sample data to obtain EEG signal prior features; and merge the original EEG signal sample data and the EEG signal prior features to obtain second target EEG signal sample data.

[0167] Exemplarily, the first sample acquisition module is further used to: process the original EEG signal sample data according to a preset characteristic index to obtain a characteristic value corresponding to the preset characteristic index as a priori feature of the EEG signal.

[0168] Exemplarily, the second model training module is also used to: input the first target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a first subclassification prediction result characterizing the physiological state; based on the first subclassification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0169] Exemplarily, the first sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state.

[0170] Exemplarily, the second model training module is also used to: input the second target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtain a second sub-classification prediction result and a first coarse classification prediction result that characterize the physiological state; based on the second sub-classification prediction result and the first coarse classification prediction result, reversely adjust the model parameters of the physiological state prediction model to be trained to obtain a physiological state auxiliary prediction model.

[0171] Exemplarily, the second detailed classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; the first coarse classification prediction result includes at least one of the following: movement imagination state, emotional state.

[0172] Exemplarily, the second model training module is also used to: input the original EEG signal sample data into the physiological state auxiliary prediction model for prediction to obtain a second coarse classification prediction result that characterizes the physiological state; based on the second coarse classification prediction result, reversely adjust the model parameters of the physiological state auxiliary prediction model to obtain a trained physiological state prediction model.

[0173] Exemplarily, the second coarse classification prediction result includes at least one of the following: motor imagery state, emotional state.

[0174] Exemplarily, the original EEG signal sample data includes at least one of the following: EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state.

[0175] Exemplarily, the first sample acquisition module is also used to: determine multiple groups of feature indicators to be verified from multiple candidate feature indicators, wherein each group of feature indicators to be verified includes at least one candidate feature indicator; verify the multiple groups of feature indicators to be verified respectively to obtain verification results corresponding to each group of feature indicators to be verified, wherein the verification results characterize the prediction accuracy of the physiological state prediction model used for indicator verification based on the characteristic values ​​corresponding to each group of feature indicators to be verified for physiological state prediction; based on the verification results, select at least one group from the multiple groups of feature indicators to be verified as a preset feature indicator.

[0176] Exemplarily, the physiological state prediction model or physiological state auxiliary prediction model to be trained includes: a temporal convolution layer, used to extract first time feature data of the target EEG signal sample data or the original EEG signal sample data in the time dimension; a spatial convolution layer, used to extract spatial feature data of the first time feature data in the spatial dimension; a separable convolution layer, used to extract second time feature data of the spatial feature data in the time dimension, and to perform feature fusion on the second time feature data.

[0177] It can be understood that the specific implementation process of the physiological state prediction device 900 can refer to the implementation process of the physiological state prediction method above, and will not be repeated here.

[0178] Fig.10 A schematic diagram of another physiological state prediction device provided in an embodiment of the present application.

[0179] like Fig.10 As shown, another physiological state prediction device 1000 provided in an embodiment of the present application includes: a third acquisition module 1010 and a second prediction module 1020 .

[0180] Exemplarily, the third acquisition module 1010 is used to acquire original EEG signal data.

[0181] Exemplarily, the second prediction module 1020 is used to input the original EEG signal data into the trained physiological state prediction model for prediction, and obtain the prediction result of the physiological state. The trained physiological state prediction model includes at least one of a trained first physiological state prediction model and a trained second physiological state prediction model, the trained first physiological state prediction model is obtained by training based on the first target EEG signal sample data, the trained second physiological state prediction model is obtained by training based on the second target EEG signal sample data, the first target EEG signal sample data is constructed based on the EEG signal prior feature, the EEG signal prior feature is obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior feature.

[0182] Exemplarily, another physiological state prediction device 1000 also includes: a first physiological state prediction model training module, which is used to assist in training the first physiological state prediction model to be trained based on the first target EEG signal sample data to obtain a first physiological state auxiliary prediction model; based on the original EEG signal sample data, the first physiological state auxiliary prediction model is trained to obtain a trained first physiological state prediction model.

[0183] Exemplarily, another physiological state prediction device 1000 also includes: a second physiological state prediction model training module, which is used to assist in training the second physiological state prediction model to be trained based on the second target EEG signal sample data to obtain a second physiological state auxiliary prediction model; based on the original EEG signal sample data, the second physiological state auxiliary prediction model is trained to obtain a trained second physiological state prediction model.

[0184] Exemplarily, another physiological state prediction device 1000 further includes a second sample acquisition module, which is used to: process original EEG signal sample data to obtain EEG signal prior features; and construct first target EEG signal sample data according to the EEG signal prior features.

[0185] Exemplarily, the second sample acquisition module is further used to: process the original EEG signal sample data to obtain EEG signal prior features; and merge the original EEG signal sample data and the EEG signal prior features to obtain second target EEG signal sample data.

[0186] Exemplarily, the second sample acquisition module is further used to: process the original EEG signal sample data according to a preset characteristic index to obtain a characteristic value corresponding to the preset characteristic index as a priori feature of the EEG signal.

[0187] Exemplarily, the first physiological state prediction model training module is also used to: input the first target EEG signal sample data into the first physiological state prediction model to be trained for prediction, and obtain a first subclassification prediction result characterizing the physiological state; based on the first subclassification prediction result, reversely adjust the model parameters of the first physiological state prediction model to be trained, and obtain a first physiological state auxiliary prediction model.

[0188] Exemplarily, the first sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state.

[0189] Exemplarily, the second physiological state prediction model training module is also used to: input the second target EEG signal sample data into the second physiological state prediction model to be trained for prediction, and obtain a second sub-classification prediction result and a first coarse classification prediction result that characterize the physiological state; based on the second sub-classification prediction result and the first coarse classification prediction result, reversely adjust the model parameters of the second physiological state prediction model to be trained to obtain a second physiological state auxiliary prediction model.

[0190] Exemplarily, the second detailed classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; the first coarse classification prediction result includes at least one of the following: movement imagination state, emotional state.

[0191] Exemplarily, the first physiological state prediction model training module or the second physiological state prediction model training module is also used to: input the original EEG signal sample data into the first physiological state auxiliary prediction model or the second physiological state auxiliary prediction model for prediction, and obtain a second coarse classification prediction result characterizing the physiological state; based on the second coarse classification prediction result, reversely adjust the model parameters of the first physiological state auxiliary prediction model or the second physiological state auxiliary prediction model to obtain a trained first physiological state prediction model or a trained second physiological state prediction model.

[0192] Exemplarily, the second coarse classification prediction result includes at least one of the following: motor imagery state, emotional state.

[0193] Exemplarily, the original EEG signal sample data includes at least one of the following: EEG signal data for controlling the occurrence of the left hand movement state, EEG signal data for controlling the occurrence of the right hand movement state, EEG signal data for controlling the occurrence of the happy state, and EEG signal data for controlling the occurrence of the sad state.

[0194] Exemplarily, the second sample acquisition module is also used to: determine multiple groups of feature indicators to be verified from multiple candidate feature indicators, wherein each group of feature indicators to be verified includes at least one candidate feature indicator; verify the multiple groups of feature indicators to be verified respectively to obtain verification results corresponding to each group of feature indicators to be verified, wherein the verification results characterize the prediction accuracy of the physiological state prediction model used for indicator verification based on the characteristic values ​​corresponding to each group of feature indicators to be verified for physiological state prediction; based on the verification results, select at least one group from the multiple groups of feature indicators to be verified as a preset feature indicator.

[0195] Exemplarily, the first physiological state prediction model to be trained, the second physiological state prediction model to be trained, the first physiological state auxiliary prediction model or the second physiological state auxiliary prediction model include: a time convolution layer, a spatial convolution layer and a separable convolution layer. The time convolution layer of the first physiological state prediction model to be trained is used to extract the first time feature data of the first target EEG signal sample data in the time dimension, the time convolution layer of the second physiological state prediction model to be trained is used to extract the first time feature data of the second target EEG signal sample data in the time dimension, the first physiological state auxiliary prediction model or the second physiological state auxiliary prediction model is used to extract the first time feature data of the original EEG signal sample data in the time dimension; the spatial convolution layer is used to extract the spatial feature data of the first time feature data in the spatial dimension; the separable convolution layer is used to extract the second time feature data of the spatial feature data in the time dimension, and to perform feature fusion on the second time feature data.

[0196] It can be understood that the specific implementation process of another physiological state prediction device 1000 can refer to the implementation process of another physiological state prediction method mentioned above, which will not be repeated here.

[0197] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method in any one of the above embodiments are implemented.

[0198] One embodiment of the present application provides a computer program product, which includes instructions. When the instructions are executed by a processor of a computer device, the computer device can perform the steps of the method of any of the above embodiments.

[0199] Fig.11 A block diagram of an electronic device provided for an embodiment of the present application.

[0200] The embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned method for generating EEG signal sample data, the method for training a physiological state prediction model, and the method for predicting a physiological state when executing the computer program. Of course, the method for generating EEG signal sample data, the method for training a physiological state prediction model, and the method for predicting a physiological state can be executed by different electronic devices.

[0201] like Fig.11 As shown, for ease of understanding, the embodiment of the present application shows a specific electronic device 1100.

[0202] The electronic device 1100 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0203] like Fig.11As shown, the device 1100 includes a computing unit 1101, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1102 or a computer program loaded from a storage unit 1108 into a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the electronic device 1100 can also be stored. The computing unit 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0204] Multiple components in the electronic device 1100 are connected to the I / O interface 1105, including: an input unit 1106, such as a keyboard, a mouse, etc.; an output unit 1107, such as various types of displays, speakers, etc.; a storage unit 1108, such as a disk, an optical disk, etc.; and a communication unit 1109, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1109 allows the electronic device 1100 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0205] The computing unit 1101 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1101 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1101 executes the various methods described above, such as at least one of the methods for generating EEG signal sample data, the training method for the physiological state prediction model, and the physiological state prediction method. For example, in some embodiments, any one or more of the methods for generating EEG signal sample data, the training method for the physiological state prediction model, and the physiological state prediction method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1108. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 1100 via the ROM 1102 and / or the communication unit 1109. When the computer program is loaded into RAM 1103 and executed by the computing unit 1101, one or more steps of any one or more of the method for generating EEG signal sample data, the method for training a physiological state prediction model, and the physiological state prediction method described above may be executed. Alternatively, in other embodiments, the computing unit 1101 may be configured to execute any one or more of the method for generating EEG signal sample data, the method for training a physiological state prediction model, and the physiological state prediction method in any other appropriate manner (e.g., by means of firmware).

[0206] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this application, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.

[0207] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0208] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In the present application, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0209] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0210] In addition, the terms "first", "second", etc. used in the embodiments of the present application are only used for descriptive purposes and should not be understood as indicating or implying relative importance, or implicitly indicating the number of technical features indicated in the present embodiment. Therefore, the features defined by the terms "first", "second", etc. in the embodiments of the present application can explicitly or implicitly indicate that at least one of the features is included in the embodiment. In the description of the present application, the word "multiple" means at least two or two or more, such as two, three, four, etc., unless otherwise clearly and specifically defined in the embodiments.

[0211] In this application, unless otherwise clearly specified or limited in the embodiments, the terms "installed", "connected", "connected" and "fixed" etc. appearing in the embodiments should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or an integrated connection. It can be understood that it can also be a mechanical connection, an electrical connection, etc.; of course, it can also be a direct connection, or an indirect connection through an intermediate medium, or it can be the internal connection of two elements, or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific implementation situation.

[0212] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0213] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A training method for a physiological state prediction model, characterized in that: The method comprises: Acquire target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on original EEG signal sample data; Based on the target EEG signal sample data, auxiliary training is performed on the physiological state prediction model to be trained to obtain an auxiliary physiological state prediction model; and Based on the original EEG signal sample data, the physiological state auxiliary prediction model is trained to obtain a trained physiological state prediction model.

2. The method according to claim 1, characterized in that The step of obtaining target EEG signal sample data includes: Processing the original EEG signal sample data to obtain the EEG signal prior features; and Construct first target EEG signal sample data according to the EEG signal priori features.

3. The method according to claim 1, characterized in that: The step of obtaining target EEG signal sample data includes: Processing the original EEG signal sample data to obtain the EEG signal prior features; and The original EEG signal sample data and the EEG signal priori features are combined to obtain second target EEG signal sample data.

4. The method according to claim 2 or 3, characterized in that: The processing of the original EEG signal sample data to obtain the EEG signal prior features includes: According to the preset characteristic index, the original EEG signal sample data is processed to obtain a characteristic value corresponding to the preset characteristic index as the prior feature of the EEG signal.

5. The method according to claim 2, characterized in that: The step of performing auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data to obtain the physiological state auxiliary prediction model includes: Inputting the first target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtaining a first sub-classification prediction result representing the physiological state; and Based on the first sub-classification prediction result, the model parameters of the physiological state prediction model to be trained are reversely adjusted to obtain the physiological state auxiliary prediction model.

6. The method according to claim 5, characterized in that The first sub-category prediction result includes at least one of the following: Left hand movement state, right hand movement state, happy state, sad state.

7. The method according to claim 3, characterized in that The step of performing auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data to obtain the physiological state auxiliary prediction model includes: Inputting the second target EEG signal sample data into the physiological state prediction model to be trained for prediction, and obtaining a second detailed classification prediction result and a first coarse classification prediction result representing the physiological state; and Based on the second fine classification prediction result and the first coarse classification prediction result, the model parameters of the physiological state prediction model to be trained are reversely adjusted to obtain the physiological state auxiliary prediction model.

8. The method according to claim 7, characterized in that The second sub-classification prediction result includes at least one of the following: left hand movement state, right hand movement state, happy state, sad state; The first rough classification prediction result includes at least one of the following: motor imagery state and emotional state.

9. The method according to claim 5 or 7, characterized in that: The step of training the physiological state auxiliary prediction model based on the original EEG signal sample data to obtain a trained physiological state prediction model includes: Inputting the original EEG signal sample data into the physiological state auxiliary prediction model for prediction to obtain a second coarse classification prediction result representing the physiological state; and Based on the second coarse classification prediction result, the model parameters of the physiological state auxiliary prediction model are reversely adjusted to obtain the trained physiological state prediction model.

10. The method according to claim 9, characterized in that The second rough classification prediction result includes at least one of the following: Motor imagery state, affective state.

11. The method according to any one of claims 1 to 3, characterized in that: The original EEG signal sample data includes at least one of the following: EEG signal data used to control the left hand movement state, EEG signal data used to control the right hand movement state, EEG signal data used to control the happy state, and EEG signal data used to control the sad state.

12. The method according to claim 4, characterized in that The preset characteristic index is obtained in the following way: Determining a plurality of groups of feature indicators to be verified from a plurality of candidate feature indicators, wherein each group of feature indicators to be verified includes at least one candidate feature indicator; Verifying the multiple groups of feature indicators to be verified respectively to obtain verification results corresponding to each group of feature indicators to be verified, wherein the verification results represent the prediction accuracy of the physiological state prediction model used for indicator verification based on the feature values ​​corresponding to each group of feature indicators to be verified for physiological state prediction; and Based on the verification result, at least one group is selected from the multiple groups of feature indicators to be verified as the preset feature indicator.

13. The method according to any one of claims 1 to 3, characterized in that: The physiological state prediction model to be trained or the physiological state auxiliary prediction model includes: A time convolution layer, used to extract first time feature data of the target EEG signal sample data or the original EEG signal sample data in a time dimension; A spatial convolution layer, used to extract spatial feature data of the first temporal feature data in a spatial dimension; and The separable convolution layer is used to extract second time feature data of the spatial feature data in the time dimension, and perform feature fusion on the second time feature data.

14. A method for generating EEG signal sample data, characterized in that: The method comprises: Processing the original EEG signal sample data to obtain the EEG signal prior features; and Based on the prior features of the EEG signal, target EEG signal sample data is generated, wherein the target EEG signal sample data is used to assist in training the physiological state prediction model to be trained so as to obtain the physiological state auxiliary prediction model, and the original EEG signal sample data is used to train the physiological state auxiliary prediction model so as to obtain the trained physiological state prediction model.

15. The method according to claim 14, characterized in that The generating target EEG signal sample data based on the EEG signal prior features comprises at least one of the following: Constructing first target EEG signal sample data according to the EEG signal priori features; The original EEG signal sample data and the EEG signal priori features are combined to obtain second target EEG signal sample data.

16. A physiological state prediction method, characterized in that: The method comprises: Obtaining raw EEG signal data; and The original EEG signal data is input into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state. Wherein, the trained physiological state prediction model is trained based on the method described in any one of claims 1-13.

17. A physiological state prediction method, characterized in that: The method comprises: Obtaining raw EEG signal data; and The original EEG signal data is input into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state. Among them, the trained physiological state prediction model includes at least one of a trained first physiological state prediction model and a trained second physiological state prediction model, the trained first physiological state prediction model is obtained by training based on first target EEG signal sample data, and the trained second physiological state prediction model is obtained by training based on second target EEG signal sample data, the first target EEG signal sample data is constructed based on EEG signal prior features, and the EEG signal prior features are obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior features.

18. The method according to claim 17, characterized in that The trained first physiological state prediction model is obtained by training according to the following steps: Based on the first target EEG signal sample data, auxiliary training is performed on the first physiological state prediction model to be trained to obtain a first physiological state auxiliary prediction model; as well as Based on the original EEG signal sample data, the first physiological state auxiliary prediction model is trained to obtain the trained first physiological state prediction model.

19. The method according to claim 17, characterized in that The trained second physiological state prediction model is obtained by training according to the following steps: Based on the second target EEG signal sample data, auxiliary training is performed on the second physiological state prediction model to be trained to obtain a second physiological state auxiliary prediction model; as well as Based on the original EEG signal sample data, the second physiological state auxiliary prediction model is trained to obtain the trained second physiological state prediction model.

20. A training device for a physiological state prediction model, characterized in that: The device comprises: A first acquisition module is used to acquire target EEG signal sample data, wherein the target EEG signal sample data is determined based on EEG signal prior features, and the EEG signal prior features are obtained based on original EEG signal sample data; A first training module is used to perform auxiliary training on the physiological state prediction model to be trained based on the target EEG signal sample data to obtain an auxiliary physiological state prediction model; and The second training module is used to train the physiological state auxiliary prediction model based on the original EEG signal sample data to obtain a trained physiological state prediction model.

21. A device for generating electroencephalogram signal sample data, characterized in that: The device comprises: A processing module, used to process the original EEG signal sample data to obtain the EEG signal prior features; and A generation module is used to generate target EEG signal sample data based on the prior features of the EEG signal, wherein the target EEG signal sample data is used to assist in training the physiological state prediction model to be trained to obtain the physiological state auxiliary prediction model, and the original EEG signal sample data is used to train the physiological state auxiliary prediction model to obtain the trained physiological state prediction model.

22. A physiological state prediction device, characterized in that: The device comprises: A second acquisition module, used to acquire original EEG signal data; and The first prediction module is used to input the original EEG signal data into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state. Wherein, the trained physiological state prediction model is trained based on the device described in claim 20.

23. A physiological state prediction device, characterized in that: The device comprises: A third acquisition module is used to acquire original EEG signal data; and The second prediction module is used to input the original EEG signal data into the trained physiological state prediction model for prediction to obtain the prediction result of the physiological state. Among them, the trained physiological state prediction model includes at least one of a trained first physiological state prediction model and a trained second physiological state prediction model, the trained first physiological state prediction model is obtained by training based on first target EEG signal sample data, and the trained second physiological state prediction model is obtained by training based on second target EEG signal sample data, the first target EEG signal sample data is constructed based on EEG signal prior features, and the EEG signal prior features are obtained by processing the original EEG signal sample data, and the second target EEG signal sample data is obtained by merging the original EEG signal sample data and the EEG signal prior features.

24. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 19 are implemented.

25. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 19 are implemented.

Citation Information

Patent Citations

  • Emotion recognition method and system fusing prior and automatic electroencephalogram characteristics

    CN112836593A

  • Emotion recognition method and system based on generative self-supervised learning and electroencephalogram signals

    CN115590515A

  • Electroencephalogram signal classification method and apparatus, device, storage medium and program product

    WO2022183966A1

Cited By

  • Multi-modal human physiological data classification model and training method therefor, multi-modal human physiological data classification method, and device

    WO2025108316A1