875 results about "Emotion identification" patented technology

Aiming at the problems of insufficient language understanding depth, weak personalized dialogue generation ability, lack of continuous learning and long-term user state modeling and the like in the current emotion recognition and psychological intervention technology, the invention provides a user emotion recognition and psychological intervention method combined with a large language model (LLM). According to the method, the potential emotional state is identified by analyzing free text information input by a user by utilizing the powerful capabilities of a large language model in the aspects of natural language understanding, emotional modeling and text generation; constructing a multi-round dialogue context, and reasoning a psychological change trend of the user; in combination with a psychological knowledge base, personalized and mild psychological intervention dialogue content with a dredging effect is generated. The system supports recognition and classification of various emotional states such as depression, anxiety and alonity, is suitable for various interaction scenes (such as APPs, webpages and social robots), and can greatly improve the precision of emotion recognition and the timeliness and effectiveness of psychological intervention. The emotion recognition and psychological intervention method based on the large language model provides solid technical support for constructing an intelligent, continuous and personalized psychological health management system, and has wide application prospects and profound social significance.

The invention relates to the technical field of pet emotion recognition, in particular to a pet dog emotion recognition method and system based on deep learning. Comprising the steps of collecting pet dynamic data, pet physiological data and scene data to obtain a structured data set; labeling the structured data set through a cross validation labeling mechanism to obtain a labeled data set; multi-modal features are extracted based on the labeled data set, and multi-modal feature integration is carried out through a cascade SEblock array to obtain multi-modal fusion features; adversarial sample data generated by a stress scene simulator is injected in a training stage, and deep learning model training is performed based on the adversarial sample data and the multi-modal fusion features to obtain a pet emotion recognition model; and performing emotion recognition on a to-be-recognized pet through the pet emotion recognition model to obtain a pet emotion recognition result. According to the method, the data quality and the model robustness of pet emotion recognition are improved, and then the human-pet interaction quality is improved.

The embodiment of the invention provides a vehicle-mounted emotion interaction method and device based on multi-dimensional recognition, and the method and device achieve the precise judgment of the emotion of a driver through innovatively constructing an emotion fusion recognition model and integrating the facial expression, voice emotion, driving behavior and physiological state features. And designing a scene-based self-adaptive interaction strategy, and establishing an interaction triggering threshold value for intelligent matching in combination with external environment data and a danger level. An interaction effect evaluation mechanism is introduced, an interaction strategy model is continuously optimized through an online learning module, and dynamic adjustment of personalized interaction content is achieved. According to the method, the defects of the traditional technology in the aspects of emotion recognition, interaction strategies, effect evaluation and the like are effectively overcome, and the intelligent level and the user experience of vehicle-mounted emotion interaction are remarkably improved.

The invention relates to the technical field of electroencephalogram signal processing, and discloses an electroencephalogram emotion recognition method and system based on a deep neural network. The method comprises the following steps: collecting and preprocessing a multi-channel EEG signal; constructing a graph data structure, extracting multi-domain features by taking electroencephalogram channels as nodes, and constructing a self-adaptive dynamic adjacency matrix; constructing a graph convolution long and short-term memory network, learning spatial features by GNN, and extracting time dependence by LSTM; enhancing emotion capture by using a multi-scale time-frequency feature fusion method in combination with STF and CWT; constructing global topological information of an FCN brain extraction region in combination with brain network features; and outputting alertness and other emotion indexes by means of the classification model. According to the method, graph structure learning and time sequence modeling are combined, EEG signal emotion recognition is optimized, and personalized adaptation and emotion recognition accuracy is improved.

The invention belongs to the technical field of brain-computer interfaces, and particularly relates to a brain-computer interface driven emotion recognition and self-adaptive regulation and control system which comprises a multichannel nerve-peripheral coupling module, an emotion intensity probability mapping module and a closed-loop nerve regulation and control current module. The multi-channel nerve-peripheral coupling module is used for realizing overall quantification of central and peripheral emotional physiology; the emotion intensity probability mapping module is used for generating continuous emotion probabilities ranging from 0 to 1 through normalization and nonlinear mapping by utilizing emotion energy and combining eye movement fatigue and electroencephalogram entropy; and the closed-loop nerve regulation and control current module is used for dynamically adjusting the transcranial electrical stimulation intensity within the safety current upper limit according to the difference value between the emotion probability and the expected target. According to the invention, the recognition precision, the response speed and the use comfort are obviously improved.

A system for real-time analysis of emotional feedback during motivational speeches, consisting of: a series of multimodal sensors, including at least one visual sensor configured to capture facial expressions of spectators, at least one directional microphone configured to capture the audio responses of the audience, and optionally one or more physiological sensors configured to capture biometric signals from spectators; an edge-based processing unit that is communicatively coupled to the arrangement of multimodal sensors, wherein the edge-based processing unit comprises the following: (a) a feature extraction module configured to extract visual features from captured facial images, acoustic features from voice responses, and physiological features from biometric signals; (b) an emotion inference machine configured to process the features using a deep learning-based emotion recognition model comprising a convolutional neural network (CNN) for classifying facial expressions, a recurrent neural network (RNN) for classifying voice emotions, and a multimodal late fusion layer configured to compute a composite emotion state vector representing the aggregated emotions of the audience; (c) a timestamp and speech alignment module configured to correlate the calculated composite emotion state vector with segmented portions of a live motivational speech based on real-time speech-to-text transcription and semantic analysis; and (d) a session-based storage unit configured to log time-indexed emotional state vectors and corresponding speech segments for post-event analysis; A speaker feedback interface comprising a portable display or a podium-mounted visualization panel, wherein the interface is configured to display visual indicators of emotional feedback in real time, the indicators being derived from the emotional state vector and including at least emotional trend graphs, threshold alerts, or engagement indices.

The invention discloses a robot interactive question-answering method and system based on a large service model, and belongs to the technical field of intelligent robots, and the method comprises the steps: carrying out the feature extraction and fusion of the original input of a user, obtaining a multi-modal vector, building a recognition model, outputting an emotion recognition tag, an intention recognition tag, a user state vector and a session history, fusing the user state vector with a domain knowledge graph, outputting a structure reasoning vector and a joint condition vector, and splicing a knowledge abstract vector with a condition fusion vector to obtain the user state vector as the input of a text generator; and outputting a natural language answer and a user state vector, mapping the natural language answer into a multi-modal behavior action, and finally outputting a voice answer signal and the multi-modal behavior action. According to the method, the answer strategy of the robot is dynamically adjusted according to the emotional state of the user by combining context awareness and knowledge reasoning technologies, so that intelligent interaction of emotional resonance and professional depth coexistence is realized.

The invention belongs to the technical field of artificial intelligence and health monitoring, and particularly relates to an emotion recognition and intervention system based on facial micro-expression and physiological signal fusion. The emotion recognition precision is improved through space-time alignment analysis of facial micro-expressions and physiological signals, adaptive feedback is achieved in combination with cognitive load correlation modeling and a wearable multi-channel regulation and control terminal, cross-period emotion evolution prediction and group situation awareness are supported, a'awareness-decision-intervention 'complete closed loop is constructed, and the emotion recognition efficiency is improved. And the accuracy and initiative of emotion management in a complex environment are enhanced.

The invention discloses an emotion prediction and disease derivation method and system based on multi-modal fusion, and the system comprises a data collection and preprocessing module, an emotion fusion module, an abnormal condition detection and cloud uploading module, and a disease possibility derivation module. The data acquisition and preprocessing module comprises a video part, a text part and an audio part, and the video part comprises face emotion recognition and prediction and human motion recognition and prediction; the text part comprises text content emotion recognition and prediction; the audio part comprises voice-to-text and voice tone emotion recognition and prediction, the system comprehensively captures an emotion state by fusing multi-mode information such as video, text and voice, and the accuracy and prediction capability of emotion recognition are improved; and by predicting the future emotion trend, the abnormal condition is warned in advance, and the response timeliness is improved.

The invention relates to the technical field of image analysis, and discloses a multi-modal emotion recognition method and system based on hypergraph diffusion and evidence fusion, a terminal and a storage medium, and the method comprises the steps: carrying out the random shielding of a data set through a randomly generated mask, thereby simulating the random data missing condition, and carrying out inverse sampling on the preprocessed simulation data by using a trained conditional diffusion model to obtain a training set in which missing modals are complemented so as to train an emotion classification network, and finally carrying out emotion recognition. According to the method, through dual-channel evidence fusion, uncertainty is estimated at a feature source level and a discrimination level at the same time, so that adaptive evidence fusion is realized, the condition of performance reduction caused by modal loss is reduced, potential features of the lost modal are explicitly recovered in a feature space, and the accuracy of final emotion recognition is improved.

The invention belongs to the field of electroencephalogram signal processing, and provides a time-frequency space electroencephalogram emotion recognition method based on three-dimensional space position embedding, which comprises the following steps of: firstly, constructing a three-dimensional electrode space position matrix based on an international 10-20 system standard, determining a space adjacency relation between electrodes, and calculating a phase locking value to obtain a functional connection matrix; then, deep feature fusion of an electrode spatial position matrix and a functional connection matrix is realized by adopting a hierarchical cross Transform architecture, the spatial position matrix represents spatial distribution features of a cerebral cortex region, and the functional connection matrix quantifies phase synchronization features of cross-brain region neural oscillation and simulates a brain spatial topological structure; and finally, extracting time, frequency and spatial features of the electroencephalogram signals through combination of a graph attention network and bidirectional long-short-term memory with an attention mechanism for emotion recognition. The method can effectively extract space structure information highly related to the emotional state, and significantly improves the accuracy of emotion recognition.

The invention provides an intelligent customer service dynamic intention recognition system based on a semantic analysis model, and the system collects the multi-dimensional data of a user through a data collection module, constructs a user portrait through a feature extraction module, extracts the portrait features, carries out the semantic analysis of multiple rounds of historical dialogue data, and extracts preference features. And constructing a dynamic user-entity association graph to extract GNN node features. Multi-modal data of a user is analyzed through an emotion recognition module, emotion features are recognized, portrait features, preference features and emotion features are fused and analyzed based on an MLP model to obtain a final emotion state, and the portrait features, the preference features, GNN node features and the emotion features are fused through an intention recognition module to obtain a final emotion state. According to the method, dynamic intention analysis is carried out on the basis of the Transform sequence-to-sequence model, the current intention of the user is recognized, the recognition accuracy is high, the dynamically changing intention is adjusted in real time, and more accurate and targeted answers or services are provided for the user.

The invention discloses a digital human construction method and device based on a heterogeneous emotion semantic graph and long-sequence emotion modeling, and the method comprises the steps: obtaining multi-modal emotion input data of a text, voice and a visual image, extracting features, and constructing a multi-modal emotion feature set with a timestamp; constructing a heterogeneous emotion semantic graph which comprises user entity nodes, modal feature nodes and emotion concept nodes, modeling a semantic association, state transition and conflict suppression relationship through a multi-type edge structure, and introducing a dynamic evolution and conflict discrimination mechanism; performing time sequence modeling on the emotional state sequence by utilizing a local-global double-layer emotional modeling mechanism, and respectively capturing short-time fluctuation and long-time trend; performing cross-modal fusion on the emotional state and the modal features, and decoding the emotional state and the modal features into behavior parameters for controlling expressions, voices and actions of the digital human; and multi-modal emotion expression of the digital human is driven. Compared with the prior art, the emotion recognition accuracy and expression continuity and naturalness can be effectively improved.

The invention discloses a non-contact multi-modal decoupling emotion recognition method and device in a dialogue scene. The method comprises the following steps: acquiring original data of multiple modals in the dialogue scene; encoding the original data into original features by using a mode-dedicated encoder; projecting the original features by using a shared feature projector to obtain projection features, and performing weighted fusion to obtain shared features; extracting exclusive features from the original features by using a modal-specific expert network, and carrying out weighted fusion on the exclusive features to obtain private features; fusing the shared features and the private features through a cross attention fusion module to obtain multi-modal fusion features; and classifying the multi-modal fusion features by using a first classifier to obtain an emotion recognition result. According to the method, the key problems of high modal feature heterogeneity, inconsistent modal information, unbalanced modal, missing and the like in the field of multi-modal emotion recognition are solved, and the performance and robustness of emotion recognition in a dialogue scene are improved.

The invention discloses a service processing method based on emotion recognition and related equipment thereof, belongs to the technical field of artificial intelligence, and is applied to processing of insurance elimination service. Firstly, unified format conversion and feature extraction are carried out on three data sources of voice, video and text; then, a multi-modal fusion algorithm is combined with an attention mechanism to carry out weighted splicing on the features, and a comprehensive emotion feature vector is constructed; and emotional expression deviation caused by cultural difference is effectively corrected by combining a regional cultural emotion mapping table and customer regional information. And when the corrected emotional feature vector triggers an emotional threshold, the specific emotional state of the customer is accurately judged by a classification algorithm. And finally, determining a corresponding service response strategy according to the emotional state of the customer. According to the invention, the accuracy and response speed of emotion recognition are improved, the dynamic optimization of the service process is realized, the customer experience and satisfaction are enhanced, and the insurance industry is assisted to realize intelligent and precise customer service management.

The invention relates to the technical field of wisdom medical treatment, in particular to a cooperative intervention system and method based on multi-modal emotion perception and five-tone therapy, and realizes precision of emotion recognition and individuation of intervention strategies through cooperative intervention of multi-modal emotion perception and traditional Chinese medicine five-tone therapy. Physiological and behavior signals of a user in different states are comprehensively captured, emotion recognition is carried out in combination with a deep learning model, the accuracy and real-time performance of emotion recognition are remarkably improved, the system can intelligently match music tracks most suitable for the current emotion state based on the five-internal-organ-five-sound theory of traditional Chinese medicine and modern music psychology, and the user experience is improved. And an intervention strategy is continuously optimized through reinforcement learning, so that more targeted and effective emotion regulation is realized, and the method is particularly suitable for long-term management and intervention of negative emotions such as anxiety and depression.

The invention discloses a real-time emotion perception and voice interaction system for an intelligent cabin. The system comprises a multi-modal data acquisition module used for synchronously acquiring a facial image, a voice signal and text input of a driver; the visual feature enhancement unit is used for carrying out restoration and emotion distribution extraction on the low-quality image; the audio noise reduction and feature extraction unit is used for extracting voice emotion features; the text emotion coding unit is used for fusing relative position coding and context semantic information; the cross-modal fusion module is used for outputting an emotion classification result by integrating visual, audio and text features; the personalized emotion database is used for storing historical emotion data of the user and performing emotion trend prediction and early warning judgment; the large language model feedback module is used for generating structured cue words according to the emotion recognition result and the driving situation and generating natural language feedback; the voice synthesis and output module is used for adjusting voice parameters and performing feedback output through a vehicle-mounted multi-channel; according to the invention, the emotion expression of human-vehicle interaction is enhanced.

The invention relates to the technical field of data processing, in particular to a method for driving emotion interaction of an intelligent device based on multi-modal understanding, and aims to eliminate illumination and noise interference and output a standardized face video stream, an effective voice segment and a touch thermodynamic diagram through an environment adaptive acquisition module. The feature extraction module extracts facial action optical flow features, voice Mel-frequency cepstral coefficient vectors and tactile pressure gradient parameters. The cross-modal correlation model adopts a tensor decomposition algorithm to calculate a space-time correlation matrix of visual and voice features, and the tactile feature weight is dynamically adjusted in combination with environmental parameters. According to the response strategy, an intervention scheme is retrieved based on a graph database, emotion confirmation statements, guide statements and behavior suggestions are fused to generate multi-mode response, and PID adjustment of the temperature control device and tactile pulse output of the vibration device are synchronously driven. And the feedback evaluation module verifies the emotion recognition consistency through a Pearson's correlation coefficient, triggers conflict sample separation storage and model increment training, and realizes closed-loop optimization.

The invention discloses a campus psychological assessment multi-mode emotion recognition and privacy protection method and system, and the method comprises the steps: collecting physiological signal data, voice signal data and facial expression data in a non-contact manner, carrying out the preprocessing of the collected data, extracting the feature vector of the signal data, and carrying out the recognition of the feature vector of the signal data; the method comprises the following steps of: inputting a modal-invariant basic model to carry out multi-modal fusion, then inputting the modal-invariant basic model into a lightweight multi-modal emotion recognition model to carry out emotion recognition, generating a visual report of a user emotion state and emotion intensity according to an emotion recognition result, calculating a DASS-21 index according to the visual report, generating a standard evaluation scale, and providing emotion guidance. According to the method, the physiological signals, the voice signals and the facial expression data are fused, the emotion features are captured from multiple angles, the emotion recognition accuracy is improved, the psychological state can be more comprehensively described through the multi-modal fusion mode, and the root of the psychological problem can be more accurately positioned in an auxiliary mode.

The invention relates to the technical field of model construction methods, in particular to a face emotion recognition model construction method for a low-computing-power platform, and the method comprises the steps: obtaining a face emotion data image, and constructing a face emotion recognition data set; constructing a face emotion recognition lightweight model based on the face emotion recognition data set; performing LAMP pruning on the face emotion recognition lightweight model to compress the model; training the YOLOv5L model based on the face emotion recognition data set, and taking the obtained model as a teacher model; and knowledge distillation is performed on the face emotion recognition lightweight model after LAMP pruning by using the weight file, and the precision of the face emotion recognition lightweight model after LAMP pruning is recovered, so that the parameter quantity and the calculation quantity of the model can be significantly reduced while the model precision is ensured, and the deployment requirement in a low-calculation-power platform is effectively met.

The invention discloses a machine vision emotion recognition and interaction system and method based on multi-modal fusion, and the method comprises the steps: obtaining the multi-modal emotion expression data of a user and the basic information data of the user, constructing a user emotion feature initial recognition model, carrying out the calculation through the user emotion feature initial recognition model, and obtaining a user emotion feature recognition result; obtaining an original emotion recognition result; based on the original emotion recognition result, historical recognition deviation data in the long-term interaction process of the user is obtained and preprocessed, and a processed individual emotion baseline data set is obtained; optimizing the user emotion feature initial recognition model by using the individual emotion baseline data set, and constructing a user feature adaptive emotion recognition model; and performing multi-modal emotion recognition prediction based on the user feature adaptive emotion recognition model. According to the method, the emotion discrimination accuracy in a multi-user recognition scene is remarkably improved, and the problem of misrecognition caused by expression differences among the users is solved.

The invention provides an emotion analysis method based on a multi-modal comparative learning individual focusing model. The method comprises the following steps: collecting data; feature extraction is conducted on the preprocessed data, and electroencephalogram signal feature differential entropy and power spectrum density are obtained; constructing a multi-modal individual focusing comparison network architecture, and performing time-frequency domain feature learning by using an individual focusing network; performing feature fusion on the middle features extracted by the modules in each branch by using a multi-modal relation calculation fusion mechanism; calculating the difference loss from different individual features and the comparison loss from the data set by using the individual domain and sub-domain equilibrium comparison loss; and the comparison loss is added into the model training loss for training, the test set is sent to the trained network for prediction, and an emotion classification result is obtained. The method can effectively improve the discrimination capability of the emotion recognition model and the final classification accuracy.

The invention relates to the technical field of computer vision and emotion calculation, in particular to an emotion real-time recognition and long-term monitoring method based on facial expressions. According to the method, an emotion recognition result is obtained by recognizing a high-definition facial image, and the emotion recognition result, environment information and physiological state data are fused to obtain time-space aligned multi-modal data; performing emotional causal analysis based on the multi-modal data, and judging emotional causes by combining a rule engine and a machine learning model: outputting a real-time emotional state recognition result and a periodic emotional report according to the emotional causes, and performing differentiated feedback according to the emotional causes. According to the method, through multi-source data fusion and a causal inference mechanism, the accuracy and interpretability of emotion recognition are effectively improved, and the technical span from passive recognition to personalized active intervention is realized.

The invention discloses a self-adaptive music playing intelligent headphone and a system thereof, and relates to the technical field of headphones, the headphone comprises a head frame and earmuffs, the head frame comprises an outer shell, a fixing frame is fixedly mounted in the outer shell, and slideways are fixedly mounted at two ends of the fixing frame; a movable connecting rod is arranged in the slide way, and a limiting groove and a limiting block are arranged at one end of the connecting rod; the earmuff comprises an earmuff shell, a connecting piece used for being connected with the connecting rod is fixedly installed in the earmuff shell, and a touch screen control module is installed on one side of the outer portion of the earmuff shell. According to the system, the mood state of the user is automatically recognized and the emotional state of the user is judged by integrating various sensors (such as a heart rate sensor and a skin electric reaction sensor), so that the accuracy of emotion recognition is improved, subtle emotion changes can be captured, more appropriate music recommendation is provided, and the use effect of equipment is improved.

The invention relates to the technical field of data processing, and discloses an emotion recognition method and system based on multi-modal feature retrieval, a terminal and a storage medium, and the method comprises the steps: collecting a video signal and an audio signal of a subject, converting the audio signal into a text signal, and extracting a video feature, an audio feature and a text feature; retrieving in a single-mode feature retrieval library according to the video features, the audio features and the text features to obtain enhanced features; aligning the enhanced features to a unified feature space through a mapping module, inputting a double-branch structure, dynamically adjusting the weight of the enhanced features through a modal weight distributor to obtain weighted enhanced features, and querying in a multi-modal feature retrieval library according to the enhanced features to obtain multi-modal retrieval features; and fusing the weighted enhanced features and the multi-modal retrieval features, inputting the fused features into a multi-modal large model for processing, and outputting an emotion recognition result of the subject. According to the invention, accurate perception of the individual emotional state is realized.

The invention discloses a children language cognition rehabilitation assisting system and method based on a self-adaptive co-creation mechanism, and belongs to the field of medical artificial intelligence and psychological rehabilitation engineering. The system comprises five core modules, the modules are connected in a closed-loop mode in a data flow mode to form a sustainable and optimized interaction system, a semantic vector, an emotion vector and a task vector of child voice are fused, a fusion state vector is constructed through a dynamic weight generation network and a cross-modal attention mechanism, and the fusion state vector and the task vector are integrated. And generating a co-creation control instruction by adopting an attention-enhanced gating circulation unit and a strategy network, and further synthesizing an interactive voice signal with emotional expressive force. Synchronous fusion and linkage feedback of semantic understanding and emotion recognition can be achieved, the interaction strategy is dynamically adjusted according to the real-time state of children, strategy network parameters are optimized through online self-learning, and the naturalness, coherence and individual adaptability of rehabilitation interaction are improved.

The invention relates to the technical field of electroencephalogram analysis, in particular to a domain-adaptive cross-subject electroencephalogram signal emotion recognition method, which comprises the following steps: acquiring an electroencephalogram signal, and preprocessing the electroencephalogram signal; inputting the preprocessed electroencephalogram signals into a trained electroencephalogram signal emotion recognition model to obtain an emotion classification result; the electroencephalogram emotion recognition model comprises a graph convolution feature extraction module, an attention module, a domain confrontation module and a classifier module. According to the method, the confrontation module formed by combining the gradient inversion layer and the domain discriminator is designed, and the change rule of the electroencephalogram of a person in positive, neutral and negative states is focused instead of the intensity of the reaction, so that the extracted emotional features have domain invariance, and the extraction accuracy is improved. And identification deviation caused by difference of different individuals in cross-subject emotion identification is eliminated.

The invention discloses an emotional man-machine interaction method, device and equipment based on emotion recognition and a computer readable storage medium. The method comprises the steps that first modal action data, second modal facial expression data and third modal physiological parameter data of a user are synchronously collected; processing the first modal motion data and a preset standard emotion-motion template through a posture estimation and dynamic time warping algorithm to generate a motion evaluation score; inputting the action evaluation score, the second modal facial expression data and the third modal physiological parameter data into a preset multi-modal fusion model for processing to generate a quantized user emotion level; based on the quantized user emotion level, determining an interface adjustment parameter and an emotional feedback text; and applying the interface adjustment parameter and the emotional feedback text to the current human-computer interaction interface. The emotional man-machine interaction method based on emotion recognition has the advantages of being accurate in emotion recognition, intelligent in interaction, personalized and the like.

The invention relates to the technical field of psychological assessment, in particular to a psychological state assessment method, system and terminal based on an interactive terminal, and the method comprises the steps: separating voice data and text data of a user into an emotion change sequence; based on the emotion tendency of the emotion change sequence, setting an emotion change quantity, and according to a matching relationship between the emotion change quantity and a dialogue situation, calculating a user response duration; obtaining the participation degree of the user at different moments by obtaining the response frequency corresponding to the response duration of the user; combining the degree of participation, the emotional variation and the emotional change probability into an emotional feature, and deducing an emotional classification and a transition label of the current emotional feature; on the basis of the emotion proportion of each emotion classification, dialogue strategy matching is carried out according to the participation amount of the emotion classification at adjacent moments, and a dialogue strategy is set; and the accuracy and effect of emotion recognition are improved.

The invention relates to the technical field of emotion recognition, and discloses an emotion monitoring system and method based on a brain-computer interface, and the emotion monitoring method based on the brain-computer interface comprises the steps: synchronously collecting and preprocessing physiological signals through multiple sensors; calculating credibility scores and screening available modes; adopting a credibility weighted attention mechanism to obtain a fusion feature vector and calculating feature quality; constructing a multi-branch inference network to perform emotion recognition, and outputting an emotion state and an overall credibility score; and detecting distribution drift and carrying out individualized multi-branch inference network calibration. According to the invention, through cooperative work of multi-modal physiological signals, when the quality of a single-modal signal is reduced, the stability of the overall performance can be ensured, and the emotion recognition accuracy is improved; through an online continuous learning mechanism, model calibration can be performed according to an individual emotion expression mode of a user, physiological feature differences of different users are adapted, and a complete solution is provided for practical application of an emotion monitoring technology.