95 results about "Emotion intensity" patented technology

The invention discloses a psychological accompanying method based on multi-modal emotion recognition, and belongs to the technical field of psychological health services, and the method comprises the steps: S1, synchronously collecting physiological signals, voice features, facial expressions and interactive behavior data of a user through a multi-modal sensor; s2, performing fusion analysis on the multi-modal data by using a deep learning model, and identifying a current emotional state and an emotional intensity level of the user; and S3, dynamically generating an adaptive psychological accompanying intervention scheme based on a preset emotion-intervention strategy mapping rule in combination with historical emotion data and personalized preferences of the user. According to the method, the physiological signals, the voice features, the facial expressions and the interactive behavior data are synchronously collected through the multi-modal sensor, the deep learning model is used for fusion analysis, and compared with single-modal recognition, the emotion state and the intensity level of the user can be judged more comprehensively and accurately, the emotion misjudgment risk is reduced, and a reliable basis is provided for subsequent intervention.

The invention belongs to the technical field of brain-computer interfaces, and particularly relates to a brain-computer interface driven emotion recognition and self-adaptive regulation and control system which comprises a multichannel nerve-peripheral coupling module, an emotion intensity probability mapping module and a closed-loop nerve regulation and control current module. The multi-channel nerve-peripheral coupling module is used for realizing overall quantification of central and peripheral emotional physiology; the emotion intensity probability mapping module is used for generating continuous emotion probabilities ranging from 0 to 1 through normalization and nonlinear mapping by utilizing emotion energy and combining eye movement fatigue and electroencephalogram entropy; and the closed-loop nerve regulation and control current module is used for dynamically adjusting the transcranial electrical stimulation intensity within the safety current upper limit according to the difference value between the emotion probability and the expected target. According to the invention, the recognition precision, the response speed and the use comfort are obviously improved.

The invention relates to the technical field of emotion regulation and control, in particular to an emotion regulation and control system based on a self-adaptive virtual reality scene, which comprises an emotion monitoring module, a virtual reality device, a self-adaptive regulation and control module, a feedback module, an emotion guiding module and an effect evaluation module, the emotion category and the emotion intensity are analyzed and judged; the virtual reality equipment is used for providing virtual reality experience for a user; the self-adaptive regulation and control module is used for adjusting elements and parameters of the virtual scene; the feedback module is used for collecting evaluation on the emotion regulation effect, analyzing the evaluation and generating a feedback report; the emotion guiding module is used for providing emotion guiding suggestions; and the effect evaluation module is used for quantifying the effect of emotion regulation and control and evaluating the effect of emotion regulation and control. According to the invention, real-time monitoring and dynamic regulation and control of the emotion of the user can be realized, personalized virtual reality experience is provided, and more effective mental health support is provided for the user.

The invention relates to the technical field of robot control, and discloses a spiking neural network-based robot control method, which comprises the following steps of: preprocessing collected multi-modal data to obtain an emotion pulse signal; inputting the emotion pulse signal into a pre-constructed emotion pulse neural network, and outputting a comprehensive emotion pulse; inputting the comprehensive emotion pulse into a central pattern generator, and outputting a behavior rhythm; acquiring an environment feedback signal generated by executing the behavior rhythm, and adjusting a connection weight according to the environment feedback signal; optimizing the comprehensive emotion pulse according to the connection weight, and converting the optimized comprehensive emotion pulse into emotion interaction voice information; and adjusting the emotion intensity according to the optimized comprehensive emotion pulse and the multi-modal data. According to the method, data are collected through the multi-mode sensor to generate emotion pulses, the emotion pulses are input into the central mode generator to generate behavior rhythms after SNN processing, weight optimization, emotional speech generation and emotional steady-state control setting are combined with the STDP algorithm, and the efficiency of a robot service scene is improved.

The invention, which relates to the field of the intelligent accompanying system, discloses an interactive digital person accompanying system for the old with cognitive impairment, comprising a data acquisition module, an emotion recognition module, a first matching module, a second matching module, a personalized interaction generation module and a reinforcement learning adaptive module. The data acquisition module acquires multi-modal sensing data of a target old person; the emotion recognition module outputs an emotion label and an intensity value through feature extraction and Transform fusion; a first matching module screens corpus fragments according to emotion intensity triggering conditions; the second matching module performs secondary screening based on the retrieval weight; the personalized interaction generation module generates digital twin interaction data through probability distribution sampling; the reinforcement learning adaptive module dynamically adjusts the corpus weight according to the interaction reward value; according to the method, the dual guarantee of emotion guarding and physiological safety is realized, the anxiety emotion of the old with cognitive impairment is remarkably relieved, and the novelty of interaction and high emotion relieving efficiency can be kept.

The invention discloses a campus psychological assessment multi-mode emotion recognition and privacy protection method and system, and the method comprises the steps: collecting physiological signal data, voice signal data and facial expression data in a non-contact manner, carrying out the preprocessing of the collected data, extracting the feature vector of the signal data, and carrying out the recognition of the feature vector of the signal data; the method comprises the following steps of: inputting a modal-invariant basic model to carry out multi-modal fusion, then inputting the modal-invariant basic model into a lightweight multi-modal emotion recognition model to carry out emotion recognition, generating a visual report of a user emotion state and emotion intensity according to an emotion recognition result, calculating a DASS-21 index according to the visual report, generating a standard evaluation scale, and providing emotion guidance. According to the method, the physiological signals, the voice signals and the facial expression data are fused, the emotion features are captured from multiple angles, the emotion recognition accuracy is improved, the psychological state can be more comprehensively described through the multi-modal fusion mode, and the root of the psychological problem can be more accurately positioned in an auxiliary mode.

The invention discloses an artificial intelligence customer service system based on natural language processing, and particularly relates to the technical field of natural language processing, the artificial intelligence customer service system comprises an input processing module, an intention collaboration module, an intention optimization module and an intention dynamic decision module, the intent collaborative module is used for calculating a context entropy value based on historical N rounds of dialogue feature distribution and a time decay weight, the intent collaborative module is used for outputting an emotion intensity signal through a multi-mode emotion recognition model according to input information and generating an intent correction vector in combination with a preset intent-emotion mapping matrix, and the intent optimization module is used for constructing and optimizing a collaborative loss function so as to improve the intent correction vector. And the intention dynamic decision-making module is used for performing intention classification on the input of the user based on the optimized model parameters and performing dynamic adjustment according to context entropy and emotion analysis, and the intention dynamic decision-making module is used for adjusting and making a decision on the response strategy of the system based on the output of the input processing, intention collaboration and optimization module and according to the context of the current dialogue.

The invention relates to an emotional infection method based on parameterized reinforcement learning, and the method comprises the steps: obtaining a real crowd video with a social identity attribute, and carrying out the recognition processing of the real crowd video, so as to obtain all groups forming a real crowd and the social identity of each individual; calculating the emotion intensity of each individual and behavior weights of behaviors corresponding to the individual under different emotion intensities on the basis of the influence of an emergency event source in the surrounding environment and the emotion influence of surrounding neighbor individuals on the individual; and obtaining evacuation behaviors of each individual under different emotion intensities and environment conditions based on the same reward function and each behavior weight of all individuals. Thus, the reality that individual emotions are affected by emergency event sources in the environment where the individual emotions are located and surrounding neighbor individual emotions is considered, the dynamic adaptability of the individual to the crowd environment where the individual emotions are located is achieved, complex behavior decisions of the individual under emotion driving are fully captured, and the method adapts to complex scene changes of high-density crowds.

The invention relates to the technical field of image recognition and processing, and discloses an emotion-driven 2D supernatural digital human video generation system of a multi-modal model, and the system comprises a voice input module which is used for receiving a voice signal of a user and then converting the voice signal into a digital signal; the voice preprocessing module is used for carrying out noise elimination and normalization processing on the voice signals; the voice emotion analysis module extracts emotion features based on the digital signals of the voice preprocessing module; the multi-modal generation module is used for mapping the emotional characteristics into digital human gestures and digital human population type actions; and the video generation module is used for synchronizing the gesture and the mouth shape action with the voice signal and generating a 2D digital human video. According to the method and the device, the speech emotion features are accurately mapped into the gestures and mouth shape actions of the digital human through the multi-modal generation model, the actions highly matched with the emotion types, the emotion intensity and the mood features are generated, so that the expression effect with rich emotions is visually presented, and the user experience is more realistic.

The invention discloses an emotion recognition model training method, an emotion recognition method, equipment and a storage medium. The emotion recognition model training method comprises the following steps: acquiring a predicted emotion category output by an emotion category component in an emotion recognition model for a physiological signal sample; comparing the predicted emotion category with an emotion category label to obtain a category label comparison result; when it is detected that the category label comparison result is that categories are matched, obtaining predicted emotion intensity output by an emotion intensity component in the emotion recognition model for the physiological signal sample, and comparing the predicted emotion intensity with an emotion intensity label to obtain an intensity label matching result; and training the emotion intensity component according to an intensity label matching result. Therefore, interference of wrong emotion classification samples on emotion intensity learning can be effectively avoided, it is ensured that intensity estimation is carried out in an accurate category context, and the precision and reliability of intensity recognition are further improved.

The invention discloses an interactive humanoid robot expression simulation method based on artificial intelligence, and relates to the technical field of expression simulation, and the method comprises the steps: collecting a brain wave signal of a user, carrying out the preprocessing, and generating a power spectrum density feature; inputting the power spectral density features into a pre-trained emotion classification model, and outputting an emotion category and an emotion intensity value of the user; performing emotional expression mapping on the emotional category and the emotional intensity value, and outputting a bionic muscle contraction instruction; performing facial adjustment on facial muscle fibers of the humanoid robot according to the bionic muscle contraction instruction, dynamically adjusting surface texture details of the humanoid robot, and generating a simulated micro expression; and capturing user face feedback data through camera shooting eyeballs, evaluating the acceptance degree of the user on the simulated micro-expression based on the user face feedback data, and outputting an expression optimization strategy. According to the method, through deformation matching and expression optimization double-closed-loop modeling driven by user feedback, biological simulation of micro-expressions of the humanoid robot is realized.

The invention relates to the technical field of data recognition, and provides an emotion analysis system and method based on a dialogue large-scale model, which are applied to programmable lighting equipment, and comprise a data processing module used for receiving text data input by a user and calling a dialogue large-scale language model to carry out emotion analysis on the text data, obtaining emotion category and emotion intensity information; the light control module is in communication connection with the data processing module, and dynamically adjusts the color, the brightness and the dynamic effect of the programmable light equipment according to the emotion category and the emotion intensity information; and the power supply management module is used for supplying power to the programmable lighting equipment and the data processing module and managing the programmable lighting equipment and the data processing module. By combining emotion analysis of a dialogue large model with programmable lighting equipment, under the support of a data processing module and a power supply management module, the emotional state of a user is visually and stably reflected, and the problem that the flexibility and accuracy of an existing system are obviously insufficient in the face of complex emotional expression and dynamic change is solved.

The invention discloses an emotion expression method and device, equipment and a computer readable storage medium. The method comprises the following steps: acquiring first session information input to a robot by a first user; generating second session information output to the first user by the robot according to the first session information; the second session information comprises a first emoticon; determining a first emotion label and / or first emotion intensity corresponding to the first emotion icon; the robot is controlled to output a first emotion related behavior corresponding to the first emotion label and / or the first emotion intensity, the first emotion related behavior comprises at least one of outputting corresponding voice interaction information, outputting a corresponding expression and executing a corresponding action, and the voice interaction information is included in the second session information.

The invention provides a group psychological data fluctuation early warning method based on VR emotion data processing, which comprises the following steps: acquiring multi-modal physiological signals such as electroencephalogram, heart rate variability and skin conductance of a user and behavior data such as voice, expression and virtual trajectory in real time, performing sliding window processing and feature extraction, fusing into multi-dimensional features, inputting the multi-dimensional features into an emotion recognition model, and performing emotion recognition on the emotion recognition model; generating an individual emotion dynamic sequence; a dynamic heterogeneous graph is constructed by combining the social relation and the emotion similarity, the emotion influence intensity between nodes is judged by using a dual-channel graph attention mechanism, and a propagation path is traced through an integral gradient method, so that interpretable group emotion diffusion mode recognition is realized; according to the method, a typical propagation mode and a time sequence convolutional network are combined, a group emotion intensity evolution trend is predicted, when fluctuation exceeds a threshold value, an emotion propagation path thermodynamic diagram is automatically generated and early warning is pushed, and the interpretability of an emotion propagation path and prediction and response efficiency of group psychological fluctuation are improved.

The invention discloses a personalized electroencephalogram emotion recognition method and system based on dynamic brain region division, and belongs to the technical field of electroencephalogram emotion recognition. The method comprises the steps that electroencephalogram signals are preprocessed, and an electroencephalogram signal matrix is constructed; on the basis of the preprocessed electroencephalogram signals, five-frequency-band differential entropy feature values are extracted, multi-head self-attention calculation is carried out in combination with rotation position coding, and channel feature representation with strong emotion intensity is output; on the basis of the constructed electroencephalogram signal matrix, dynamically dividing a brain function region by using a CNM algorithm, optimizing the structure of the brain function region by using a modularity value, and outputting brain region characteristics; and fusing the channel feature representation and the brain region features, predicting an emotion tag through a graph neural network, and outputting an emotion recognition result. According to the method, the individual brain function region can be dynamically divided, the function integration information of the brain region is effectively captured, and deep fusion of brain region function connection and channel emotion information is realized.

The invention provides an employee emotion index evaluation method and device based on multi-modal data. The method comprises the following steps: acquiring multi-modal related data of an employee; the related data comprises voice data of the employees, text data in an enterprise communication tool, video data captured by visual behaviors and physiological signals of the employees; carrying out feature extraction on the related data and carrying out cross-modal alignment to obtain multi-modal technical features; calculating a data quality coefficient and a scene correlation coefficient of each mode so as to calculate a final dynamic weight of each mode; fusing the multi-modal technical features based on the final dynamic weight of each modal, and performing analysis to obtain a comprehensive emotion index of the employee; the comprehensive emotional index comprises emotional tendency, emotional intensity and a pressure index. According to the method and the device, the comprehensive emotion index of the employee is obtained by comprehensively analyzing the data of the multiple modes, so that the defects that the current emotion evaluation of the employee is not comprehensive enough and low in accuracy are overcome.

The invention discloses a dynamic special effect processing method and device, a storage medium and related equipment, which are applied to the technical field of dynamic special effect rendering, and are used for performing plot analysis on an obtained to-be-processed video to obtain a video plot background, an emotional tone in the plot and a key plot node, and performing dynamic special effect processing according to the video plot background and the emotional tone in the plot. The method comprises the following steps: respectively performing emotion reasoning and emotion trajectory construction to obtain an emotion label and an emotion trajectory of a role, identifying a plot turning point through the emotion trajectory of the role and a key plot node, and obtaining a bullet screen analysis result corresponding to a video to be processed according to the emotion label, the obtained emotion intensity, the emotion association role, the plot turning point and the to-be-processed video. And determining a triggering opportunity, a triggering emotion and a triggering special effect, and performing emotion special effect rendering through the triggering opportunity, the triggering emotion and the triggering special effect.

The invention discloses a multi-modal driving system based on streaming big language model output, which belongs to the technical field of multi-modal interaction and comprises the following steps: a streaming big language model module receives input information and then generates a text unit sequence in a streaming manner; when each text unit is generated, a multi-dimensional emotion label sequence containing emotion types, emotion intensity values and semantic association degrees is synchronously output; the speech generation module maps the text unit sequence and the corresponding multi-dimensional emotion label sequence into speech synthesis parameters, and drives a streaming text-to-speech model to generate an emotional speech stream; the label generation module generates an expression label sequence and an action label sequence of the virtual image in real time; the emotion synchronous control module performs synchronous interpolation and coordination control by taking the time step of the text unit as a reference to generate a synchronous multi-mode driving signal; and the rendering and driving module drives the virtual image based on the signal to realize collaborative output of voice, mouth shape, expression and limb movement, and realizes synchronous presentation of multi-modal emotion expression.

The invention relates to the technical field of voice semantics, can be applied to business system platforms of financial science and technology, medical health and the like, and discloses a business complaint report generation method, device, equipment and medium, and the method comprises the following steps: obtaining business data and customer complaint voice, carrying out text conversion on the customer complaint voice to obtain a customer complaint text, and sending the customer complaint text to a server; performing character recognition on the business data and the customer complaint text to obtain business data fields and text data fields; performing template filling on the customer complaint report template according to the business data field and the text data field to obtain an initial customer complaint report; performing voice coding on the customer complaint voice to obtain coding features, and performing emotion node recognition on the coding features to obtain emotion fluctuation nodes; performing emotion intensity analysis on the emotion fluctuation node to obtain an emotion intensity score; and performing content optimization on the initial customer complaint report according to the emotion fluctuation node and the emotion intensity score to obtain a target customer complaint report. The report generation accuracy and the report generation efficiency can be improved.

The invention discloses a multimedia memoir generation method and device based on multi-dimensional emotion perception, relates to the technical field of artificial intelligence, can be applied to financial science and technology and medical health business scenarios, and comprises the steps that in the AI interaction process, multi-dimensional emotion related data expressed by user recall is collected in real time; comprehensively analyzing the multi-dimensional emotion related data, and determining a real-time emotion type and emotion intensity of the user; according to the real-time emotion type and the emotion intensity, corresponding visual feedback materials and auditory feedback materials are dynamically and adaptively generated, and an immersive interaction scene is constructed based on the visual feedback materials and the auditory feedback materials; in the immersive interaction scene, intercepting a plurality of audio and video material slices when the emotion of the user reaches a peak value; and integrating the plurality of audio and video material slices and the core content expressed by the user memory to obtain the multimedia memoir of the user. The emotion information of the user in the memory expression process can be effectively captured and fused.

The invention provides a financial text emotion analysis method and system based on double-layer low-rank adaptation, belongs to the field of natural language processing and financial science and technology, and aims at solving the problems that existing financial emotion analysis is single in dimension and high in model fine adjustment cost. According to the method, an emotion label system with five dimensions of emotion category, emotion intensity, duration, layered influence and policy response is constructed, a financial text is converted into a structured five-dimensional emotion label through an instruction fine tuning framework to be output, and a double-layer low-rank adaptation module is injected into a pre-trained large language model to perform efficient parameter fine tuning. The system comprises a data annotation module and a model fine adjustment module, and automatic annotation of emotion tags, expert verification and efficient training of a large model are achieved. By applying the method, the emotional characteristics of the financial event can be accurately extracted, the precision of emotional analysis is improved, and reliable decision support is provided for stock market trend prediction and risk control.

The invention provides an intelligent secret state psychological care method, device and system, and the method comprises the steps: obtaining natural language text data and user behavior data of a target user, and obtaining occupational scene data from an external management system; determining a text feature vector corresponding to the natural language text data, a behavior feature vector corresponding to the user behavior data and an occupational scene feature vector corresponding to the occupational scene data; performing feature fusion on the text feature vector, the behavior feature vector and the occupational scene feature vector to obtain a target fusion vector; performing emotion recognition according to the target fusion vector, and determining a target emotion of the target user; determining an emotion intensity value of the target emotion, and performing risk grade division and intervention suggestion according to the emotion intensity value; and encrypting the privacy data according to the emotion intensity value, and storing the privacy data in a ciphertext. Accuracy and reliability of emotion recognition can be guaranteed, compliance and controllability of data use are guaranteed, and privacy background lines of students are not touched.

The application discloses an artificial intelligence customer service system based on natural language processing and concretely relates to the technical field of natural language processing, and comprises an input processing module, an intention cooperation module, an intention optimization module and an intention dynamic decision module.The input processing module is used for accepting user voice and text input and performing pretreatment, calculating context entropy values based on historical N-round conversation feature distribution and time attenuation weight;the intention cooperation module is used for outputting emotion intensity signals through a multi-modal emotion recognition model according to input information, and generating an intention correction vector in combination with a preset intention-emotion mapping matrix;the intention optimization module is used for constructing and optimizing a cooperative loss function, performing intention classification on the input of the user based on optimized model parameters, and dynamically adjusting according to context entropy and emotion analysis; and the intention dynamic decision module is used for adjusting and deciding the response strategy of the system based on the output of the input processing module, the intention cooperation module and the optimization module and according to the context of the current conversation.

In a system that provides psychological support based on dialogue with children, this technology offers support that enables information sharing (advocacy) that respects the child's wishes while appropriately understanding changes in the child's emotional state and the urgency of the situation. [Solution] The child support AI system according to the present invention comprises: dialogue history holding means for holding a history of conversations with a user; emotion analysis means for analyzing the user's emotional state based on input information included in the dialogue history; and state mark generation means for determining psychological urgency and generating a state mark based on two evaluation indicators: (i) the frequency (temporal density) of negative emotions appearing within a predetermined time period, and (ii) the emotional intensity in a single conversation. Furthermore, this system presents supporters with status markers corresponding to the determined psychological urgency, and also includes visualization means that, based on user permission to share, presents supporters with summarized information of the conversation content that has been permitted to be shared.

This invention discloses a method, device, and electronic device for controlling in-vehicle aromatherapy based on occupant emotion recognition. The method includes: acquiring time-series data of the target occupant's voice, physiological state, and behavior; inputting these data into a pre-trained occupant emotion recognition model to obtain the target occupant's current emotion type and corresponding emotion intensity; determining the corresponding target aromatherapy type based on the current emotion type, and determining the corresponding aromatherapy release concentration and release rate based on the emotion intensity; and adjusting and controlling the in-vehicle aromatherapy device according to the target aromatherapy type, release concentration, and release rate. This invention improves the accuracy of in-vehicle aromatherapy control and enhances user comfort, and can be applied to the field of vehicle control technology.

The invention relates to the field of artificial intelligence and man-machine conversation, and particularly discloses an emotion-enhanced historical session representation and drive response generation method, which comprises the following steps: S1, outputting a normalized historical session text sequence; s2, encoding a historical session text, and generating a text vector representation; s3, emotion recognition and coding are carried out, and emotion vector representation is converted; s4, identifying and coding a vertical field, and converting vertical field vector representation; s5, fusing the text vector, the emotion vector and the standing vector by adopting a splicing fusion mode, and outputting historical session vector representation of emotion enhancement; and S6, generating the response of the intelligent customer service, and adjusting a generation strategy according to the emotion intensity and the standing trend. According to the emotion-enhanced historical session representation and drive response generation method provided by the invention, the LLM structure does not need to be modified, the compatibility and expansibility are high, the deployment is convenient, and the pertinence of customer service response and the user satisfaction can be remarkably improved.

The invention relates to the technical field of artificial intelligence, and provides an emotion recognition method and device based on audio data and electronic equipment, and the method comprises the steps: inputting the audio data in a target service scene into an emotion recognition model, and obtaining an emotion type recognition result and an emotion intensity prediction result; the emotion recognition model is obtained by training a latest historical version model corresponding to incremental training data and an emotion label and an intensity label corresponding to the incremental training data, and the incremental training data is obtained based on a newly added target service scene; and performing emotion intensity prediction on the audio service data corresponding to the newly added target service scene by using the target number of historical version models, and screening and constructing the audio service data according to the predicted emotion intensity. The historical version model of the next version in the target number of historical version models is obtained based on incremental training of the historical version model of the previous version. According to the invention, subtle emotion changes can be caught acutely, and accurate recognition of audio emotion is realized.

The invention relates to the technical field of virtual reality games, and discloses a virtual reality game system and method based on a visual tracking technology, and the system comprises a multi-dimensional collection module and a virtual reality module. According to the virtual reality game system and method based on the visual tracking technology, interaction data and action expressions of all users are obtained through a multi-dimensional collection module, a data set is formed through classification, a virtual reality module constructs a face model of each user, facial feature points and virtual lines are marked, then emotion intensity is generated through analysis, and the emotion intensity of each user is obtained. The virtual reality module constructs a limb model of each user, marks limb feature points and virtual lines, then analyzes and generates perception intensity, and independently optimizes movement performance of each part, split modeling is high in capture precision, the virtual reality module forms a comprehensive model according to a face model and the limb models, and the comprehensive model is more accurate. And the delay degree when the user action is substituted into the comprehensive model is judged, the game role action delay and jamming problems are found in time, and the intelligent optimization user experience is better.

The invention discloses a student-oriented psychological counseling method based on a large model. The method comprises the following steps: S1, acquiring emotion expression text data; s2, establishing an emotional state feature vector based on the emotional intensity; s3, collecting emotional state feature vectors for multiple times in a preset time window; s4, generating an emotion buffering strategy based on a short-term emotion fluctuation monitoring result; s5, guiding the emotional state; s6, storing the emotional state feature data after the emotional state feature data is relieved into an emotional file of the student; s7, based on emotional state feedback data, adopting an adaptive learning algorithm to finely adjust the large model, optimizing the analysis of an emotional fluctuation state and the generation ability of an emotional buffering strategy, and gradually adjusting and optimizing an emotional buffering method; and S8, based on the emotional state feedback data and the emotional change trend of the student, repeatedly executing the steps S1-S7 to form an emotional buffer closed-loop feedback system. According to the invention, a more efficient and more intelligent solution can be provided for student psychological health management.

The invention relates to an emotional state dynamic monitoring system and method, in particular to an emotional state dynamic monitoring system and method based on video image spatio-temporal characteristics, and solves the problems that an existing emotional state monitoring system and method are single in recognition dimension, poor in environmental adaptability, short in time sequence modeling and low in recognition efficiency. The emotion recognition precision is low, and the long-term evolution trend of the emotional state is difficult to effectively capture. The emotional state recognition module is adopted to recognize and quantify the emotional state to obtain the emotional intensity, then the time sequence modeling and trend analysis module is combined to obtain the emotional duration score and the emotional intensity trend, and the real emotional state can be comprehensively reflected; meanwhile, a spatial-temporal feature extraction module is adopted to extract spatial features and time sequence features of the face video data, and time sequence evolution characteristics of an emotional state are reflected through time sequence modeling; in addition, the weight of each frame of image in the face video data is adaptively adjusted by evaluating the environmental factors, so that the emotion recognition precision and stability can be ensured.