Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

3384 results about "Emotionality" patented technology

Emotionality is the observable behavioral and physiological component of emotion. It is a measure of a person's emotional reactivity to a stimulus. Most of these responses can be observed by other people, while some emotional responses can only be observed by the person experiencing them. Observable responses to emotion (i.e., smiling) do not have a single meaning. A smile can be used to express happiness or anxiety, a frown can communicate sadness or anger, and so on. Emotionality is often used by psychology researchers to operationalize emotion in research studies.

Multimodal data-based method and system for recognizing cognitive engagement in classroom

PendingUS20250022314A1Speech recognitionEnergy efficient computingCognitive engagementData set
A method and system are introduced for recognizing cognitive engagement in classrooms by utilizing multimodal data. Associated modalities of cognitive engagement are learned from visual and audio data. This approach involves constructing a multidimensional representation model for cognitive engagement that includes behaviors, emotions, and speech. To identify engagement, three distinct deep learning models are employed: You Only Look Once version 8 (Yolov8) for analyzing body posture, Efficient Network (EfficientNet) for facial expressions, and Text Convolution Neural Network (TextCNN) for speech text. These models are trained and refined with the aid of student engagement surveys, leading to a decision-making process that integrates the results from the different modalities. Additionally, a dataset and a data annotation system are developed for engagement recognition. This innovative method aims to achieve detailed engagement recognition, addressing various perception needs in real-world applications.
Owner:HUAZHONG NORMAL UNIV

Augmenting artificial intelligence prompt design with emotional context

In addition to an original prompt that is manually provided by a user, contextual information is sent to a generative AI to elicit a higher quality response. Sensors collect audio, video, physiological, cognitive, environmental, and digital data from the user. Machine-learning models evaluate the sensor data to infer the emotional state of the user. The emotional state is used to augment the original prompt with contextual information. The augmented prompt is fed into the generative AI to make it context-aware. Accordingly, the generative AI can automatically pick up on non-verbal cues that the user did not manually articulate in the original prompt. Just as a human-to-human conversation involves a combination of verbal and non-verbal communications, the present concepts enable the generative AI to also leverage non-verbal communication when interacting with human users.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Emotional evolution method and terminal for virtual avatar in educational metaverse

Disclosed are an emotional evolution method and terminal for a virtual avatar in educational metaverse. By collecting expression data and audio data of the virtual avatar, and performing emotional feature extraction based on the expression data and the audio data; fusing an extracted sound emotional feature with an extracted expression emotional feature by using an emotional feature fusion model, and performing emotion recognition on a multi-modal emotional feature fusion result obtained by fusion to obtain an emotional category corresponding to the multi-modal emotional feature fusion result; labeling the multi-modal emotional feature fusion result based on a semantic vector of the emotional category to generate an emotional evolution sequence; and driving the virtual avatar to perform emotional expression according to a target emotional evolution pattern extracted from the emotional evolution sequence, a unified and united multi-modal emotional feature fusion result is formed, the emotional self-evolution of the virtual avatar is achieved.
Owner:FUJIAN TQ DIGITAL +1

Emotional engagement detection method based on positive emotional perception

PendingUS20250014320A1Image enhancementImage analysisPositive affectivityEmotional perception
An emotional engagement detection method based on positive emotional perception is provided, which relates to a field of data analysis technologies. The emotional engagement detection method is to extract features from data of different dimensions during student classroom learning, to achieve information recognition of each dimension, and perform decision fusion and result analysis and application. The emotional engagement detection method is to extract the features from the data of different dimensions during the student classroom learning, applies a fusion strategy based on a deep learning network for subsequent supervision classification, to construct a positive emotional engagement model of a student. Different modalities information such as cognition, emotion and thinking of the student obtained from different means is integrated to a frame, to comprehensively reflect a positive emotion of the student.
Owner:JIANGXI NORMAL UNIV

Gait emotion recognition method, system, storage medium, and computer equipment based on spatiotemporal graph convolution.

This invention relates to a gait emotion recognition method, system, storage medium, and computer device based on spatiotemporal graph convolution. The method includes the following steps: S1, data augmentation by reversing the temporal direction of gait; S2, obtaining deep emotion features and prior emotion features respectively through a spatiotemporal graph convolutional network and prior feature statistical methods; S3, performing nonlinear mapping on the prior emotion features using a feature mapping layer; S4, inputting the fused features of the deep emotion features and prior emotion features into an emotion classifier to obtain the emotion category. The feature mapping layer of this invention achieves more effective feature fusion by performing nonlinear mapping on prior features; it also introduces causal temporal convolution to replace general temporal convolution, effectively extracting fine-grained temporal features by enhancing temporal correlation and cross-period feature fusion. Furthermore, a walking direction recognition auxiliary task is designed to accelerate the training and convergence speed of the model, enhancing the ability to extract temporal-dependent features and the performance of emotion recognition.
Owner:SOUTH CHINA UNIV OF TECH

Intelligent real-time emotion evaluation method for social media and online text data based on multi-modal knowledge graph

The invention discloses an intelligent real-time emotion evaluation method for social media and online text data based on a multi-modal knowledge graph, and the method comprises the steps: firstly obtaining and preprocessing multi-modal original data; secondly, designing single-mode feature extraction of dialogue texts, voices and facial expressions based on BERT-BiLSTM, AST and ResNet-50 pre-training models; furthermore, sharing among multiple modes and private emotion semantic information are considered, and complementation of cross-mode emotion information is promoted by enhancing repeated emotion information and utilizing uniqueness of private information. Meanwhile, a multi-mode knowledge graph method is provided from bottom to top to carry out emotion real-time evaluation. Analyzing user behaviors by using DeepFM and generating user features, and capturing external knowledge layer features in combination with K-BERT; finally, on the basis of a TransformerEncoder structure, cross-modal emotion information interaction and feature fusion are achieved, real-time recognition and classification of multi-modal emotion perception are completed through a Softmax layer, and therefore the purpose of intelligent real-time emotion evaluation is achieved.
Owner:XI AN JIAOTONG UNIV

Digital human emotion recognition and feedback system based on large model

The invention discloses a digital human emotion recognition and feedback system based on a large model, and relates to the technical field of large models.During operation of the system, multi-modal data of a driver are collected in real time through an embedded sensor network in various driving environments, and the emotion, driving behaviors and driving environment parameters of the driver are obtained; the method comprises the steps of constructing fatigue, anger and other multi-dimensional emotion features of a driver to form an emotion feature vector, analyzing an emotion change trend through threshold comparison, obtaining an evaluation state, dynamically generating a feedback strategy for optimizing a driving state based on an emotion state and a driving scene of the driver, and embedding a generative large model into a module. Diversified feedback responses including audio reminding, driving mode adjustment and entertainment content recommendation are automatically generated, feedback strength and form are adaptively adjusted through multi-dimensional parameters, a feedback generation effect is dynamically adjusted, and an emotion state analysis result and vehicle behavior monitoring data are integrated, so that a user experience is improved. And evaluating the potential dangerous state of the driver in real time.
Owner:SUZHOU LVHUA TECH CO LTD

Intelligent psychological intervention system based on multi-modal fusion

The invention discloses an intelligent psychological intervention system based on multi-modal fusion, which is characterized in that a three-dimensional evaluation system is constructed by integrating speech sentiment analysis, keyboard dynamics monitoring and physiological signal acquisition, and time sequence alignment and feature weighted fusion of multi-source data are realized by adopting a cross-modal Transform model. The core of the system comprises an adaptive intervention engine which defines a multi-dimensional state space based on a hierarchical reinforcement learning architecture, optimizes an intervention strategy through a PPO algorithm, and realizes dynamic emotion interaction in AR and VR scenes in combination with a digital twin training module; according to the clinical decision support system, physiological behavior characteristics and psychological assessment trends are integrated by using a multi-time scale risk prediction model, and a personalized early warning threshold system is constructed, so that the psychological state recognition accuracy is improved, the intervention intensity self-adaptive adjustment response time is shortened, and the high-risk signal early warning timeliness reaches the minute level; and the problems of evaluation hysteresis and strategy stiffness of traditional psychological intervention are obviously improved.
Owner:JIANGSU ZHUODUN INFORMATION TECH CO LTD

Adaptive digital therapy system with real-time emotional state analysis and symbolic language communication

ActiveUS20240416067A1ElectrocardiographyMedical devicesEmotional healthClosed loop feedback
The present invention relates to a system and method for providing adaptive digital therapy, enhancing the emotional well-being of users through the analysis and translation of expressive and physiological states. Aspects of the invention are directed to identifying the neuroplastic window via user inputs, with or without the aid of psychedelics. This invention is particularly suited for supporting psychoactive therapies involving compounds such as 5-HT2A agonists, dissociatives, and empathogens, as well as applications beyond psychoactive treatments. By utilizing multi-modal deep learning methods, the system captures a wide array of user inputs, including text, speech, vision, symbols, and brain waves, to form a dynamic user representation. This representation is then used to provide real-time, tailored generative communications informed by established psychological therapeutic frameworks. The invention features a closed-loop feedback system through an access module, enabling continuous data relay, patient response metric derivation, and transmission of emotional optimization communications. The system also introduces novel communication methods, including symbolic language input, to articulate complex experiences and extends its capabilities to include natural emotional states, broadening its therapeutic applicability.
Owner:FOX BRIAN PATRICK

Digital human interaction control method and device fusing emotional semantics and logical reasoning and storage medium

The invention provides a digital human interaction control method and device fusing emotion semantics and logical reasoning and a storage medium. The method comprises the following steps: analyzing multi-modal input data of a user, constructing emotion-semantics joint representation, and generating a logic decision path; and through a cognitive fusion module, emotion-semantic representation and a logic decision path are fused, and an interaction response adapting to emotion and logic consistency is generated. The system optimizes an emotion semantic model and a logical reasoning rule on line according to user feedback and interaction history, and real-time interaction of emotion dynamic and logical rules is achieved. The system can dynamically adjust the logic decision path based on the multi-mode emotional state of the user, and improves the naturalness and situation adaptability of interaction. A dynamic time warping algorithm and a factorization machine are introduced to process a multi-modal feature fusion problem, and the accuracy and robustness of emotional state recognition are improved. The online optimization mechanism enables the model and the rule to be evolved continuously, and reasoning errors are corrected automatically through user feedback, so that error circulation is avoided.
Owner:HANGZHOU DIGITAL SPACE TECHNOLOGY CO LTD

Emotion recognition method based on large model and related device

The invention relates to the field of data processing, in particular to an emotion recognition method based on a large model and a related device. The method comprises the following steps: firstly, acquiring to-be-processed multi-modal data; the multi-modal data at least comprises text information, audio information and image information input by a user; the image information at least comprises a facial expression image and / or a limb action image. And inputting the multi-modal data into an emotion recognition model for emotion state analysis to obtain a predicted emotion state corresponding to the user. And finally, performing confidence evaluation based on the predicted emotional state, and generating a user emotion recognition result based on the predicted emotional state and a corresponding evaluation result. According to the method, richer emotion details are captured from the multi-modal data through the emotion recognition model, cross-modal emotion intelligent recognition is realized, the accuracy of emotion recognition is further improved by combining confidence evaluation, the emotion recognition efficiency is improved, and the application range of emotion recognition is expanded.
Owner:BEIJING LIXIN INTELLIGENT TECH CO LTD

Dialogue interaction system based on multi-modal emotion perception and knowledge graph dynamic enhancement

The invention belongs to the field of artificial intelligence, and provides a dialogue interaction system based on multi-mode emotion perception and knowledge graph dynamic enhancement. A user edge terminal obtains multi-modal data, a lightweight Transform fusion network is adopted, the multi-modal data is converted into a fusion feature vector through cross-modal attention fusion and dynamic weight adjustment, and the fusion feature vector and historical conversations in a preset round are compressed in real time; the cloud service platform inputs the compressed data into DKGE, mining and fusing feature vectors and entity knowledge and emotional relations implied in historical dialogues in real time in the dialogue interaction process to update a dynamic knowledge graph, performing knowledge enhancement processing based on the dynamic knowledge graph, and constructing an initial reply prototype of the current round of interaction of the user; inputting the fusion feature vector and the updated dynamic knowledge graph into a dialogue strategy model, and determining a response strategy and a knowledge calling direction of the current round of dialogue; and the edge terminal generates real-time interaction reply information according to the initial reply prototype, the response strategy and the knowledge calling direction.
Owner:LONGMA ZHIXIN (ZHUHAI HENGQIN) TECH CO LTD

Intelligent emotional interaction method for service robot

The invention relates to the technical field of intelligent robots, in particular to a service robot intelligent emotion interaction method, which comprises the following steps: acquiring emotion related data of a user through a multi-modal sensor on a service robot, analyzing the acquired data based on a deep learning model, and extracting emotion features of the user; future emotion changes are predicted through a time sequence analysis algorithm, a service robot generates a personalized interaction strategy through an emotion decision-making system according to the current and predicted emotion states, and the system adopts a self-adaptive algorithm based on reinforcement learning, so that the interaction strategy can be continuously optimized along with the emotion changes of a user; the robot performs modeling and optimization on long-term interaction data by utilizing a self-learning mechanism in combination with emotional feedback of the user, so that the precision and interaction effect of emotional response are gradually improved; according to the method, the problems of inaccurate emotion recognition, inflexible interaction strategy and lack of adaptive optimization in the prior art are effectively solved, and the interaction experience of the service robot and the user is remarkably improved.
Owner:BEIJING HAIBAICHUAN TECH CO LTD

Large-model complaint intention recognition method based on sentiment analysis

The invention discloses a large-model complaint intention recognition method based on sentiment analysis, and the method comprises the steps: obtaining call voice data of a customer, and converting the call voice data into text data; preprocessing the text data, and removing noise and marking components; performing emotion feature analysis on the text data, extracting an emotion feature value, and generating an emotion vector; the emotion vectors and the text data are input into a large model together, and the large model combines the emotion feature values and context semantics to generate intention feature vectors; constructing an emotion-intention state vector, inputting the emotion-intention state vector into an asynchronous dominant actor commentator algorithm model, and generating a corresponding complaint intention probability value; judging a complaint intention probability, and generating risk early warning; and preferentially distributing high-risk customers and responding to customer demands. Through combination of voice data preprocessing, text semantic feature extraction, emotion intensity quantitative analysis and a multi-modal fusion algorithm and efficient risk assessment based on an asynchronous dominant actor reviewer model, the early warning and response capabilities of customer complaint risks are significantly improved.
Owner:HENAN ZHONGYUAN CONSUMER FINANCE CO LTD

Robot anthropomorphic interaction method based on multi-modal emotion recognition and customized portrait generation

The invention discloses a robot anthropomorphic interaction method based on multi-modal emotion recognition and customized portrait generation. The method comprises the following steps: S1, dynamically fusing multi-modal emotions; the method comprises the following steps: S1, synchronously acquiring voice, visual and text signals through a multi-source heterogeneous sensor, capturing a user voice stream by a high-fidelity microphone array, and extracting acoustic characteristics such as intonation and speed, S2, performing cross-modal reasoning; s3, synchronously generating contents; step S4: style migration; step S5, anthropomorphic voice and expression generation; according to the method, man-machine interaction emotion is analyzed and generated by utilizing a large language model and multi-modal information fusion, the singleness of interaction emotion and the deficiency of emotional sharing ability are avoided, a strong emotion interaction characteristic is achieved, the image of the robot is obtained through a generative technology and can be migrated to any image, the limitation that a specific image is independently made is broken through, and the interaction effect of the robot is improved. The advantage that one robot can be suitable for different scenes is achieved.
Owner:JIANGSU YUNMU ZHIZAO TECH CO LTD

Emotion analysis method and system based on multi-modal fusion

The invention discloses an emotion analysis method and system based on multi-modal fusion. The method comprises the following steps: S1, acquiring multi-modal data and initial feature representation of each modal; s2, inputting the initial feature representation of each mode into a multi-head attention mechanism for preliminary fusion, and generating a primary fusion feature; s3, in combination with the bidirectional long-short-term memory network and the multi-scale causal convolutional network, generating time sequence features; s4, constructing a hierarchical dependency relationship network among modals by using a multilayer graph neural network, and forming global context sensing feature representation; s5, dynamically generating and adjusting the fusion weight of each mode; s6, combining classification and regression output by using a multi-layer full-connection network and a multi-task learning framework, and generating multi-dimensional expression of an emotional state; and S7, migrating the group sentiment model to specific sentiment analysis of individual users through transfer learning and personalized modeling technologies. According to the method, high-precision and multi-dimensional sentiment analysis is realized by utilizing multi-modal fusion and self-adaptive weight adjustment.
Owner:无锡慧仁创欣智能科技有限公司

Multi-modal sentiment analysis method and device based on multi-agent collaboration

The invention provides a multi-modal sentiment analysis method and device based on multi-agent collaboration, and the method comprises the steps: carrying out the clock synchronization collection and preprocessing of multi-modal data, and obtaining a multi-modal data package with a time sequence mark; and performing feature extraction on the multi-modal data packet by using a plurality of intelligent agents, and mapping the extracted feature vector and a preset emotion ontology to obtain a multi-modal emotion vector. And detecting the difference degree between the vectors in the multi-modal emotion vectors, and starting a conflict detection algorithm based on feature credibility to perform evaluation when a significant difference is detected to obtain an evaluation result. And performing feature fusion operation on the multi-modal emotion vector according to the evaluation result and a preset weight coefficient to obtain an emotion recognition result, and performing timestamp association storage on the emotion recognition result and the corresponding multi-modal data. By introducing a difference detection and evaluation mechanism, the abnormal feature vector is effectively prevented from influencing the fusion result, and the reliability of modal sentiment analysis is improved.
Owner:SHENZHEN FUTURE QINGYAN INTELLIGENT TECHNOLOGY CO LTD

Man-machine interaction method and system based on multiple modes

The invention provides a multi-mode-based man-machine interaction method and system, and relates to the technical field of man-machine interaction. Voice input of a user is received, environment information is collected, facial expressions of the user are captured, and voice features, environment features and facial features are obtained based on the input; utilizing a pre-trained emotion recognition model to generate emotion features of the user, and utilizing a pre-trained user behavior model to generate behavior features according to the current operation information of the user; after the features are obtained, the first weights and the second weights of the features are dynamically adjusted, feature weighted fusion is carried out, and comprehensive features are obtained; the multiple candidate responses are generated based on the comprehensive characteristics, the final response is screened out through a preset scoring mechanism and output, comprehensive understanding of the intention and the emotional state of the user is achieved through comprehensive utilization of multiple data sources, and meanwhile the weight of each characteristic can be dynamically adjusted so that more intelligent and humanized interaction experience can be generated.
Owner:GUANGZHOU DAZZLE VIEW INTELLIGENT TECH CO LTD

Smart home voice interaction control method and system

The invention discloses a smart home voice interaction control method and system, and relates to the technical field of smart home. The problems that in the prior art, the intention of a user cannot be accurately understood through non-voice information such as emotion and expression of the user, a control strategy is solidified and lacks individuation, and user requirements and emotion cannot be met in real time are solved. By fusing voice and non-voice information, accurate recognition of user intentions is enhanced, recognition accuracy of voice instructions is improved, emotional states and requirements of users are understood more comprehensively, particularly in a noisy environment or a complex situation, recognition and response effects of the system are obviously improved, and user experience is improved. By utilizing the emotion analysis and context understanding technology of the user, the interaction mode is dynamically adjusted according to the emotion state of the user, the emotion demands of different users can be flexibly adapted, more humanized services are provided, the control strategy is continuously optimized according to the feedback of the user, the user satisfaction is improved, and the user experience is improved. Therefore, the intelligent degree and the user experience of the smart home system are improved.
Owner:XIAMEN OCEAN VOCATIONAL & TECH COLLEGE

Dynamic real time avatar-based ai communication system

A novel avatar-based conversational AI platform that integrates large language models (LLMs) with realistic avatar visualization is disclosed. The platform employs advanced AI technologies to create lifelike avatars capable of personalized and emotionally responsive communication with users. avatar creation tools enable users to generate unique avatar configurations, while animation machine learning subsystems automatically generate the avatar's speech, movements, and emotional responses in real-time. personality machine learning subsystems direct the avatar's voice, personality, and emotions, enhancing the realism of the interaction. The platform supports integration with third-party applications and provides comprehensive deployment and asset management tools. A two-way messaging architecture enables real-time interactions between avatars and users. Authorization and licensing controls protect intellectual property rights, while the avatar's personality dynamically evolves based on user interactions. By integrating LLMs, real-time animation, and emotional intelligence, the platform offers a groundbreaking solution for creating immersive and personalized conversational experiences across various applications.
Owner:SAGEN AI CORP

Electroencephalogram and synchronous physiological signal emotion recognition method based on cross-modal comparative learning and multi-scale representation

The invention relates to the technical field of emotion recognition, and discloses an electroencephalogram and synchronous physiological signal emotion recognition method based on cross-modal comparative learning and multi-scale characterization, in a pre-training stage, features are extracted from physiological signals of different modalities through encoders corresponding to the modalities, and modal characterization related to emotion stimulation is learned; the modal representations are mapped to a potential space through a mapping layer to calculate the similarity, then the contrast loss of each modal is calculated, and contrast learning in the modal is carried out; performing cross-modal comparative learning on the representation based on each modal extracted by an encoder, and aligning the representation of different modals to a shared potential space; according to the invention, the encoder is pre-trained at different time scales by using short-term and long-term emotion changes in each mode; in the fine tuning stage, emotion recognition training is carried out by using a pre-trained encoder, an initialized modal fusion module and a classifier, and the model weight is optimized based on the emotion label of the physiological signal.
Owner:HEFEI UNIV OF TECH

Scene-based emotional interactive accompanying doll system and method

The invention discloses a scene-based emotional interactive accompanying doll system and method, and relates to the technical field of artificial intelligence, and the system comprises a data collection module, a feature analysis module, a portrait construction module, an interactive decision module, an execution control module and a database module. The data acquisition module is used for acquiring interaction data and scene data; the feature analysis module generates an emotion feature vector and a scene feature vector by using a multi-modal feature network, and determines a user emotion state and a scene type; the portrait construction module is used for constructing a user portrait; the interaction decision module comprises an emotion evolution unit, a scene interaction unit and a physiological regulation unit and is used for generating an execution instruction sequence; the execution control module is used for controlling the doll to complete emotion interaction behaviors. Through the scene perception and sentiment analysis technology, accurate recognition and personalized interaction response of the doll to the user sentiment state are achieved, and intelligent sentiment accompanying service is provided.
Owner:BEIJING LEKAIWENYU TECHNOLOGY CO LTD

Method for real-time generation of empathy expression of virtual human based on multimodal emotion recognition and artificial intelligence system using the method

Provided are a conversational artificial intelligence (AI) system and method based on real-time multimodal emotion recognition. The system includes a model server configured to provide a machine learning-based conversational model, a terminal configured to perform a conversation with the machine learning-based conversational model through the model server, display a virtual human responding to a user during a conversation with the user, and capture a facial image of the user during the conversation, and a multimodal empathetic conversation-generation system configured to access the model server and receive a response to a question of the user from the terminal, and assess an emotion of the user from the facial image of the user and control, based on the assessed emotion, an expression of the virtual human displayed on the terminal.
Owner:SANGMYUNG UNIV IND ACAD COOP FOUND

Emotion-enhanced digital human driving and presenting system and method

The invention discloses an emotion-enhanced digital human driving and presenting system and method, and belongs to the technical field of computers.The system comprises an audio decoupling module, a potential diffusion model module, a human motion prior module, a training module and a rendered image generation module; predicting and reconstructing the facial expression and gesture action sequence to obtain a final action sequence; and generating a neural rendering image based on the final action sequence. According to the method, through voice input, emotion and style features in voice are captured, a cross attention feature fusion mechanism is introduced to enhance expression of emotion and personal style features, a voice-driven gesture generation task is expanded to a facial expression and gesture action synchronous generation task, the integrity of generated digital human actions is realized, and the user experience is improved. The emotional expressive force of facial expressions and gestures of the digital human is greatly improved.
Owner:ZHEJIANG UNIV

AI multi-mode emotion interaction memory terminal

The invention relates to the technical field of AI interaction, and discloses an AI multi-modal emotion interaction memory terminal, which realizes microsecond-level synchronization of voice, facial expression and text data through a multi-thread acquisition engine, dynamically allocates each modal weight by adopting a multi-head cross attention mechanism, and adaptively adjusts modal importance based on a conversation context hidden state; when the cross-modal confidence difference exceeds a threshold value, a gating LSTM conflict resolution module is activated, and the multi-source data collaboration problem is solved; the emotional memory modeling constructs an emotional state transition topology based on a graph convolutional network, protects user privacy in combination with a differential privacy mechanism, and realizes associated event storage of millisecond backtracking of short-term memory and long-term memory. The technology integrates multi-modal dynamic perception, privacy security calculation and adaptive learning ability, significantly improves the real-time performance and personification degree of emotion interaction, and can be applied to the fields of intelligent customer service, emotion accompanying, health monitoring and the like.
Owner:SHENZHEN XINZHI FUTURE TECHNOLOGY CO LTD

User emotion recognition and psychological intervention system and method based on large language model

Aiming at the problems of insufficient language understanding depth, weak personalized dialogue generation ability, lack of continuous learning and long-term user state modeling and the like in the current emotion recognition and psychological intervention technology, the invention provides a user emotion recognition and psychological intervention method combined with a large language model (LLM). According to the method, the potential emotional state is identified by analyzing free text information input by a user by utilizing the powerful capabilities of a large language model in the aspects of natural language understanding, emotional modeling and text generation; constructing a multi-round dialogue context, and reasoning a psychological change trend of the user; in combination with a psychological knowledge base, personalized and mild psychological intervention dialogue content with a dredging effect is generated. The system supports recognition and classification of various emotional states such as depression, anxiety and alonity, is suitable for various interaction scenes (such as APPs, webpages and social robots), and can greatly improve the precision of emotion recognition and the timeliness and effectiveness of psychological intervention. The emotion recognition and psychological intervention method based on the large language model provides solid technical support for constructing an intelligent, continuous and personalized psychological health management system, and has wide application prospects and profound social significance.
Owner:CHANGCHUN UNIV OF TECH

AI-powered personalized advertising system

An AI-driven system for personalized advertising in real time, where: ◯ an analytics unit to monitor and analyze user behavior in real time across multiple digital platforms such as websites, mobile applications, social media, and smart devices; the unit collects data on user engagement, browsing patterns, time spent, and content preferences to enable targeted, personalized advertising; ◯ a prediction module that predicts preferences and interests of a user, operatively connected to the user interaction data collection unit, wherein the prediction module uses machine learning models such as deep learning, recurrent neural networks (RNNs) and transformer-based architectures to predict interests of users based on historical interactions and inferred preferences; ◯ an emotion and sentiment analysis unit that assesses the user's mood in real time through computer vision, natural language processing (NLP) and voice analysis, whereby the analysis of facial expressions, voice pitch and linguistic mood is used to determine emotional states and receptivity to advertising content; ◯ an embodiment of a context awareness component in operational communication with the emotion analysis and mood unit, in some cases further augmented by various environmental and situational data such as the device type and its physical location, date and time, and the content processed in the device, processing methods, etc., in establishing adaptability and automatic ad placement to be as relevant as possible to the user and their status as prescribed; ◯ Use reinforcement learning algorithms and generative AI models to drive advertising with personalization engines. Creative elements, messaging, and presentations are dynamically adjusted in real time based on user responses to ensure advertising is personalized and always optimized for best performance; o a privacy-focused AI system with federated learning, differential privacy methods, and on-device AI processing to reduce targeted advertising while complying with international data protection laws such as the General Data Protection Regulation (GDPR) and California consumer privacy laws; o an operationally adapted ad delivery mechanism to engage with real-time bidding (RTB) networks, programmatic advertising exchanges and demand-side platforms (DSPs) and place advertisements through digital advertising networks, which guarantees the delivery of tailored advertising to the most relevant audience in real time; and o a contextual feedback loop in which the machine learning models used in the preference and interest prediction module and in advertising personalization The engine is continuously updated to reflect the latest user engagement data, improving personalization over time and optimizing advertising performance.
Owner:AL-ABABNEH HASSAN ALI +3

Knowledge base sensitive question test method, system, equipment and medium

The invention is applicable to the technical field of data processing, and discloses a knowledge base sensitive question test method, which comprises the following steps of: firstly, constructing a semantic vector model of a knowledge base for efficiently retrieving knowledge points with high relevancy with a to-be-tested question to form a candidate answer set; performing intention judgment on user questions by using an intention recognition model, and distinguishing factual verification or emotion expression; selecting knowledge points with the highest confidence degree from the candidate answer set as answers according to the fact verification type questions; responding to emotion expression questions based on an emotion response library; on the basis, the answers are further optimized in combination with the context of the questions; judging whether the optimized answer contains sensitive content or not, and performing necessary revision on the answer according to a sensitivity judgment result; and outputting the revised answer as a test result. The method effectively improves the question answering accuracy and sensitivity processing capacity of the knowledge base, and is suitable for various scenes needing intelligent question answering and knowledge base application.
Owner:GUANGZHOU SANQI DREAM NETWORK TECH CO LTD

Multi-modal interaction method and system of digital human intelligent agent

The invention relates to the field of multi-modal interaction analysis, in particular to a multi-modal interaction method and system of a digital human agent. The method comprises the following steps: acquiring a real-time face image and a voice signal input stream of an interactive user based on an intelligent agent; performing real-time micro-expression recognition and deep emotion analysis based on the real-time facial image to obtain real-time emotion features of the user; performing time sequence evolution analysis on the real-time emotion characteristics of the user, performing holographic user emotion deep mining, and constructing a user emotion holographic characteristic spectrum; carrying out adaptive acoustic gain processing on the voice signal input stream, and carrying out voice-emotion association analysis based on the user emotion holographic characteristic spectrum to generate a voice-emotion linkage mapping spectrum; and carrying out eyeball fixation point migration tracking based on the user emotion holographic feature map and the real-time face image, and generating a user interaction depth intention signal. Through the real-time deep semantic understanding and emotion perception ability, the intelligent agent interaction intelligence and response accuracy are improved.
Owner:GUANGDONG HUITONG INFORMATION TECH CO LTD

Event analysis method, system and device based on task generation and multiple modes

The invention discloses an event analysis method, system and device based on task generation and multiple modes, which are used for quickly and accurately mastering the development trend of an event. The method comprises the steps that structured event information is generated through multi-modal data, and an event relation is obtained; constructing an event graph; extracting a multi-modal feature, and obtaining a multi-modal emotion relationship vector by using a cross-modal attention mechanism; based on a preset graph neural network, combining the event graph to obtain an emotion feature vector; calculating a comparative learning loss value, and obtaining a target emotion feature based on the comparative learning loss value; generating a target event atlas by using a cross-modal attention mechanism; extracting relation characteristics, and combining the attention weight and a preset time sequence model to obtain an event prediction map; extracting a causal chain and reasoning, and obtaining a trigger condition and an emotion factor after reasoning; and combining the event prediction map and the target event map with the node feature sequence, the trigger condition and the emotion factor to obtain an event analysis result.
Owner:CETC BIGDATA RES INST CO LTD