Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

225 results about "Emotion perception" patented technology

Emotion perception refers to the capacities and abilities of recognizing and identifying emotions in others, in addition to biological and physiological processes involved. Emotions are typically viewed as having three components: subjective experience, physical changes, and cognitive appraisal; emotion perception is the ability to make accurate decisions about another's subjective experience by interpreting their physical changes through sensory systems responsible for converting these observed changes into mental representations. The ability to perceive emotion is believed to be both innate and subject to environmental influence and is also a critical component in social interactions. How emotion is experienced and interpreted depends on how it is perceived. Likewise, how emotion is perceived is dependent on past experiences and interpretations. Emotion can be accurately perceived in humans. Emotions can be perceived visually, audibly, through smell and also through bodily sensations and this process is believed to be different from the perception of non-emotional material.

Dialogue interaction system based on multi-modal emotion perception and knowledge graph dynamic enhancement

The invention belongs to the field of artificial intelligence, and provides a dialogue interaction system based on multi-mode emotion perception and knowledge graph dynamic enhancement. A user edge terminal obtains multi-modal data, a lightweight Transform fusion network is adopted, the multi-modal data is converted into a fusion feature vector through cross-modal attention fusion and dynamic weight adjustment, and the fusion feature vector and historical conversations in a preset round are compressed in real time; the cloud service platform inputs the compressed data into DKGE, mining and fusing feature vectors and entity knowledge and emotional relations implied in historical dialogues in real time in the dialogue interaction process to update a dynamic knowledge graph, performing knowledge enhancement processing based on the dynamic knowledge graph, and constructing an initial reply prototype of the current round of interaction of the user; inputting the fusion feature vector and the updated dynamic knowledge graph into a dialogue strategy model, and determining a response strategy and a knowledge calling direction of the current round of dialogue; and the edge terminal generates real-time interaction reply information according to the initial reply prototype, the response strategy and the knowledge calling direction.
Owner:LONGMA ZHIXIN (ZHUHAI HENGQIN) TECH CO LTD

AI-assisted large-model intelligent question and answer accuracy improvement method

The invention provides an AI-assisted large-model intelligent question and answer accuracy improvement method, and belongs to the technical field of intelligent question and answer. Comprising the steps of data collection, data cleaning, data labeling, dynamic knowledge base construction, knowledge base updating trigger mechanism establishment, pre-training language model improvement, post-processing language understanding enhancement, combination of rule-based and machine learning reasoning, reasoning result verification and optimization, dialogue strategy optimization, emotion perception and response, multi-language search and language recognition search. And multi-dimensional evaluation index setting and regular evaluation and feedback improvement are realized. The intelligent question and answer accuracy improving method is high in understanding ability, timely in data updating, outstanding in reasoning ability and high in language recognition and dialogue ability.
Owner:CCID CONSULTING CO LTD

Multi-modal interaction method and system of digital human intelligent agent

The invention relates to the field of multi-modal interaction analysis, in particular to a multi-modal interaction method and system of a digital human agent. The method comprises the following steps: acquiring a real-time face image and a voice signal input stream of an interactive user based on an intelligent agent; performing real-time micro-expression recognition and deep emotion analysis based on the real-time facial image to obtain real-time emotion features of the user; performing time sequence evolution analysis on the real-time emotion characteristics of the user, performing holographic user emotion deep mining, and constructing a user emotion holographic characteristic spectrum; carrying out adaptive acoustic gain processing on the voice signal input stream, and carrying out voice-emotion association analysis based on the user emotion holographic characteristic spectrum to generate a voice-emotion linkage mapping spectrum; and carrying out eyeball fixation point migration tracking based on the user emotion holographic feature map and the real-time face image, and generating a user interaction depth intention signal. Through the real-time deep semantic understanding and emotion perception ability, the intelligent agent interaction intelligence and response accuracy are improved.
Owner:GUANGDONG HUITONG INFORMATION TECH CO LTD

Financial risk assessment system based on emotion perception and dynamic knowledge graph

The invention relates to the technical field of financial risk assessment, and discloses a financial risk assessment system based on emotion perception and a dynamic knowledge graph, and the technical scheme is characterized in that the system comprises a multi-source data collection module which is in butt joint with a plurality of data sources and collects structured data and unstructured data; carrying out standardization processing on the data to obtain standard data; the emotion perception engine is used for quantifying customer emotion features; the dynamic knowledge graph construction module is used for attenuating the weight of historical data according to the time dimension and updating the knowledge graph in real time when an entity extraction model is used for extracting an entity and a corresponding relation and incremental updating is carried out on the knowledge graph; the multi-modal risk assessment model is used for fusing structured data, emotion features and knowledge graph embedding and outputting a risk score; and the dynamic feedback and optimization module iteratively updates the risk assessment logic according to the risk score and the market feedback, and performs incremental training on the multi-modal risk assessment model through misjudgment data.
Owner:JIANGSU SUNING BANK CO LTD

Intelligent customer service method and system based on large model

The invention relates to the technical field of artificial intelligence and natural language processing, in particular to an intelligent customer service method and system based on a large model, and the method comprises the steps: generating a unique session ID based on a user identity, and associating a historical context; multi-modal input of texts, voices, images and the like is carried out, and data standardization is carried out through a unified interface; realizing mixed intention recognition by combining a rule engine and a large model; constructing a dynamic customer portrait through multiple rounds of dialogue records, historical work orders and business data; according to the question emergency degree and customer value grading response, analyzing customer emotion in real time, adjusting a reply style, and outputting an answer; the manual operation process of the traditional customer service is converted into an AI automatic closed loop; the method has the beneficial effects that customer intention deep understanding, multi-mode interaction, emotion perception and service process automation are realized through a large language model (LLM) technology, and the service efficiency and the user satisfaction are remarkably improved.
Owner:SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD

Emotion accompanying robot system based on multi-dimensional perception and interaction method

The invention relates to an emotion accompanying robot system based on multi-dimensional perception and an interaction method, and belongs to the technical field of intelligent robots. The system comprises a sensing module which captures micro-expression, voice, body temperature, touch and other multi-source data through a biological radar array, multispectral imaging and a touch sensing fabric; the decision-making module quantifies the emotion intensity by using an emotion state calculation engine, constructs a user personalized emotion file in combination with the dynamic knowledge graph, and generates a dynamic emotion graph; and the execution module realizes anthropomorphic emotion expression through bionic face driving, joint compliance control and thermal feedback. The interaction method comprises the steps of data capture, emotion file construction, dynamic graph generation, interactive execution and feedback adjustment, definition of an emotion intensity quantification formula, a graph edge weight model and the like. According to the method, physiological signals, environment situations and bionic expression are fused, multi-modal precise emotion perception and safe interaction are achieved, man-machine naturalness is improved, the method is suitable for elderly accompanying, psychological counseling and other scenes, and the emotion accompanying effect is enhanced.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

International remote translation system based on AI and implementation method thereof

The invention discloses an international remote translation system based on AI and an implementation method thereof, and belongs to the technical field of artificial intelligence. Comprising a voice input module, an emotion perception module, a predictive simultaneous interpretation module, a language adaptation module based on few-sample learning, a dynamic translation quality evaluation and feedback module and a multi-language cooperative processing module, and can automatically recognize an input language and dynamically adjust a translation model in a multi-language environment. The emotion information in the voice and the text is captured in real time, the translation path is optimized in combination with the context weight, the emotion transmission accuracy and the translation context consistency are remarkably improved, the term requirements of different fields can be rapidly met, the translation quality is continuously optimized through dynamic feedback, the translation accuracy and smoothness are ensured, and the translation efficiency is improved. And the method has wide applicability in multi-language, cross-cultural communication and professional field application, and has relatively high innovativeness and practical value.
Owner:NANJING INST OF MECHATRONIC TECH

Cold region city emotion perception evaluation and measurement method

According to the cold region city emotion perception evaluation and measurement method, a cold region city is selected as a research object, and physiological signals and subjective scores are comprehensively considered; street view images are scored by training the street view perception model, perception of the street view images is realized, physiological signals and subjective scores are combined to realize comprehensive evaluation of corresponding areas of the cold region city, and a comprehensive evaluation result is less subject to subjective influence and is stable; the method can analyze the influence of the winter street space of the cold region city on the residential emotion perception, accurately measure the quality of the cold region city street space influencing the residential emotion, has the advantages of high efficiency and easy popularization and application, can be widely applied to the field of urban planning living street space quality investigation and measurement, and has a wide application prospect. And a method and a basis are provided for cold region city planning street space optimization practice.
Owner:BUILDING DESIGN RES INST HARBIN INST OF TECH

Multi-modal fusion driven emotion perception enhanced TTS speech synthesis method

The invention provides a TTS speech synthesis method for emotion perception enhancement under multi-modal fusion driving, and the method comprises the following steps: S1, carrying out the collection and preprocessing of multi-modal data, the multi-modal data comprising text data, speech data and facial expression data; s2, extracting and analyzing emotion features; s3, emotion perception speech synthesis model training; s4, speech synthesis and post-processing; s5, performing model evaluation and optimization; by collecting and analyzing multi-mode data such as texts, voices and facial expressions, emotion features can be captured more comprehensively and accurately, complementary information among different modes is fully mined through application of a multi-mode fusion network and a collaborative attention mechanism, the emotion expression of the synthesized voices is closer to real emotions, and the user experience is improved. And the precision of emotion perception is greatly improved.
Owner:TIANJIN CHENGJIAN UNIV

End-side-cloud three-in-one active chatting robot system for high-emotional quotients

An end-side-cloud three-in-one active chat robot system for high-emotional merchants comprises an end side, a local edge server and a cloud end, and the end side is used for collecting multi-modal data of a user and performing local lightweight real-time processing and response execution; the local edge server is used for receiving and fusing the multi-modal features and the context information from the end side, and carrying out sentiment calculation, dialogue management and active trigger decision making with medium complexity; the cloud end is used for operating a super-large-scale model and providing global knowledge management, long-term user portrait storage and model training optimization; and the end side, the local edge server and the cloud end carry out cooperative communication through an encrypted channel to form a distributed intelligent processing architecture. According to the method, global optimization is realized by integrating end-side lightweight sensing, edge multi-modal fusion and cloud long-term memory. A composite finite state machine (FSM) active questioning mechanism is combined with sentiment calculation, and is different from traditional rule type triggering. Off-line and on-line fusion scheduling and multi-agent role playing are combined to be applied to a high-emotional-quotient interaction scene, and the simulation is improved. Multi-modal emotion perception circulation is introduced, and the problem of single text emotion misjudgment is solved.
Owner:SHANGHAI LANHAOJING INTELLIGENT TECHNOLOGY CO LTD

Cooperative intervention system and method based on multi-mode emotion perception and five-tone therapy

The invention relates to the technical field of wisdom medical treatment, in particular to a cooperative intervention system and method based on multi-modal emotion perception and five-tone therapy, and realizes precision of emotion recognition and individuation of intervention strategies through cooperative intervention of multi-modal emotion perception and traditional Chinese medicine five-tone therapy. Physiological and behavior signals of a user in different states are comprehensively captured, emotion recognition is carried out in combination with a deep learning model, the accuracy and real-time performance of emotion recognition are remarkably improved, the system can intelligently match music tracks most suitable for the current emotion state based on the five-internal-organ-five-sound theory of traditional Chinese medicine and modern music psychology, and the user experience is improved. And an intervention strategy is continuously optimized through reinforcement learning, so that more targeted and effective emotion regulation is realized, and the method is particularly suitable for long-term management and intervention of negative emotions such as anxiety and depression.
Owner:XIEHE HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI & TECH UNIV

Real-time emotion perception and voice interaction system for intelligent cockpit

The invention discloses a real-time emotion perception and voice interaction system for an intelligent cabin. The system comprises a multi-modal data acquisition module used for synchronously acquiring a facial image, a voice signal and text input of a driver; the visual feature enhancement unit is used for carrying out restoration and emotion distribution extraction on the low-quality image; the audio noise reduction and feature extraction unit is used for extracting voice emotion features; the text emotion coding unit is used for fusing relative position coding and context semantic information; the cross-modal fusion module is used for outputting an emotion classification result by integrating visual, audio and text features; the personalized emotion database is used for storing historical emotion data of the user and performing emotion trend prediction and early warning judgment; the large language model feedback module is used for generating structured cue words according to the emotion recognition result and the driving situation and generating natural language feedback; the voice synthesis and output module is used for adjusting voice parameters and performing feedback output through a vehicle-mounted multi-channel; according to the invention, the emotion expression of human-vehicle interaction is enhanced.
Owner:SUZHOU UNIV

Schizophrenia early warning and evaluation system based on human brain multi-region signals

The invention discloses a schizophrenia early warning and evaluation system based on human brain multi-region signals, and relates to the technical field of early warning and evaluation, and the system comprises a neural connection analysis unit which is used for recognizing neural connection characteristics of a brain network based on biomarker characteristics, comparing the neural connection characteristics with a database, and determining the neural connection characteristics of the brain network; clustering individuals with similar neural connection features according to a comparison result to generate a risk group; the emotion perception analysis unit is used for acquiring facial emotion states of the risk group in a preset time period and predicting evolution trends of neural connection features in different facial emotion states; and the early warning evaluation unit is used for inputting the evolution trend of the neural connection characteristics into a pre-constructed evaluation model, outputting a risk level evaluation result and formulating an early warning measure based on the risk level evaluation result. According to the method, neural connection features and emotion perception analysis are combined, so that early-stage neural connection abnormity and emotion turning intervals of schizophrenia can be accurately identified and positioned.
Owner:衢州市第三医院

Classroom real-time learning emotion perception and intelligent intervention system

The invention discloses a classroom real-time learning emotion knowledge and intelligent intervention system, and relates to the technical field of artificial intelligence auxiliary education. Comprising a time sequence perception modeling module, a conflict identification analysis module, an intervention priority control module, a decision fusion output module, a stability prediction and early warning module and a closed-loop vibration suppression regulation and control module, the time sequence perception modeling module establishes a unified time baseline and a phase reference field, and performs joint modeling on multi-source classroom learning condition data under the constraint of the unified time baseline and the phase reference field; time sequence semantic fusion features are extracted, and a contradictory candidate trajectory set is generated. According to the method, multi-modal time sequence semantic features are fused, a learning situation conflict source is identified, conflict intensity is quantified, an intervention priority and a punishment mechanism are constructed to guarantee rhythm stability, an evidence chain and an attention mechanism are adopted to generate a consistent decision, oscillation detection and time reversal regulation are combined, closed-loop control of the intervention process is achieved, strategy oscillation is effectively avoided, and the method is suitable for popularization and application. And the intervention continuity and stability are improved.
Owner:HENAN MUHUA EDUCATION TECH CO LTD

Scene layout optimization method and system based on multiple visual elements and emotion perception

The invention discloses a scene layout optimization method and system based on multiple visual elements and emotion perception. Relates to the technical field of management optimization. The method comprises the steps of obtaining image data and a scene type of a target scene; feature information of visual elements of each category in the image data is extracted, and weight information of the visual elements of each category is determined according to the scene type and user feedback information; determining an emotion intensity value of the target scene according to the feature information and the weight information of all the types of visual elements, and determining a layout optimization suggestion of the target scene according to the emotion intensity value; and according to the layout optimization suggestion, generating image data of the target scene after layout optimization by using an image generation model. The technical problem that in the prior art, a scene layout optimization mode has the technical defects that a static weight distribution mechanism is rigid, comprehensive influence among a plurality of visual elements is not fully considered, and dynamic quantification capacity of emotional intensity is insufficient, so that the scene layout optimization effect is poor is solved.
Owner:BEIJING UNIV OF POSTS & TELECOMM +1

Analgesia feedback and control method and system based on multi-modal data, electronic equipment and storage medium

The invention provides an analgesia feedback and control method and system based on multi-modal data, electronic equipment and a storage medium, and relates to the technical field of analgesia feedback and control. The method related to the technology comprises the following steps: acquiring pain associated data based on a multi-mode sensor and an emotion perception assembly; generating a comprehensive pain index based on the pain sense associated data, and matching an analgesia scheme based on the comprehensive pain index; or directly outputting an analgesia scheme based on the pain associated data; and performing analgesia control based on the analgesia scheme. According to the analgesia feedback and control technology, data, such as electroencephalogram, voice emotion and environment, associated with pain sense are integrated, the limitation of a single signal is broken through, and analgesia feedback and control are more accurate and intelligent.
Owner:THE FIRST AFFILIATED HOSPITAL OF ANHUI MEDICAL UNIV

Vending machine multi-mode emotion perception and personalized dialogue generation method and system

The invention discloses a vending machine multi-mode emotion perception and personalized dialogue generation method and system, and the method comprises the steps: collecting a face image and a voice signal of a user through a camera and a microphone, and outputting a dual-mode emotion tag through the analysis of a face expression and a voice emotion; fusing the label and the dialogue text to generate a structured Prompt containing emotion, intention and context; based on an Agent framework multi-modal large model, combining context history and a personalized strategy to generate a reply text matched with the emotional scene; according to the text and the comprehensive emotion label, TTS parameters are dynamically adjusted, and anthropomorphic voice is output; in multiple rounds of dialogues, styles are kept consistent through an emotion smoothing formula, and emotion-verbal skill-conversion data are precipitated in combination with a user feedback optimization strategy. The interaction limitation of a traditional vending machine is broken through, multi-mode emotion perception, personalized personification interaction and continuous evolution are achieved, the vending machine is promoted to be upgraded to an emotional shopping guide platform, user experience and sales transformation are improved, and a technical model is provided for intelligent retail.
Owner:SHANGHAI QUZHI NETWORK TECH CO LTD

Accompanying robot control method and system based on emotion perception classification

The invention belongs to the technical field of robots, and provides an accompanying robot control method and system based on emotion perception classification. The method comprises the following steps: acquiring multi-dimensional emotion related data of a target object, and analyzing based on the emotion related data to obtain an emotion anomaly judgment probability; when the emotion abnormity judgment probability is higher than a probability threshold value, performing voice interaction with the target object, and processing voice interaction data and emotion related data by using a multi-modal emotion classification model to perform emotion perception classification on the target object to obtain an emotion type and an emotion degree; and when the emotion type is an abnormal emotion and the emotion degree exceeds the regulation and control capability of the accompanying robot, determining external personnel, including emotion regulation and control personnel and / or safety personnel, based on the emotion type and the emotion degree, and scheduling the external personnel to perform emotion intervention on the target object. The method can break through the emotion processing limitation of the accompanying robot, and remarkably improves the accompanying service quality and the user emotion care experience.
Owner:WEST LAKE XINCHEN (HANGZHOU) TECH CO LTD

Digital human contradictory dispute mediation method based on intelligent perception and emotion regulation

The invention discloses a digital human contradictory dispute mediation method based on intelligent perception and emotion regulation. The method comprises the following steps: firstly, acquiring voice information and visual information of two contradictory parties; calculating a voice emotion score by using the voice information, calculating a visual emotion score by using the visual information, and carrying out weighted calculation to obtain a comprehensive emotion score; then generating an initial speech speed, an initial expression and an initial gesture of the digital human; matching a proper response strategy from the knowledge base and transmitting the response strategy to the digital person; and finally, mapping voice information in the voice emotion score to a voice synthesis parameter, generating emotional voice signals consistent with both parties of a contradictory dispute in language by combining a response strategy, and outputting the emotional voice signals by a digital person for contradictory dispute mediation. In the mediation process, the digital person monitors the comprehensive emotion score and the contradictory scene in real time for dynamic adjustment. The real emotional state of the user is accurately captured based on intelligent perception, emotion mediation is carried out based on emotion perception, and the reality sense of digital human interaction and the user trust degree are improved.
Owner:GUANGDONG UNIV OF EDUCATION

Facial expression implementation control method for man-machine interaction robot

The invention relates to the field of human-computer interaction, and discloses a human-computer interaction robot facial expression implementation control method, which comprises the following steps: dynamically capturing the face, sound and posture of a user in a human-computer interaction scene, and generating an initial emotion perception sequence; performing hierarchical cross mapping on the initial emotion perception sequence, and performing combinatorial analysis on facial expressions, voices and intonations and body movement features to form an emotion matching vector; based on the emotion matching vector, utilizing a priority regulation model to predict the emotion trend of the user at the next moment, and identifying an expression enhancement point and an emotion attenuation area; mapping the generated facial micro-expression adjusting instruction to a robot facial driving unit, and performing real-time correction and conflict resolution on an expression action sequence; and reversely fusing a user fixation point, facial muscle micro-motion and voice emotion which are acquired in real time into an emotion matching vector, and dynamically updating a perception weight and expression regulation and control parameters. The method has the advantage of improving the emotion matching degree of the robot expressions.
Owner:BEIJING HAIBAICHUAN TECH CO LTD

Intelligent audio recommendation control method and system

The invention relates to the technical field of music recommendation, in particular to an intelligent audio recommendation control method and system. The method comprises the following steps: detecting a real-time face image of a user in an initial music playing process, carrying out multi-period emotion evolution modeling, and constructing a user emotion state evolution curve; identifying the initially played music, and performing emotion resonance matching based on the emotional state evolution curve of the user to obtain emotion resonance response data; constructing a global music feature map of the user music library; performing deep rhythm demand analysis on the emotion resonance response data according to the global music feature map, and extracting an emotion demand adaptive music set; adaptive music recommendation decision making is carried out based on the emotion demand adaptive music set, and recommendation control execution is carried out. The music emotion demand of the user is predicted through accurate user emotion perception, adaptive music is efficiently and accurately recommended, the satisfaction degree of the user is improved, and good auditory experience is provided.
Owner:QILIXING TECHNOLOGY (SHENZHEN) CO LTD

Industrial equipment online state and configuration state management system

The invention relates to the technical field of equipment management, in particular to an industrial equipment on-line state and configuration state management system which comprises an emotion perception regulation and control module for collecting heart rate data and skin electricity data of a working area, analyzing physiological index fluctuation through heart rate variability measurement in combination with skin electricity response, recognizing a working pressure state and obtaining emotion characteristics. According to the invention, by comprehensively collecting and analyzing the physiological and environmental data of the working area, the dynamic adjustment ability of the production environment emotion is improved. By monitoring the heart rate variability and the electrodermal response, the pressure state of the employee is effectively recognized, and emotion data is further supplemented through sound analysis. The data comprehensive analysis not only optimizes the operation parameters of the equipment, such as adjusting speed and temperature, but also realizes the humanization of the production environment, reduces the pressure of employees, and improves the production efficiency.
Owner:ANHUI DIGITGRAVITY TECH CO LTD

Pet accompanying robot state control system and method capable of dynamically updating character

The invention discloses a pet accompanying robot state control system and method capable of dynamically updating characters, and the method comprises the steps: sensing the current state of a user, and recognizing the emotion state of the user through a multi-mode emotion calculation method based on the current state of the user; each feedback state of the pet robot is generated; based on the selected specific feedback state, the appropriate pet robot feedback expression, action and sound effect are intelligently matched; and synchronously controlling the pet robot to realize integral state output of man-machine interaction. According to the method, the specific feedback state is output by combining the multi-mode emotion perception with the personality of the pet robot, so that the personalized interaction experience of the pet robot is improved. Meanwhile, through a dynamic updating mechanism of the character of the pet robot, the pet robot can evolve continuously, and the emotional accompanying experience of thousands of people in long-term use of the user is improved.
Owner:PANOVASIC TECHNOLOGY CO LTD

Vehicle-mounted interaction system and method for adjusting driver emotion, vehicle and medium

The invention discloses a vehicle-mounted interaction system and method for adjusting the emotion of a driver, a vehicle and a medium, and relates to the technical field of intelligent driving. The vehicle-mounted interaction system comprises an emotion sensing module, a data processing module and a feedback control module which are connected with one another, the emotion sensing module is used for acquiring multi-modal information of a driver, and the multi-modal information comprises facial data, physiological data and voice data; the data processing module is used for fusing the multi-modal information and determining an emotional state level of the driver; and the feedback control module is used for controlling operation parameters of the multi-channel actuator according to the emotional state level, and the multi-channel actuator comprises an auditory channel, a visual channel, an olfactory channel and a tactile channel. By adopting the vehicle-mounted interaction system, the emotion of the driver can be actively sensed and cooperatively adjusted, and the driving safety and comfort are effectively improved.
Owner:江苏开沃汽车有限公司

Case mediation sentiment analysis and decision support method based on deep learning

The invention discloses a case mediation sentiment analysis and decision support method based on deep learning, and the method comprises the following steps: S1, collecting multi-source data in a mediation process, carrying out the preprocessing, and constructing a multi-modal input feature set; s2, constructing a dual-channel collaborative attention network emotion recognition model; s3, optimizing model structure hyper-parameters by using a wild goat optimization algorithm; s4, reasoning multi-modal features, and outputting a structured emotion vector; s5, constructing a multi-node mediation state map, and depicting an emotional evolution path; s6, generating a mediation behavior scheme based on the multi-node mediation state map and the strategy rule; and S7, collecting feedback data, and updating the model and the strategy library. The invention aims to improve the emotion perception accuracy and the mediation decision intelligent level in the case mediation process through a multi-modal emotion recognition and strategy generation mechanism.
Owner:ZHEJIANG FAYI TECHNOLOGY CO LTD

Personalized communication system fused with music emotion perception

The invention discloses a communication resource optimization method and system based on multi-source emotion perception, and aims to solve the problem that emotion analysis and communication resource allocation are disjointed in the prior art. The method comprises three core modules: a music emotion analysis module, a multi-source emotion perception module and an emotion-channel mapping engine module. The method comprises the following steps: firstly, constructing a music emotion vector by extracting a Mel-frequency cepstral coefficient, a rhythm characteristic and a timbre characteristic of a music signal; secondly, fusing the user voice fundamental frequency contour and the micro-expression dynamic characteristics to generate a user emotion vector; and finally, constructing an emotion-channel mapping engine based on deep reinforcement learning (DRL), and realizing dynamic optimization of a modulation coding scheme by defining a joint state space and designing a third-order reward function. According to the method, the emotion satisfaction degree is creatively used as a core index of resource allocation, the problem of emotion perception deficiency in traditional communication optimization is solved, and the user experience and the network resource utilization rate are remarkably improved.
Owner:马白雪

Emotional diary intelligent glasses system driven by multi-mode intelligent body

The invention discloses an emotional diary intelligent glasses system driven by a multi-modal agent. The emotional diary intelligent glasses system comprises a multi-modal perception layer, a unified vector space processing layer and an agent collaborative decision-making layer. The multi-modal sensing layer constructs a full-dimensional sensing network by integrating a camera, a microphone array and an eye movement tracker, and collects image, sound and eye movement information; the unified vector space processing layer realizes cross-modal information unified representation by using a multi-modal large model; the agent collaborative decision-making layer comprises an emotion perception agent, a scene understanding agent, a diary generation agent and a personalized adaptive agent. According to the method, deep understanding of the emotional state and the environment scene of the user is realized through a multi-modal fusion perception and agent cooperation mechanism, the personalized emotional diary is generated in combination with chain thinking and reflection, and the content insight and the user experience are effectively improved.
Owner:LINKER

Personalized interaction method and system based on multi-modal emotion perception

The invention discloses a personalized interaction method and system based on multi-modal emotion perception, and relates to the technical field of intelligent interaction, and the method comprises the steps: collecting user historical interaction event data, and extracting interaction content features and user behavior features; obtaining interaction emotion data of the user in real time through a multi-mode sensor; fusing the interactive emotion multi-modal data to generate a dynamic emotion quantized value; generating an emotion correction factor; dynamically generating a personalized interaction strategy; and executing the interaction strategy, and collecting user response data to update a historical interaction event library. The method has the advantages that the key problem that a traditional interaction system is difficult to perceive the real-time emotional state of the user is effectively solved, a closed-loop optimization system of perception-decision-execution-feedback is constructed, and the user interaction satisfaction degree and the situation adaptive capacity of the whole system are continuously improved.
Owner:BINGKUI XIAOYI (GUANGDONG) INTELLIGENT TECHNOLOGY CO LTD

Method and system for enhancing color pattern emotion perception of blind person based on color temperature

The invention relates to a color temperature-based blind person color pattern emotion perception enhancement method and system, and the method comprises the steps: collecting a target image, and extracting the contour information and color information in the image; performing HSV judgment to obtain a cooling and heating classification result; mapping the cooling and heating classification result to a preset temperature interval, and generating a temperature control signal; according to the contour information, driving a target pin in the tactile array to protrude to form a tactile contour area; a temperature control signal is applied to the heating unit corresponding to the touch contour area, so that the temperature of the protruding pin is adjusted to be the target temperature corresponding to the cold and warm classification result. The method has the beneficial effects that the image color temperature is mapped into five grades of temperature gradients, so that a blind user can perceive a complete color emotion pedigree through touch, accurate touch expression of color emotion information is realized, and a visual color temperature-temperature sensing corresponding relation is established.
Owner:HANGZHOU LUMI CULTURE CO LTD

Personalized music recommendation method and device based on emotion perception, equipment and medium

The invention belongs to the technical field of music recommendation, and provides a personalized music recommendation method, device, equipment and medium based on emotion perception, and the method comprises the steps: collecting user motion monitoring parameters and physiological state data, and carrying out the personalized motion rhythm calculation to obtain a user motion rhythm model; according to the physiological state data and a user exercise rhythm model, heart rate frequency band-beat synchronous matching and intelligent index hierarchical management are carried out, and a music index candidate pool is obtained; performing multi-scale wavelet transform decomposition on the physiological state data stream, and performing user personalized emotion perception to generate a real-time emotion sub-state; performing exercise emotion trend prediction on the user exercise rhythm model according to the real-time emotion sub-state to generate a user exercise emotion situation map; and performing multi-target music recommendation optimization processing from the music index candidate pool according to the user motion emotion situation map to obtain a recommendation result. The method has the beneficial effect that the personalized music recommendation accuracy is improved.
Owner:XIANGJIANG LAB