205 results about "Emotion perception" patented technology

The invention belongs to the field of artificial intelligence, and provides a dialogue interaction system based on multi-mode emotion perception and knowledge graph dynamic enhancement. A user edge terminal obtains multi-modal data, a lightweight Transform fusion network is adopted, the multi-modal data is converted into a fusion feature vector through cross-modal attention fusion and dynamic weight adjustment, and the fusion feature vector and historical conversations in a preset round are compressed in real time; the cloud service platform inputs the compressed data into DKGE, mining and fusing feature vectors and entity knowledge and emotional relations implied in historical dialogues in real time in the dialogue interaction process to update a dynamic knowledge graph, performing knowledge enhancement processing based on the dynamic knowledge graph, and constructing an initial reply prototype of the current round of interaction of the user; inputting the fusion feature vector and the updated dynamic knowledge graph into a dialogue strategy model, and determining a response strategy and a knowledge calling direction of the current round of dialogue; and the edge terminal generates real-time interaction reply information according to the initial reply prototype, the response strategy and the knowledge calling direction.

The invention relates to the field of multi-modal interaction analysis, in particular to a multi-modal interaction method and system of a digital human agent. The method comprises the following steps: acquiring a real-time face image and a voice signal input stream of an interactive user based on an intelligent agent; performing real-time micro-expression recognition and deep emotion analysis based on the real-time facial image to obtain real-time emotion features of the user; performing time sequence evolution analysis on the real-time emotion characteristics of the user, performing holographic user emotion deep mining, and constructing a user emotion holographic characteristic spectrum; carrying out adaptive acoustic gain processing on the voice signal input stream, and carrying out voice-emotion association analysis based on the user emotion holographic characteristic spectrum to generate a voice-emotion linkage mapping spectrum; and carrying out eyeball fixation point migration tracking based on the user emotion holographic feature map and the real-time face image, and generating a user interaction depth intention signal. Through the real-time deep semantic understanding and emotion perception ability, the intelligent agent interaction intelligence and response accuracy are improved.

The invention relates to the technical field of financial risk assessment, and discloses a financial risk assessment system based on emotion perception and a dynamic knowledge graph, and the technical scheme is characterized in that the system comprises a multi-source data collection module which is in butt joint with a plurality of data sources and collects structured data and unstructured data; carrying out standardization processing on the data to obtain standard data; the emotion perception engine is used for quantifying customer emotion features; the dynamic knowledge graph construction module is used for attenuating the weight of historical data according to the time dimension and updating the knowledge graph in real time when an entity extraction model is used for extracting an entity and a corresponding relation and incremental updating is carried out on the knowledge graph; the multi-modal risk assessment model is used for fusing structured data, emotion features and knowledge graph embedding and outputting a risk score; and the dynamic feedback and optimization module iteratively updates the risk assessment logic according to the risk score and the market feedback, and performs incremental training on the multi-modal risk assessment model through misjudgment data.

The invention relates to the technical field of artificial intelligence and natural language processing, in particular to an intelligent customer service method and system based on a large model, and the method comprises the steps: generating a unique session ID based on a user identity, and associating a historical context; multi-modal input of texts, voices, images and the like is carried out, and data standardization is carried out through a unified interface; realizing mixed intention recognition by combining a rule engine and a large model; constructing a dynamic customer portrait through multiple rounds of dialogue records, historical work orders and business data; according to the question emergency degree and customer value grading response, analyzing customer emotion in real time, adjusting a reply style, and outputting an answer; the manual operation process of the traditional customer service is converted into an AI automatic closed loop; the method has the beneficial effects that customer intention deep understanding, multi-mode interaction, emotion perception and service process automation are realized through a large language model (LLM) technology, and the service efficiency and the user satisfaction are remarkably improved.

The invention relates to an emotion accompanying robot system based on multi-dimensional perception and an interaction method, and belongs to the technical field of intelligent robots. The system comprises a sensing module which captures micro-expression, voice, body temperature, touch and other multi-source data through a biological radar array, multispectral imaging and a touch sensing fabric; the decision-making module quantifies the emotion intensity by using an emotion state calculation engine, constructs a user personalized emotion file in combination with the dynamic knowledge graph, and generates a dynamic emotion graph; and the execution module realizes anthropomorphic emotion expression through bionic face driving, joint compliance control and thermal feedback. The interaction method comprises the steps of data capture, emotion file construction, dynamic graph generation, interactive execution and feedback adjustment, definition of an emotion intensity quantification formula, a graph edge weight model and the like. According to the method, physiological signals, environment situations and bionic expression are fused, multi-modal precise emotion perception and safe interaction are achieved, man-machine naturalness is improved, the method is suitable for elderly accompanying, psychological counseling and other scenes, and the emotion accompanying effect is enhanced.

The invention provides a TTS speech synthesis method for emotion perception enhancement under multi-modal fusion driving, and the method comprises the following steps: S1, carrying out the collection and preprocessing of multi-modal data, the multi-modal data comprising text data, speech data and facial expression data; s2, extracting and analyzing emotion features; s3, emotion perception speech synthesis model training; s4, speech synthesis and post-processing; s5, performing model evaluation and optimization; by collecting and analyzing multi-mode data such as texts, voices and facial expressions, emotion features can be captured more comprehensively and accurately, complementary information among different modes is fully mined through application of a multi-mode fusion network and a collaborative attention mechanism, the emotion expression of the synthesized voices is closer to real emotions, and the user experience is improved. And the precision of emotion perception is greatly improved.

An end-side-cloud three-in-one active chat robot system for high-emotional merchants comprises an end side, a local edge server and a cloud end, and the end side is used for collecting multi-modal data of a user and performing local lightweight real-time processing and response execution; the local edge server is used for receiving and fusing the multi-modal features and the context information from the end side, and carrying out sentiment calculation, dialogue management and active trigger decision making with medium complexity; the cloud end is used for operating a super-large-scale model and providing global knowledge management, long-term user portrait storage and model training optimization; and the end side, the local edge server and the cloud end carry out cooperative communication through an encrypted channel to form a distributed intelligent processing architecture. According to the method, global optimization is realized by integrating end-side lightweight sensing, edge multi-modal fusion and cloud long-term memory. A composite finite state machine (FSM) active questioning mechanism is combined with sentiment calculation, and is different from traditional rule type triggering. Off-line and on-line fusion scheduling and multi-agent role playing are combined to be applied to a high-emotional-quotient interaction scene, and the simulation is improved. Multi-modal emotion perception circulation is introduced, and the problem of single text emotion misjudgment is solved.

The invention relates to the technical field of wisdom medical treatment, in particular to a cooperative intervention system and method based on multi-modal emotion perception and five-tone therapy, and realizes precision of emotion recognition and individuation of intervention strategies through cooperative intervention of multi-modal emotion perception and traditional Chinese medicine five-tone therapy. Physiological and behavior signals of a user in different states are comprehensively captured, emotion recognition is carried out in combination with a deep learning model, the accuracy and real-time performance of emotion recognition are remarkably improved, the system can intelligently match music tracks most suitable for the current emotion state based on the five-internal-organ-five-sound theory of traditional Chinese medicine and modern music psychology, and the user experience is improved. And an intervention strategy is continuously optimized through reinforcement learning, so that more targeted and effective emotion regulation is realized, and the method is particularly suitable for long-term management and intervention of negative emotions such as anxiety and depression.

The invention discloses a real-time emotion perception and voice interaction system for an intelligent cabin. The system comprises a multi-modal data acquisition module used for synchronously acquiring a facial image, a voice signal and text input of a driver; the visual feature enhancement unit is used for carrying out restoration and emotion distribution extraction on the low-quality image; the audio noise reduction and feature extraction unit is used for extracting voice emotion features; the text emotion coding unit is used for fusing relative position coding and context semantic information; the cross-modal fusion module is used for outputting an emotion classification result by integrating visual, audio and text features; the personalized emotion database is used for storing historical emotion data of the user and performing emotion trend prediction and early warning judgment; the large language model feedback module is used for generating structured cue words according to the emotion recognition result and the driving situation and generating natural language feedback; the voice synthesis and output module is used for adjusting voice parameters and performing feedback output through a vehicle-mounted multi-channel; according to the invention, the emotion expression of human-vehicle interaction is enhanced.

The invention discloses a schizophrenia early warning and evaluation system based on human brain multi-region signals, and relates to the technical field of early warning and evaluation, and the system comprises a neural connection analysis unit which is used for recognizing neural connection characteristics of a brain network based on biomarker characteristics, comparing the neural connection characteristics with a database, and determining the neural connection characteristics of the brain network; clustering individuals with similar neural connection features according to a comparison result to generate a risk group; the emotion perception analysis unit is used for acquiring facial emotion states of the risk group in a preset time period and predicting evolution trends of neural connection features in different facial emotion states; and the early warning evaluation unit is used for inputting the evolution trend of the neural connection characteristics into a pre-constructed evaluation model, outputting a risk level evaluation result and formulating an early warning measure based on the risk level evaluation result. According to the method, neural connection features and emotion perception analysis are combined, so that early-stage neural connection abnormity and emotion turning intervals of schizophrenia can be accurately identified and positioned.

The invention discloses a classroom real-time learning emotion knowledge and intelligent intervention system, and relates to the technical field of artificial intelligence auxiliary education. Comprising a time sequence perception modeling module, a conflict identification analysis module, an intervention priority control module, a decision fusion output module, a stability prediction and early warning module and a closed-loop vibration suppression regulation and control module, the time sequence perception modeling module establishes a unified time baseline and a phase reference field, and performs joint modeling on multi-source classroom learning condition data under the constraint of the unified time baseline and the phase reference field; time sequence semantic fusion features are extracted, and a contradictory candidate trajectory set is generated. According to the method, multi-modal time sequence semantic features are fused, a learning situation conflict source is identified, conflict intensity is quantified, an intervention priority and a punishment mechanism are constructed to guarantee rhythm stability, an evidence chain and an attention mechanism are adopted to generate a consistent decision, oscillation detection and time reversal regulation are combined, closed-loop control of the intervention process is achieved, strategy oscillation is effectively avoided, and the method is suitable for popularization and application. And the intervention continuity and stability are improved.

The invention discloses a scene layout optimization method and system based on multiple visual elements and emotion perception. Relates to the technical field of management optimization. The method comprises the steps of obtaining image data and a scene type of a target scene; feature information of visual elements of each category in the image data is extracted, and weight information of the visual elements of each category is determined according to the scene type and user feedback information; determining an emotion intensity value of the target scene according to the feature information and the weight information of all the types of visual elements, and determining a layout optimization suggestion of the target scene according to the emotion intensity value; and according to the layout optimization suggestion, generating image data of the target scene after layout optimization by using an image generation model. The technical problem that in the prior art, a scene layout optimization mode has the technical defects that a static weight distribution mechanism is rigid, comprehensive influence among a plurality of visual elements is not fully considered, and dynamic quantification capacity of emotional intensity is insufficient, so that the scene layout optimization effect is poor is solved.

The invention provides an analgesia feedback and control method and system based on multi-modal data, electronic equipment and a storage medium, and relates to the technical field of analgesia feedback and control. The method related to the technology comprises the following steps: acquiring pain associated data based on a multi-mode sensor and an emotion perception assembly; generating a comprehensive pain index based on the pain sense associated data, and matching an analgesia scheme based on the comprehensive pain index; or directly outputting an analgesia scheme based on the pain associated data; and performing analgesia control based on the analgesia scheme. According to the analgesia feedback and control technology, data, such as electroencephalogram, voice emotion and environment, associated with pain sense are integrated, the limitation of a single signal is broken through, and analgesia feedback and control are more accurate and intelligent.

The invention discloses a vending machine multi-mode emotion perception and personalized dialogue generation method and system, and the method comprises the steps: collecting a face image and a voice signal of a user through a camera and a microphone, and outputting a dual-mode emotion tag through the analysis of a face expression and a voice emotion; fusing the label and the dialogue text to generate a structured Prompt containing emotion, intention and context; based on an Agent framework multi-modal large model, combining context history and a personalized strategy to generate a reply text matched with the emotional scene; according to the text and the comprehensive emotion label, TTS parameters are dynamically adjusted, and anthropomorphic voice is output; in multiple rounds of dialogues, styles are kept consistent through an emotion smoothing formula, and emotion-verbal skill-conversion data are precipitated in combination with a user feedback optimization strategy. The interaction limitation of a traditional vending machine is broken through, multi-mode emotion perception, personalized personification interaction and continuous evolution are achieved, the vending machine is promoted to be upgraded to an emotional shopping guide platform, user experience and sales transformation are improved, and a technical model is provided for intelligent retail.

The invention belongs to the technical field of robots, and provides an accompanying robot control method and system based on emotion perception classification. The method comprises the following steps: acquiring multi-dimensional emotion related data of a target object, and analyzing based on the emotion related data to obtain an emotion anomaly judgment probability; when the emotion abnormity judgment probability is higher than a probability threshold value, performing voice interaction with the target object, and processing voice interaction data and emotion related data by using a multi-modal emotion classification model to perform emotion perception classification on the target object to obtain an emotion type and an emotion degree; and when the emotion type is an abnormal emotion and the emotion degree exceeds the regulation and control capability of the accompanying robot, determining external personnel, including emotion regulation and control personnel and / or safety personnel, based on the emotion type and the emotion degree, and scheduling the external personnel to perform emotion intervention on the target object. The method can break through the emotion processing limitation of the accompanying robot, and remarkably improves the accompanying service quality and the user emotion care experience.

The invention discloses a digital human contradictory dispute mediation method based on intelligent perception and emotion regulation. The method comprises the following steps: firstly, acquiring voice information and visual information of two contradictory parties; calculating a voice emotion score by using the voice information, calculating a visual emotion score by using the visual information, and carrying out weighted calculation to obtain a comprehensive emotion score; then generating an initial speech speed, an initial expression and an initial gesture of the digital human; matching a proper response strategy from the knowledge base and transmitting the response strategy to the digital person; and finally, mapping voice information in the voice emotion score to a voice synthesis parameter, generating emotional voice signals consistent with both parties of a contradictory dispute in language by combining a response strategy, and outputting the emotional voice signals by a digital person for contradictory dispute mediation. In the mediation process, the digital person monitors the comprehensive emotion score and the contradictory scene in real time for dynamic adjustment. The real emotional state of the user is accurately captured based on intelligent perception, emotion mediation is carried out based on emotion perception, and the reality sense of digital human interaction and the user trust degree are improved.

The invention relates to the field of human-computer interaction, and discloses a human-computer interaction robot facial expression implementation control method, which comprises the following steps: dynamically capturing the face, sound and posture of a user in a human-computer interaction scene, and generating an initial emotion perception sequence; performing hierarchical cross mapping on the initial emotion perception sequence, and performing combinatorial analysis on facial expressions, voices and intonations and body movement features to form an emotion matching vector; based on the emotion matching vector, utilizing a priority regulation model to predict the emotion trend of the user at the next moment, and identifying an expression enhancement point and an emotion attenuation area; mapping the generated facial micro-expression adjusting instruction to a robot facial driving unit, and performing real-time correction and conflict resolution on an expression action sequence; and reversely fusing a user fixation point, facial muscle micro-motion and voice emotion which are acquired in real time into an emotion matching vector, and dynamically updating a perception weight and expression regulation and control parameters. The method has the advantage of improving the emotion matching degree of the robot expressions.

The invention relates to the technical field of music recommendation, in particular to an intelligent audio recommendation control method and system. The method comprises the following steps: detecting a real-time face image of a user in an initial music playing process, carrying out multi-period emotion evolution modeling, and constructing a user emotion state evolution curve; identifying the initially played music, and performing emotion resonance matching based on the emotional state evolution curve of the user to obtain emotion resonance response data; constructing a global music feature map of the user music library; performing deep rhythm demand analysis on the emotion resonance response data according to the global music feature map, and extracting an emotion demand adaptive music set; adaptive music recommendation decision making is carried out based on the emotion demand adaptive music set, and recommendation control execution is carried out. The music emotion demand of the user is predicted through accurate user emotion perception, adaptive music is efficiently and accurately recommended, the satisfaction degree of the user is improved, and good auditory experience is provided.

The invention discloses a pet accompanying robot state control system and method capable of dynamically updating characters, and the method comprises the steps: sensing the current state of a user, and recognizing the emotion state of the user through a multi-mode emotion calculation method based on the current state of the user; each feedback state of the pet robot is generated; based on the selected specific feedback state, the appropriate pet robot feedback expression, action and sound effect are intelligently matched; and synchronously controlling the pet robot to realize integral state output of man-machine interaction. According to the method, the specific feedback state is output by combining the multi-mode emotion perception with the personality of the pet robot, so that the personalized interaction experience of the pet robot is improved. Meanwhile, through a dynamic updating mechanism of the character of the pet robot, the pet robot can evolve continuously, and the emotional accompanying experience of thousands of people in long-term use of the user is improved.

The invention discloses a vehicle-mounted interaction system and method for adjusting the emotion of a driver, a vehicle and a medium, and relates to the technical field of intelligent driving. The vehicle-mounted interaction system comprises an emotion sensing module, a data processing module and a feedback control module which are connected with one another, the emotion sensing module is used for acquiring multi-modal information of a driver, and the multi-modal information comprises facial data, physiological data and voice data; the data processing module is used for fusing the multi-modal information and determining an emotional state level of the driver; and the feedback control module is used for controlling operation parameters of the multi-channel actuator according to the emotional state level, and the multi-channel actuator comprises an auditory channel, a visual channel, an olfactory channel and a tactile channel. By adopting the vehicle-mounted interaction system, the emotion of the driver can be actively sensed and cooperatively adjusted, and the driving safety and comfort are effectively improved.

The invention discloses a case mediation sentiment analysis and decision support method based on deep learning, and the method comprises the following steps: S1, collecting multi-source data in a mediation process, carrying out the preprocessing, and constructing a multi-modal input feature set; s2, constructing a dual-channel collaborative attention network emotion recognition model; s3, optimizing model structure hyper-parameters by using a wild goat optimization algorithm; s4, reasoning multi-modal features, and outputting a structured emotion vector; s5, constructing a multi-node mediation state map, and depicting an emotional evolution path; s6, generating a mediation behavior scheme based on the multi-node mediation state map and the strategy rule; and S7, collecting feedback data, and updating the model and the strategy library. The invention aims to improve the emotion perception accuracy and the mediation decision intelligent level in the case mediation process through a multi-modal emotion recognition and strategy generation mechanism.

The invention discloses an emotional diary intelligent glasses system driven by a multi-modal agent. The emotional diary intelligent glasses system comprises a multi-modal perception layer, a unified vector space processing layer and an agent collaborative decision-making layer. The multi-modal sensing layer constructs a full-dimensional sensing network by integrating a camera, a microphone array and an eye movement tracker, and collects image, sound and eye movement information; the unified vector space processing layer realizes cross-modal information unified representation by using a multi-modal large model; the agent collaborative decision-making layer comprises an emotion perception agent, a scene understanding agent, a diary generation agent and a personalized adaptive agent. According to the method, deep understanding of the emotional state and the environment scene of the user is realized through a multi-modal fusion perception and agent cooperation mechanism, the personalized emotional diary is generated in combination with chain thinking and reflection, and the content insight and the user experience are effectively improved.

The invention discloses a personalized interaction method and system based on multi-modal emotion perception, and relates to the technical field of intelligent interaction, and the method comprises the steps: collecting user historical interaction event data, and extracting interaction content features and user behavior features; obtaining interaction emotion data of the user in real time through a multi-mode sensor; fusing the interactive emotion multi-modal data to generate a dynamic emotion quantized value; generating an emotion correction factor; dynamically generating a personalized interaction strategy; and executing the interaction strategy, and collecting user response data to update a historical interaction event library. The method has the advantages that the key problem that a traditional interaction system is difficult to perceive the real-time emotional state of the user is effectively solved, a closed-loop optimization system of perception-decision-execution-feedback is constructed, and the user interaction satisfaction degree and the situation adaptive capacity of the whole system are continuously improved.

The invention relates to a color temperature-based blind person color pattern emotion perception enhancement method and system, and the method comprises the steps: collecting a target image, and extracting the contour information and color information in the image; performing HSV judgment to obtain a cooling and heating classification result; mapping the cooling and heating classification result to a preset temperature interval, and generating a temperature control signal; according to the contour information, driving a target pin in the tactile array to protrude to form a tactile contour area; a temperature control signal is applied to the heating unit corresponding to the touch contour area, so that the temperature of the protruding pin is adjusted to be the target temperature corresponding to the cold and warm classification result. The method has the beneficial effects that the image color temperature is mapped into five grades of temperature gradients, so that a blind user can perceive a complete color emotion pedigree through touch, accurate touch expression of color emotion information is realized, and a visual color temperature-temperature sensing corresponding relation is established.

The invention belongs to the technical field of music recommendation, and provides a personalized music recommendation method, device, equipment and medium based on emotion perception, and the method comprises the steps: collecting user motion monitoring parameters and physiological state data, and carrying out the personalized motion rhythm calculation to obtain a user motion rhythm model; according to the physiological state data and a user exercise rhythm model, heart rate frequency band-beat synchronous matching and intelligent index hierarchical management are carried out, and a music index candidate pool is obtained; performing multi-scale wavelet transform decomposition on the physiological state data stream, and performing user personalized emotion perception to generate a real-time emotion sub-state; performing exercise emotion trend prediction on the user exercise rhythm model according to the real-time emotion sub-state to generate a user exercise emotion situation map; and performing multi-target music recommendation optimization processing from the music index candidate pool according to the user motion emotion situation map to obtain a recommendation result. The method has the beneficial effect that the personalized music recommendation accuracy is improved.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as financial science and technology, medical health and the like, and discloses an action generation method, device, equipment and medium based on multi-modal emotion perception.The action generation method comprises the steps that multi-modal data of a target object is obtained, weights are distributed based on the emotion recognition degree, and fused emotion features are generated through fusion; determining an emotion type, an emotion intensity value and a change rate, generating a personalized adjustment coefficient and a scene adjustment coefficient in combination with personalized features and scene features of the target object, processing the initial action parameter to obtain a final action parameter, executing an emotion action, obtaining feedback data, and updating an action parameter mapping relation based on the feedback data. The emotion perception comprehensiveness is improved by fusing the multi-modal data, the action parameters are dynamically adjusted by combining the personalized features and the scene features, the action parameter mapping relation is updated based on the feedback data, and the accuracy, personalization and real-time performance of emotion response are improved.

The invention discloses an adjusting and optimizing algorithm model based on elder care emotion accompanying. The model comprises a multi-mode emotion perception module for receiving voice, images and physiological signals and extracting features such as timbre, facial expression and pulse to generate emotion feature vectors; the emotion recognition module is used for predicting the real-time emotion state of the old people through fusion of CNN and LSTM and multi-modal features; the strategy adjusting and optimizing module adopts a Bayesian optimization or genetic algorithm to automatically adjust and optimize the voice intonation, the interaction rhythm and the dialogue strategy of the accompanying system; the feedback learning module iteratively updates the model based on the old people feedback data, and optimizes the interaction effect; and the personalized accompanying generation module generates accompanying strategies such as voice consolation and music recommendation according to the tuning result. The multi-mode emotion perception module is composed of a voice monitoring sub-module, an expression monitoring sub-module and a physiological signal monitoring sub-module. The strategy tuning module comprises a self-adaptive parameter search sub-module and a multi-target optimization sub-module; and the feedback learning module comprises a user feedback collection and reinforcement learning sub-module, so that the interaction experience and the emotion adaptability of the accompanying system are improved.

The invention provides an autism child personalized emotion perception method based on tactile interaction, and the method comprises an identification stage: employing a trained autism child personalized emotion identification model to identify tactile behavior data in a man-machine interaction process of an autism child and a human-shaped accompanying robot, and obtaining an emotion classification result; in the model training stage, the personalized emotion recognition model of the autism children comprises a public feature extractor, a domain independent feature extraction and classifier, a domain general feature extraction and classifier and an aggregation prediction classifier. The training process of the personalized emotion recognition model for children with autism comprises the following steps: acquiring tactile behavior data; dividing the tactile behavior data into source domain data and target domain data; obtaining a source domain feature and a target domain feature through a common feature extractor; obtaining a domain independent classification result through a domain independent feature extraction and classifier, and obtaining a domain general classification result through a domain general feature extraction and classifier; and obtaining a classification result of the emotion category through an aggregation prediction classifier.

The invention discloses a multi-chess game robot control method and system based on behavior and emotion adaptive game difficulty adjustment. The method comprises the following steps: initializing a multi-chess game scene; interaction object behavior and emotion perception; calculating the instantaneous state time sequence of the interaction object; performing two-way mapping calculation on the difficulty coefficient to obtain a final difficulty coefficient; and according to the output final difficulty coefficient state, a game strategy of a preset AlphaZero reinforcement learning model and kinematics parameters of the mechanical arm are adjusted, so that dual anthropomorphism of the game level and the action performance of the robot is achieved. Executing control and safety detection; according to the method, behaviors and emotions of the interaction object are sensed in real time, self-adaptive adjustment of the game difficulty is achieved in the two dimensions of the game strategy and the physical action, and the interaction experience and the intelligent level of man-machine game are effectively improved.

The invention discloses a multi-round dialogue logic optimization method in an intelligent question answering system based on a knowledge graph, and belongs to the technical field of artificial intelligence and natural language processing, and the method comprises the following steps: S1, constructing and dynamically updating a triple knowledge graph; s2, based on a graph neural network and a graph attention mechanism, performing time sequence and emotion perception modeling on cross-round semantic association in the triple knowledge graph, and outputting a dialogue context vector; s3, inputting a dialogue context vector and a current user input feature into the generative model, performing semantic mapping through an independent intention, entity and behavior embedding encoder, and generating a robot behavior in combination with logic constraint and emotion-driven weight adjustment from a triple knowledge graph; s4, optimizing the generative model based on a task-associated adversarial training mechanism; and S5, carrying out multi-modal emotion fusion and consistency verification. According to the method, dynamic, coherent and emotional intelligent multi-round dialogue logic optimization can be realized.