247 results about "Interaction systems" patented technology

The invention discloses a virtual-real fusion exhibition display interaction system and a multi-mode perception method, and belongs to the technical field of exhibition display interaction. The system collects audience eyeball fixation points, gesture actions and ambient light data through AR / VR equipment, analyzes coordinates of a region of interest through an eyeball fixation point attention mechanism, a gesture space-time encoder and a multi-modal fusion unit, triggers holographic projection explanation and virtual exhibition stand light and shadow dynamic adjustment (including illumination intensity, color, Gaussian blur and the like) based on a threshold value, and performs real-time display on the virtual exhibition stand. And multi-user collaborative interaction is realized through federal learning. According to the method, reinforcement learning is adopted to optimize an event-driven threshold value, and virtual and real visual splitting is eliminated in combination with ambient light adaptive mapping. The problems of low participation degree, insufficient single-mode interaction information and multi-user cooperation of traditional exhibition are solved, interest analysis accuracy is improved through multi-mode fusion, personalized experience is enhanced through dynamic interaction, the method is suitable for multiple scenes such as museums and science and technology museums, and exhibition intellectualization, immersion and group interaction efficiency are effectively improved.

The invention discloses a controllable digital human real-time interaction system based on a multi-modal sensor, and relates to the technical field of digital humans, and the system comprises a multi-modal sensor data collection module which captures user interaction videos, collects interaction voice signals of a user, and collects the temperature of the user and the distance between the user and equipment; the multi-modal feature extraction module comprises a static feature extraction unit and a dynamic feature extraction unit; the multi-modal fusion module is used for analyzing the trustworthiness degree from the multi-modal feature extraction module, judging the importance of each information source in the current task, comprehensively considering and dynamically adjusting weight distribution, and fusing multi-modal feature data; the intention understanding module is used for understanding the interaction intention of the user by utilizing a large language model (LLM) based on the fused features and contexts; and the digital human interaction output module is used for generating an open domain text reply based on the interaction intention of the user and finally realizing digital human multi-mode fusion interaction output.

The invention discloses an active real-time interaction system based on LLM. The active real-time interaction system comprises a self-cognition module, a real-time perception module, an active planning module, a situation decision module, a dynamic execution module, an emotion engine module, an adaptive interaction module and a safety management and control module. The system adopts a multi-dimensional vector to represent role attributes, and constructs a hierarchical memory storage structure to record interaction experience; generating an environment state vector through a multi-modal data processing technology; executing the target task decomposition algorithm to generate a multi-path execution plan; making a real-time decision based on the multi-dimensional decision factor; mapping the abstract decision into an instruction sequence and monitoring an execution process; simulating a system emotional state and influencing decision expression; dynamically adjusting an interaction strategy according to the user characteristics; evaluating decision rationality and starting a corresponding intervention mechanism. All the modules form a closed-loop workflow through a standardized data interface, the problems that a traditional AI system is passive in response, lacks self-cognition, is limited in environmental perception, is single in planning capability, lacks flexibility in decision making and the like are solved, and active service, self-evolution and safety controllability of the system are achieved.

The invention discloses a digital human interaction system based on a web end, relates to the technical field of digital human interaction, and aims to solve the problem of accumulated dislocation of browser end digital population animation and actual audio playback caused by multiple clocks and buffer scheduling. The system comprises a visual position cooperative control module, a session initialization module, an audio track and rendering canvas binding module, a multi-domain alignment time base cluster establishment module, construction of a time base cluster containing a system reference sub-time base and a content logic sub-time base, potential candidate anchor point generation module, an optimal anchor point selection module, synchronization error calculation, and judgment of a synchronization steady state, a fine adjustment state or a lost state. An optimal anchor point is screened to adjust the animation, and a visual effect studio dynamic maintenance module and an enhancement generation module assist in out-of-step processing and parameter optimization; through cooperation of multiple modules, accurate synchronization of audio and digital human animation is realized.

The invention provides an interactive system virtual test method and device based on multi-mode cognitive twin bodies. The method comprises the following steps: 1) constructing user cognitive twin: outputting a behavior decision tree with confidence through an adversarial generative network based on population attributes, cognitive preferences and behavior history; 2) creating a dynamic interaction environment: encoding a to-be-tested interface into a semantic graph structure which can be analyzed by a machine, and associating a physical operation constraint rule base; 3) running a multi-agent test: deploying a twin cluster in the virtual sandbox, and recording an operation path, an attention thermodynamic diagram and decision delay; and 4) generating a design defect map, namely, positioning an interface cognitive friction point by comparing the deviation degree of an expected interaction flow and an actual behavior track. According to the method, the problems that a traditional user test period is long and scene coverage is limited are solved, and early interception of interaction risks and design optimization preposition are achieved. The method can be widely applied to high-risk / high-cost / high-cycle test scenes of the man-machine interaction system.

The invention belongs to the field of vehicles, and discloses a cabin active conversation method and system, and the method comprises the steps: obtaining user information and vehicle information, and determining a user portrait; matching a corresponding active dialogue type in a preset database based on the user portrait; and determining a trigger score of the active dialogue type based on the user portrait, and triggering a corresponding active dialogue when the trigger score meets a preset condition. According to the method and the system, user demands and preferences can be accurately grasped, and personalization and scene adaptability of dialogue contents can be ensured. Meanwhile, the triggering score of the active dialogue type is determined according to the user portrait, the dialogue can be triggered at a proper time, dialogue triggering does not depend on a preset fixed logic or scene any more, dynamic decision making is carried out based on real-time and personalized data, the method can adapt to complex and changeable driving scenes and user requirements, and the user experience is improved. The intelligence and initiative of the vehicle-mounted voice interaction system are effectively improved, and the user experience is enhanced.

The invention relates to the technical field of interaction, and discloses a content dynamic generation and immersive sightseeing interaction system, which comprises a user behavior capture module used for capturing the position, sight direction and interaction action of a user in a virtual environment in real time and generating user behavior data; the distributed optimal control module is connected with the user behavior capturing module and is used for generating a global control strategy based on the user behavior data generation content; and the content generation module is connected with the distributed optimal control module. According to the invention, a technology of combining a distributed optimal control module and user behavior modeling is adopted, and the technical effect of highly matching dynamic content generation and user behaviors is achieved. Compared with a scheme of generating content depending on a fixed rule in the prior art, the method solves the defect that content generation cannot adapt to dynamic behaviors of the user in real time, and greatly improves the immersion and the degree of freedom of the user in the virtual scene.

The invention relates to the technical field of interactive systems, and particularly discloses a game motor home interactive demonstration control system which comprises a sensing interaction module, an intelligent scene engine, a multi-mode output module, a cooperative control module and a safety monitoring module. The perception interaction module integrates physiological, action and environment sensors, deeply analyzes explicit instructions and implicit demands (such as inferring emotions through a heart rate variability rate) of a user in combination with a Transform model, and generates a structured interaction intention label; according to the physiological, action and environment multi-dimensional data fusion mechanism, the system can accurately capture the user state, an accurate basis is provided for follow-up scene adjustment, and the fitting degree of interaction response is remarkably improved; the intelligent scene engine constructs a user immersion model through deep reinforcement learning, calculates an immersion index based on parameters such as heart rate, micro-expression and action angular velocity, and dynamically triggers a high immersion, balance or guide mode.

The invention provides a beauty teaching interaction system based on virtual reality, and the system comprises a VR / AR scene engine module which is used for scene modeling and prop modeling, and is used for completing the production of scene assets; the motion capture module is used for establishing hardware equipment and software tools, carrying out motion capture and positioning of students, designing a teaching management background, and carrying out remote interaction and teaching between teachers and the students; the background building module is used for presetting a plurality of scene libraries and carrying out guided learning of the students; the interaction and output module is used for configuring a virtual creation tool and obtaining and exporting a final work; and the exhibition hall display module is used for building a virtual art exhibition hall and carrying out virtual display and work scoring. According to the invention, various beauty teaching situations are constructed through VR / AR and other technologies, so that students can experience artistic works in a virtual scene, carry out diversified artistic creation and accept guidance, and teachers can carry out real-time remote interaction and tutoring, break physical distance limitation and realize immersive artistic learning.

The invention relates to the technical field of artificial intelligence, in particular to an interaction system and method with an emotion dynamic evolution memory function, a medium and a processor. The interactive system comprises a sensing layer, a processing layer and a decision-making layer, the perception layer comprises a semantic text coding module and a fusion processing module; the semantic text coding module outputs the acquired audio as semantic features and high-dimensional features, and performs linear space conversion processing; the fusion processing module and the data output by the semantic text encoding module are linearly spliced to form multi-modal feature vectors, and the multi-modal feature vectors are classified into the current emotion state of the intelligent agent and the emotion state of the user; the processing layer is used for correcting the data output by the sensing layer; and the decision-making layer is used for carrying out information decision-making and storage on the data output by the processing layer. The technical problem that in the prior art, the number of labels is limited, undefined interaction modes are difficult to process, and consequently the character of a robot is limited is solved.

An electronic gaming system is described. The electronic gaming system includes a server computing device configured to receive an input from a first user computing device including a request to initiate an electronic game and assign a plurality of user devices to the electronic game. The server is further configured to identify a second player account as an initial play player account, wherein the initial play player account is designated to initiate a first play of the electronic game. The server is further configured to transmit content to a second user computing device that causes a gameplay user interface at the second user computing device to include a first display area including video images from a video stream from the second user computing device and a second display area including video images received by the server from a video stream received from the first user computing device.

The invention belongs to the field of analogue simulation, and particularly relates to a large language model role interaction system based on plot driving and tool calling, and the system comprises a role mapping module which generates a language-character feature set according to the input of a user; the state library module initializes plot parameters according to the feature set; the plot evolution module is used for driving plot logic based on a plot rule engine and dynamically generating a behavior target, a tone strategy and a tool calling request or a random branch event of a role; the scene behavior constraint module is used for generating a behavior constraint rule set from a multi-scene behavior constraint rule base according to the scene identifier and the plot event; the tool calling module is used for responding to the request and acquiring response result parameters of the external tool; the session generation module is used for synthesizing all the information and driving the large language model to generate coherent role sessions fused with scenes, actions and tools, and personalization, coherence, scene adaptability and function fusion degree of role interaction are improved.

The invention relates to the technical field of intelligent wearing, and discloses an intelligent interaction system and method based on AR glasses. According to the method, an environment scene is intelligently divided, a plurality of interaction areas are generated, then an initial interaction task instruction is received through a user interface, AR glasses are started to execute a task, initial environment data are collected in the execution process, and historical interaction records are obtained. Then, the interaction priority and the attention level of each interaction area are calculated by using the data, so that a customized navigation path is generated. When the AR glasses interact according to the path, position information of the AR glasses is collected in real time, interference source characteristics are obtained, whether the AR glasses enter an interference influence range is detected, if yes, an offset alarm is triggered, whether the AR glasses deviate from a preset path is judged based on the position information, and if not, a path correction command is generated. In addition, real-time visual data can be captured, an abnormal mode or a specific target is analyzed and recognized, and if the abnormal mode or the specific target is recognized, the position information and the corresponding visual data are stored.

The invention discloses a personalized interaction method and system based on multi-modal emotion perception, and relates to the technical field of intelligent interaction, and the method comprises the steps: collecting user historical interaction event data, and extracting interaction content features and user behavior features; obtaining interaction emotion data of the user in real time through a multi-mode sensor; fusing the interactive emotion multi-modal data to generate a dynamic emotion quantized value; generating an emotion correction factor; dynamically generating a personalized interaction strategy; and executing the interaction strategy, and collecting user response data to update a historical interaction event library. The method has the advantages that the key problem that a traditional interaction system is difficult to perceive the real-time emotional state of the user is effectively solved, a closed-loop optimization system of perception-decision-execution-feedback is constructed, and the user interaction satisfaction degree and the situation adaptive capacity of the whole system are continuously improved.

The invention relates to the field of personality simulation interaction, in particular to an occupational personality simulation interaction system and method based on multi-source perception fusion. According to the method, firstly, original interaction data of each mode of a user is quantified into feature vectors, emotion tags of different modes of the user and confidence coefficients of the emotion tags are obtained based on the feature vectors of the modes, conflict rule matching is carried out in a humanization conflict rule base according to the emotion tags of all the modes of the user, and a conflict rule matching result is obtained. Obtaining the actual conflict type and the actual conflict degree of the user, adjusting the weight of each mode according to the actual conflict type and the actual conflict degree of the user and the confidence coefficient of the emotion label of each mode in combination with a humanization conflict strategy library, and obtaining the adjustment priority of each mode of the user; and generating occupational personality response information based on the adjustment priority of each mode of the user. According to the method, behaviors and emotion conflicts of the user can be caught acutely, and misalignment of simulated interaction response information is avoided.

The invention relates to the technical field of intelligent interaction, in particular to an interaction system based on emotion recognition, and the system comprises the steps: collecting multi-modal sensing data and environment context of a user; the feature matching module is used for constructing a first situation feature by utilizing each single-dimensional feature deviation degree obtained by calculating the current multi-modal sensing data of the user and a corresponding coupling feature deviation degree when the first situation is matched, and constructing a second situation feature when the first situation is not matched; constructing a second situational feature by using the deviation degree of each single-dimensional feature obtained by calculating the current multimode sensing data of the user; the emotion risk index calculation module is used for fusing the first situation feature or the second situation feature according to a pre-trained fusion model to obtain an emotion risk index; and the interaction module is used for triggering the interaction strategy of the corresponding level according to the relationship between the emotion risk index and the latest emotion risk threshold. In the emotion recognition process, the current situation type of the user is fused, and the accuracy of emotion recognition is greatly improved.

The invention provides a communication interconnection multi-seat cabin system which comprises seats with a partition seat position detection function and at least one mobile terminal independent of seat cabins, the seats are in wireless communication connection with the mobile terminals, and body position sensing assemblies used for detecting the body states of passengers are arranged on the seats; the multi-seat cockpit system further comprises a game console with a wireless communication interconnection function and a display screen, the seats, the game console, the mobile terminal and the display screen form a multimedia cockpit interaction system, and a passenger sends a posture operation instruction on the seats through the body position sensing assembly to relieve fatigue. According to the invention, not only can a passenger on one automobile seat operate the game, but also passengers on a plurality of automobile seats can interact with each other, so that the communication among a plurality of passengers is facilitated. The posture of a user can be adjusted through the body position sensing assembly, and muscles can be stretched and physical fatigue can be relieved by adjusting the body posture while communication interaction is carried out.

The invention discloses an ancient building VR education interaction system and method based on gesture control and physical feedback, and relates to the technical field of VR intelligent education. Multi-source data of a target ancient building are collected and processed through a data processing method, and then a corresponding target ancient building three-dimensional model is generated based on the processed multi-source data; establishing a VR education scene through a VR engine, establishing a target ancient building education interaction model, formulating an interaction logic rule between a user gesture and the target ancient building education interaction model, analyzing user interaction data, recording corresponding operation through the VR education scene, and setting a physical feedback signal according to the interaction data of the user; finally, interaction data of the user is recorded in real time, the learning progress, interest points and knowledge mastering conditions of the user are evaluated, the presentation mode of VR education content is dynamically adjusted, personalized learning suggestions and guidance are provided, and powerful support is provided for efficient inheritance and high-quality education of historic building culture.

The embodiment of the invention belongs to the technical field of psychological state detection, and discloses a psychological state assessment interaction system and device, and the corresponding system comprises an AI interaction module which is used for interacting with a user and obtaining feedback information of the user in the interaction process, and the feedback information comprises voice reply data, text reply data and physiological data of a question; the deep learning model is used for extracting feature data of the feedback information; the support vector machine model is used for evaluating the psychological state of the user according to the feedback information; input data of a kernel function of the support vector machine model is feature data; and the VR video generation module is used for generating a corresponding VR video according to the psychological state and pushing the VR video to the user, and the VR video has an interaction function with the user so as to further determine a lower state of the psychological state of the user and autonomously modify the VR video according to the lower state. The emotion, cognition and behavior characteristics can be extracted from the dialogue of the user, and the psychological state is quantified.

The invention discloses a multi-mode man-machine interaction system based on hybrid perception, and relates to the technical field of man-machine interaction. According to the invention, through multi-modal data fusion and a dynamic priority mechanism, the environmental adaptability and response efficiency of the interactive terminal are significantly improved; the data acquisition module synchronously acquires a video stream and an audio stream by using a camera and a microphone, and calculates a user distance in combination with an infrared sensor, so that a basic object can be accurately identified in a complex scene, and false marking is avoided; the interaction analysis module constructs a priority scoring system based on distance characteristics and voice energy, so that the interaction priority of near-field users is ensured, active interaction intentions can be captured through the voice energy, and the problem of interaction conflicts in a multi-user scene is solved; and when the target object has no voice signal within the second set time, the system is automatically switched to other sounding basic objects, so that interaction interruption is avoided, and the user experience is improved.

The invention relates to the technical field of education, in particular to a health education interaction system and method based on virtual reality and deep learning. The health education interaction system creatively integrates motion sensing games, VR video teaching, personalized reading and a body measurement motion module, and all-around and immersive learning experience is created; the system motivates the participation degree of a user through a motion sensing game, interactive learning is achieved through VR video teaching, personalized reading meets the requirements of the user, and the health state is monitored through motion measurement. The intelligent analysis module is used for deeply mining data and providing personalized health assessment and suggestions; the self-learning unit continuously optimizes a knowledge base and a recommendation algorithm, and constructs a dynamic health knowledge graph; the system breaks through the limitation of traditional health education, improves the knowledge propagation efficiency and acceptance, effectively promotes the formation and maintenance of health behaviors, and brings revolutionary change to the field of health education.

The invention discloses an interactive system based on a YOLO-CNN face emotional state model and multi-modal behavior response, and the system comprises six modules which are connected in sequence. The system obtains facial emotion features through a face emotion feature extraction module, a multi-modal fusion module fuses the features with voice and limb movement features to generate a fusion feature matrix, an emotion reasoning engine outputs an emotion reasoning result based on the matrix, and a closed-loop reinforcement learning optimization module optimizes a co-emotional response strategy in combination with historical and real-time interaction data. The virtual body interaction control module generates a control instruction, and the virtual body interaction execution module drives the virtual body to complete interaction and feed back data. The system improves the multi-modal information fusion depth and common situation strategy dynamic optimization capability, solves the problems of fusion limitation and strategy optimization lack closed loop in the prior art, adapts to the fields of education, medical treatment and the like, and enhances the human-computer interaction emotion suitability and stability.

The invention discloses a software interaction system and method for promoting virtual-real fusion landing of meta universe, and belongs to the technical field of virtual-real interaction. The method is realized by pure software, and supports two modes of exchanging virtual assets for entity commodities and automatically returning the virtual assets after the entity commodities are purchased. The system accesses a digital platform through a standardized interface to complete asset verification, cancel-after-verification and voucher generation, supports delivery modes such as logistics distribution, store cancel-after-verification and offline self-pick-up, can automatically return virtual assets when purchasing entity commodities, and does not need a user to upload a voucher. The method breaks through the interaction barrier between the digital world and the physical world, is suitable for platforms such as games, movies and televisions, music and cartoons, realizes virtual-real two-way automatic intercommunication, and has high practicability and commercial value.

The invention relates to a game interaction system combined with limb movement induction, and the system comprises an environment sensing module which collects three-dimensional space data in real time to construct a dynamic environment model; the motion capture module is used for acquiring limb motion data through a multi-mode sensor and storing historical motion modes; the game logic analysis module is used for analyzing a demand action sequence, a target moving path and action demand parameters; the action prediction module is used for generating a predicted action sequence and a space coordinate track; the collision risk assessment module is used for calculating the contact probability and danger level of the predicted action and the obstacle; and the dynamic guidance generation module generates an action correction instruction according to the evaluation result. The system provides safe and smooth interaction experience for a user in a complex dynamic environment through accurate collision detection and intelligent action adjustment, not only meets a game target, but also effectively avoids collision, remarkably enhances immersion and operation safety, and is suitable for various limb action sensing game scenes.

The present application relates to gamepad human-computer interaction technical field, specifically, it relates to wired gamepad human-computer interaction system based on multi-modal feedback, it includes reaction arrangement unit, deployment unit and feedback record unit, before the game, user is through to the key position and function grading, then through reaction acquisition module to the reaction time of clicking each key is collected, then through deployment unit to the reaction time sorting, to obtain the reaction time sequence of each key, then key adjustment module is according to reaction time sorting and the grading data of key position and function to each key function adjustment, make the key on gamepad meet the use of user, to avoid the contradiction between the fixed key position on gamepad and the operation of user, improve the adaptation degree between gamepad and user, facilitate the game of user.

The invention discloses an audiovisual multi-mode cross-attention bionic robot emotion interaction system and method. Comprising an audio-visual information acquisition module, an audio emotion feature extraction module, a visual emotion feature extraction module, a cross-modal feature fusion module, an emotion classification and strength estimation module, a bionic expression action generation module and an expression execution module. Audio data and video image data are collected, a first modal emotion feature vector and a second modal emotion feature vector are obtained, the two modals are mutually enhanced on the semantic level, high-precision emotion recognition is achieved through a cross-modal cross attention mechanism, and a robot is driven to complete natural expression actions in combination with a bionic expression library. Therefore, the emotion understanding ability and the interaction feedback level of the robot are improved.

The application provides an information processing method and device and related equipment. The method is applied to a terminal device of a human-computer interaction system. The method comprises the following steps: outputting target machine output content corresponding to a target first plot node of an interaction project. Actual user reply content of a user is acquired. If a first response message sent by a server is received, target customized audio information and target basic audio information are outputted. If a second response message sent by the server is received, it is determined whether the continuous interaction time length of the user is greater than a preset interaction time length. If it is determined that the continuous interaction time length is equal to or greater than the preset interaction time length, the target customized audio information and the target basic audio information are outputted. If it is determined that the continuous interaction time length is less than the preset interaction time length, the target customized audio information is not outputted, and the target basic audio information is outputted. By using the above method, the attention of the user can be effectively attracted, and the concentration of the user when performing the interaction project can be improved.

The invention discloses an interaction system, method and device based on intelligent equipment, equipment and a medium, and relates to the technical field of artificial intelligence. The method comprises the steps that through data communication between terminal equipment and intelligent equipment, the intelligent equipment automatically detects the action execution condition of a second object in a scene with an interaction requirement, and the intelligent equipment executes target interaction content only when the second object meets a state condition, so that the action execution process of the second object is prevented from being disturbed, and the interaction efficiency is improved. And the interaction success probability and the interaction effect are improved.

The invention discloses a card type audio interaction system and method based on a customizable mapping relation. According to the system, through establishing a dynamic mapping relation between a physical card slot state event and a digital audio content, innovative interaction experience of one-time plugging and one-time sound is realized. A user can freely define the mapping relation through a plurality of modes such as mobile application, webpage interface or voice, so that the same hardware platform can adapt to a plurality of application scenes such as daily card management and creative music production. The mapping framework provided by the invention is independent of specific hardware implementation, has high universality and expansibility, and provides a new technical solution for the field of human-computer interaction.

The application discloses a body intelligent agent interaction system and a control method, and relates to the technical field of artificial intelligence. The method comprises the following steps: a terminal sensor module is configured to collect physical signals of environment or user interaction, and generate standardized event data; a reflection processing module comprises a lightweight decision unit, which is used for receiving scene labels and user feedback information to self-optimize protected core behavior logic, and deep evolution is performed after a growth authorization signal is received; a narrative processing module is used for processing complex interaction cognition, generating scene labels and sending the scene labels to the reflection processing module, sending an inhibition instruction and a growth authorization signal to the reflection processing module, and performing context interpretation; wherein, the reflection processing module and the narrative processing module communicate through a preset interface, and the narrative processing module has no right to directly modify the core behavior logic; the system guarantees the explanation right and adjustment right of the narrative layer to the reflection layer, and prevents tampering of the core instinct at runtime through strict permission isolation.