174 results about "Interaction systems" patented technology

The invention discloses a digital human interaction system based on a web end, relates to the technical field of digital human interaction, and aims to solve the problem of accumulated dislocation of browser end digital population animation and actual audio playback caused by multiple clocks and buffer scheduling. The system comprises a visual position cooperative control module, a session initialization module, an audio track and rendering canvas binding module, a multi-domain alignment time base cluster establishment module, construction of a time base cluster containing a system reference sub-time base and a content logic sub-time base, potential candidate anchor point generation module, an optimal anchor point selection module, synchronization error calculation, and judgment of a synchronization steady state, a fine adjustment state or a lost state. An optimal anchor point is screened to adjust the animation, and a visual effect studio dynamic maintenance module and an enhancement generation module assist in out-of-step processing and parameter optimization; through cooperation of multiple modules, accurate synchronization of audio and digital human animation is realized.

The invention belongs to the field of vehicles, and discloses a cabin active conversation method and system, and the method comprises the steps: obtaining user information and vehicle information, and determining a user portrait; matching a corresponding active dialogue type in a preset database based on the user portrait; and determining a trigger score of the active dialogue type based on the user portrait, and triggering a corresponding active dialogue when the trigger score meets a preset condition. According to the method and the system, user demands and preferences can be accurately grasped, and personalization and scene adaptability of dialogue contents can be ensured. Meanwhile, the triggering score of the active dialogue type is determined according to the user portrait, the dialogue can be triggered at a proper time, dialogue triggering does not depend on a preset fixed logic or scene any more, dynamic decision making is carried out based on real-time and personalized data, the method can adapt to complex and changeable driving scenes and user requirements, and the user experience is improved. The intelligence and initiative of the vehicle-mounted voice interaction system are effectively improved, and the user experience is enhanced.

The invention relates to the technical field of interactive systems, and particularly discloses a game motor home interactive demonstration control system which comprises a sensing interaction module, an intelligent scene engine, a multi-mode output module, a cooperative control module and a safety monitoring module. The perception interaction module integrates physiological, action and environment sensors, deeply analyzes explicit instructions and implicit demands (such as inferring emotions through a heart rate variability rate) of a user in combination with a Transform model, and generates a structured interaction intention label; according to the physiological, action and environment multi-dimensional data fusion mechanism, the system can accurately capture the user state, an accurate basis is provided for follow-up scene adjustment, and the fitting degree of interaction response is remarkably improved; the intelligent scene engine constructs a user immersion model through deep reinforcement learning, calculates an immersion index based on parameters such as heart rate, micro-expression and action angular velocity, and dynamically triggers a high immersion, balance or guide mode.

The invention relates to the technical field of artificial intelligence, in particular to an interaction system and method with an emotion dynamic evolution memory function, a medium and a processor. The interactive system comprises a sensing layer, a processing layer and a decision-making layer, the perception layer comprises a semantic text coding module and a fusion processing module; the semantic text coding module outputs the acquired audio as semantic features and high-dimensional features, and performs linear space conversion processing; the fusion processing module and the data output by the semantic text encoding module are linearly spliced to form multi-modal feature vectors, and the multi-modal feature vectors are classified into the current emotion state of the intelligent agent and the emotion state of the user; the processing layer is used for correcting the data output by the sensing layer; and the decision-making layer is used for carrying out information decision-making and storage on the data output by the processing layer. The technical problem that in the prior art, the number of labels is limited, undefined interaction modes are difficult to process, and consequently the character of a robot is limited is solved.

An electronic gaming system is described. The electronic gaming system includes a server computing device configured to receive an input from a first user computing device including a request to initiate an electronic game and assign a plurality of user devices to the electronic game. The server is further configured to identify a second player account as an initial play player account, wherein the initial play player account is designated to initiate a first play of the electronic game. The server is further configured to transmit content to a second user computing device that causes a gameplay user interface at the second user computing device to include a first display area including video images from a video stream from the second user computing device and a second display area including video images received by the server from a video stream received from the first user computing device.

The invention belongs to the field of analogue simulation, and particularly relates to a large language model role interaction system based on plot driving and tool calling, and the system comprises a role mapping module which generates a language-character feature set according to the input of a user; the state library module initializes plot parameters according to the feature set; the plot evolution module is used for driving plot logic based on a plot rule engine and dynamically generating a behavior target, a tone strategy and a tool calling request or a random branch event of a role; the scene behavior constraint module is used for generating a behavior constraint rule set from a multi-scene behavior constraint rule base according to the scene identifier and the plot event; the tool calling module is used for responding to the request and acquiring response result parameters of the external tool; the session generation module is used for synthesizing all the information and driving the large language model to generate coherent role sessions fused with scenes, actions and tools, and personalization, coherence, scene adaptability and function fusion degree of role interaction are improved.

The invention relates to the technical field of intelligent wearing, and discloses an intelligent interaction system and method based on AR glasses. According to the method, an environment scene is intelligently divided, a plurality of interaction areas are generated, then an initial interaction task instruction is received through a user interface, AR glasses are started to execute a task, initial environment data are collected in the execution process, and historical interaction records are obtained. Then, the interaction priority and the attention level of each interaction area are calculated by using the data, so that a customized navigation path is generated. When the AR glasses interact according to the path, position information of the AR glasses is collected in real time, interference source characteristics are obtained, whether the AR glasses enter an interference influence range is detected, if yes, an offset alarm is triggered, whether the AR glasses deviate from a preset path is judged based on the position information, and if not, a path correction command is generated. In addition, real-time visual data can be captured, an abnormal mode or a specific target is analyzed and recognized, and if the abnormal mode or the specific target is recognized, the position information and the corresponding visual data are stored.

The invention discloses a personalized interaction method and system based on multi-modal emotion perception, and relates to the technical field of intelligent interaction, and the method comprises the steps: collecting user historical interaction event data, and extracting interaction content features and user behavior features; obtaining interaction emotion data of the user in real time through a multi-mode sensor; fusing the interactive emotion multi-modal data to generate a dynamic emotion quantized value; generating an emotion correction factor; dynamically generating a personalized interaction strategy; and executing the interaction strategy, and collecting user response data to update a historical interaction event library. The method has the advantages that the key problem that a traditional interaction system is difficult to perceive the real-time emotional state of the user is effectively solved, a closed-loop optimization system of perception-decision-execution-feedback is constructed, and the user interaction satisfaction degree and the situation adaptive capacity of the whole system are continuously improved.

The invention relates to the field of personality simulation interaction, in particular to an occupational personality simulation interaction system and method based on multi-source perception fusion. According to the method, firstly, original interaction data of each mode of a user is quantified into feature vectors, emotion tags of different modes of the user and confidence coefficients of the emotion tags are obtained based on the feature vectors of the modes, conflict rule matching is carried out in a humanization conflict rule base according to the emotion tags of all the modes of the user, and a conflict rule matching result is obtained. Obtaining the actual conflict type and the actual conflict degree of the user, adjusting the weight of each mode according to the actual conflict type and the actual conflict degree of the user and the confidence coefficient of the emotion label of each mode in combination with a humanization conflict strategy library, and obtaining the adjustment priority of each mode of the user; and generating occupational personality response information based on the adjustment priority of each mode of the user. According to the method, behaviors and emotion conflicts of the user can be caught acutely, and misalignment of simulated interaction response information is avoided.

The invention relates to the technical field of intelligent interaction, in particular to an interaction system based on emotion recognition, and the system comprises the steps: collecting multi-modal sensing data and environment context of a user; the feature matching module is used for constructing a first situation feature by utilizing each single-dimensional feature deviation degree obtained by calculating the current multi-modal sensing data of the user and a corresponding coupling feature deviation degree when the first situation is matched, and constructing a second situation feature when the first situation is not matched; constructing a second situational feature by using the deviation degree of each single-dimensional feature obtained by calculating the current multimode sensing data of the user; the emotion risk index calculation module is used for fusing the first situation feature or the second situation feature according to a pre-trained fusion model to obtain an emotion risk index; and the interaction module is used for triggering the interaction strategy of the corresponding level according to the relationship between the emotion risk index and the latest emotion risk threshold. In the emotion recognition process, the current situation type of the user is fused, and the accuracy of emotion recognition is greatly improved.

The invention provides a communication interconnection multi-seat cabin system which comprises seats with a partition seat position detection function and at least one mobile terminal independent of seat cabins, the seats are in wireless communication connection with the mobile terminals, and body position sensing assemblies used for detecting the body states of passengers are arranged on the seats; the multi-seat cockpit system further comprises a game console with a wireless communication interconnection function and a display screen, the seats, the game console, the mobile terminal and the display screen form a multimedia cockpit interaction system, and a passenger sends a posture operation instruction on the seats through the body position sensing assembly to relieve fatigue. According to the invention, not only can a passenger on one automobile seat operate the game, but also passengers on a plurality of automobile seats can interact with each other, so that the communication among a plurality of passengers is facilitated. The posture of a user can be adjusted through the body position sensing assembly, and muscles can be stretched and physical fatigue can be relieved by adjusting the body posture while communication interaction is carried out.

The invention discloses an ancient building VR education interaction system and method based on gesture control and physical feedback, and relates to the technical field of VR intelligent education. Multi-source data of a target ancient building are collected and processed through a data processing method, and then a corresponding target ancient building three-dimensional model is generated based on the processed multi-source data; establishing a VR education scene through a VR engine, establishing a target ancient building education interaction model, formulating an interaction logic rule between a user gesture and the target ancient building education interaction model, analyzing user interaction data, recording corresponding operation through the VR education scene, and setting a physical feedback signal according to the interaction data of the user; finally, interaction data of the user is recorded in real time, the learning progress, interest points and knowledge mastering conditions of the user are evaluated, the presentation mode of VR education content is dynamically adjusted, personalized learning suggestions and guidance are provided, and powerful support is provided for efficient inheritance and high-quality education of historic building culture.

The embodiment of the invention belongs to the technical field of psychological state detection, and discloses a psychological state assessment interaction system and device, and the corresponding system comprises an AI interaction module which is used for interacting with a user and obtaining feedback information of the user in the interaction process, and the feedback information comprises voice reply data, text reply data and physiological data of a question; the deep learning model is used for extracting feature data of the feedback information; the support vector machine model is used for evaluating the psychological state of the user according to the feedback information; input data of a kernel function of the support vector machine model is feature data; and the VR video generation module is used for generating a corresponding VR video according to the psychological state and pushing the VR video to the user, and the VR video has an interaction function with the user so as to further determine a lower state of the psychological state of the user and autonomously modify the VR video according to the lower state. The emotion, cognition and behavior characteristics can be extracted from the dialogue of the user, and the psychological state is quantified.

The invention discloses a multi-mode man-machine interaction system based on hybrid perception, and relates to the technical field of man-machine interaction. According to the invention, through multi-modal data fusion and a dynamic priority mechanism, the environmental adaptability and response efficiency of the interactive terminal are significantly improved; the data acquisition module synchronously acquires a video stream and an audio stream by using a camera and a microphone, and calculates a user distance in combination with an infrared sensor, so that a basic object can be accurately identified in a complex scene, and false marking is avoided; the interaction analysis module constructs a priority scoring system based on distance characteristics and voice energy, so that the interaction priority of near-field users is ensured, active interaction intentions can be captured through the voice energy, and the problem of interaction conflicts in a multi-user scene is solved; and when the target object has no voice signal within the second set time, the system is automatically switched to other sounding basic objects, so that interaction interruption is avoided, and the user experience is improved.

The invention discloses an interactive system based on a YOLO-CNN face emotional state model and multi-modal behavior response, and the system comprises six modules which are connected in sequence. The system obtains facial emotion features through a face emotion feature extraction module, a multi-modal fusion module fuses the features with voice and limb movement features to generate a fusion feature matrix, an emotion reasoning engine outputs an emotion reasoning result based on the matrix, and a closed-loop reinforcement learning optimization module optimizes a co-emotional response strategy in combination with historical and real-time interaction data. The virtual body interaction control module generates a control instruction, and the virtual body interaction execution module drives the virtual body to complete interaction and feed back data. The system improves the multi-modal information fusion depth and common situation strategy dynamic optimization capability, solves the problems of fusion limitation and strategy optimization lack closed loop in the prior art, adapts to the fields of education, medical treatment and the like, and enhances the human-computer interaction emotion suitability and stability.

The invention discloses a software interaction system and method for promoting virtual-real fusion landing of meta universe, and belongs to the technical field of virtual-real interaction. The method is realized by pure software, and supports two modes of exchanging virtual assets for entity commodities and automatically returning the virtual assets after the entity commodities are purchased. The system accesses a digital platform through a standardized interface to complete asset verification, cancel-after-verification and voucher generation, supports delivery modes such as logistics distribution, store cancel-after-verification and offline self-pick-up, can automatically return virtual assets when purchasing entity commodities, and does not need a user to upload a voucher. The method breaks through the interaction barrier between the digital world and the physical world, is suitable for platforms such as games, movies and televisions, music and cartoons, realizes virtual-real two-way automatic intercommunication, and has high practicability and commercial value.

The present application relates to gamepad human-computer interaction technical field, specifically, it relates to wired gamepad human-computer interaction system based on multi-modal feedback, it includes reaction arrangement unit, deployment unit and feedback record unit, before the game, user is through to the key position and function grading, then through reaction acquisition module to the reaction time of clicking each key is collected, then through deployment unit to the reaction time sorting, to obtain the reaction time sequence of each key, then key adjustment module is according to reaction time sorting and the grading data of key position and function to each key function adjustment, make the key on gamepad meet the use of user, to avoid the contradiction between the fixed key position on gamepad and the operation of user, improve the adaptation degree between gamepad and user, facilitate the game of user.

The invention discloses an audiovisual multi-mode cross-attention bionic robot emotion interaction system and method. Comprising an audio-visual information acquisition module, an audio emotion feature extraction module, a visual emotion feature extraction module, a cross-modal feature fusion module, an emotion classification and strength estimation module, a bionic expression action generation module and an expression execution module. Audio data and video image data are collected, a first modal emotion feature vector and a second modal emotion feature vector are obtained, the two modals are mutually enhanced on the semantic level, high-precision emotion recognition is achieved through a cross-modal cross attention mechanism, and a robot is driven to complete natural expression actions in combination with a bionic expression library. Therefore, the emotion understanding ability and the interaction feedback level of the robot are improved.

The application provides an information processing method and device and related equipment. The method is applied to a terminal device of a human-computer interaction system. The method comprises the following steps: outputting target machine output content corresponding to a target first plot node of an interaction project. Actual user reply content of a user is acquired. If a first response message sent by a server is received, target customized audio information and target basic audio information are outputted. If a second response message sent by the server is received, it is determined whether the continuous interaction time length of the user is greater than a preset interaction time length. If it is determined that the continuous interaction time length is equal to or greater than the preset interaction time length, the target customized audio information and the target basic audio information are outputted. If it is determined that the continuous interaction time length is less than the preset interaction time length, the target customized audio information is not outputted, and the target basic audio information is outputted. By using the above method, the attention of the user can be effectively attracted, and the concentration of the user when performing the interaction project can be improved.

The invention discloses an interaction system, method and device based on intelligent equipment, equipment and a medium, and relates to the technical field of artificial intelligence. The method comprises the steps that through data communication between terminal equipment and intelligent equipment, the intelligent equipment automatically detects the action execution condition of a second object in a scene with an interaction requirement, and the intelligent equipment executes target interaction content only when the second object meets a state condition, so that the action execution process of the second object is prevented from being disturbed, and the interaction efficiency is improved. And the interaction success probability and the interaction effect are improved.

The invention discloses a card type audio interaction system and method based on a customizable mapping relation. According to the system, through establishing a dynamic mapping relation between a physical card slot state event and a digital audio content, innovative interaction experience of one-time plugging and one-time sound is realized. A user can freely define the mapping relation through a plurality of modes such as mobile application, webpage interface or voice, so that the same hardware platform can adapt to a plurality of application scenes such as daily card management and creative music production. The mapping framework provided by the invention is independent of specific hardware implementation, has high universality and expansibility, and provides a new technical solution for the field of human-computer interaction.

The application discloses a body intelligent agent interaction system and a control method, and relates to the technical field of artificial intelligence. The method comprises the following steps: a terminal sensor module is configured to collect physical signals of environment or user interaction, and generate standardized event data; a reflection processing module comprises a lightweight decision unit, which is used for receiving scene labels and user feedback information to self-optimize protected core behavior logic, and deep evolution is performed after a growth authorization signal is received; a narrative processing module is used for processing complex interaction cognition, generating scene labels and sending the scene labels to the reflection processing module, sending an inhibition instruction and a growth authorization signal to the reflection processing module, and performing context interpretation; wherein, the reflection processing module and the narrative processing module communicate through a preset interface, and the narrative processing module has no right to directly modify the core behavior logic; the system guarantees the explanation right and adjustment right of the narrative layer to the reflection layer, and prevents tampering of the core instinct at runtime through strict permission isolation.

Methods and systems are disclosed for suggesting a scene of an image using one or more machine learning models based on detected events. The methods and systems detect an event associated with a second user through an interaction system associated with a first user, and generate a prompt including the event and a request for a plurality of scenarios associated with the event. The method and system processes the cues through a large language model (LLM) to generate a plurality of scenes related to the event, and presents individual content items corresponding to individual ones of the plurality of scenes.

This application discloses a voice interaction system and method based on an edge-based large model. The system's terminal integrates three modules—an automatic speech recognition module, a speech synthesis module, and a lightweight large model—in a local offline environment. This enables localized core processing of speech recognition, semantic understanding, response generation, and voice playback, reducing reliance on the network, lowering interaction latency, and avoiding the uploading of voice data to the cloud, thus mitigating the risk of data privacy leaks at the source. By calling a cloud-based vector knowledge base for professional knowledge retrieval, the system compensates for the limitations of local terminal knowledge storage. Combined with the reasoning and generation capabilities of the local offline large model, the accuracy of knowledge-based question answering is significantly improved, addressing the weakness of purely local solutions in terms of interaction capabilities. Furthermore, the cloud only provides knowledge retrieval services, ensuring the professionalism and accuracy of knowledge retrieval while avoiding cloud involvement in the terminal's local interaction process, further reducing edge-cloud interaction latency and improving interaction security.

The application discloses an immersive no-wearing motion capture digital human body feeling interaction system and relates to the technical field of human-computer interaction.The system comprises a scene simulation layer, a character simulation layer and a motion simulation layer.The scene simulation layer is responsible for building and simulating the whole simulation environment or background, and provides a lifelike background for characters and motions.The character simulation layer is responsible for simulating the character roles in the simulation, and realizes a virtual human model with a film-level real sense.The motion simulation layer is responsible for simulating the specific motions of the character roles, and is responsible for processing the interaction between the characters and the environment.The immersive no-wearing motion capture digital human body feeling interaction system is based on the double-computing mainboard hardware architecture created by the application, and realizes the output of better interaction effects under the demand of lower hardware computing power through the full-stack algorithm optimization from the code bottom layer to the application layer, so that the low-delay and high-natural digital human body feeling interaction is realized.

According to the heterogeneous resource-oriented virtual power plant hierarchical clustering-cooperative game aggregation and trusted interaction system provided by the invention, refined and structured representation of a strong heterogeneous resource set is realized by constructing a dynamic digital twinborn archive and adaptive clustering of resources, and a hybrid prediction model fusing physical rules and data driving is adopted, so that the reliability of the system is improved, and the reliability of the system is improved. Physical rationality of behavior prediction and quantitative capture of uncertainty are ensured; through a hierarchical distributed optimization architecture of a master-slave-alliance collaborative game, a global complex optimization problem is efficiently decoupled, and real-time collaborative optimal scheduling under large-scale resource access is realized while privacy and autonomy of a resource main body are protected; through an online rolling credibility regulation capability interval evaluation mechanism, a diversified capability vector with a confidence level is output, so that the virtual power plant becomes a reliable transaction object which is transparent to a power grid and has a risk known, and the interaction credibility and credit rating of the virtual power plant in the power market are fundamentally enhanced.

The invention provides an interaction device and an interaction system. The interaction device of the finger type wearable structure comprises a function module and an electronic unit, and the electronic unit arranged in the function module is used for being in communication connection with the electronic unit of the intelligent glasses. Wherein the interaction equipment can be selectively fixed with or separated from the intelligent glasses. And when separated from the intelligent glasses, the functional module can perform first function interaction with the intelligent glasses, so that the interaction requirement of a strong interaction scene can be met. And when fixed with the intelligent glasses, the functional module can perform second function interaction with the intelligent glasses, so that the interaction requirement of a weak interaction scene can be met. While the interaction requirement of the strong interaction scene is met, the use complexity of the interaction equipment in the weak interaction scene is reduced, and the use immersion of the user in the weak interaction scene is improved. Moreover, the interaction equipment is small in size and regular in shape, and can be directly fixed on the intelligent glasses, so that the portability and the storage performance of the interaction equipment are greatly improved.

A method includes determining that a first user of an interaction system participates in an interaction function with a second user of the interaction system. The method further includes accessing profile data of the first user; and determining, based on the profile data, whether the first user has captured or designated a first user's own image for use in the interaction function. In response to determining that a first user has not captured or specifies a first user's own image, the method comprises: accessing a media content item comprising a role; identifying a head portion of a character in the media content item; replacing the head part with a placeholder space; and displaying the media content item with the placeholder space in a user interface corresponding to the interaction function.

A sender holds a first platform account with an interaction system. The sender selects a content item to be shared with a recipient. In response to determining that a recipient identifier of the recipient is not linked to a platform account, an off-platform communication is transmitted to a second user device associated with the recipient identifier. The off-platform communication is in an electronic format supported by the second user device and contains a user-selectable registration link. In response to detecting establishment of a second platform account linked to the recipient identifier, the recipient is enabled to access the content item on the second user device via a user interface provided by an interaction application. A relationship between the first platform account and the second platform account is established within the interaction system.

The utility model belongs to the technical field of interaction, and provides an automatic on-off circuit, a video exhibition stand and an interaction system. The circuit comprises a detection module, a control module and an interface module, the detection module is arranged on a lens arm of the video exhibition stand, the control module is connected with the detection module and the interface module, and the interface module is used for being connected with terminal equipment. The detection module sends a first signal to the control module when the lens arm is unfolded; the control module sends a first instruction to the interface module according to the first signal; the interface module transmits the first instruction to the terminal equipment, so that the terminal equipment opens exhibition platform software according to the first instruction; the detection module also sends a second signal to the control module when the lens arm is closed; the control module further sends a second instruction to the interface module according to the second signal; and the interface module further transmits the second instruction to the terminal equipment, so that the terminal equipment closes the exhibition platform software according to the second instruction. According to the application, the opening or closing of the exhibition stand software can be automatically triggered only by unfolding or closing the lens arm.