104 results about "Interaction systems" patented technology

The invention relates to the technical field of artificial intelligence, in particular to an interaction system and method with an emotion dynamic evolution memory function, a medium and a processor. The interactive system comprises a sensing layer, a processing layer and a decision-making layer, the perception layer comprises a semantic text coding module and a fusion processing module; the semantic text coding module outputs the acquired audio as semantic features and high-dimensional features, and performs linear space conversion processing; the fusion processing module and the data output by the semantic text encoding module are linearly spliced to form multi-modal feature vectors, and the multi-modal feature vectors are classified into the current emotion state of the intelligent agent and the emotion state of the user; the processing layer is used for correcting the data output by the sensing layer; and the decision-making layer is used for carrying out information decision-making and storage on the data output by the processing layer. The technical problem that in the prior art, the number of labels is limited, undefined interaction modes are difficult to process, and consequently the character of a robot is limited is solved.

The invention belongs to the field of analogue simulation, and particularly relates to a large language model role interaction system based on plot driving and tool calling, and the system comprises a role mapping module which generates a language-character feature set according to the input of a user; the state library module initializes plot parameters according to the feature set; the plot evolution module is used for driving plot logic based on a plot rule engine and dynamically generating a behavior target, a tone strategy and a tool calling request or a random branch event of a role; the scene behavior constraint module is used for generating a behavior constraint rule set from a multi-scene behavior constraint rule base according to the scene identifier and the plot event; the tool calling module is used for responding to the request and acquiring response result parameters of the external tool; the session generation module is used for synthesizing all the information and driving the large language model to generate coherent role sessions fused with scenes, actions and tools, and personalization, coherence, scene adaptability and function fusion degree of role interaction are improved.

The invention relates to the technical field of intelligent interaction, in particular to an interaction system based on emotion recognition, and the system comprises the steps: collecting multi-modal sensing data and environment context of a user; the feature matching module is used for constructing a first situation feature by utilizing each single-dimensional feature deviation degree obtained by calculating the current multi-modal sensing data of the user and a corresponding coupling feature deviation degree when the first situation is matched, and constructing a second situation feature when the first situation is not matched; constructing a second situational feature by using the deviation degree of each single-dimensional feature obtained by calculating the current multimode sensing data of the user; the emotion risk index calculation module is used for fusing the first situation feature or the second situation feature according to a pre-trained fusion model to obtain an emotion risk index; and the interaction module is used for triggering the interaction strategy of the corresponding level according to the relationship between the emotion risk index and the latest emotion risk threshold. In the emotion recognition process, the current situation type of the user is fused, and the accuracy of emotion recognition is greatly improved.

The invention discloses an ancient building VR education interaction system and method based on gesture control and physical feedback, and relates to the technical field of VR intelligent education. Multi-source data of a target ancient building are collected and processed through a data processing method, and then a corresponding target ancient building three-dimensional model is generated based on the processed multi-source data; establishing a VR education scene through a VR engine, establishing a target ancient building education interaction model, formulating an interaction logic rule between a user gesture and the target ancient building education interaction model, analyzing user interaction data, recording corresponding operation through the VR education scene, and setting a physical feedback signal according to the interaction data of the user; finally, interaction data of the user is recorded in real time, the learning progress, interest points and knowledge mastering conditions of the user are evaluated, the presentation mode of VR education content is dynamically adjusted, personalized learning suggestions and guidance are provided, and powerful support is provided for efficient inheritance and high-quality education of historic building culture.

The invention discloses a software interaction system and method for promoting virtual-real fusion landing of meta universe, and belongs to the technical field of virtual-real interaction. The method is realized by pure software, and supports two modes of exchanging virtual assets for entity commodities and automatically returning the virtual assets after the entity commodities are purchased. The system accesses a digital platform through a standardized interface to complete asset verification, cancel-after-verification and voucher generation, supports delivery modes such as logistics distribution, store cancel-after-verification and offline self-pick-up, can automatically return virtual assets when purchasing entity commodities, and does not need a user to upload a voucher. The method breaks through the interaction barrier between the digital world and the physical world, is suitable for platforms such as games, movies and televisions, music and cartoons, realizes virtual-real two-way automatic intercommunication, and has high practicability and commercial value.

The present application relates to gamepad human-computer interaction technical field, specifically, it relates to wired gamepad human-computer interaction system based on multi-modal feedback, it includes reaction arrangement unit, deployment unit and feedback record unit, before the game, user is through to the key position and function grading, then through reaction acquisition module to the reaction time of clicking each key is collected, then through deployment unit to the reaction time sorting, to obtain the reaction time sequence of each key, then key adjustment module is according to reaction time sorting and the grading data of key position and function to each key function adjustment, make the key on gamepad meet the use of user, to avoid the contradiction between the fixed key position on gamepad and the operation of user, improve the adaptation degree between gamepad and user, facilitate the game of user.

The invention discloses an audiovisual multi-mode cross-attention bionic robot emotion interaction system and method. Comprising an audio-visual information acquisition module, an audio emotion feature extraction module, a visual emotion feature extraction module, a cross-modal feature fusion module, an emotion classification and strength estimation module, a bionic expression action generation module and an expression execution module. Audio data and video image data are collected, a first modal emotion feature vector and a second modal emotion feature vector are obtained, the two modals are mutually enhanced on the semantic level, high-precision emotion recognition is achieved through a cross-modal cross attention mechanism, and a robot is driven to complete natural expression actions in combination with a bionic expression library. Therefore, the emotion understanding ability and the interaction feedback level of the robot are improved.

The application provides an information processing method and device and related equipment. The method is applied to a terminal device of a human-computer interaction system. The method comprises the following steps: outputting target machine output content corresponding to a target first plot node of an interaction project. Actual user reply content of a user is acquired. If a first response message sent by a server is received, target customized audio information and target basic audio information are outputted. If a second response message sent by the server is received, it is determined whether the continuous interaction time length of the user is greater than a preset interaction time length. If it is determined that the continuous interaction time length is equal to or greater than the preset interaction time length, the target customized audio information and the target basic audio information are outputted. If it is determined that the continuous interaction time length is less than the preset interaction time length, the target customized audio information is not outputted, and the target basic audio information is outputted. By using the above method, the attention of the user can be effectively attracted, and the concentration of the user when performing the interaction project can be improved.

The invention discloses an interaction system, method and device based on intelligent equipment, equipment and a medium, and relates to the technical field of artificial intelligence. The method comprises the steps that through data communication between terminal equipment and intelligent equipment, the intelligent equipment automatically detects the action execution condition of a second object in a scene with an interaction requirement, and the intelligent equipment executes target interaction content only when the second object meets a state condition, so that the action execution process of the second object is prevented from being disturbed, and the interaction efficiency is improved. And the interaction success probability and the interaction effect are improved.

The application discloses a body intelligent agent interaction system and a control method, and relates to the technical field of artificial intelligence. The method comprises the following steps: a terminal sensor module is configured to collect physical signals of environment or user interaction, and generate standardized event data; a reflection processing module comprises a lightweight decision unit, which is used for receiving scene labels and user feedback information to self-optimize protected core behavior logic, and deep evolution is performed after a growth authorization signal is received; a narrative processing module is used for processing complex interaction cognition, generating scene labels and sending the scene labels to the reflection processing module, sending an inhibition instruction and a growth authorization signal to the reflection processing module, and performing context interpretation; wherein, the reflection processing module and the narrative processing module communicate through a preset interface, and the narrative processing module has no right to directly modify the core behavior logic; the system guarantees the explanation right and adjustment right of the narrative layer to the reflection layer, and prevents tampering of the core instinct at runtime through strict permission isolation.

Methods and systems are disclosed for suggesting a scene of an image using one or more machine learning models based on detected events. The methods and systems detect an event associated with a second user through an interaction system associated with a first user, and generate a prompt including the event and a request for a plurality of scenarios associated with the event. The method and system processes the cues through a large language model (LLM) to generate a plurality of scenes related to the event, and presents individual content items corresponding to individual ones of the plurality of scenes.

This application discloses a voice interaction system and method based on an edge-based large model. The system's terminal integrates three modules—an automatic speech recognition module, a speech synthesis module, and a lightweight large model—in a local offline environment. This enables localized core processing of speech recognition, semantic understanding, response generation, and voice playback, reducing reliance on the network, lowering interaction latency, and avoiding the uploading of voice data to the cloud, thus mitigating the risk of data privacy leaks at the source. By calling a cloud-based vector knowledge base for professional knowledge retrieval, the system compensates for the limitations of local terminal knowledge storage. Combined with the reasoning and generation capabilities of the local offline large model, the accuracy of knowledge-based question answering is significantly improved, addressing the weakness of purely local solutions in terms of interaction capabilities. Furthermore, the cloud only provides knowledge retrieval services, ensuring the professionalism and accuracy of knowledge retrieval while avoiding cloud involvement in the terminal's local interaction process, further reducing edge-cloud interaction latency and improving interaction security.

According to the heterogeneous resource-oriented virtual power plant hierarchical clustering-cooperative game aggregation and trusted interaction system provided by the invention, refined and structured representation of a strong heterogeneous resource set is realized by constructing a dynamic digital twinborn archive and adaptive clustering of resources, and a hybrid prediction model fusing physical rules and data driving is adopted, so that the reliability of the system is improved, and the reliability of the system is improved. Physical rationality of behavior prediction and quantitative capture of uncertainty are ensured; through a hierarchical distributed optimization architecture of a master-slave-alliance collaborative game, a global complex optimization problem is efficiently decoupled, and real-time collaborative optimal scheduling under large-scale resource access is realized while privacy and autonomy of a resource main body are protected; through an online rolling credibility regulation capability interval evaluation mechanism, a diversified capability vector with a confidence level is output, so that the virtual power plant becomes a reliable transaction object which is transparent to a power grid and has a risk known, and the interaction credibility and credit rating of the virtual power plant in the power market are fundamentally enhanced.

A method includes determining that a first user of an interaction system participates in an interaction function with a second user of the interaction system. The method further includes accessing profile data of the first user; and determining, based on the profile data, whether the first user has captured or designated a first user's own image for use in the interaction function. In response to determining that a first user has not captured or specifies a first user's own image, the method comprises: accessing a media content item comprising a role; identifying a head portion of a character in the media content item; replacing the head part with a placeholder space; and displaying the media content item with the placeholder space in a user interface corresponding to the interaction function.

A sender holds a first platform account with an interaction system. The sender selects a content item to be shared with a recipient. In response to determining that a recipient identifier of the recipient is not linked to a platform account, an off-platform communication is transmitted to a second user device associated with the recipient identifier. The off-platform communication is in an electronic format supported by the second user device and contains a user-selectable registration link. In response to detecting establishment of a second platform account linked to the recipient identifier, the recipient is enabled to access the content item on the second user device via a user interface provided by an interaction application. A relationship between the first platform account and the second platform account is established within the interaction system.

The utility model belongs to the technical field of interaction, and provides an automatic on-off circuit, a video exhibition stand and an interaction system. The circuit comprises a detection module, a control module and an interface module, the detection module is arranged on a lens arm of the video exhibition stand, the control module is connected with the detection module and the interface module, and the interface module is used for being connected with terminal equipment. The detection module sends a first signal to the control module when the lens arm is unfolded; the control module sends a first instruction to the interface module according to the first signal; the interface module transmits the first instruction to the terminal equipment, so that the terminal equipment opens exhibition platform software according to the first instruction; the detection module also sends a second signal to the control module when the lens arm is closed; the control module further sends a second instruction to the interface module according to the second signal; and the interface module further transmits the second instruction to the terminal equipment, so that the terminal equipment closes the exhibition platform software according to the second instruction. According to the application, the opening or closing of the exhibition stand software can be automatically triggered only by unfolding or closing the lens arm.

This invention discloses a personalized digital family member replication, persona reshaping, and immersive interactive system based on AI and VR, belonging to the fields of artificial intelligence and virtual reality technology. The invention first collects multi-source data such as images, voice, text, and feature tags to complete 3D digital human reconstruction, personality logic, and unique voiceprint replication. Then, it supports user-customizable switching between various personas such as poet, singer, and storyteller. Combined with affective computing technology, it achieves anthropomorphic two-way interaction, enabling functions such as dialogue, singing, recitation, and knowledge explanation. Next, a VR engine is used to build virtual scenes, achieving immersive face-to-face interaction. Finally, the data is encrypted and stored in the cloud with tiered access permissions. This invention highly restores the real characteristics of the person, offers flexible and configurable personas, rich interactive forms, and a strong immersive experience. It can realize family remembrance and emotional comfort, as well as the digital inheritance of family knowledge and traditions, with a wide range of applications and high security.

A third-party user input content item is presented. A content sharing function is invoked responsive to determining user selection of a content sharing graphical element. The content sharing function comprises presentation of a destination graphical element identifying a first content sharing destination. The first content sharing destination is locked. A combination graphical element is user-selectable to invoke a combination function. Responsive to determining user selection of the combination graphical element, the combination function is invoked to access a second user input content item and combine the third-party user input content item with the second user input content item to create a combined user input content item. The first content sharing destination is unlocked and the user is enabled to share the combined user input content item to the unlocked first content sharing destination.

The invention discloses a multi-degree-of-freedom force feedback exoskeleton manipulator for virtual reality, and relates to the technical field of man-machine interaction equipment, the multi-degree-of-freedom force feedback exoskeleton manipulator for virtual reality comprises a base, five groups of fingers are movably mounted on the base, a protective shell is fixedly mounted above the base through bolts, and a rotating part is rotatably mounted on the left side of the base; the device has the advantages that the pad is tightly attached to the back of the hand through the self-adaptive unit, it is ensured that the flexible strain gauge accurately captures action signals, and a foundation is laid for response of the motion unit; the adjusting unit monitors the hand microenvironment in real time, the temperature and humidity are adjusted through intelligent lifting and airflow circulation, the comfort degree is improved, and the equipment safety is guaranteed; the motion unit drives a multi-connecting rod mechanism according to predicted data, multi-degree-of-freedom motion simulation and force feedback are achieved, and the virtual reality interaction system which is sensitive in perception, timely in response and immersive in experience is constructed through mutual cooperation of the three units.

This invention discloses a near-field perception social interaction system and method based on augmented reality, belonging to the field of human-computer interaction and augmented reality. The system includes AR glasses and incorporates a communication module, a SLAM positioning module, an AR rendering module, a real-time interaction module, a real-time destruction module, a matching module, and an eye-tracking module. Users bind an activity identifier, and the AR glasses acquire and automatically match identifiers of surrounding devices via short-range wireless communication. Upon successful matching, the virtual information of the other party is overlaid and displayed. A real-time data channel is established after the user gazes at and nods in confirmation, and the data is transmitted in a streaming manner. The system is immediately destroyed from memory after transmission is complete. This invention is applicable to scenarios such as fan meetings, concerts, and sporting events.

The application discloses a large floating crane beam simulation interaction construction method, which comprises the following steps: establishing a three-dimensional model in a simulation interaction system, inputting an initial beam erection scheme, performing simulation and obtaining a final beam erection scheme, guiding actual beam erection construction through the final beam erection scheme and synchronously updating in the simulation interaction system to guide the beam erection construction in real time. Through human-computer interaction, driving engine and digital twin and other technologies, the application simulates a real construction scene, and performs early practice and war game on the beam erection, thereby providing a powerful tool for formulating a reasonable process arrangement, a reasonable construction period and eliminating safety hazards. Moreover, the simulation interaction system can guide the actual beam erection operation in real time during actual beam erection, greatly improves the efficiency of beam lifting and beam falling and ensures the beam falling precision through reasonable optimization of specific time-consuming processes, realizes the compatibility of precise positioning and efficient beam erection, and achieves the purpose of cost reduction and benefit increase.

According to a first aspect of the present invention, it may be provided a method for controlling a virtual 3D object based on a touchless interaction system being associated with a computer device. The method may be computer-implemented. The method may comprise displaying the virtual 3D object by a display means being associated with the computer device. The method may comprise generating, in a second interaction mode and using the touchless interaction system, at least one pointer control command configured to move at least one pointer displayed on the display means in accordance with a free-space movement of at least one finger, preferably of the fingertip of the at least one finger, of a user, while the at least one finger is distanced from the display means. The method may comprise receiving, in the second interaction mode, a selection user input selecting a desired pointer functionality. The method may comprise based on the receiving and essentially for a period of time in which the selection user input is received: causing generating, using the touchless interaction system, at least one functionality-specific control command configured to control the virtual 3D object in accordance with the pointer functionality and in accordance with the free-space movement of the at least one finger of the user. The virtual 3D object may be displayed by a display means in 2D, preferably creating a 3D illusion, e.g., using autostereoscopy as described in more detail below.

The invention relates to the technical field of artificial intelligence and man-machine interaction, in particular to a gamification interaction system and method for guiding type emotional communication. The method comprises the following steps: in response to a user interaction scene, initializing an emotional state space containing a plurality of preset emotional theme areas; in response to a user trigger operation, generating and activating an entropy reduction probe for exciting a user to express emotion information based on the emotion state space; after the entropy reduction probe is activated, capturing multi-modal emotion information input by a user, and associating the multi-modal emotion information with the entropy reduction probe to generate a structured emotion information unit; and based on the content of the structured emotion information unit, dynamically generating one or more man-machine interaction inquiry instructions through a preset interactive inquiry model, so as to perform deep mining on the emotion information. According to the method, the psychological threshold of emotional communication is effectively reduced through combination of the gamified random probe and AI-driven deep inquiry.

The invention discloses a multi-mode vehicle-mounted music interaction system and method based on a driving situation, and relates to the technical field of intelligent networked automobile man-machine interaction, and the method comprises the steps that a data collection and preprocessing module receives an original data stream and generates standardized multi-source data; the multi-modal dynamic arbitration engine module uses a sliding window synchronization mechanism to align data to generate a situation snapshot, and determines an interaction mode priority and a dynamic weight coefficient through a dynamic conflict decision matrix; the situation awareness recommendation system module constructs a three-dimensional situation feature model and generates a situation vector, calculates a recommendation score in combination with a music feature vector library and generates a playlist; and the instruction execution and feedback module executes music playing and light adjustment. According to the method, the problem of data asynchronization is solved through a sliding window mechanism, the interaction strategy is dynamically adjusted through the decision matrix to guarantee safety, emotion guidance is achieved through matching of the situation vector and the music feature vector, and the cabin interaction safety and the user experience are improved.

The invention discloses an intelligent hosting homework correction interaction system and method based on dual-scene application, belongs to the technical field of educational informatization, and aims to solve the problems that hosting homework correction efficiency is low, explanation interference is large, the concentration degree of students is difficult to monitor, and homework tutoring professional degree is insufficient. The system comprises student-side intelligent learning tables and chairs, a teacher-side subject correction system and an AI intelligent homework correction system. The student end is provided with a dual-mode AI camera, so that homework shooting and student concentration multi-dimensional identification can be realized; the teacher end adopts a cloud AI initial correction + teacher fine correction mode, and is matched with queuing scheduling and one-to-one audio and video explanation functions; and a parent appointment matching module is additionally arranged to complete job routing distribution, data synchronization and dual-scene queue management. Through deep coupling of software and hardware, homework correction efficiency is improved, silent one-to-one explanation is achieved, the learning state is monitored in real time, and the system is suitable for hosting institutions and family tutoring scenes and is remarkable in popularization value.

An interaction system for an animated figure is provided, including an animated figure having a shell layer including a shell sensor. The shell sensor is embedded in or adhered to the shell layer and configured to detect applied pressure via capacitive touch technology, resistive touch technology, or both. The interaction system further includes an automated controller, a shell layer, and a compliance system including the shell sensor. The shell sensor senses pressure applied on the shell layer of the animated figure and monitors movement of the animated figure in response to the applied pressure. The automated controller determines whether the responsive movement exceeds a movement threshold associated with the animated figure. If the movement exceeds the movement threshold, the automated controller returns the animated figure to a movement threshold compliance state.

The invention relates to a blockchain and digital identity-based authenticated interaction system and method that enables authentication between at least two actors, at least one authenticating actor and at least one authenticated actor, and between said actors.

The invention relates to the technical field of intelligent interaction, in particular to a portable control device and an interaction system, and the portable control device comprises a shell which is provided with an operation part and is configured to be detachably arranged on an external installation part; the information interaction module is arranged on the shell, and the information interaction module is electrically connected with the operation part; and the control module is arranged on the shell, the control module is electrically connected with the information interaction module, and the control module is configured to be used for receiving the operation instruction signal of the operation part and controlling the execution unit to execute according to the operation instruction signal. Flexible adaptation and efficient operation of the control device in multiple scenes are achieved, and meanwhile the requirements for stability and portability are met.

The application discloses a rotary type suspension interaction system and method for virtual reality simulation shooting, and belongs to the field of virtual reality, and specifically comprises the following steps: completing device pairing and platform calibration, and enabling a player to log in through identity authentication and acquire initial information; a client renders a 3D game world according to server scene data, a dynamic platform constructs an immersive interactive space in combination with special effects and spatial audio, and simultaneously synchronizes player state and action information through a network module; the player simulates aiming through a suspension hand action, Leap Motion collects hand data and maps the hand data into game instructions, and then uploads the game instructions to a server, the server updates a game state after performing collision detection and damage calculation; the client redraws a picture according to the updated state, and the platform synchronously executes physical feedback; after the game ends, the system generates settlement information for the player and releases and resets device resources; the application improves the interactive immersion and real-time performance of virtual reality games, and is suitable for a multiplayer online interactive game scene.

Systems and techniques are described herein for tracking a human-machine-interface device. For instance, a method for tracking a human-machine-interface device is provided. The method may include determining image-based data comprising a position associated with a controller in an image; determining audio-based data based on an audio signal output by the controller and captured at one or more microphones; and determining a pose of the controller based on the image-based data and the audio-based data.