4992 results about "Interaction method" patented technology

The invention relates to the technical field of building data interaction, in particular to a building engineering interaction method and system based on a BIM model and a medium. The method comprises the following steps: collecting construction site environment parameters and structure response data by using a distributed sensor network; preprocessing the data by an edge computing node; generating standardized environment data and key structure indexes; comparing environment threshold values to identify abnormal events; the method comprises the following steps of: displaying spatial positioning and risk levels through a visual interface, receiving a regulation and control instruction input by a user, dynamically adjusting construction parameters of a BIM model, generating an optimized construction progress scheme, comparing the optimized scheme with an original model to identify a construction conflict area, and generating a conflict resolution report. Through the advanced monitoring technology and construction management technology, the response speed and decision-making efficiency of the building engineering project are improved, and the safety guarantee and resource utilization efficiency in the construction process are improved.

The invention relates to a multi-modal intelligent robot system and an interaction method, and belongs to the technical field of robot digital data processing, and the method comprises the following steps: S1, multi-modal input collection; s2, carrying out multi-modal input preprocessing; s3, performing multi-modal information fusion, inputting the information into a pre-trained multi-modal feature fusion model, and performing feature fusion on each modal feature through a quantitative feature data fusion mechanism to obtain a user interaction intention vector and a user emotional state vector; s4, interaction response generation: matching a preset interaction response strategy library based on the user interaction intention vector to obtain basic response content, and performing emotion adaptation adjustment on the basic response content in combination with the user emotion state vector to generate multi-modal response content including text information, voice information and action information; s5, interactive feedback is executed; the method has the beneficial effects that the robot is fused with multi-modal information through the basic response content and the user emotional state vector, and interaction is dynamically optimized.

The embodiment of the invention provides a government affair digital human dynamic interaction method and system based on a multi-mode large model. The method is applied to the technical field of government affair intelligent services, and comprises the following steps: acquiring a policy announcement text, and performing cleaning and structuring processing to obtain a structured policy data set; and extracting old and new policy data, performing difference comparison, marking key change fields, and generating policy change data. Abstracting and element extraction are carried out on the change data to form structured semantic fragments, and the structured semantic fragments are incrementally embedded into the policy knowledge graph. And generating a question and answer pair sample based on the updated knowledge graph, and carrying out self-supervised fine tuning training on the multi-modal large model. A user inputs multi-modal data, and the model generates a government affair response and feeds back the government affair response. According to the scheme, the multi-modal large model can continuously keep the latest policy knowledge; the model is enabled to generate accurate government affair response with consistent context while understanding multi-modal input such as text, voice and image, and timeliness, accuracy and interactive experience of policy interpretation are improved.

The invention discloses a dynamic interaction method based on cooperation of a multi-modal dynamic fusion large model and an intelligent agent. The method comprises the following steps: performing feature extraction on user voice information to obtain a voice coding vector, a text semantic vector and an emotion feature vector; performing dynamic weight feature fusion on the voice coding vector, the text semantic vector and the emotion feature vector through a multi-modal dynamic fusion large model to obtain a fusion feature vector; inputting the fusion feature vector into an intention-scene coupling network, and identifying to obtain a user intention label; and identifying according to the user behavior log to obtain a user portrait tag, inputting the user intention tag and the user portrait tag into an autonomous decision-making agent, generating a target decision-making action through a lightweight policy network, and then interacting with the user according to the target decision-making action. The intelligent interaction efficiency and accuracy of the customer service system are improved, the interaction experience of the user is also improved, and the method can be widely applied to the technical field of artificial intelligence.

Provided in the embodiments of the present application are a video generation method and interaction method based on a digital human, and a device, a storage medium and a program product. In the embodiments of the present application, text-to-speech processing is performed on the basis of voice features of a user and an emotion label, speech-to-expression processing is performed on the basis of a mapping relationship between the voice features of the user and expression coefficients, and a digital human model is rendered on the basis of speech signals and the expression coefficients, so as to obtain video data of the digital human model. Thus, voice features of a user are accurately simulated, so as to ensure that a speech output of a digital human sounds natural and is also highly personalized, thereby realizing personalized driving of the digital human, and improving the realism of the digital human in terms of voice and dynamic images. Thus, the user experience is improved, and the interactivity of the digital human and the authenticity and immersion are enhanced.

The invention relates to the technical field of artificial intelligence and robots. According to the multi-modal perception and interaction method and device in the body environment, the method comprises the steps that environment entropy estimation processing is carried out through a dynamic weighting multi-modal feature fusion algorithm, and an environment entropy value representing the disorder degree of the environment is generated; performing cross-modal alignment processing to generate a fusion environment understanding map; performing dynamic decision processing through the task adaptive reinforcement learning model to generate an interaction instruction; driving an execution mechanism to execute the interaction action to obtain an execution result of the interaction action; carrying out dynamic adjustment processing on the weight of the environment entropy value to generate an updated environment entropy weight; and performing local knowledge node incremental updating processing on the meta-knowledge base to generate an optimized meta-knowledge base so as to solve the problems of insufficient consistency of cross-modal data and poor environmental understanding robustness caused by large distribution deviation between virtual features generated by a generation model in a noise or data missing scene and a real environment in related technologies.

The invention discloses a multi-mode interaction method for an accompanying robot, and relates to the technical field of robot interaction.The multi-mode interaction method comprises the steps that voice, visual and tactile signals are converted into quantum states through multi-mode quantum state coding, emotion weights are dynamically fused, and unified quantum representation is constructed; the dynamic quantum decision engine analyzes environmental noise and user emotion intensity in real time based on a quantum measurement theory, generates an adaptive strategy through dynamic modal weight distribution, and solves a multi-modal instruction conflict; holographic reinforcement learning optimization is combined with quantum acceleration calculation and classical reinforcement learning, the reward function weight is dynamically adjusted, cross-modal knowledge migration is achieved through the quantum tunneling effect, and the system strategy is continuously optimized. The problems that a traditional multi-mode interaction system is rigid in mode switching, high in emotion recognition error rate, lack of self-adaptive optimization of a feedback strategy and the like are solved, and the interaction efficiency and the user experience are improved.

The invention discloses a database interaction method, device and equipment based on multi-agent cooperation and a medium, and relates to the technical field of database interaction. The method comprises the steps of obtaining a query request, performing semantic partitioning and vectorization, and obtaining a retrieval vector set; and selecting a search source and searching to obtain an information block. And obtaining candidate knowledge through knowledge base retrieval. And integrating the information blocks and the candidate knowledge to obtain a candidate information set. And constructing a dynamic demand understanding model according to the query request and the candidate information set, and obtaining a task state matrix and a tool calling task. And calling a corresponding auxiliary tool and operating, updating the task state matrix according to an operation result and returning the task state matrix to the task planning agent to update the tool calling task until the tool calling task is no longer output, and obtaining a task result. And when the database interaction module is called, generating a chart according to an output result of the database interaction module, and outputting the chart and a task result together. Otherwise, directly outputting a task result.

The invention provides an AR intelligent shopping guide interaction method and system applied to store management, and the method comprises the steps: firstly obtaining an interaction data set of a user in a store, covering a user position movement track, a commodity attention action sequence and voice consultation content, carrying out the user intention analysis of the interaction data set, and carrying out the user intention analysis of the interaction data set; the method comprises the steps of obtaining commodity demand characteristics and interaction preference characteristics, generating AR shopping guide interaction content, including commodity three-dimensional display information and an interaction guide instruction, adaptive to a user based on the commodity demand characteristics and the interaction preference characteristics, aligning and fusing the AR shopping guide interaction content with a store physical scene space, generating an AR shopping guide interaction scene capable of being displayed in real time, and displaying the AR shopping guide interaction scene in real time. And finally, responding to user interaction operation in the AR shopping guide interaction scene, generating feedback information and updating the interaction data set to trigger interactive process iterative optimization, thereby providing personalized and immersive shopping guide experience, and improving store operation efficiency and customer satisfaction.

The invention provides an interaction method based on artificial intelligence equipment, belongs to the technical field of artificial intelligence, and remarkably optimizes the efficiency of an AI equipment interaction system through distributed resource dynamic scheduling, multi-framework heterogeneous collaboration and full-link intelligent monitoring. Based on an elastic capacity expansion and contraction and priority scheduling strategy of Kubernetes, GPU resource islands are eliminated, and the computing power distribution efficiency is improved; a Flink checkpoint mechanism and Spark RDD blood relationship tracking are integrated, training task breakpoint continuous calculation and millisecond-level fault recovery are achieved, and repeated data processing is avoided; gPU node performance indexes are collected in real time through Prometheus Exporter, and in combination with Grafana visual early warning, the anomaly detection response speed is shortened to the second level; seamless access of frames such as TensorFlow / PyTorch is supported, heterogeneous device protocol conversion is achieved through a unified API gateway, and the cross-platform migration cost is reduced.

The invention provides a model-based interaction method and system, wearable equipment and a storage medium, and belongs to the technical field of intelligent interaction.The method comprises the steps that in response to a received interaction instruction, voice data, a gesture image, eye movement data and an environment image are obtained based on the interaction instruction; extracting user intention features based on the voice data, the gesture image and the eye movement data, and determining scene type features based on the environment image; determining an interaction theme based on the interaction instruction, obtaining user historical interaction information associated with the interaction theme from a context memory database, and generating a context feature vector based on the user historical interaction information; and inputting the user intention feature, the scene type feature and the context feature vector into an intention recognition model based on quantum enhancement to obtain a user intention, and generating interaction response data based on the user intention. According to the invention, the accuracy of user intention recognition can be improved, and the intelligence of interaction is improved.

The invention relates to the technical field of electric digital data processing, in particular to an artificial intelligence algorithm-driven digital human language understanding and corresponding reaction interaction method. The method comprises the following steps: collecting historical language data, text data, action instruction data and physical environment information of a user to obtain structured training data; vectorizing the text data to obtain a text semantic vector; environment feature vectors are extracted from the physical environment information; splicing the text semantic vector and the environment feature vector to obtain an environment enhanced text vector; and constructing a pre-training language model based on the environment enhanced text vector, and performing secondary pre-training to generate an optimized language model parameter. According to the invention, by fusing the user language and the physical environment information and combining with the multi-module intelligent component, context perception, efficient understanding and multi-modal natural interaction of the digital human in a complex scene are realized, and the intelligence, adaptability and user experience of the system are remarkably improved.

The invention relates to the technical field of interaction based on visual earphones, and discloses an interaction method and device based on a visual earphone, computer equipment and a medium, and the method comprises the steps: judging whether a user wearing the visual earphone sends an interaction instruction or not; analyzing content in the interaction instruction to determine a user demand; in response to the user demand, controlling a camera to scan current content to obtain a scanned picture; performing data processing on the scanned picture based on the user demand to obtain a processing result; and feeding back the processing result to the user. The method has the beneficial effects that the user demand is determined through the interaction instruction, and intelligent and personalized services can be provided according to the user demand. Through the camera integrated with the earphone, a user can obtain environment information in real time without depending on external equipment, and obtain instant feedback through the earphone, so that the practicability and interaction experience of the intelligent wearable equipment in a complex environment are greatly improved.

The invention provides an interaction method and device based on image recognition, and relates to the technical field of man-machine interaction, and the technical scheme is characterized in that the method comprises the steps: analyzing the moving speed and change frequency of target and non-target elements in a training scene, and calculating an environment dynamic factor; adjusting a high threshold value and a low threshold value of target identification confidence; comparing the target recognition confidence output by multi-modal image recognition with the adjusted high threshold and low threshold, and determining a visual feedback type; setting a visual feedback intensity parameter according to the determined visual feedback type and the target type; and displaying the set visual feedback in the visual field of the technical object in an overlapping manner. The interaction method and device based on image recognition provided by the invention have the advantages that the cognitive load of the technical object is reduced, and the rapid target recognition capability of the technical object in a complex and uncertain battlefield environment is improved.

The invention discloses a humanoid robot object interaction method guided by a diffusion model based on key frames. Comprising the following steps: S1, generating interaction between a human body and an object based on a diffusion model of a key frame; s2, guiding the humanoid robot to interact with the object based on the contact instruction; and S3, interaction between the humanoid robot and the object based on the action generation guidance. According to the method, in an action generation stage, key frames of a robot and an object within a period of time are predicted according to a current state, a motion sequence is recovered by using interpolation, and then a universal robot and object interaction strategy is finely adjusted based on a generated and simulated closed-loop structure and a fixed diffusion model weight. The interaction strategy is rewarded due to accurate simulation of aligned movement and contact information and successful object control, the gap between the output of the diffusion model and the training data set of the simulation environment is made up, and the reward does not need to be designed for a specific task.

The invention relates to the technical field of artificial intelligence and natural language processing, in particular to an agent system based on a large language model and an interaction method, and the system comprises a data collection module which is used for receiving text, voice or other forms of data input by a user in real time; the natural language processing module is used for performing semantic understanding and grammatical analysis on the received data to generate an executable user intention; the knowledge reasoning module is used for reasoning an optimal response result or action scheme according to the requirements of the user and historical interaction records; the method has the beneficial effects that the interaction experience of the user is greatly improved through natural language processing, sentiment analysis and personalized response technologies. The system can perform accurate response according to the emotion and demand of the user, and can provide efficient and intimate services in applications such as intelligent customer service, intelligent assistant, personalized recommendation and the like.

The invention belongs to the field of data processing, and provides a road engineering low-carbon data credible interaction method and system, and the method comprises the steps: constructing a full life cycle stage division model, generating corresponding low-carbon data according to the business activity of each stage, and adding a stage identifier, a timestamp and a spatial position label to the low-carbon data; based on a preset engineering logic, a data causal relationship and a carbon emission factor model, constructing a data context tree comprising a plurality of low-carbon data nodes, and organizing the low-carbon data nodes in different space-time ranges and life cycle stages into a life cycle data context tree with a staged conduction relationship; before data interaction is carried out, multi-dimensional verification operation is carried out on target data based on the data context tree; and calculating a credible score of the target data based on a structural path verification result, a space-time consistency verification result and a carbon factor mapping verification result, and controlling the interactive access permission of the low-carbon data according to a score result.

The invention relates to the technical field of display terminal interaction, in particular to an intelligent display terminal multi-mode interaction method and system. Comprising a multi-module acquisition unit, and the multi-module acquisition unit is used for acquiring visual, voice and text data; the modal feature extraction unit is used for extracting key semantic features from vision, voice and texts, the differential fusion unit dynamically allocates fusion coefficients based on weight coefficients of all modals, and an optimal fusion logic is selected for different input modal combinations by adopting a differential fusion strategy; and the multi-module response unit is used for outputting the multi-mode content and outputting and displaying the multi-mode content through the terminal equipment. The current available modal combination is identified through the differential fusion strategy, and the optimal fusion sub-module is scheduled, so that different fusion logics are dynamically called during operation, different fusion sub-modules are dynamically selected according to modal availability and switched during operation, and the problems of resource waste and precision reduction caused by general fusion are avoided.

The invention discloses an Android system user interface interaction method and device based on a large language model, and relates to the technical field of intelligent man-machine interaction, and the method comprises the steps: receiving a natural language instruction of a user, and synchronously capturing a real-time interface state of a current Android screen to generate a structured context containing semantic information of interactive elements; inputting the instruction and the context into a large language model, and generating a hierarchical task plan formed by a plurality of atomic operations with a logic dependency relationship; based on a dynamic adaptation mechanism, converting the atomic operation sequence into an operation instruction which can be executed by the Android system; receiving interface change information after instruction execution, and feeding back the interface change information as a new round of context to the large language model to determine a task execution state; and finally generating natural language feedback information to the user according to the execution state. By means of the mode, complex cross-application tasks can be understood and executed, and interaction intelligence of the Android system is remarkably improved through real-time interface perception and dynamic planning adjustment.

The invention provides a dialogue interaction method and system based on long historical dialogue semantic understanding, and belongs to the technical field of natural language process.The dialogue interaction method comprises the steps that firstly, a historical dialogue information set containing multiple rounds of user consultation and customer service response of an e-commerce platform target user is obtained, and then deep semantic mining is conducted on the historical dialogue information set; dialogue intention features and dialogue theme association features are obtained, a historical dialogue semantic understanding result containing user core demand induction and a dialogue theme development knowledge path is generated according to the two features, an adaptive dialogue interaction strategy is generated according to the historical dialogue semantic understanding result, and the adaptive dialogue interaction strategy comprises response emphasis, guide direction and rhythm control information. And finally, executing the strategy to realize dialogue interaction, outputting a response statement and receiving new input of the user, thereby improving customer service quality and user experience of the e-commerce platform.

The invention relates to intelligent glasses, an interaction method and device of the intelligent glasses, electronic equipment and a medium. The sensing module, the decision making module, the execution module and the feedback module are arranged on the glasses body so as to sense multi-dimensional environment data of a surrounding environment and current behavior data of a user in a preset intelligent interaction mode, predict a behavior intention of the user, track a first behavior change of the user and a first environment change of the surrounding environment and send the first behavior change to the feedback module; and determining an instruction chain meeting a preset execution condition, executing the instruction chain to track a second behavior change of the user based on the instruction chain, and optimizing a generation algorithm of the instruction chain based on the second behavior change. Therefore, the technical problems that in the related technology, the intelligent wearable device understands the environment in a one-sided mode, interaction is passive, the intelligent wearable device can only operate according to a set rule, the intelligent level is insufficient, convenience cannot be provided for a user, and normal use of the user is easily affected are solved.

The invention provides an interaction method and device based on agent cooperation, an agent and a storage medium, belongs to the technical field of artificial intelligence, particularly relates to the technical fields of deep learning, large models, agents, AIGC and the like, and is applied to application scenes such as wisdom education, video production, wisdom medical treatment and the like. The intelligent agent cooperation-based interaction method comprises the following steps: performing intention understanding on initial input information for a target object to obtain an initial intention understanding result; performing interaction mode demand detection on the initial intention understanding result by using a first agent to obtain an interaction mode demand attribute; an interaction element matched with the interaction mode demand attribute is called to interact with the target object, interaction information representing the demand intention of the target object is obtained, and the interaction element is used for responding to the interaction behavior; and controlling the second agent to execute the target task based on the interaction information to obtain an execution result, and pushing the execution result to the target object.

The invention discloses a human-computer interaction method and system based on a vision-language-action model, and belongs to the field of human-computer interaction. According to the method, an anchoring ring strategy is adopted to collect human teaching data to finely adjust the VLA model, and then the trained model is applied to an actual human-computer interaction scene. In the data acquisition stage, a first operator guides a master robot to execute task actions, and a slave robot synchronously moves and interacts with a second operator, and returns to a predefined initial position after each interaction; a teaching sample is formed by recording a robot state, an environment image and an instruction text, and a high-quality data set is generated through data enhancement. In the application stage, the real-time robot state, the environment image and the instruction text serve as input, an action instruction is generated through the VLA model, and the robot is driven to complete a cooperation task. According to the method, the data utilization efficiency and the model generalization ability are remarkably improved, the difference between simulation and the real environment is effectively overcome, and efficient, safe and natural man-machine cooperation is achieved.

The invention provides a man-machine interaction method, device, system and equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of large language models, intelligent assistants and the like. According to the implementation scheme, in response to a received user instruction, an operation instruction generation request is obtained based on the user instruction and function description information of multiple functions; an operation instruction generation request is sent to the server, and the operation instruction generation request is used for triggering the server to apply the cloud large model so as to select at least one function from the multiple functions based on the user instruction and the function description information, and an operation instruction used for completing the user instruction is generated based on the at least one function; and in response to a received operation instruction sent by the server, executing a calling operation for each function in the at least one function based on the operation instruction so as to obtain an execution result of the user instruction.

The invention relates to the technical field of man-machine interaction, in particular to a dialogue Agent interaction method based on multi-modal intention understanding, which comprises the following steps: S1, collecting multi-modal data in a user interaction process in real time, and calculating a time synchronization deviation value of each modal data source; s2, constructing a space-time fusion feature vector; s3, analyzing a dominant action instruction and a recessive behavior clue in the space-time fusion feature vector; s4, generating a multi-level intention analysis tree; s5, when the corrected confidence coefficient of any node in the intention analysis tree is lower than a set threshold value, activating a targeted sensor to complementarily collect data; and S6, analyzing a tree drive response decision according to the finally confirmed intention. According to the method, high-precision identification and response control of the dialogue Agent on the user intention in a complex scene are realized by constructing a multi-modal interaction method with space-time consistency fusion capability, an explicit and implicit intention analysis mechanism and an adaptive modal clarification strategy.

The invention discloses a digital large-screen interaction method and device based on multi-agent cooperation and a medium, and relates to the technical field of digital large-screen interaction.The method comprises the steps that postures, expressions and voice data of a user are collected in real time, the attention weight is calculated in combination with spatial position information, the emotional state change rate is monitored, and the user experience is improved in combination with personal historical browsing preferences; acquiring a main interaction user, an emotional state feature and an emotional change trend; according to the main interaction user, the emotional state features and the emotional change trend, obtaining an initial confidence coefficient of the suspected interested field through a semantic understanding model; and based on the candidate guide images, identifying a user selection intention through a multi-modal fusion processing mechanism, calculating a selection probability, triggering content activation of the main interaction area and content dynamic generation of the auxiliary information area, synchronizing state information, and starting an immersive collaborative interaction process. Through three-level collaborative service configuration, the beneficial effects of improving large screen content organization efficiency and enhancing immersive interaction experience are achieved.

The embodiment of the invention relates to an interaction method and device, equipment and a storage medium. The method provided herein includes: receiving an interaction request associated with a target session, the target session being associated with a plurality of users; presenting a virtual scene corresponding to the target session, wherein the virtual scene is created based on a configuration operation of at least one user in the plurality of users; and presenting a first virtual object in the virtual scene, wherein the first virtual object is added to the virtual scene based on a preset operation of a first user associated with the first virtual object. In this way, according to the embodiment of the invention, the virtual scene corresponding to the session can be created based on the configuration operation of the user in the session, and the virtual object associated with the user can be presented in the virtual scene, so that the interaction demand of a plurality of users in the session in the virtual scene can be met.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

The invention provides an AI role interaction method, interaction device and interaction equipment in a game platform, and relates to the technical field of game interaction.The method comprises the steps that a current game scene, game task information and game character information are obtained, and a first behavior parameter set of AI roles is generated; collecting current operation behavior data and voice interaction data of a user; performing intention recognition processing on the operation behavior data and the voice interaction data to generate a user behavior feature vector, and determining a relation link between the user behavior feature vector and at least one of game scene information, task information and character information to generate a dynamic interaction strategy; a second behavior parameter set is generated according to the dynamic interaction strategy, and multi-modal interaction content matched with the second behavior parameter set is rendered and generated; and displaying the multi-modal interaction content to the user terminal. According to the method, the interaction of the AI role can be more real and natural, and the game immersion and satisfaction of the user can be remarkably improved.

The invention provides a switch security protocol interaction method and device, equipment and a storage medium, and the method comprises the steps: carrying out the protocol type recognition of a received network data frame, and generating first intermediate data according to the recognized protocol type; according to the protocol type identifier of the first intermediate data, converting the format of the network data frame through a protocol mapping rule to generate second intermediate data; determining a security processing strategy corresponding to a preset strategy rule set according to the strategy identification field of the second intermediate data; reconstructing the original content of the second intermediate data into a target data frame conforming to a target protocol format according to a security processing strategy; and according to the security level field and the communication direction of the target data frame, performing path screening through the trusted path list, and determining a target interaction path. According to the scheme, the trusted interaction path can be dynamically screened based on the protocol type and the security level field of the target data frame, and controllable data transmission between switches under security protocol cooperation is realized.