2510 results about "Interaction method" patented technology

The invention discloses an Android system user interface interaction method and device based on a large language model, and relates to the technical field of intelligent man-machine interaction, and the method comprises the steps: receiving a natural language instruction of a user, and synchronously capturing a real-time interface state of a current Android screen to generate a structured context containing semantic information of interactive elements; inputting the instruction and the context into a large language model, and generating a hierarchical task plan formed by a plurality of atomic operations with a logic dependency relationship; based on a dynamic adaptation mechanism, converting the atomic operation sequence into an operation instruction which can be executed by the Android system; receiving interface change information after instruction execution, and feeding back the interface change information as a new round of context to the large language model to determine a task execution state; and finally generating natural language feedback information to the user according to the execution state. By means of the mode, complex cross-application tasks can be understood and executed, and interaction intelligence of the Android system is remarkably improved through real-time interface perception and dynamic planning adjustment.

The invention discloses a digital large-screen interaction method and device based on multi-agent cooperation and a medium, and relates to the technical field of digital large-screen interaction.The method comprises the steps that postures, expressions and voice data of a user are collected in real time, the attention weight is calculated in combination with spatial position information, the emotional state change rate is monitored, and the user experience is improved in combination with personal historical browsing preferences; acquiring a main interaction user, an emotional state feature and an emotional change trend; according to the main interaction user, the emotional state features and the emotional change trend, obtaining an initial confidence coefficient of the suspected interested field through a semantic understanding model; and based on the candidate guide images, identifying a user selection intention through a multi-modal fusion processing mechanism, calculating a selection probability, triggering content activation of the main interaction area and content dynamic generation of the auxiliary information area, synchronizing state information, and starting an immersive collaborative interaction process. Through three-level collaborative service configuration, the beneficial effects of improving large screen content organization efficiency and enhancing immersive interaction experience are achieved.

The invention relates to the technical field of computers, and discloses a real-time rendering and interaction method and system for an immersive virtual reality scene. The method comprises the following steps: fusing tuner inertial data and eyeball tracking data, and constructing a prospective state prediction model; generating a predictive focus field in combination with scene visual saliency; synthesizing an anisotropic temporal-spatial resolution graph according to the predicted head angular velocity; gPU variable-rate coloring is driven to realize non-uniform rendering; and re-projection or dynamic fuzzy correction is executed in a self-adaptive manner according to the attitude prediction error before display. According to the technical scheme, the perception delay and the rendering load are remarkably reduced, and the frame rate stability and the visual immersion in a high-dynamic scene are improved.

The invention relates to a man-machine interaction method and device, computer equipment, a storage medium and a program product. The method comprises the following steps: acquiring interaction content input by a user; scene recognition is carried out on the interaction content through a large language model, and a scene label of the interaction is determined; determining a target long-term memory partition corresponding to the scene tag from a plurality of long-term memory partitions preset for the user; inputting target long-term memory content in the target long-term memory subarea and short-term memory content stored in a short-term memory area preset for the user into an intelligent agent; the intelligent agent is used for generating reply content for the interaction content according to the target long-term memory content and the short-term memory content. By adopting the method, effective association and collaborative calling of different scene memories can be realized, and the dynamic requirement of a user on coherent interaction in multi-scene switching is met.

The invention discloses a cloud mobile phone interaction method and device, a storage medium and electronic equipment, and relates to the technical field of cloud computing, and the method comprises the steps: responding to an interaction request initiated by at least one cloud mobile phone client, carrying out the conflict verification of the interaction request, and carrying out the merging processing of the interaction request under the condition of determining that the interaction request conflict exists, generating a unified operation instruction; controlling the cloud mobile phone instance to execute the unified operation instruction to operate the execution instruction, and generating interaction data; and distributing the interaction data to a cloud mobile phone client connected with the cloud mobile phone instance. According to the method, multiple terminals can be supported to initiate interaction requests to the same cloud mobile phone instance at the same time, effectiveness and consistency of operation instructions are ensured through conflict verification and merging processing, real-time performance and accuracy of multi-terminal cooperative control are achieved, and the problems of asynchronous operation, rhythm breakage and the like in a multi-user cooperative scene are effectively solved.

The invention belongs to the field of man-machine interaction, and particularly discloses a man-machine interaction method for electronic screen control, which comprises the following steps: acquiring touch track data of a user according to a touch sensor, and performing feature extraction on the touch track data to obtain a touch feature vector; the method comprises the following steps: acquiring gesture action data of a user according to image acquisition equipment, and performing key point detection on the gesture action data to obtain a gesture feature vector; the method comprises the following steps: acquiring voice instruction data of a user according to an audio acquisition device, and performing acoustic feature extraction on the voice instruction data to obtain a voice feature vector; acquiring current environment parameters in real time through an environment detection module, wherein the environment parameters comprise illumination intensity, environment noise level and distance between a user and a screen; the objective of the invention is to solve the problem of insufficient reliability of a man-machine interaction mode in a complex environment in the prior art.

The invention belongs to the technical field of intelligent interaction, particularly relates to an intelligent interaction method, system and device based on AI communication and a storage medium, and aims to solve the problems that in the prior art, AI scene coverage is narrow and is separated from a business process; the system comprises four modules: a context sensing and modeling module which collects multi-source context information in real time, and generates a three-dimensional context tensor through structured alignment and time sequence normalization; the intention analysis and reasoning module performs intention level decomposition by using a deep semantic model based on the tensor, and outputs an intention recognition result and probability distribution; the response generation and adaptation module is used for generating multi-mode responses such as texts, voices, images or equipment instructions in combination with intention and context tensors, and outputting the multi-mode responses after consistency verification; and the interactive feedback and optimization module collects user explicit and implicit feedback and is used for updating model parameters and strategy weights online to realize continuous optimization of the system.

The invention discloses an information system existing interface-based AI large language model interaction method, which comprises the following steps of: constructing an interface operation feature set according to an information system operation log; identifying a service intention category and a function granularity level corresponding to the interface, and generating an interface function granularity identification table; constructing an action rule chain according to the interface service intention category and the function granularity level; performing field consistency calibration in combination with a field time sequence identifier, a stage identifier and a trigger point identifier to form standardized intermediate JSON data; according to the standardized intermediate JSON data, generating cue words including field operation instructions, business semantic instructions and time sequence background instructions; model request sending, model output result analysis and consistency verification are carried out through an existing API interface, and system state updating information is recorded. According to the method, the system transformation cost is reduced, the accuracy of interface semantic expression is improved, and an enforceable and extensible technical path is provided for intelligent upgrading of a traditional information system.

The invention relates to the technical field of data processing and analysis, in particular to a data interaction method and system based on an intelligent dataset, and the method comprises the steps: capturing an interaction task demand and context through multi-source heterogeneous data fusion and dynamic feature construction, and providing a basis for subsequent processing; a load cloud picture is generated based on cognitive domain division and a graph attention network, and a high-load area and a conflict focus set are recognized in real time; through causal analysis and diffusion coefficient quantification, a conflict propagation path and influence intensity are clarified so as to prevent and cope with conflict diffusion in advance; through combination of load migration trajectory and diffusion coefficient simulation deduction, a conflict generalization trend is predicted, and conflict early warning is realized. Key decision points are positioned through map fusion, and resource allocation is optimized; by triggering adaptive disambiguation and intention reconstruction, contradiction of high-conflict tasks is dynamically reduced, interaction efficiency and accuracy are improved, conflicts are effectively eliminated, and smoothness and stability of data interaction are guaranteed.

The invention belongs to the technical field of community intelligent inspection, and discloses an intelligent decision-making and interaction method and system for a community inspection robot, and the method comprises the steps: collecting community image, sound and gas concentration data through multiple sensors, extracting visual, audio and gas multi-mode features, and carrying out the multi-mode feature extraction; constructing a cross-media knowledge graph to associate an abnormal event entity and a multi-modal feature entity; then aggregating features of entity nodes and neighbor nodes thereof in the knowledge graph based on a graph convolutional network, generating a graph structure enhanced feature representation, and transforming and outputting a hidden danger probability score; and finally, if the score exceeds a preset threshold value, triggering grading early warning. The problems that traditional inspection data are isolated and complex scene semantic understanding is insufficient are solved, hidden danger recognition accuracy and early warning reliability are improved, the intelligent and efficient requirements of intelligent community inspection are effectively met, and the method is suitable for community safety management scenes.

The invention provides a graph database interaction method and system based on a large language model, and the method comprises the steps: firstly obtaining a graph database query request input by a user, carrying out the structural analysis processing of the graph database query request, generating a structural query feature, calling a pre-trained large language model to carry out the semantic intention recognition of the structural query feature, extracting a context semantic feature, and carrying out the recognition of the semantic intention. Generating a candidate interaction path set according to the structure query feature and the context semantic feature, executing an operation corresponding to the candidate interaction path set in a graph database to obtain a result data set containing node attributes, connection edge attributes and path integrity scores, and finally performing feedback processing on the result data set to obtain a result. And generating a path optimization strategy and updating analysis parameters of the large language model based on the path optimization strategy, thereby improving the interaction efficiency and accuracy of the graph database in combination with the large language model.

The invention discloses a real-time software deformation interaction method based on a physical engine in an environment. The real-time software deformation interaction method comprises the following steps: S1, establishing a virtual environment and a software model; s2, constructing an interactive perception and collision detection network; s3, receiving and analyzing a multi-modal interaction instruction; s4, real-time deformation calculation based on a physical engine; s5, performing multi-user collaborative state synchronization and rendering feedback; and S6, carrying out fault state simulation on the software object. According to the method, real-time and high-precision simulation of software deformation is realized through deep fusion of software dynamics calculation of a physical engine and an interaction instruction stream, and through hierarchical physical attribute binding and client prediction, the network synchronization data volume is greatly reduced while the millimeter-level deformation precision is ensured, so that the network synchronization efficiency is improved. And low-delay and high-consistency experience under multi-person cooperative operation is ensured.

The invention relates to the technical field of vehicles, in particular to a multi-mode out-of-vehicle interaction method and related equipment based on environment self-adaptation, and the method comprises the steps: obtaining perception information in real time through an environment perception module, the perception information comprising environment conditions, interaction object information and scene semantic understanding information; based on the perception information, utilizing an adaptive decision engine to dynamically analyze an optimized interaction mode and parameters, and generating interaction content; outputting interaction information according to the interaction content generated by the self-adaptive decision engine through a multi-modal output module; the interaction strategy is dynamically adjusted by sensing the environment state in real time, and the safety and the interaction efficiency can be improved.

The invention belongs to the field of intelligent driving interaction, discloses an HUD interaction method and system combining DMS and ADAS functions, and constructs a multi-mode state sensing system by obtaining a real-time image of a driver and steering wheel grip data. According to the method, eye, pupil and head posture recognition based on deep learning is complementary with a grip distribution matrix, so that fatigue behaviors, distraction behaviors and abnormal holding behaviors can be detected earlier and more accurately, and the precision and robustness of driver state recognition are effectively improved. According to the method, after the fatigue degree of the driver is analyzed, the cognitive load of the driver is dynamically evaluated in a finer-grained mode by constructing the composite indexes based on the eyelid opening degree, the sight line deviation, the grip variation coefficient and the respiratory rhythm. The evaluation mode can reflect the attention, mental load and information processing capability of the driver in real time, so that the system can generate a prompt strategy which better conforms to human factors according to the current state of the driver.

The invention discloses a gesture interaction method and device, a ring and a storage medium, and relates to the technical field of intelligent wearable device.The method comprises the steps that a hand motion data stream of a user is collected in real time through an inertial measurement unit of the intelligent ring, and an electromyographic signal data stream of the user is collected in real time through an electromyographic sensor of the intelligent ring; when the signal feature of the electromyographic signal data flow meets a preset activation condition and the track starting section of the hand motion data flow and the electromyographic signal data flow meet a synchronism condition in time sequence, a gesture interaction signal is triggered; and in response to the gesture interaction signal, executing an interaction operation. The identification accuracy of the user interaction intention in the office scene can be improved.

The invention discloses a multi-modal intelligent question and answer system and interaction method based on a privatized deployment large language model. The system comprises a model containerization deployment module, a multi-round question and answer and intention recognition module, a document analysis and multi-modal question and answer module, a knowledge base construction and retrieval enhancement generation module and a system integration and monitoring module. A DeepSeekR1 large language model, an inference service and a dependency library are packaged into a container mirror image through a containerization operation environment Docker, and unified scheduling and dynamic capacity expansion and contraction are achieved through Kubernetes; realizing context understanding and task distribution by adopting a dialogue state management and intention recognition technology; in combination with OCR, an embedded model BGE / SimCSE and a vector database FAISS / Milvus, semantic analysis and intelligent question and answer of multi-format documents such as PDF, Word and images are supported; and a hierarchical knowledge base is constructed and a retrieval enhancement generation technology is fused to improve the answer accuracy. According to the invention, safe, efficient and intelligent management and interaction of enterprise knowledge are realized.

The invention provides a self-adjusting dialogue type multi-agent system and interaction method based on dynamic topology, and the system comprises a scheduling module which is used for receiving user input and routing a task to a corresponding field task agent in a conventional state; the domain task intelligent agents are used for processing the received tasks, evaluating the cognitive states in real time and sending out assistance signals when the cognitive states meet preset conditions; the shared knowledge management module is used for maintaining a dynamically updated distributed semantic knowledge graph; wherein the distributed semantic knowledge graph is used for sharing, associating and persisting structured knowledge entities and context information generated in the session process among all modules in real time; the topology control module is used for dynamically switching the communication control topology of the system from a first topology structure to a second topology structure in response to the received assistance signal; and when the assistance signal is eliminated, the communication control topology is recovered from the second topology structure to the first topology structure.

The invention discloses an interaction method and device, electronic equipment and a readable storage medium, and belongs to the technical field of electronic equipment, and the method comprises the steps: obtaining a video stream of a user; determining a behavior state of the user according to the video stream; wherein the behavior state comprises at least one of the following items: an emotional state, an attention state, a facial expression, a body posture and an action; and outputting first interaction content according to the behavior state of the user.

Provided in the present disclosure are a virtual gift-based interaction method, and a related device. The method comprises: receiving a first image determined by a user in a virtual gift customized interface of a target livestream; in response to detection of a user instruction for transmitting a virtual gift, acquiring a second image corresponding to the target livestream; on the basis of the first image and the second image, generating a target virtual gift; and transmitting the target virtual gift to a livestream account associated with the target livestream.

The invention belongs to the technical field of intelligent property and digital interaction, and discloses a property service scene-oriented digital human all-in-one machine and a multi-mode interaction method. According to the invention, a cloud edge-end collaborative architecture is adopted, and a full-stack solution is constructed through a multi-modal sensing and interaction module, an edge computing and control module and a cloud collaborative platform; the core lies in four cooperative technologies: dynamic multi-modal fusion based on gated cross attention and online reinforcement learning, event-driven process management of a hierarchical state machine and persistent context, reliable cross-system cooperation of a sender box mode and transactional messages, and adaptive resource scheduling of environment compensation and multi-objective optimization. According to the invention, high-reliability intelligent service is realized, the interaction success rate in a complex environment is remarkably improved, the data consistency of the heterogeneous system is high, the performance is stable under extreme conditions, and the system can replace a manual foreground to adapt to various property service scenes such as office buildings and parks.

The invention provides a multi-modal interaction method and device of an intelligent customer service system, equipment and a storage medium, and relates to the technical field of artificial intelligence. The method comprises the steps of obtaining multi-modal vehicle consultation data input by a target user; performing feature extraction on the vehicle consultation data of the multiple modes to obtain multiple feature vectors corresponding to the vehicle consultation data of the multiple modes; according to the types of the multiple modes and the current interaction scene of the target user, obtaining weights of the multiple modes in the current interaction scene; performing feature fusion on the multiple feature vectors according to the weights of the multiple modes to obtain a fused feature vector; and generating a service scheme for the target user according to the fused feature vector. According to the embodiment of the invention, standard processing and deep fusion of multi-modal data are realized, the problems of low response efficiency and inaccurate recommendation of traditional customer service are solved, and finally, the purposes of accurately insight into car purchase demands of users and efficiently outputting personalized marketing services are achieved.

The embodiment of the invention discloses a data interaction method of a string type energy storage system, the energy storage system and a related device, the method is applied to a PCS controller in the string type energy storage system, and the string type energy storage system comprises a plurality of battery clusters, a cluster controller, a stack controller and the PCS controller; comprising the following steps: acquiring the total system power and the online cluster number of a plurality of battery clusters sent by a stack controller; acquiring operation state parameters of the battery clusters forwarded by the stack controller and correspondingly acquired by the cluster controller; determining the execution power of the plurality of battery clusters in response to the total power of the system, the online cluster number and the operation state parameters; and generating a control instruction when it is determined that a battery cluster fault exists according to the operation state parameters. Therefore, independent and accurate management of each cluster of batteries is realized, the overall energy efficiency of the system is improved, and meanwhile, the safety and reliability of the system are ensured through a dynamic power distribution strategy and a layered fault response mechanism.

The invention discloses a hospital inquiry system based on the Internet. The hospital inquiry system comprises a business platform layer, a multi-terminal application layer, a composite interaction layer and a verification layer, the service platform layer is constructed by adopting a Java Springboot and SpringCloud micro service architecture, and a plurality of core functions can be packaged into an independent service process; the multi-end application layer can select an optimal technology stack to form a multi-end application based on operation habits and performance requirements of different terminal users, and each end performs front-end and back-end separated interaction with the service middle station through an API gateway; and the composite interaction layer is used for establishing a communication link between a doctor and a patient so as to carry out a full-service process of online inquiry, prescription making and medicine distribution. According to the system, a one-stop business process of online inquiry, prescription extraction, medicine purchasing and distribution is realized, meanwhile, doctors are supported to receive diagnosis through a mobile terminal or a computer anytime and anywhere, and the problem that the licensing behaviors of the doctors are bound to fixed places and time of physical hospitals is solved.

The invention relates to the technical field of natural language processing, in particular to a collaborative dialogue type interaction method, system and equipment based on multiple models, and the method comprises the steps: respectively determining a theme coefficient, a statement coefficient and a keyword coefficient by analyzing theme drift and statement association degree of a dialogue and semantic evolution and importance of keywords; according to the method, feature weights are constructed by quantifying feature differences between statements, between keywords and between cross-round dialogues, word vectors and feature weights of all keywords in each round of dialogues before the current round of dialogues are fused, and candidate replies of the current round of dialogues are scored by adopting a semantic scoring model based on a fusion result. According to the method, the problem of decision errors caused by inconsistent understanding of the models in the multi-model collaborative dialogue is solved, the model weight is dynamically adjusted by quantifying the internal contradiction in the dialogue, and the interaction accuracy and reliability of the multi-model collaborative dialogue in a complex scene are improved.

The invention discloses a multi-modal interaction method and system, electronic equipment and a storage medium, and relates to the technical field of image understanding, and the method comprises the steps: obtaining a language instruction input by a user and a target image, and extracting an interaction content region pointed by the language instruction from the target image; inputting the language instruction, the target image and the interaction content area into a multi-modal interaction model for multi-modal information fusion processing to obtain an interaction function identifier and a basic interaction parameter; generating complete interaction parameters according to the basic interaction parameters; and calling an interaction function module corresponding to the interaction function identifier to generate an answer to the language instruction according to the complete interaction parameter, and returning the answer to the user. According to the method, the image-text and interaction content area is identified through the multi-modal interaction model, and the text is complemented through light-weight OCR, so that the time delay can be effectively reduced, and the real-time efficient response requirement of a learning scene is met.

The invention relates to the technical field of virtual display, and discloses a virtual operation interaction method and system based on intelligent display equipment, and the method comprises the steps: obtaining a gesture image and an eye image in real time; respectively identifying and calculating a corresponding relation between the first hand feature and the first eye feature; if yes, entering a simple menu, and displaying a first-level menu; continuing to judge whether a second hand feature exists or not, and if yes, displaying a second-level menu; judging whether the secondary menu is a complex menu or not, if yes, continuing to judge whether a third hand feature exists or if yes, locking the secondary menu; after the second-level menu is locked, whether a fourth hand feature exists or not is judged, and if yes, the position and / or the size of the second-level menu are / is adjusted according to the fourth hand feature; wherein the fourth hand feature comprises dragging and / or zooming actions. According to the method, errors in the virtual operation interaction process can be reduced, and the interaction experience is improved.

The embodiment of the invention provides an interaction method and device in a game, electronic equipment and a storage medium. A graphical user interface is provided through terminal equipment, and the method comprises the following steps: detecting an interactive event in a game scene, and determining a current touch position of a target interactive operation in the graphical user interface; generating a trigger response area according to the current touch position; and in response to a touch operation in the trigger response area, triggering an interaction operation corresponding to the interactive event. According to the technical means of dynamically generating the trigger response area, the user can directly trigger the interactive operation corresponding to the interactive event near the touch position without moving a finger to a fixed interactive button position on the screen, so that the large movement of the finger of the user on the screen is reduced, the problem of incoherent operation is avoided, and the user experience is improved. Meanwhile, the misoperation rate of the mobile terminal is reduced, and the response efficiency of game interaction is improved.

The invention provides a memory-based man-machine interaction method, electronic equipment, a medium and a program product, and relates to the technical field of artificial intelligence. Based on an interaction scene corresponding to the multi-modal interaction input information, performing long and short term memory hierarchical storage processing, memory mixed retrieval processing and / or memory active forgetting processing on the multi-modal interaction input information to obtain processed target memory data; and generating a multi-modal interaction output result based on the target memory data. By adopting the method and the device, memory-based dynamic response can be realized in human-computer interaction based on a scenarized layered humanoid memory architecture.

The invention discloses a secure interaction method and system for a data space sandbox and a data source, and the method comprises the steps: initializing and authenticating a sandbox environment, and generating a unique environment identifier EnvID; based on the threshold signature scheme, negotiating among the plurality of key management nodes, the sandbox and the data source to generate a session key; the method comprises the following steps: sending a data request to a data source through a sandbox, requesting data added with an environment identifier EnvID based on a sandbox private key signature, after the data source receives the data request and verifies the signature, encrypting outer-layer data based on a session key, encrypting inner-layer data based on an attribute-based encryption algorithm, and generating Merkle root hash of response data; and decrypting outer-layer data based on the session key in a memory through a sandbox, decrypting and processing inner-layer data based on an attribute-based encryption private key, generating a zero-knowledge proof zkProof, and submitting Merkle root hash and the zero-knowledge proof zkProof to a block chain for evidence storage and auditing.

The invention relates to an information interaction method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: obtaining query content; displaying query related nodes; the query related node is used for representing a task generated in the process of obtaining the query result of the query content; executing the task represented by the query related node, and displaying an interactive question when the user needs to participate in interaction in the task execution process; the interactive questioning module is used for carrying out at least one of information confirmation and information inquiry aiming at the task; and in response to a reply operation for the interactive question, displaying reply content, the reply content being used for continuing to execute the task to obtain a task execution result. By adopting the method, the accuracy of the content generated by the intelligent agent can be improved.