17 results about "Interaction framework" patented technology

The invention provides a flexible distributed energy network multi-agent collaborative optimization method based on MARL, and the method comprises the steps: building a distributed energy network multi-agent interaction framework which comprises a local energy transaction model for distinguishing an intelligent soft switching path, a network cost model based on a power transmission distribution factor, and a power distribution network operator and user income model; a physical system operation constraint model is established and covers intelligent soft switch operation characteristics, network topology radial constraint, energy storage charging and discharging dynamic states, controllable distributed power supply and photovoltaic output limitation, translational load scheduling and DistFlow power flow constraint. And finally, constructing a collaborative optimization mechanism based on a multi-agent near-end strategy optimization algorithm, modeling the system into a partially observable Markov decision process, adopting a centralized training distributed execution framework, and guaranteeing transaction security and data privacy through block chain evidence storage, RSA encryption and an intelligent contract. The system economy and the operation flexibility are improved.

The invention belongs to the field of man-machine interaction, and particularly discloses an intelligent AI dialogue interaction method and system based on an RICH normal form, and the method comprises the steps: obtaining current dialogue context data and a user input signal, processing the data through an intention recognition model, and obtaining a user intention vector and a scene label; according to the user intention vector and the scene label, acquiring hierarchical state information in a preset multilayer interaction framework, and if the matching degree of the vector and the current hierarchical state is lower than a preset threshold value, activating an information sharing mechanism to obtain an updated shared knowledge graph; through the shared knowledge graph, a dynamic scene adaptation module is fused, a potential switching path and intention extension of a conversation are determined, and an optimized interaction path sequence is obtained; the objective of the invention is to solve the problems of inaccurate intention recognition, stiff interaction path switching and incoherent response logic of a traditional dialogue system in a complex scene in the prior art.

The invention provides a hand-eye collaborative interaction system based on eye movement tracking and a pressure ring, which is characterized in that two different modal inputs are subjected to a coarse positioning-fine operation interaction framework with complementary advantages, and specifically, large-range coarse glancing and positioning are completed by using natural and rapid characteristics of eye movement tracking; small-range fine pointing and confirmation are completed by means of the stable and controllable characteristics of the ring pressure sensing device, and the cooperative workflow of'coarse positioning-fine operation 'combining the advantages of rapidness and coarse-grained positioning of eye movement tracking with continuous and high-precision manual control provided by the finger-wearing device is adopted. On the premise that physiological and cognitive burdens of a user are not obviously increased, rapid and stable selection and control of long-distance and high-density virtual objects in the head-mounted display device can be achieved, and coordinate-level precision can be achieved.

The application relates to the technical field of digital twinning, in particular to a highway carbon emission full life cycle accounting system based on digital twinning, which comprises a front-end interaction framework and a back-end accounting framework, the front-end interaction framework and the back-end accounting framework realize data bidirectional interaction through network communication, the front-end interaction framework is used for realizing the human-computer interaction functions of digital twinning visual display, carbon emission accounting data operation and platform management instruction issuing. The application realizes accurate carbon emission full life cycle accounting, solves the pain point of the incomprehensive traditional accounting range, realizes the deep fusion of digital twinning and carbon emission data, improves the visualized control level, realizes multi-module collaborative linkage, improves the accounting efficiency and the control standardization, provides standardized data support, guarantees the consistency of the accounting accuracy, simultaneously, helps the green development of highways, and the system can realize the input of carbon reduction measure data and the accurate accounting of carbon reduction amount.

The invention discloses an LLM-based learner agent simulation learning and forgetting method and a feedback interaction framework with a teacher agent. The method mainly comprises the following steps: S1, a memory mechanism of a learner: mainly obtaining knowledge from a teacher agent through dialogue interaction and summarizing question answering experience of the learner, and storing the knowledge and the experience in a specific vector database in a two-tuple form to simulate memory so as to simulate the learning ability of the learner; s2, according to a forgetting mechanism, after a teacher message is received, a related vector database is retrieved through a vector similarity method, unforgotten memory is obtained and serves as supplement of an original message, the forgotten memory is filled into a prompt template to form a prompt, and the prompt is transmitted into a Monte Carlo Tree Of Though (MCTOT) module. The feedback evaluation is to analyze the evaluation and score of the teacher on the answer, and the score replaces the evaluation and score of the self-evaluation of the learner. Through the steps, the ability of the learner to solve the problem can be improved along with experience accumulation, and staged forgetting can be carried out to better fit the performance of the real learner.

The invention provides a BIM modeling and real-time rendering method and device based on parallel computing, and belongs to the technical field of building information models.The method comprises the steps that a visual interaction framework is built based on an open source rendering engine; based on an open source modeling engine, BIM parametric modeling algorithm interfaces such as sweeping, lofting and Boolean operation are packaged; according to professional modeling and visualization requirements, the BIM modeling and rendering process is decomposed into a plurality of task units, a parallel computing task execution queue is constructed, and dynamic allocation of computing resources is achieved; according to the task execution queue, parallel computing is carried out in batches, and a packaged BIM parametric modeling algorithm interface is called to carry out modeling operation; performing Mesh triangularization processing on the generated BIM model result to generate a Mesh data structure suitable for real-time rendering; hooking the generated Mesh data structure to a scene tree of a visual interaction framework for real-time rendering; and after all tasks in the parallel computing queue are executed, parameter setting after rendering is completed according to user configuration.

An interactive system is presented for interacting with a user through biosignals and sensor data. The system includes a user input system, an interaction framework, a dynamic user interface (UI), a processor, and a memory. The interaction framework processes biosignal inputs, sensor data, and current context data to provide a context estimation, which may be used to classify user attention and determine the state of selection targets. The dynamic UI receives the UI configuration and LLM / GenAI suggestions or instructions, and provides output to the user. The system can also include additional features, such as presenting selection targets in the idle state, analyzing biosignal inputs and context data to determine user attention, and performing actions based on selection states.

The invention discloses an intelligent interactive collaborative operation system and method based on an AI large model technology, and the system comprises an AI interactive framework module which provides a unified task entrance which supports receiving user input and actively deducing user intentions to provide dynamic suggestions, the suggested contents are derived from input texts, local storage documents, recent access webpages, common service systems and command line tool histories, and meanwhile, content starting and state operations are supported to be directly executed in a window through a shortcut key; the dynamic task disassembling module is used for analyzing a natural language or multimedia instruction into structured sub-tasks based on a large language model and a multi-modal model; and the automatic state synchronization module is used for receiving and storing the execution state of the sub-task in real time through the persistent connection channel.

The invention relates to a cockpit 3D-HMI multi-screen collaborative interaction method, system, medium and equipment, and relates to the technical field of automobile man-machine interaction. The method comprises the following steps: constructing a 3D-HMI dynamic scene map based on a preset resource library and a vehicle real-time state; based on the 3D-HMI dynamic scene map, performing differential rendering on a plurality of display terminals at different positions in the vehicle cabin to obtain display content of each display terminal; in response to a user interaction instruction received on any display terminal, updating the 3D-HMI dynamic scene map; and synchronously updating the display content on the corresponding display terminal based on the updated 3D-HMI dynamic scene map. Compared with the prior art, the immersion feeling of all passengers in the cabin is greatly enhanced, and the operation intuition and safety are improved; the space in the vehicle is converted into a continuous entertainment and information platform through the multi-screen collaborative 3D HMI, a bottom layer interaction framework is provided for future vehicle-mounted application, and high expandability is achieved.

The invention provides an on-orbit service autonomous task planning method based on large and small model cooperation, and belongs to the technical field of spacecraft on-orbit service intelligent task planning. The problems of lengthy decision chain, high response delay and poor adaptability in current on-orbit service task planning are solved. The method comprises the following steps: constructing a hierarchical intelligent decision-making architecture for large and small model collaboration, wherein the hierarchical intelligent decision-making architecture is used for realizing deep collaboration of large model semantic understanding and small model library calculation; a heterogeneous model interaction framework based on a model context protocol (MCP) is developed and used for data circulation of a large model and a small model; and constructing a general small model library for on-orbit service task planning, wherein the general small model library is used for on-orbit service autonomous task planning. The method is mainly used for aerospace tasks.

This invention discloses an AI interaction system based on a large language model, comprising the following modules: a multimodal input processing unit for collecting and encoding speech, text, images, and structured information to generate interaction state vectors; a target parsing and weight calculation unit for determining multidimensional interaction targets and calculating weight coefficients based on state vectors, task types, and user feedback; an actor subnetwork and a comment subnetwork for generating action policies and state-action value functions, respectively; a dynamic target mapping layer for adjusting the value function relationship between the two networks; a counterfactual trajectory generation unit for generating candidate counterfactual trajectories; a counterfactual coupling layer for calculating reward differences and generating gating signals; and a parameter joint update unit for synchronously optimizing model parameters. This invention significantly improves the policy generalization ability, learning stability, and intelligent decision-making level of the AI ​​interaction system by introducing a dynamic target mapping and counterfactual coupling mechanism into the large language model interaction framework.

Managing memory when processing a large language model (LLM) using a multi-turn interaction framework can be difficult as the LLM can produce significantly more key-value (KV) pairs than can be stored in a processor's memory. The multi-turn framework allows the LLM to process information more efficiently using the KV pairs. The KV pairs can be cached, such as in a KV cache. Policies can be used to identify KV pairs that should remain in the cache, KV pairs that can be moved to a more distant cache, or KV pairs that can be discarded. These policies can assist in managing the memory so the most valuable KV pairs for LLM processing efficiency remain in the processor's local cache memory. More distant cache can be memory locations outside of the processor, or in memory stacks connected via a communication bus.

An interactive system is presented for interacting with a user through biosignals and sensor data. The system includes a user input system, an interaction framework, a dynamic user interface (UI), a processor, and a memory. The interaction framework processes biosignal inputs, sensor data, and current context data to provide a context estimation, which may be used to classify user attention and determine the state of selection targets. The dynamic UI receives the UI configuration and LLM / GenAI suggestions or instructions, and provides output to the user. The system can also include additional features, such as presenting selection targets in the idle state, analyzing biosignal inputs and context data to determine user attention, and performing actions based on selection states.

The invention discloses a power distribution network map interaction method based on a man-machine interaction framework. The method comprises the following steps: realizing a power distribution network map process; the power distribution network map interface is connected to a man-machine interaction framework, and the man-machine interaction framework supports the access of each process interface; a communication channel is established between the power distribution network map and the man-machine interaction framework, so that the man-machine interaction framework uniformly receives and massively sends messages of each access process; the power distribution network map opens a map positioning interface; the power distribution network map and the power distribution network single line diagram mutually call a diagram opening function according to a power distribution network object; the power distribution network map realizes signboard display and listing operation functions; the power distribution network map realizes a remote control function of a power distribution network object; according to the method, the operation convenience, the browsing intuition and the information acquisition efficiency of the power distribution network management user on the power grid object are remarkably improved, and a key interactive experience support is provided for lean management of the power distribution network.

The invention discloses an interaction system, method and device based on a virtual digital object and a program product. Relates to the field of artificial intelligence, and comprises a back-end architecture used for receiving a data request through a virtual digital object, authenticating the data request, generating an operation instruction through an intelligent agent dispatching center under the condition that the data request passes the authentication, obtaining a processing result of the data request from a service system, and sending the processing result to the back-end architecture; the processing result is returned to the virtual digital object, and the service system comprises data requested by the data request; and the front-end architecture is used for calling the service plug-in to execute the operation instruction so as to obtain a processing result, and the front-end architecture adopts two deployment modes of an embedded architecture and a non-embedded architecture. Through the method and the device, the problem of low user request processing efficiency caused by difficulty in meeting diversified interaction requirements due to the fact that an MCP basic service architecture in related technologies is a universal interaction framework is solved.

The application provides a script-based virtual-real fusion guide method and system based on Beidou positioning, and relates to the technical field of intelligent travel guide, which comprises filtering and calibrating the user position collected through Beidou positioning and collecting real scene pictures; an interactive framework is constructed, and the node content is triggered when the deviation between the user position and the node position is not greater than the deviation threshold; the virtual character is called according to the node content to explain the real scene pictures, and the interactive task is published in combination with the behavior data of the user; the emotion recognition is performed on the node content, the real scene pictures, the behavior data and the interactive task to generate emotion features, which are input into an AI composition model to output scene music; the interactive interface of the virtual character and the interactive task is fused with the real scene pictures based on a fusion rendering algorithm, and the guide picture is output and the scene music is played synchronously, so that the script-based virtual-real fusion immersive guide based on Beidou high-precision positioning can be realized, and the tour experience of tourists and the operation efficiency of the scenic spot can be greatly improved.

The application relates to the technical field of interactive control, and specifically discloses a global control method and device for cross-platform pages, equipment and a medium. The method comprises the following steps: in response to a creation request of a target page, creating a native page instance corresponding to the target page through a native container layer, and creating a cross-platform page instance corresponding to the target page through a cross-platform rendering layer; creating a unique page identifier for the target page, and creating a page-level communication channel based on the unique page identifier; the life cycle of the page-level communication channel is bound to the life cycle of the target page; based on the unique page identifier, the page-level communication channel is associated with the native page instance and the cross-platform page instance respectively, so that the native page instance and the cross-platform page instance control each other based on the page-level communication channel, and an interactive framework for realizing the control of the native page instance and the cross-platform page instance by the page-level communication channel is constructed.