11092 results about "User input" patented technology

The invention discloses a multi-agent interactive efficient data analysis system, which comprises a natural language analysis unit, which is used for carrying out preliminary analysis on a natural language query request input by a user based on a natural language analysis model, and predicting a user intention to obtain the user intention; the task intelligent routing unit is used for exchanging information through a communication mechanism between the intelligent agents according to the intention of the user and distributing the data analysis tasks to the corresponding intelligent agents; the agent execution unit is used for executing various operations required by a data analysis task by an agent, including task disassembly and strategy evaluation, information storage and memory calling, external tool use and action execution, and obtaining an analysis result; and the agent report generation unit is used for generating a data analysis report based on the analysis result according to a preset report template and a formatting rule. And automation of a data analysis task is realized through efficient cooperation and a task allocation mechanism among multiple agents.

The invention discloses a multi-round knowledge-guided question-answering method and system fusing a large language model and a knowledge graph. The method comprises the following steps: S1, constructing the knowledge graph; s2, performing retrieval and clarification; s3, extracting labels and classifying questions; s4, performing scene guidance and dynamic retrieval; and S5, answer generation and formatting output. The method aims at solving the fuzzy problem in complex policy and regulation questions and answers, and the accuracy of user demand analysis and the comprehensiveness of answers are improved. According to the method, a knowledge graph is taken as a core, and multi-path semantic analysis and problem guidance capabilities are provided by constructing a hierarchical structure covering first-level items, second-level items, scene categories and keyword nodes. In combination with strong semantic comprehension and generation capabilities of the pre-trained large language model, the system can dynamically track context information in user input, iteratively access related nodes along different paths of the knowledge graph, and gradually clarify user intentions.

The invention discloses an enterprise global data analysis method based on a knowledge graph and a large language model, and the method comprises the following steps: collecting internal and external multi-source data of an enterprise, cleaning, standardizing and mapping, and constructing a unified data graph; after a user inputs a natural language query, a reasoning target and task description are generated in combination with semantic understanding, two reasoning paths are formed through structural reasoning and semantic reasoning respectively, and the two reasoning paths are fused for interactive verification and optimization. Logic conflicts and data missing are detected in real time in the reasoning process, and supplementary knowledge is automatically called for local reasoning correction. Through the corrected reasoning result, the system carries out semantic alignment and correlation analysis on multi-source data, a unified enterprise data analysis view is dynamically generated, a reasoning path and evolution information are recorded in the reasoning and analysis process, and subsequent traceable query is supported. According to the method, the data integration, intelligent reasoning and decision support capabilities of an enterprise in a complex data environment are improved.

Methods and systems for retrieval-augmented generation are described. Responsive to a user input, an input embedding associated with the user input is obtained. A synthetic question embedding is retrieved from an embeddings database, based on a similarity to the input embedding. The synthetic question embedding is used to obtain a relevant source text based on a stored mapping between the synthetic question embedding and the source text. A prompt is provided to a large language model (LLM) to generate and display a textual response to the user input, based on the user input and the source text. The disclosed methods and systems effectively narrow the pool of source documents based on similarity measures between the user input embedding and the synthetic question embedding, to enable the retrieval of more relevant sources for use in response generation.

An example operation includes one or more of rendering a graphical user interface within a software application including a plurality of elements, modifying locations of the plurality of elements within the graphical user interface based on user inputs on the graphical user interface, generating a dynamic mapping of the graphical user interface including the modified locations of the plurality of elements based on an execution of an artificial intelligence (AI) model on the rendered graphical user interface, and storing the dynamic mapping of the graphical user interface within a storage.

The invention discloses a knowledge exploration method and system based on a generative thinking chain and a feedback mechanism, and the method comprises the steps: receiving a multi-modal query inputted by a user, and carrying out the intention analysis to recognize a core demand; preprocessing the multi-modal query, extracting key information, and decomposing a complex problem into a plurality of sub-problems or sub-tasks; dynamically constructing a hierarchical reasoning path based on the generative thinking chain, and marking a logic basis for each step of reasoning path; reasoning path priority is optimized through dynamic weight distribution, a reasoning strategy is dynamically adjusted on line in combination with a meta-reinforcement learning framework, and a reasoning path is optimized; verifying the reasoning path by using a causal reasoning analysis tool, and generating an anti-fact path to correct error nodes; and outputting a structured text and a visual reasoning process, and optimizing model parameters in real time based on multi-user feedback aggregation of the game theory. According to the method, the problems of intelligent query and reasoning in a complex scene can be effectively solved, and the accuracy, real-time performance and credibility of knowledge service are realized.

A long video understanding method based on iterative hierarchical key frame selection comprises the following steps: firstly, carrying out hierarchical frame sampling on an input video to obtain hierarchical visual features, and then carrying out a key frame query module on the Nth-layer visual features of a video frame and an input problem text to obtain a key frame query result; video key frame query is carried out in combination with context semantics to generate query vectors, whether the query vectors are enough to generate answers to the input questions is predicted, if not, the query key frames are updated in the (N + 1) th layer of visual features with the higher frame rate, and the input question texts are combined with the context semantics to carry out iterative query of the key frames again; and inputting the inquired key frame and the instruction or the question into a multi-mode large model to generate an understanding result. According to the method, the video frames are queried and the associated frames are screened out based on the user input problem, so that the performance and efficiency of long video understanding are improved, and the method has wide application prospects in scenes such as entertainment, security and education.

An Applicant Assistant System may receive, from a user device, a user input indicating a query or task associated with information displayed in a user interface. The device may determine one or more components associated with the user interface and access component metadata of the determined one or more components, the component metadata for each of the one or more components indicating one or more of a fact, a data link, or an action. A prompt comprising at least some of the component metadata, at least some context information, and an indication of one or more available response elements may be provided to a large language model (LLM). The LLM may response with one or more response elements that may be processed by the System, such as to cause updates to the user interface on the user device.

The invention discloses a building electromechanical BIM model information rapid retrieval method and system, and the method comprises the steps: generating composite retrieval parameters fusing semantic keywords and three-dimensional coordinate constraints according to a multi-mode retrieval instruction inputted by a user; on the basis of the composite retrieval parameters, constructing a dynamic search space by utilizing a hierarchical graph convolutional network, and generating a candidate model index structure of multi-dimensional feature coding; inputting the candidate model index into a multi-objective optimization engine, performing real-time optimization on a search path by adopting a dynamic pruning algorithm driven by reinforcement learning, and outputting a candidate model set of which the confidence coefficient is higher than a preset confidence threshold after pruning; and on the basis of the candidate model set, associated equipment nodes are expanded through a knowledge graph embedding and complementing technology, and an enhanced retrieval result set containing the hidden associated equipment is generated. By utilizing the embodiment of the invention, efficient, multi-dimensional and multi-modal information accurate positioning and quick retrieval can be realized in a large-scale complex BIM model.

The embodiment of the invention discloses an interactive intelligent analysis method and device based on a knowledge graph and a medium, and relates to the technical field of data processing.The method comprises the steps that a natural language query text input by a user is obtained, intention detection is conducted on the natural language query text, the corresponding intention fuzzy confidence degree is determined, and the knowledge graph is obtained according to the intention fuzzy confidence degree; matching a target query channel; when the target query channel is a guide query channel, performing path derivation on the natural language query text through a business knowledge graph constructed by pre-learning to generate a personalized analysis card sequence so as to obtain a target analysis dimension in the personalized analysis card sequence triggered by a user; and under the triggering of the target analysis dimension, switching the guide query channel into a precise query channel, and through the precise query channel, calling a pre-learned query mode knowledge base to generate a target query statement corresponding to the target analysis dimension, so as to determine a corresponding visual analysis result through the target query statement.

Technology is disclosed herein for content assistance processes via foundation model integrations in software applications. In an implementation, a computing device receives natural language input from a user relating to content of a document in a user interface of an application. The computing device generates a first prompt for a foundation model to generate at least a completion to the natural language input. The computing device receives a reply to the first prompt from the foundation model which includes a completion to the natural language input. The computing device causes display of the completion in association with the natural language input in the user interface and receives user input comprising an indication to combine the input and the completion, resulting in a revised natural language input. The computing device submits a second prompt including the revised natural language input to the foundation model.

The invention discloses a privacy enhanced intelligent search method and system based on multi-round iteration. The method comprises the following steps: performing hierarchical semantic analysis on a query input by a user; splitting the complex query into sub-queries based on a task dependency graph algorithm; according to the sub-query, retrieving an evidence fragment from the multi-source data, constructing a semantic element coverage matrix to detect a knowledge gap, and if an uncovered element exists, generating a supplementary sub-query for iterative completion until a preset termination condition is met; integrating cross-modal data through a federated learning technology, and generating a structured knowledge graph fragment in combination with semantic vector alignment and an evidence fusion algorithm; performing dynamic desensitization processing on the retrieval result; and a closed-loop iterative updating mechanism is formed based on a user explicit and implicit feedback optimization retrieval strategy. The problems of traditional intelligent search in the aspects of semantic understanding depth, complex problem reasoning, search result accuracy and integrity, user privacy security and the like are effectively solved.

The invention provides an industrial agent decision-making method and device, electronic equipment and a storage medium. The method comprises the following steps: loading multi-source industrial data to a knowledge graph, and constructing a domain ontology and an MCP ontology; performing parameter fine tuning on a preset base large language model; receiving an industrial process planning demand input by a user, and performing semantic analysis on the industrial process planning demand; processing the query result by utilizing an MCP context strategy to generate a prompt context; inputting the prompt context and the industrial process planning demand into a fine tuning large language model to generate a first process planning scheme; performing rule verification on the first process planning scheme based on the knowledge graph, and judging whether the first process planning scheme meets a preset rule or not according to a verification result; and converting the final process planning scheme into a control script or an interface calling sequence which can be analyzed by an industrial execution system, and outputting the control script or the interface calling sequence. According to the method, the cross-software system compliance process planning with unified knowledge, automatic generation and rule verification can be realized.

The invention provides a multi-round dialogue interaction method and system based on context reconstruction and multi-library retrieval, and the method comprises the steps: firstly obtaining a multi-round dialogue data set of a target user, which comprises a plurality of dialogue round sequences composed of user input statements and system response statements; performing context reconstruction processing on the multi-round dialogue data set to generate context reconstruction characteristics of each dialogue round sequence, covering current round semantic focus offset and historical round semantic dependence intensity, and retrieving a matched multi-database retrieval result from a preset heterogeneous database based on a dynamic context window, a candidate response statement set and confidence are included. Performing multi-strategy matching on context reconstruction features and retrieval results, generating a response generation strategy to adjust candidate response semantic priorities and confidence thresholds, and finally feeding back the response generation strategy to a dialogue service system to trigger response optimization operation, and updating heterogeneous database retrieval weights and context window dynamic adjustment parameters.

The invention provides an intelligent mechanical arm control system scheme based on multi-model cooperation, and belongs to the field of automation and intelligent control. The system is divided into four parts of man-machine interaction, detection and perception, task decoupling planning and program generation, and robot execution operation. Man-machine interaction is carried out, a user inputs an instruction in a text or voice format, and instruction processing is carried out through voice recognition and a natural language translation model; detecting and sensing, and identifying and positioning a target captured by the camera by using a multi-modal large model; task decoupling planning and program generation: analyzing the user instruction and the perception information into an executable program by applying a task planning model and a program translation model; and checking and correcting the program by using the program checking model, and driving the mechanical arm to complete a task. According to the system scheme, variable environments can be dealt with, complex language instructions can be understood, intelligent control over the mechanical arm is achieved, and the multi-task execution capacity and the intelligent level of the mechanical arm are remarkably improved.

The invention relates to the technical field of building data interaction, in particular to a building engineering interaction method and system based on a BIM model and a medium. The method comprises the following steps: collecting construction site environment parameters and structure response data by using a distributed sensor network; preprocessing the data by an edge computing node; generating standardized environment data and key structure indexes; comparing environment threshold values to identify abnormal events; the method comprises the following steps of: displaying spatial positioning and risk levels through a visual interface, receiving a regulation and control instruction input by a user, dynamically adjusting construction parameters of a BIM model, generating an optimized construction progress scheme, comparing the optimized scheme with an original model to identify a construction conflict area, and generating a conflict resolution report. Through the advanced monitoring technology and construction management technology, the response speed and decision-making efficiency of the building engineering project are improved, and the safety guarantee and resource utilization efficiency in the construction process are improved.

The invention is suitable for the technical field of artificial intelligence, and provides a multi-modal large language model dialogue generation method based on natural language understanding, comprising the following steps: receiving multi-modal information input by a user through a multi-modal large language model, the multi-modal information comprising a plurality of modal data; preprocessing modal data in the multi-modal information, and extracting to obtain multi-modal features; performing unified fusion feature representation on the extracted multi-modal features based on a dynamic weighted fusion strategy of a multi-head attention mechanism; determining the dialogue state of the long context based on a long context processing algorithm, and ensuring that the generated reply content is associated with the dialogue history; and according to the unified fusion feature representation and the dialogue state, a natural language is generated through an RAG retrieval enhancement generation technology for replying. According to the method, input of multiple modes can be processed and understood, the ability of understanding the intention of the user is improved, the continuity of the context is maintained, and the generated reply is more natural.

The invention relates to the technical field of information retrieval, and discloses a multi-modal fusion and reinforcement learning collaborative retrieval enhancement generation method and system. The method comprises the following steps: receiving an original query input by a user, and generating a sub-query based on a large language model in combination with a multi-modal context of a current iteration step; forming a current state in combination with the sub-query and the multi-modal context, modeling a retrieval enhancement generation task as a Markov decision process, and adaptively selecting an optimal action from a predefined action set in the current state by utilizing a large language model according to a decision strategy; executing a corresponding multi-modal retrieval operation according to the optimal action, fusing the obtained multi-modal information, generating an intermediate answer or a final answer of the sub-query, and updating a multi-modal context by using the intermediate answer; off-line training optimization is carried out on the large language model through imitation learning and a calibration chain, and decision strategies and sub-queries are inferred online through the model after fine adjustment. According to the invention, more efficient and accurate complex query processing is realized.

The embodiment of the invention discloses a context-based big language model dialogue processing method and device and electronic equipment, and can solve the problem of how to provide a dynamic management method based on context similarity analysis and intelligent screening to optimize big language model interaction. The method comprises the steps of obtaining current text information input by a user; coding the current text information and a plurality of pieces of pre-stored historical dialogue information to obtain a current text vector and a plurality of historical dialogue vectors; according to the semantic similarity between each historical dialogue vector and the current text vector, screening the plurality of historical dialogue vectors to obtain screened target historical dialogue information; splicing the current text information and the screened target historical dialogue information to obtain a target input text; the target input text is input into a target language model, target output response information is obtained, and the target language model comprises a large language model.

The technology discloses a system for validation of generative AI model operators using preloaded query context connected to independent AI models in generative AI-driven trivia gameplay. The system includes a user interface connected to a generative AI model that generates trivia responses based on user input. A model superstructure between the user interface, the generative AI model, and independent validation model(s) facilitates the evaluation of the user input or trivia response by the validation model(s). The validation model(s) are provided with a pre-loaded query context to detect adherence to predetermined conditions. A consensus module receives the validation model's output and delivers the user input or trivia response to the generative AI model or user interface, respectively, based on the evaluation.

Embodiments described herein relate to systems and methods for automatically generating content for a generative answer interface of a collaboration platform. The system receives a natural language user input identifying corresponding blocks of text or snippets using a content extraction service. A prompt is generated using the blocks of text and is used to obtain a generative response. The generative response and links to corresponding content are displayed in the generative answer interface and can be inserted into content of the collaboration platform. The systems and methods described use a network architecture that includes a prompt generation service and a set of one or more purpose-configured large language model instances (LLMs) and / or other trained classifiers or natural language processors used to provide generative responses for content collaboration platforms.

The invention provides a question and answer method based on a thinking chain and an intelligent agent and a ChatBI system. The method comprises the steps that a question text input by a user is received, the intelligent agent is used for analyzing and planning the question text, a thinking chain mechanism is used for decomposing the question text into a plurality of subtasks, and the execution sequence of the subtasks is determined. The whole question and answer process is gradually disassembled into a plurality of subtasks through a thinking chain mechanism, and each subtask is sequentially executed according to the execution sequence, so that the accuracy and the flexibility of query are improved. And for the execution process of each sub-task, in response to determining that the execution of the sub-task fails, re-planning the execution sequence of the plurality of sub-tasks until the plurality of sub-tasks are executed in sequence, and obtaining a question and answer result corresponding to the question text. In the execution process of the subtasks, the agent dynamically optimizes the question and answer process by evaluating the execution results of the subtasks in real time, the limitation of static query is avoided, and the question and answer efficiency and the accuracy of question and answer results are improved.

The invention relates to the technical field of process automation, in particular to an RPA service automation method capable of enabling a large language model MCP. The method comprises the following steps: acquiring user input data, and performing intention understanding through a multi-round intention recognition model according to the user input data to obtain semantic instruction data; performing standard semantic protocol conversion according to the semantic instruction data to obtain standard semantic protocol data; performing flow chart node matching according to the standard semantic protocol data to obtain flow chart node data; and generating a business process according to the flow chart node data to obtain business process data. According to the method, the multi-round intention recognition capability of the large language model and the standard semantic protocol conversion are fused, so that the accurate mapping from the natural language to the business process is realized, and the intelligent level and the user friendliness of the RPA system are improved. Through process node matching and process logic verification, the execution effectiveness of the automatic generation process is ensured, and the labor cost and configuration errors are reduced.

Outputs generated by an LLM may depend significantly on the precise language of instructions and context included in a prompt into the LLM. However, can be difficult for users to define the exact language of instructions and context to be included in the prompt to generate desirable outputs. A computer-implemented method may involve: obtaining a candidate prompt including input data and instructions; inputting the candidate prompt into a LLM and receiving at least one candidate output generated by the LLM; receiving user input directed to the candidate prompt and / or the at least one candidate output; inputting at least the user input and one or both of the candidate prompt and the candidate output into the LLM as a modification prompt and receiving a subsequent candidate prompt generated by the LLM. The subsequent candidate prompt may include modified candidate instructions different from the candidate instructions.

The present application provides a large language model-based event processing method and apparatus, a device and a medium. The large language model-based event processing method comprises: acquiring a question input by a user; acquiring pre-generated event information; fusing the question and the event information to obtain a fusion result; and inputting the fusion result into a pre-trained large language model to obtain reply content corresponding to the question.

Systems, computer program products, and methods are described herein for building material data management. With reference to an example method, the method receives a first dataset formed of first data entries associated with a building material data source and generates a building material data entity based on the building material data source. The method includes outputting a representation of the building material data entity. The first dataset may be formed of data records (e.g., construction documents, user inputs, sensor data, or machines data), and the representation may be a visual representation may include notifications, visual presentations of the building material entity, etc.

Methods and systems for a document review process are provided. The method includes receiving an input digital model representation comprising at least one externally-accessible model endpoint for generating a digital artifact. Then, generating a document splice comprising access to multiple document subunits, with at least one document subunit written in a natural language and comprising the digital artifact; the access to each document subunit is provided through an externally-accessible document endpoint for the subunit. Then, generating a document by combining the document subunits, and generating a view associated with the document, based on an user authorization result including selective access rights to the document subunits. The view comprises access to the digital model representation, the digital artifact, each document subunit, and the document. Finally, receiving a user input and updating, via one of the externally-accessible document endpoints, the document splice based on the user input.

The invention discloses an ST code generation method based on graph alignment coding large model and multi-agent collaboration, and the method comprises the steps: receiving an ST code programming demand inputted by a user through a demand analysis module, refining and analyzing the demand based on multiple rounds of interactive conversations of the user and insight agents, and generating a standardized ST code programming demand; the retrieval module receives a standardized ST code programming requirement, and retrieves and obtains related knowledge through a retrieval agent in combination with an ST code knowledge base; and the double-agent collaborative self-correction code generation module receives standardized ST code programming requirements and retrieved related knowledge, a graph alignment coding large model constructed based on a graph neural network and a cross-modal alignment technology serves as a coding agent to cooperatively work with a review agent, ST code structure information is injected into the large model, and a final ST code is generated. According to the method, high-accuracy and high-reliability ST code automatic generation can be realized, and the development efficiency of a PLC program in the industrial control field is improved.

The invention discloses an Agent-based tool combination and task processing method and device, equipment and a medium, and the method comprises the steps: carrying out the natural language processing of a task instruction inputted by a user, and generating a structured semantic vector containing task semantics; performing similarity matching on the structured semantic vector and a predefined tool node semantic tag in a knowledge base, and outputting a candidate tool node set related to the current task; performing dynamic priority ranking on the candidate tool node set based on context parameters to generate an initial thinking chain; converting the thinking chain into a tree flow chart structure, and performing dynamic addition and deletion or parameter adjustment on tool nodes in the flow chart according to a feedback or preset optimization strategy; and updating tool combinational logic according to the adjusted thinking chain, processing the task instruction, and outputting a task processing result. The tool nodes are matched through the Agent agents, and the thinking chain is generated through dynamic sorting, so that the task processing efficiency and accuracy are improved.

The invention provides a multi-modal intelligent question-answering and recommendation system supporting emotional speech output, and relates to the technical field of visual question-answering, and the system specifically comprises a multi-modal question-answering module, a multi-modal recommendation module, a speech recognition module, and a speech synthesis module. Wherein the multi-mode question answering module converts an image input by a user into a natural language form, and final question answering is completed in combination with a comet knowledge base COMET; the voice recognition module is used for recognizing voice data input into the multi-mode intelligent question answering and recommending system and processing the voice data into a text form; the multi-modal recommendation module identifies whether modal missing exists in input data or not, generates representation of the missing modal, obtains vector representation of the user and the article through a graph convolutional neural network and learning according to an interaction matrix of the user and the article, carries out reliability calculation, and finally sends a multi-modal recommendation result to the user and the article. Sending back to the multi-mode question and answer module; and the voice synthesis module outputs the voice to the user.