6869 results about "User input" patented technology

The invention provides an industrial agent decision-making method and device, electronic equipment and a storage medium. The method comprises the following steps: loading multi-source industrial data to a knowledge graph, and constructing a domain ontology and an MCP ontology; performing parameter fine tuning on a preset base large language model; receiving an industrial process planning demand input by a user, and performing semantic analysis on the industrial process planning demand; processing the query result by utilizing an MCP context strategy to generate a prompt context; inputting the prompt context and the industrial process planning demand into a fine tuning large language model to generate a first process planning scheme; performing rule verification on the first process planning scheme based on the knowledge graph, and judging whether the first process planning scheme meets a preset rule or not according to a verification result; and converting the final process planning scheme into a control script or an interface calling sequence which can be analyzed by an industrial execution system, and outputting the control script or the interface calling sequence. According to the method, the cross-software system compliance process planning with unified knowledge, automatic generation and rule verification can be realized.

The invention relates to the technical field of building data interaction, in particular to a building engineering interaction method and system based on a BIM model and a medium. The method comprises the following steps: collecting construction site environment parameters and structure response data by using a distributed sensor network; preprocessing the data by an edge computing node; generating standardized environment data and key structure indexes; comparing environment threshold values to identify abnormal events; the method comprises the following steps of: displaying spatial positioning and risk levels through a visual interface, receiving a regulation and control instruction input by a user, dynamically adjusting construction parameters of a BIM model, generating an optimized construction progress scheme, comparing the optimized scheme with an original model to identify a construction conflict area, and generating a conflict resolution report. Through the advanced monitoring technology and construction management technology, the response speed and decision-making efficiency of the building engineering project are improved, and the safety guarantee and resource utilization efficiency in the construction process are improved.

The invention belongs to the field of natural language processing, particularly relates to a multi-modal document generation method and device based on multi-agent collaboration, and aims to solve the problems that an existing method is low in intention recognition accuracy, limited in retrieval range and not professional enough in content generation. The method comprises the following steps: generating a structured template; analyzing the text input by the user to identify a writing intention, and determining a target template; vectorizing each candidate resource feature to obtain a corresponding sparse vector, a dense vector and a knowledge vector, and performing semantic alignment; extracting context features of the input text, respectively performing multi-path retrieval recall, evaluating and sorting recall results, and screening out target features; and constructing a thinking chain in combination with the knowledge graph, and generating a multi-modal document according to the target template. According to the method, the outline structure can be extracted, the picture / table style can be recognized, the templates adaptive to different document types can be dynamically generated, and full-process automation from user input to document output is achieved.

The invention discloses a multi-agent dynamic arrangement method based on multi-modal analysis and adaptive retrieval, and relates to the technical field of artificial intelligence and information retrieval. Comprising the steps of S1, converting a text, an image, structured data and voice content input by a user into a unified multi-mode semantic representation, S2, converting the unified multi-mode semantic representation into a specific execution process, and S3, automatically scheduling a reasoning agent, a knowledge obtaining agent and an execution agent according to DAG nodes, task elements and available resources, and obtaining the task elements and the execution agent according to the reasoning agent, the knowledge obtaining agent and the execution agent. S4, after task process construction and agent arrangement are completed, dynamic retrieval, evidence convergence and strategy optimization are carried out on information requirements related to a user task, so that a reasoning agent obtains complete knowledge support with consistent context, and S5, knowledge evidence is combined with a task process, so that the task process is completed. The method comprises the following steps: step S6, implementing problem solving, strategy generation and task closed-loop execution through a reasoning agent, step S6, performing actual operation on a target task by an execution agent according to an executable instruction sequence output by the reasoning agent, and outputting a result, and step S7, performing result verification according to an output result returned by the execution agent, and the correctness, integrity and consistency of an output result are examined through rule verification, model evaluation and evidence alignment.

An AI-powered content generation system that creates consistent, coherent, and engaging multi-modal content by integrating multiple specialized AI components. The system analyzes user input, identifies key elements, and maintains continuity throughout the generation process. It incorporates a feedback loop to learn and adapt based on user preferences, enabling personalized content experiences. The modular architecture allows for seamless integration of AI components focusing on text, images, audio, and interactive elements. The system ensures consistency across modalities and over extended periods, while managing rights, licenses, and royalties using blockchain technology. This advanced platform revolutionizes content creation, consumption, and management in the digital age.

The invention relates to an industrial equipment maintenance intelligent question-answering system based on multi-agent collaboration. Wherein the input unit is used for receiving text, voice, image or equipment scanning and other multi-mode user input information and analyzing the information into structured problem information; the scheduling unit performs semantic understanding and problem classification on the structured problem information based on the fine-tuned cross-language pre-training language model and an incremental training mechanism; the processing unit calls a corresponding domain agent according to the classification result, and generates an intelligent question and answer processing result including predictive maintenance suggestions, structured reply content and semantic annotation information; and the fusion unit fuses the local knowledge base, the graph database and the networking retrieval information, performs multi-hop semantic reasoning on the intelligent question and answer processing result, and generates multi-modal reply information including text description, image screenshots, prediction curves and recommendation links. The system can support multi-language and multi-mode intelligent question answering and predictive maintenance in a complex industrial maintenance scene.

The invention discloses an AI-based animation split script automatic generation and visual preview method and system, and the method comprises the following steps: 1, receiving a natural language script text inputted by a user, the natural language script text comprising scene description, role action, dialogue and shot indication information; step 2, performing semantic analysis and structured analysis on the script text based on a natural language processing technology, and identifying and extracting key narrative elements; by introducing an artificial intelligence technology, end-to-end automatic generation and interactive optimization from a character script to a dynamic split rehearsal video are realized, the system can deeply understand scenes, actions, role emotions and shot languages in the script, corresponding visual elements are automatically matched and generated, and the dynamic split rehearsal effect is improved. And the timeline and the rhythm conforming to the film and television grammar are constructed, so that the efficiency and the consistency of the split creation are greatly improved, and the professional threshold and the manufacturing cost are reduced.

The invention discloses a retrieval enhancement generated document screening system and method fusing a verification mechanism, and relates to the technical field of document screening, the system comprises a user input and query analysis module for extracting key information through natural language processing, and converting the key information into a high-dimensional semantic vector, a meta-tag and a keyword set; the multi-source document retrieval module is used for obtaining documents from multiple data sources through mixed retrieval and generating a candidate set through preliminary screening and sorting; the credibility evaluation and security verification module is used for generating scores and labels after multi-dimensional evaluation and screening qualified documents; the document consistency detection module is used for detecting document conflicts, processing and sequencing, and ensuring logic consistency; the document acquisition and generation module is used for inputting qualified documents into a generation model and generating answers with references; and the result output and tracing module is used for outputting answers and recording whole-process data to ensure traceability. The invention aims to ensure the accuracy and credibility of the generated content through a multi-dimensional verification mechanism.

The invention discloses a low-code development automatic generation method based on a large language model, which comprises the following steps: collecting natural language description information input by a user, and preprocessing; inputting the standardized demand corpus set into a large language model, and executing semantic understanding and context modeling; matching the low-code component library based on the structured semantic representation to generate component assembly description information; generating and verifying an engineering skeleton according to the assembly description information, and outputting an executable low-code application initial version; running the executable low-code application initial version, and monitoring and analyzing execution difference to generate an increment adjustment instruction; and inputting the increment adjustment instruction into the large language model, performing reconstruction and adaptive optimization, and outputting an executable low-code application final version. According to the method, large language model semantic understanding and adaptive optimization technologies are fused, automatic generation and continuous optimization of low-code applications are realized, and the method has the advantages of intelligence, high precision and engineering reliability.

The invention discloses a cross-modal interactive image restoration method fusing text semantic guidance and visual structure priori, which comprises the following steps of: firstly, acquiring natural language description input by a user and an image to be restored, and generating a semantic segmentation map of the image through a semantic segmentation model; encoding the text and image semantics by using a pre-trained cross-modal encoding model to obtain text and semantic features; guiding a semantic alignment attention module through Prompt to realize deep fusion of multi-modal semantic features and image space features; structural enhancement and regulation of image features are realized by constructing a text guide weight graph, performing element-level modulation on the text guide weight graph and the optimized semantic segmentation graph, constructing a cross-modal structure semantic feature graph and generating a structural modulation factor; a four-stage image restoration network is adopted, and a high-quality restoration image conforming to semantic guidance and structure prior is generated step by step. According to the method, the semantic consistency, the structural integrity and the visual reality sense of an image restoration result are improved.

Techniques for generating an executable API call for an LLM-generated request, where the executable API call is usable to cause a component to generate a potential response to a user input, are described. In some embodiments, the system receives a user input and uses a language model to generate a request for a component to provide a potential response to the user input. The system uses the request, an API description corresponding to the component, and other information not available to the language model during processing to generate an executable API call corresponding to the request. The system can execute the executable API calls (in a system-determined order or concurrently) to cause the corresponding components to generate potential responses to the user input.

The embodiment of the invention provides a method and system for automatically generating a document based on a template and a large model, and relates to the technical field of document generation, the method comprises the following steps: step S1, a user inputs information through a browser interface and uploads a to-be-reviewed file; step S2, analyzing the uploaded multi-modal file and extracting structured data; s3, outputting a standardized template instance file according to the decision tree dynamic combination template; s4, calling a large model to generate a project background and a file content abstract; s5, the generated content is rendered and combined with the attachment to form a complete conference review file; s6, executing cross-document consistency intelligent verification and executing intelligent error correction; and S7, generating and storing a final document with version traceability information. According to the method, on the basis of the document template and the large model capacity, document formats are unified, content is accurately generated, and the document writing efficiency is remarkably improved.

The invention relates to the technical field of intelligent manufacturing, in particular to a milling process intelligent decision-making method based on multi-agent collaboration, which comprises the following steps of: constructing a milling process planning-oriented multi-modal knowledge base, receiving and analyzing a milling processing demand input by a user based on a central large language model agent, and establishing a multi-modal knowledge base; decomposing a process planning task into associated sub-tasks based on knowledge in the multi-modal knowledge base, and distributing the associated sub-tasks to corresponding professional agents; and obtaining related knowledge based on a retrieval enhancement generation technology, and executing the subtask. Through the LLM-driven multi-agent collaborative system and the RAG technology, autonomous dynamic optimization of the process scheme is realized to improve the intelligence level, a distributed architecture is adopted to enhance the flexibility to adapt to frequent changes, a multi-modal knowledge base is constructed to capture and reuse expert implicit knowledge to ensure the consistency of the scheme, and the method has the advantages of being high in practicability and high in practicability. And multi-dimensional knowledge is integrated and deeply applied to cope with complex process requirements, so that the defects in the prior art are effectively overcome.

The invention relates to the technical field of natural language processing, in particular to an intelligent search engine system and method based on NLP and vector hybrid retrieval, and the system comprises a query analysis module which is used for receiving a query statement input by a user and obtaining structured query information based on the query statement; the symbiotic index module comprises a sparse extension index unit which is used for constructing a sparse inverted index table based on keywords in the structured query information; the vectorization hypergraph index unit is used for forming a hypergraph index based on the business data; the recall arrangement module is used for acquiring a candidate object set according to the structured query information; the constraint rearrangement module is used for calculating a joint priority score between query and candidate objects based on the candidate object set, and obtaining a sorting result under constraint conditions of meeting a supplier proportion, a category proportion and a price interval; and the evidence generation module is used for generating evidence information based on the sorting result and outputting the evidence information to the user interface.

The invention provides a scientific research trusted agent construction method based on an evidence-reasoning-verification chain, and relates to the technical field of agent construction, and the method comprises the steps: analyzing a scientific query input by a user based on a large language model; adopting the high-quality evidence set obtained through formal research problem representation retrieval to construct a scientific knowledge graph, and synthesizing a plurality of scientific hypotheses based on the high-quality evidence set and the scientific knowledge graph; constructing an integrated constraint reasoning path, and outputting a structured reasoning chain; after tuple processing is carried out, the credibility is verified through scientific knowledge graph alignment, and a credible reasoning chain is generated and output as the core content of the structured scientific report. According to the method and the device, the technical problems that the scientific research intelligent agent cannot be verified and traced and is lack of scientific basis in the prior art can be solved, and the technical effects of ensuring that the content generated by the scientific research intelligent agent is logically consistent, sufficient and traceable in evidence and has academic credibility are achieved.

Techniques are described for identifying functionalities (i.e., user experiences) that are requested by users but are not supported by natural understanding (NU) processing. Some embodiments may involve identifying functionalities by transforming user inputs to functionality-based representations. The functionality-based representations may be grouped into individual functionalities. The user inputs associated with an individual functionality may be evaluated using an NU component to determine whether the functionality is supported. These techniques may enable discovery at a functionality level, rather than at a user input level, an intent level, or an entity level. These techniques may also be used to group user inputs to determine trending functionalities.

The invention belongs to the technical field of big language model security, and particularly discloses a defense method and system for big language model cue word attack, a terminal and a medium. Comprising the steps of receiving information content input by a user, and generating a plurality of detection input copies based on a preset rule; inputting the copies into mutually independent detection processes in parallel to obtain a plurality of risk scores; constructing a comprehensive risk score based on the risk score, and determining a risk level of the input content according to the comprehensive risk score; when the risk level falls into a defense triggering interval, executing an active defense strategy, and implementing instruction confusion, semantic dilution and structural isolation processing to generate first output content; when the risk level is below a pass threshold, second output content is generated based on the user original input. According to the method, on the premise that normal interaction experience is not affected, fine-grained, controllable and dynamic safety protection can be carried out on multi-type cue word attacks, and the overall safety and usability of a large language model are improved.

The invention discloses a question and answer method and system based on a knowledge graph, and the method comprises the steps: outputting a structured query graph of which nodes comprise entities, relationships and semantic weights according to a natural language question input by a user; on the basis of the structured query graph, outputting candidate entity sub-graphs of which the ambiguity is eliminated; outputting a reasoning path set with the highest probability according to the candidate entity subgraph; based on the reasoning path set, outputting candidate answers which conform to logic and are coherent in grammar; and according to the topological consistency of the candidate answers and the knowledge graph, calculating an answer credibility score by using a causal reasoning model, and outputting a final answer and an interpretability verification report by analyzing a logic causal chain implied in the answers and verifying with the knowledge graph. By utilizing the embodiment of the invention, deep integration and value mining of park multi-source data can be realized, and powerful support is provided for fine management and intelligent decision-making of the smart park.

The invention discloses a method for converting a natural language into a low code based on multi-modal reinforcement learning, which comprises the following steps of: performing word segmentation, embedding and multi-layer feature extraction on a natural language instruction input by a user, combining a self-attention mechanism and a graph attention mechanism, extracting and optimizing an original semantic feature vector, and automatically identifying a business field; semantic relationship triples in the domain knowledge graph are fused, and a multi-modal semantic alignment and context enhancement strategy is adopted, so that the accuracy and stability of semantic representation are remarkably improved; when semantic drift or ambiguity is detected, a multi-candidate correction mechanism is triggered to obtain a better analysis result, and the robustness of semantic understanding is enhanced; and finally, mapping an analysis result into an instruction which can be identified by a low-code platform, automatically generating a code structure, continuously optimizing a semantic model and a knowledge graph based on user feedback, realizing adaptive learning, and improving the conversion efficiency and quality from a natural language to codes.

Some implementations of the disclosure provide a computer-implemented method including operations of receiving, by an orchestration agent, user input corresponding to a user question, wherein generating a response to the user question includes one of generating, editing, or refining programming code, and generating, by the orchestration agent, a prompt instructing a first sub-large language model (LLM) to perform a first task. In response to the prompt, generating, by the first sub-LLM, instructions for a second sub-LLM to perform a second task, wherein results of performing the second task by the second sub-LLM are provided to the first sub-LLM and performing, by the first sub-LLM, the first task utilizing the results of the second task generated by the second sub-LLM. An additional operation includes generating, by the orchestration agent, a GUI that displays the response to the user question, wherein the response includes or is based on the programming code.

The invention relates to a knowledge graph agent construction method and system based on multi-modal fusion, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring multi-modal data, and mapping different modal data to a unified semantic space through a cross-modal embedding technology to obtain multi-modal reference data; extracting features of the multi-modal reference data through an attention mechanism to obtain multi-modal joint features; constructing and updating a dynamic knowledge graph based on the multi-modal joint features to obtain a time sequence dynamic dependency knowledge graph; and according to the time sequence dynamic dependency knowledge graph, context-aware reasoning is carried out through a cross-modal reasoning engine to obtain a user input mode, and an interaction strategy is dynamically adjusted based on the user input mode to generate a multi-modal response. And the knowledge graph agent construction based on multi-modal fusion is realized.

The invention discloses a full-scene task autonomous execution method and system based on a large model, belongs to the technical field of computer application and artificial intelligence, and aims to solve the technical problems that an existing RPA technology is lack of autonomous thinking ability, and a browser use technology is limited in application range, is greatly influenced by factors such as webpage change and the like, and is poor in reliability. The Computer use technology is inaccurate in operation, high in development difficulty and has security risks, and the technical scheme comprises the following steps: establishing an MCP service, and compiling a task autonomous execution tool set containing various basic operation instructions including software opening, browser starting, precise clicking and information filling; the MCP service is deployed in the Windows virtual machine environment, and stable operation of the service is ensured; constructing a task autonomous execution workflow agent with task understanding, planning and scheduling capabilities; the user inputs a task target through a natural language, and the agent receives and records the specific demand of the user as a target guide for subsequent task generation and execution.

The invention discloses a multi-knowledge-base scheduling routing method based on intention recognition and feedback optimization, and the method comprises the steps: S1, receiving multi-modal input from a user, carrying out the deep semantic analysis of the input content through natural language understanding and multi-modal analysis, and outputting a standardized intention label; s2, constructing a capability portrait for each knowledge base, and then generating a route matching score matrix according to a similarity relationship between the user intention tag and the capability portrait of each knowledge base; s3, screening out one or more most relevant candidate knowledge bases according to the scoring matrix and a set matching threshold value, and selecting a retrieval combination strategy to realize information recall; s4, information retrieval is executed based on the selected knowledge base, recall results and original user input are submitted to a large language model for content generation, and answers or suggestions are formed and output; and S5, user feedback collection and strategy optimization are carried out. According to the method, a more accurate, efficient and self-evolutionary knowledge base scheduling mechanism can be realized.

The invention discloses a document generation system and method based on multi-agent collaboration, and the method comprises the steps: understanding and extracting the high-level semantic information of a text input by a user, and dynamically generating a problem to guide the user to define a demand, so as to form a detailed document demand; recognizing the theme and key elements of the document from the detailed document requirements; the optimal sequence of task execution is determined based on a shortest path algorithm, potential conflicts in task execution are predicted and solved through parallel processing and a search algorithm, and optimized task planning is formed through feedback circulation; generating a document outline according to user requirements, retrieving associated contents of document chapters so as to write chapter contents, and performing grammar and format verification to form a preliminary document; defining a document quality evaluation index according to user requirements and industry standards, performing document quality evaluation on the preliminary document, and feeding back the document quality evaluation result to the user; and generating a complete final document and presenting the complete final document to the user. According to the invention, the document generation quality is improved.

Techniques for generating tasks to be completed in order to perform an action responsive to a user input and, for a given task, shortlisting available components to those that are relevant for the task are described. The system processes a user input to determine tasks to be completed in order to perform an action responsive to the user input. The system determines a priority of the tasks and selects a top-ranked task. The system determines descriptions of processing performable by components that are semantically similar to the current task, and requests a description of the function the corresponding components would perform for the current task. Based on the received descriptions, the system selects one or more components to perform the task. Thereafter, the system causes the action to be performed and outputs a response to the user input.

Systems and methods described herein relate to the use of generative artificial intelligence to facilitate rendering of user interface elements in a user interface associated with a digital assistant. A backend response is automatically generated in response to user input provided via the user interface associated with the digital assistant. Prompt data is generated. The prompt data includes an instruction to generate an intermediate representation of an output data structure supported by the digital assistant. The prompt data is provided to a generative machine learning model to obtain the intermediate representation. The intermediate representation is processed to obtain the output data structure. One or more user interface elements are rendered based on the output data structure. The one or more user interface elements present the response data via the user interface associated with the digital assistant.

The invention discloses a streaming knowledge injection and adversarial self-optimization large language model training method and system, and the method comprises the steps: collecting the newest knowledge of an authoritative information source in real time, converting the newest knowledge into a structured constraint rule through a semantic analyzer, and dynamically updating a knowledge base; based on the updated knowledge base, adopting a PPO algorithm to optimize a generator, actively constructing a high-risk adversarial sample, and forcing the model to expose security vulnerabilities; after user input and adversarial samples are input into the model, total loss is calculated through constraint detection, gradient updating is blocked if the total loss exceeds a threshold value, and otherwise, a multi-level safety verification stage is started; and finally, fusing a security verification result and the adversarial loss, updating a total loss function and cooperatively adjusting model parameters to form a continuous self-optimization training cycle. According to the method, compliance is guaranteed through streaming knowledge injection, vulnerabilities are actively mined in combination with adversarial training, verification precision is improved by means of multi-level detection and dynamic threshold adjustment, and safety and reliability of a large language model in a complex scene are enhanced.

The invention relates to the technical field of artificial intelligence and material engineering, and discloses a formula optimization method and device, equipment and a storage medium, and the method comprises the steps: carrying out the knowledge extraction of an obtained structured formula data set and unstructured technical literature data in response to a formula optimization target input by a user, and generating a table literature knowledge set; inputting the table literature knowledge set and the formula optimization target into a large language model to obtain a generated text corresponding to the formula optimization target; performing logic rule screening and risk assessment on the generated text through a knowledge fusion layer to obtain text output conforming to a confidence threshold, and generating a new formula scheme according to the text output; and performing multi-objective optimization on the new formula scheme based on a preset experimental cost constraint condition, and outputting an optimized recommended formula and a support evidence chain. By automatically fusing innovative components and process information in literatures, the output recommended formula has scientific basis and interpretability, and the practicability and innovativeness of an automatic formula are improved.

The invention provides a household appliance knowledge question-answering method and system based on retrieval enhancement generation. The method comprises the following steps: acquiring household appliance field multi-modal data from a multi-format document library; extracting text information, table information and chart information in the multi-modal data; performing domain term injection processing on the extracted information, and constructing a packet domain enhancement index; receiving a natural language question input by a user; the natural language problem is analyzed through a query optimizer, and semantic retrieval and keyword retrieval are executed in parallel; carrying out fusion processing on the semantic retrieval result and the keyword retrieval result; selecting matched document fragments by adopting a relevancy sorting algorithm; inputting the matched document fragments into a large language model to generate candidate answers; verifying the compliance and traceability of the candidate answers through a credibility evaluation module; outputting a final answer with a reference source; and storing the high-frequency questions and the final answers into a cache library to solve the problems that the answer accuracy of a knowledge question-answering system is reduced and the response efficiency is limited.

Techniques for ASR processing using language model (LM)-generated context are described. A LM is prompted to generate words that are relevant for / may be included in a future user input. The prompt to the LM can include words from user interaction history, dialog history, dialog topic, user preferences, etc. The information included in the prompt may focus on rare or unique words rather than words that the ASR model is already confident in recognizing. The techniques can be plugged into an existing / pretrained ASR model and can be used with any existing / pretrained LM, thus saving resources needed to implement and maintain the components.