18795 results about "Linguistic model" patented technology

The invention discloses a method for enhancing dynamic knowledge retrieval based on a large language model, belongs to the field of knowledge retrieval, and aims to solve the problems of knowledge solidification, insufficient timeliness and illusion of a traditional LLM (Logistics Language Model). A multi-granularity knowledge base is dynamically constructed, and a rule and semantic partitioning technology is combined, so that a text is converted into a normalized vector, and a hybrid index is established; a two-channel retrieval triggering mechanism is adopted, keyword matching scores and BERT semantic probability analysis are fused, and retrieval requirements are intelligently judged; vectorization retrieval is realized through a BGE-M3 model, and candidate results are reordered in combination with a cross encoder to improve the precision. The system supports multi-language adaptive processing, dynamic switching of word segmentation strategies and cross-language retrieval, and introduces real-time knowledge updating and version control. According to the method, the answer timeliness and accuracy are remarkably improved, the context coherence of multiple rounds of dialogues is optimized, the method can be widely applied to the fields of intelligent customer service, professional questions and answers and the like, the LLM illusion risk is effectively reduced, and the knowledge traceability is enhanced.

Provided in the present application is an intelligent question answering method based on a collaboration between a large language model and a knowledge graph, relating to the technical fields of artificial intelligence and natural language processing, the method comprising: decomposing a complex question into a plurality of simple questions, and analyzing the degree of association between the simple questions and a basic function so as to form a multi-hop reasoning path; automatically extracting structured information from the simple questions on the basis of a multi-task learning framework of a large model, so as to construct a knowledge graph; and constructing a cumulative reasoning learning framework on the basis of a logic reasoning large model, and performing iterative verification on a process result formed by the knowledge graph on the basis of the multi-hop reasoning path, so as to correct the reasoning path until a correct answer is inferred.

The invention discloses a power plant operation and maintenance knowledge intelligent query method based on a large language model and an RAG technology. The method comprises the following steps: constructing a power plant operation and maintenance knowledge vector library covering structured, semi-structured and unstructured data; receiving a natural language question of a user, inputting an improved instruction to align a preprocessor, and generating a question semantic vector and an intention tag; relevant knowledge fragments are retrieved and sorted through a semantic matching retriever in combination with the intention labels; constructing a large language model cue word structure based on the retrieval result and the original question, generating candidate answers and recording a reference path; and finally, performing term specification and consistency verification according to the expert rule base, and outputting a structured and traceable final answer. According to the invention, the improved RAG technology is fused to realize intelligent query of the operation and maintenance knowledge of the power plant.

The invention relates to the technical field of information data analysis. The invention provides a public policy case analysis knowledge graph fusion reasoning method and system. The method comprises the following steps: generating standardized preprocessing data; performing extraction processing on the standardized pre-processed data to generate a structured triple set; processing the structured triple set to generate a multi-dimensional knowledge graph; constructing a hybrid inference engine, and processing the multi-dimensional knowledge graph to generate inference result data; performing incremental updating processing of nodes and relationships on the multi-dimensional knowledge graph, and performing parameter optimization processing on the hybrid inference engine to generate an updated knowledge graph and an optimized inference engine; and reasoning result data are processed, and a visual analysis result is output, so that the problems of limitation of a rule engine on causal reasoning, semantic fuzziness and logic illusion of a large language model in the policy field and insufficiency of a single-field knowledge graph on cross-field interaction influence revelation are solved.

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.

In a described embodiment, a system for information processing is provided including a data acquisition module configured to receive feedback corresponding to one or more outputs generated by a language model. The system further includes a cognitive reasoning module configured to evaluate the reasoning process of the language model, emulate cognitive functions including metacognitive processes, and generate an assessment based on an analysis of the received feedback, wherein the assessment includes classifying the one or more outputs into components, assigning quality scores for each component, and identifying an improvement corresponding to the one or more outputs. Additionally, the system includes a process adjustment module coupled to the cognitive reasoning module for adjusting the reasoning process of the language model based on the assessment is provided. A refinement module coupled to the process adjustment module is provided for iteratively refining the reasoning process based on subsequent updates to the generated assessment until a performance threshold is met.

The invention relates to a knowledge graph construction method and system based on a large language model, and the method and system achieve the automatic construction and dynamic maintenance of a knowledge graph through multi-modal data fusion, reinforcement learning and comparative learning joint optimization, teacher-student model knowledge migration, time sequence dynamic analysis and an incremental updating mechanism. Constructing a reinforcement learning framework, and taking accuracy and integrity as reward indexes to train a large model to extract an entity relationship; a large-scale knowledge graph is used as a teacher model, and conflict resolution and semantic alignment of newly added knowledge and an existing graph are realized through a graph attention network; a verification rule is dynamically generated based on historical data and domain knowledge, and relation periodicity and mutation points are detected in combination with Fourier transform and a CUSUM algorithm; and finally, generating a traceable knowledge graph through incremental updating and version control. And the multi-modal data processing precision, the entity relationship extraction dynamic adaptability and the knowledge graph maintenance efficiency are improved.

The embodiments of the present disclosure belong to the technical field of data processing. Provided is a multimodal scenario risk determination method based on a generative AI large language model. The method specifically comprises: step 1, acquiring multimodal data to form a target data set, wherein the multimodal data comprises visual data and text data; step 2, using an ALBEF algorithm to extract key features corresponding to the target data set, and fusing the key features into a comprehensive scenario representation; and step 3, on the basis of a preset safety index and a large language model, evaluating a risk degree corresponding to the comprehensive scenario representation, comparing the risk degree with a risk threshold, and determining whether the scenario corresponding to the comprehensive scenario representation is a high-risk scenario. By means of the solution in the present disclosure, a high-risk scenario can be rapidly recognized and identified, so as to provide a basis for taking emergency measures, thereby enhancing the real-time response capability.

The invention relates to a cross-domain intelligent reasoning method based on knowledge graph enhancement, and the method achieves the precise reasoning in a complex scene through the construction of a hierarchical knowledge expression framework and a dynamic optimization mechanism. A multi-source heterogeneous data fusion technology is adopted, subject fine-grained knowledge units are generated through multi-modal feature extraction, and a three-dimensional knowledge graph structure comprising a core common concept layer, a subject feature ontology layer and a dynamic semantic mapping layer is established; based on a path exploration algorithm driven by reinforcement learning, cross-domain implicit association is mined while subject independence is reserved, and controllability and interpretability of the reasoning process are achieved in combination with an attention fusion mechanism of a large language model. According to the method, the limitation of traditional unified ontology modeling is broken through, the problems of concept drift and path deviation existing in reasoning in the cross fields of medicine-finance, engineering-law and the like are effectively solved, and the accuracy and knowledge traceability of complex decision tasks are remarkably improved.

The invention discloses an intelligent geometric reasoning and semantic understanding method based on a three-dimensional large language model, which comprises the following steps of: acquiring point cloud data of a building component through three-dimensional scanning equipment, associating text information, and constructing a multi-modal three-dimensional large language model comprising a geometric perception coding module, a context semantic understanding module and a parameter efficient fine tuning module; a cross-modal contrast loss and task instruction fine tuning strategy is adopted in model training, and finally semantic recognition, attribute completion and historical background analysis results of the building components are output. The method is suitable for building heritage digital protection, intelligent building process monitoring and three-dimensional digital archive management, component function recognition precision and cultural semantic mining capability in a complex scene can be improved, and real-time semantic updating and interactive response of a dynamic construction environment are supported.

The invention belongs to the technical field of knowledge maps and artificial intelligence, and discloses a building safety risk identification method of a big language model assisted knowledge map. According to the technical scheme, the overall process comprises the steps of data collection and preprocessing, construction of urban building structured table data, construction of an urban building safety knowledge graph, integration of the structured table data and knowledge graph data, model fine adjustment, model training, model performance evaluation and model recognition effect verification. According to the technical scheme, the large language model with the high semantic modeling capacity and the knowledge graph with the high graph structure expression capacity are integrated, the related knowledge of urban building safety is automatically extracted, constructed and integrated, high-risk events such as fire disasters and structural hidden dangers are recognized, and the informatization level and the intelligent level of urban building safety management are improved.

The invention relates to the technical field of financial data processing, in particular to a multi-source heterogeneous fund data processing method and system, and the method comprises the steps: recording source information through building a data source registry, and marking a unique identifier for data; performing differential analysis on the fund data in different formats to generate standardized column type storage data; traversing column type storage data to extract statistical characteristics, performing field classification through metadata analysis and financial dictionary matching, analyzing business connotations of fields difficult to classify in combination with a localized large language model, and mapping the business connotations to a header fusion knowledge graph; generating a mapping rule from the source field to the enterprise-level data model by applying a rule engine template on the basis of field classification and semantic recognition results; converting the data structure according to the mapping rule and executing standardization processing; the quality is further optimized through data cleaning; and finally, the data are verified, standardized fund data supporting data traceability are output, and the strict requirements of financial supervision application are met.

The invention discloses an electronic medical record intelligent evaluation method based on complex quality control indexes, and relates to the field of medical information processing and artificial intelligence. The method comprises the steps that an original electronic medical record text is collected and preprocessed, and structured diagnosis and treatment information and an event sequence diagram are extracted; through prompt word chain construction and a semantic reasoning mechanism, a large language model is guided to intelligently evaluate complex quality control indexes in medical records. The complex quality control indexes comprise diagnosis basis sufficiency, treatment scheme rationality, key result and change record integrity, treatment measure integrity and causal relationship rationality. According to the method, technologies such as a medical knowledge graph, a graph neural network and semantic vector retrieval are utilized to realize external knowledge recall and causal reasoning support; a self-consistency reasoning mechanism, a self-reflection mechanism and a multi-model cross validation mechanism are introduced to improve the accuracy and credibility of an evaluation result; and finally, outputting a structured quality control report and a visual reasoning chain. According to the method, the intelligence and refinement level in a complex medical quality control task can be remarkably improved, high interpretability and practical value are achieved, and the method is suitable for application scenes such as hospital quality management, scientific research evaluation and medical document standardization.

Systems and methods for processing input data using a generic large language model (LLM) and a secondary LLM, whereby the secondary LLM is configured to process structured data. An application is provided, including a semantic kernel, a manager module, and a plurality of workers. An input is received via the semantic kernel. The manager module invokes the plurality of workers comprising a first worker and a second worker. The first worker invokes the generic LLM and the second worker invokes the secondary LLM.

The invention discloses a multi-modal knowledge graph rule reasoning method and device based on a large model, and the method comprises the steps: carrying out the feature extraction and cross-modal alignment of input text data and image data, and generating a multi-modal feature vector of a unified semantic space; performing knowledge graph storage on the emotion entities and the relationships by adopting an attribute graph model to complete construction of an emotion knowledge graph; generating an interpretable inference rule from the emotion knowledge graph by using a large language model, and eliminating a conflict rule in combination with logic verification; calculating the confidence coefficient of a reasoning path based on an attention mechanism, and carrying out quantitative evaluation on a rule reasoning result; the knowledge graph and the rule base are updated online according to user feedback, and the real-time performance and accuracy of the inference system are optimized through weight adjustment and a forgetting mechanism. According to the method, through innovative technologies such as multi-modal data integration, dynamic knowledge evolution and interpretability reasoning, the limitation of a traditional sentiment analysis method in the aspects of evidence dimension, adaptive capacity, interpretability and the like is broken through.

The invention provides an agent-based large language model retrieval enhancement generation system and method, and the system comprises a planning layer which is used for receiving user query, carrying out the multi-round iterative decomposition of a complex task through a task planning agent, and generating an atomic query or a direct response; the execution layer is used for executing the atomic query generated by the planning layer in parallel, calling a search module to obtain external knowledge base data, and caching an intermediate result through a memory module; the answer detection module is used for performing multi-dimensional detection on the generated result, including preference, accuracy, integrity and logicality; the dynamic decision-making module is used for adaptively adjusting a subsequent retrieval strategy and a task planning process according to a detection result and user feedback; and a cross-layer interaction mechanism enables the planning layer and the execution layer to realize collaborative optimization through context sharing and iterative feedback.

The invention discloses a hierarchical semantic-driven retrieval enhancement generation method and system, a natural hierarchical relationship and a semantic boundary of a document are effectively reserved by constructing a tree hierarchical structure based on a document chapter title, and a recursive semantic boundary splitting strategy is adopted to refine overlong text nodes, so that the semantic integrity is ensured, and the retrieval enhancement generation efficiency is improved. And the model input length limitation is met, and the semantic information is prevented from being lost. Meanwhile, node knowledge point extraction and abstract generation are achieved through a large language model, top-down multi-level title path transmission and bottom-up content aggregation are combined, the structural perception and semantic expression ability of nodes is enhanced, and in the retrieval stage, based on similarity distribution of query and node semantic expression, an adaptive retrieval threshold value is dynamically calculated, and the retrieval efficiency is improved. A fixed top-k retrieval strategy is replaced, intelligent screening of different query and hierarchical nodes is achieved, information coverage and redundancy suppression are balanced, and retrieval efficiency and accuracy are remarkably improved.

Disclosed in the present application are a multi-modal data processing method and apparatus, an electronic device, and a storage medium. The method comprises: acquiring a reference image and a reference text; extracting a reference visual feature of the reference image; by means of a multi-modal large language model, determining an embedding of the reference text, an embedding of a start mark of the reference visual feature, an embedding of the reference visual feature, and an embedding of an end mark of the reference visual feature; on the basis of the multi-modal large language model, splicing the embedding of the reference text, the embedding of the start mark, the embedding of the reference visual feature, and the embedding of the end mark into a target embedding sequence, performing attention processing on the basis of the embedding of the start mark, the embedding of the end mark, and an embedding selected by a sliding window in the target embedding sequence, and outputting a predicted sequence; and generating a predicted image and a predicted text on the basis of the predicted sequence.

The invention discloses a multi-modal bill processing method based on dynamic knowledge enhancement. The multi-modal bill processing method comprises the following steps: S1, constructing a dynamic knowledge base containing an aging weight; s2, synchronously processing text, image and format features of the bill by adopting a multi-modal feature fusion network to generate a composite feature vector; s3, semantic-level, format-level and timeliness three-level fusion retrieval is carried out based on the composite feature vector, and a three-level fusion retrieval engine comprises dynamic weighted sorting with timeliness attenuation, a difference degree triggered artificial review mechanism and a policy sensitive slope adjustment algorithm; s4, setting a multi-expert cooperative verification system, wherein the multi-expert cooperative verification system comprises cooperative work of a rule engine, a large language model and a logical reasoning module; s5, implementing a dynamic knowledge updating mechanism, and automatically triggering incremental learning of the knowledge base when policy change or format update is detected; and S6, outputting structured data, and synchronously generating an auditing traceability chain containing a decision path. According to the method, the key field identification accuracy can be improved, and auditing traceability and non-perceptual increment updating in the whole process are realized.

The invention provides an IMU (inertial measurement unit)-assisted depth SLAM (simultaneous localization and mapping) method and system fusing language-vision multi-mode perception, and the system comprises functional modules such as initial calibration and semantic map initialization, pre-integration prediction and key frame judgment, dense point cloud reconstruction and relative pose estimation, semantic embedding extraction, semantic guidance loopback detection and semantic three-dimensional map incremental updating. IMU motion priori, depth geometric constraint and language model semantic factors are subjected to combined modeling through a graph optimization framework, and high-precision positioning and labeled map construction in a complex dynamic environment are achieved. Compared with the prior art which only depends on geometric or inertial information, the method has the advantages that the loop-back mismatching rate is reduced, the closed-loop convergence efficiency and the long-time relocation robustness are improved, and a semantic interface is provided for upper-layer tasks such as natural language navigation and target retrieval. The method can be widely applied to the fields of service robots, security inspection, intelligent driving, post-disaster search and rescue and the like.

The invention provides an intelligent SQL generation method and system for business query, and belongs to the technical field of artificial intelligence. Related data of query statements are acquired, and a corresponding query intention knowledge graph is constructed by semantic clustering; the method comprises the following steps: analyzing a historical SQL statement structure, extracting a natural language template and an SQL template, and expanding through a large language model to generate a feed-shot example set; and constructing a composite cue word template by combining task setting guidance, a feed-shot example and CoT chain thinking reasoning guidance. An intention completion module is arranged in a large language model, a natural language query statement of a user is combined with a composite cue word template context, a structured query statement is generated through entity recognition, semantic completion, parameter filling and fuzzy intention training, and the structured query statement is converted into a standard SQL statement through a knowledge graph and a template. According to the method, the use threshold of business personnel is remarkably reduced, and efficient conversion from natural language questions to SQL statements is realized.

A system and method for efficient natural language processing combines large and small language models with a thought caching architecture. The system includes a router that directs prompts either to a large language model for thought generation or to a thought cache containing previously generated thoughts. When using the large model, generated thoughts are combined with the original prompt and routed through a smaller language model to produce responses. The thought cache stores reasoning patterns that can be retrieved and reused, eliminating the need to regenerate similar thoughts for related prompts. The system supports both local and cloud-based caching, enabling personal and enterprise-wide thought storage and retrieval. This architecture reduces computational overhead while maintaining reasoning capabilities, effectively extends context windows beyond traditional limits, and enables efficient scaling across different deployment scenarios. The system can operate with reduced resources by leveraging cached thoughts without requiring constant access to the large model.

The invention relates to the technical field of intelligent recommendation, and discloses a hybrid retrieval RAG-based resource recommendation method and system, and the method comprises the steps: collecting resource text data, and constructing a vector library and a tag library; expanding the user question based on the language model to obtain a plurality of semantic extension questions; performing intention recognition, judging whether the user question is a resource recommendation question, and if yes, determining a target classification type; screening the data according to the field definition in the tag library to obtain a candidate knowledge fragment set; obtaining candidate vectors, mapping the user question and the semantic extension question into query vectors, calculating the similarity between the query vectors and each candidate vector, and selecting knowledge supplement content; and performing resource splicing on all the knowledge supplement contents to generate resource recommendation answers. According to the method, a structured label screening mechanism and a semantic vector fine arrangement mechanism are fused, and the problems of recall redundancy, matching deviation and the like caused by the fact that an existing RAG system only depends on semantic similarity retrieval are solved.

The invention provides a shield intelligent auxiliary type selection system and method based on a large language model. The model selection system comprises a data input module, a rule knowledge base module, a large model reasoning module and a result generation module. The integrated decision-making system integrating a rule knowledge base, a deep learning model and expert system logic is constructed for the practical problems of complicated geological conditions, multiple rule constraints, high expert dependency and the like in shield construction, and the system combines a structured model selection rule and historical case data, and has the advantages of intelligence, standardization, self-learning, high efficiency and the like. The problems of low efficiency, high subjectivity, insufficient intelligent degree and the like of the existing shield tunneling machine model selection depending on artificial experience and partial standardized guide are solved, and the transformation of shield construction management from artificial experience to intelligent decision can be promoted.

The invention discloses a question and answer reasoning method and device based on key value cache compression, equipment and a medium, and relates to the technical field of natural language processing, and the method comprises the steps: segmenting a cue word in a current question and answer task into a lexical sequence, and generating an initial key value cache of the lexical sequence; dividing the lexical element sequence into context lexical elements and tail end lexical elements corresponding to each layer based on a preset tail end window size of each attention layer of the target large language model; screening out keyword elements of each attention layer from the context lexical elements according to importance scores between key matrixes of the context lexical elements and query matrix mean values of the tail end lexical elements; removing key value pairs of lexical elements except the keyword elements in the initial key value cache to obtain a compressed key value cache; and generating a reasoning result corresponding to the compressed key value cache by using the target large language model. The high computing power consumption of the large language model caused by key value cache data increase is reduced, and the dependence of an existing key value cache compression method on a complete attention weight matrix is broken through.

The invention relates to the technical field of information retrieval, and discloses a multi-modal fusion and reinforcement learning collaborative retrieval enhancement generation method and system. The method comprises the following steps: receiving an original query input by a user, and generating a sub-query based on a large language model in combination with a multi-modal context of a current iteration step; forming a current state in combination with the sub-query and the multi-modal context, modeling a retrieval enhancement generation task as a Markov decision process, and adaptively selecting an optimal action from a predefined action set in the current state by utilizing a large language model according to a decision strategy; executing a corresponding multi-modal retrieval operation according to the optimal action, fusing the obtained multi-modal information, generating an intermediate answer or a final answer of the sub-query, and updating a multi-modal context by using the intermediate answer; off-line training optimization is carried out on the large language model through imitation learning and a calibration chain, and decision strategies and sub-queries are inferred online through the model after fine adjustment. According to the invention, more efficient and accurate complex query processing is realized.

The invention relates to the technical field of process automation, in particular to an RPA service automation method capable of enabling a large language model MCP. The method comprises the following steps: acquiring user input data, and performing intention understanding through a multi-round intention recognition model according to the user input data to obtain semantic instruction data; performing standard semantic protocol conversion according to the semantic instruction data to obtain standard semantic protocol data; performing flow chart node matching according to the standard semantic protocol data to obtain flow chart node data; and generating a business process according to the flow chart node data to obtain business process data. According to the method, the multi-round intention recognition capability of the large language model and the standard semantic protocol conversion are fused, so that the accurate mapping from the natural language to the business process is realized, and the intelligent level and the user friendliness of the RPA system are improved. Through process node matching and process logic verification, the execution effectiveness of the automatic generation process is ensured, and the labor cost and configuration errors are reduced.

The invention discloses an agent long-term memory modeling method based on a memory network, and relates to the field of agents, and the method comprises the steps: storing vector data to a vector database, and storing structured metadata to a relational database; receiving an input request of a user, and executing vector similarity retrieval in the vector database to obtain semantic similar fragments; executing structured data query in the relational database to obtain structured metadata; the memory abstract is retrieved; forming a candidate data set; taking a filtered result as memory information, inputting the memory information into a large language model through a cue word project, and generating reply content; the input request of the user and the generated reply content are combined to form a new interaction record; processing the new interaction record and historical interaction records stored in a vector database and a relational database through a large language model to generate a memory abstract; aiming at the insufficient long-term memory emotion interaction coherence of the intelligent agent, the emotion interaction coherence is improved.

The invention discloses a multi-modal knowledge graph construction method and device based on a large model and a program product, belongs to the technical field of artificial intelligence and knowledge engineering crossing, and particularly relates to a knowledge graph dynamic construction and evolution method based on a large language model technology and multi-modal data processing. The problems of symbol grounding and semantic understanding obstacle in the prior art are solved. According to the method, innovation and breakthrough are realized in three dimensions of knowledge acquisition, representation and reasoning by fusing deep learning and knowledge engineering technologies. The multi-modal knowledge graph construction method and device based on the large model and the program product are applied to the field of multi-modal knowledge graph construction and are suitable for specific task scenes such as intelligent question and answer, decision support and semantic search.

The invention discloses an electric power field knowledge question-answering system construction method based on a large language model, and relates to the field of electric power field knowledge question-answering, and the method comprises the steps: judging the data type of electric power field knowledge, and carrying out the processing of the electric power field knowledge according to the judgment result through matching with a processing technology, and generating an entity relation triple; constructing a power field knowledge graph; optimizing the power field knowledge graph based on the attention network, outputting an answer causal path of the fault problem by using the optimized power field knowledge graph, and marking a confidence score of the answer causal path; and inputting the solution causal path and the confidence score into a language model to obtain a fault question answering result, and optimizing the question answering result according to the consistency of the fault question answering result and the power field knowledge graph. According to the method, on the premise that the fault diagnosis logic is rigorous and the result is traceable, knowledge in large-scale unstructured literatures in the power industry is activated, so that accurate question and answer services can be provided for operation and maintenance personnel in real time.