2008 results about "Question answering" patented technology

The invention relates to an intelligent question-answering system optimization method and device based on a knowledge graph, and the method comprises the steps: obtaining original knowledge data of a target knowledge domain, and constructing a knowledge graph structure model; extracting term information of entity nodes in the knowledge graph structure model, and constructing an entity term set; receiving a natural language question input by a user, executing a semantic understanding operation based on the standardized expression set to obtain a structured question semantic representation, and matching the question semantic representation with the case training set to obtain context semantic features; constructing a cue word template, and executing a query instruction generation operation to obtain a target query statement of the graph database; submitting the target query statement to a graph database to execute data retrieval operation, and obtaining query result data corresponding to the question semantic representation; and performing personalized rendering processing on the query result data based on the user portrait information to generate final question and answer return content. The method has the effect of improving the query accuracy.

The invention discloses an electric power field knowledge question-answering system construction method based on a large language model, and relates to the field of electric power field knowledge question-answering, and the method comprises the steps: judging the data type of electric power field knowledge, and carrying out the processing of the electric power field knowledge according to the judgment result through matching with a processing technology, and generating an entity relation triple; constructing a power field knowledge graph; optimizing the power field knowledge graph based on the attention network, outputting an answer causal path of the fault problem by using the optimized power field knowledge graph, and marking a confidence score of the answer causal path; and inputting the solution causal path and the confidence score into a language model to obtain a fault question answering result, and optimizing the question answering result according to the consistency of the fault question answering result and the power field knowledge graph. According to the method, on the premise that the fault diagnosis logic is rigorous and the result is traceable, knowledge in large-scale unstructured literatures in the power industry is activated, so that accurate question and answer services can be provided for operation and maintenance personnel in real time.

The invention discloses a reverse question guide question answering implementation method and system, and belongs to the technical field of artificial intelligence and natural language processing. Context-aware intention dynamic correction is realized through a three-level intention classification system, and cross-modal knowledge matching is realized by adopting a distributed semantic index technology; based on the reinforcement learning strategy, optimizing a cooperative work mechanism of the dialogue strategy and the knowledge base; comprising the steps of intention recognition: analyzing a session of a user by using an intention recognition model, and constructing a three-level intention classification system based on deep semantic understanding, including main class recognition, fine-grained analysis and context perception; question rewriting: constructing a dynamic rewriting engine to rewrite the user question; recalling and cleaning multi-source item knowledge; generating a reverse question; locking items and acquiring item data; generating questions and answers. According to the method, the robustness, the real-time performance and the scene adaptation capability of a professional question answering system can be improved, and the government affair service question answering accuracy, the intention recognition precision and the cross-region recommendation adoption rate are improved.

The invention relates to the technical field of electric power engineering, and discloses an electric power engineering multi-modal RAG system based on a knowledge graph and multi-Agent collaboration, and the system comprises a multi-modal dynamic knowledge base construction module which is configured to carry out the structural processing, multi-dimensional knowledge organization and dynamic optimization of electric power engineering multi-modal data; the self-adaptive retrieval strategy engine module is configured to construct a weight decision network based on deep reinforcement learning and execute multi-channel parallel retrieval and result fusion; the iterative self-reflection reasoning module is configured to generate a reasoning path in combination with the retrieval result and verify evidence validity from multiple dimensions; the MCP tool intelligent calling module is configured to integrate multiple types of standardized MCP tools; and the multi-Agent collaborative framework is configured to provide multiple types of Agents which are specific in function and have a cross-module interaction capability. According to the method, the question and answer accuracy, the reasoning depth and the result interpretability in the complex multi-modal scene of the electric power engineering can be remarkably improved.

The invention relates to the technical field of intelligent retrieval, in particular to an enterprise RAG intelligent question answering system based on vector database reordering. The system specifically comprises: a document recall module, which retrieves a vector database to obtain candidate document blocks containing business metadata; the comprehensive scoring module is used for calculating a semantic correlation score by adopting a later-stage interaction architecture based on bidirectional token importance weighting, performing path semantic matching and context sensing rule evaluation according to a preset metadata ontology graph to obtain a service attribute score, and analyzing the evidence sub-graph to obtain a fact path score; fusing the semantic correlation score, the service attribute score and the fact path score to generate a comprehensive correlation score; and the sorting output module performs optimization resorting based on a preset punishment mechanism and the comprehensive correlation score to generate an optimized context set, and calls a generation model to output answers based on the optimized context set. According to the method, semantic accuracy, business compliance and fact reliability can be considered, and more trustworthy high-quality enterprise-level answers can be generated.

The invention provides a medical multi-hop text question and answer retrieval enhancement method based on heterogeneous knowledge. The method comprises the following steps: firstly, constructing a uniform heterogeneous graph structure based on a medical knowledge graph of a medical document, and establishing a semantic bridge through an entity-document mapping relationship; performing semantic decomposition on a complex medical problem input by a user by utilizing the large model, and iteratively generating a series of mutually independent atomic queries; searching a reasoning path in the entity sub-graph of the heterogeneous graph, and calculating a path score by fusing the weighted combination of the entity association text similarity, the entity matching degree and the path edge weight; training a retriever by adopting a marginal sorting loss function, and optimizing a retrieval effect through positive and negative sample comparative learning; and finally, calling a large model to convert the reasoning path with the highest score into a text, and extracting a document fragment corresponding to a path node. According to the method, the problems that an existing retrieval enhancement technology is insufficient in complex problem processing capacity, poor in reasoning interpretability and the like are effectively solved, and high-accuracy medical questions and answers are achieved.

The invention discloses a multi-modal fused intelligent question answering and knowledge retrieval method and system, and the method comprises the steps: building a multi-modal data index model oriented to a heterogeneous knowledge source, carrying out the feature mapping of text, image, table, chart, audio and video contents through a unified semantic embedding space, and generating a cross-modal index set; after a query request is received, performing semantic matching and structure matching on the cross-modal index set by using a multi-channel retriever to obtain candidate evidence fragments; and based on an evidence granularity decomposition strategy, performing minimum evidence unit division on text statements, table units, chart data points and multimedia frame contents in the candidate evidence fragments, and establishing a semantic consistency graph among the units. According to the method, high-credibility traceable generation of question and answer results is realized through multi-modal fusion and space-time consistency constraint, and the retrieval precision and interpretation transparency in a complex knowledge scene are remarkably improved.

The present application relates to the technical field of artificial intelligence, and in particular to a question answering method based on a large model, and an electronic device. The electronic device comprises a communication interface, a memory, and a processor, the memory is configured to store a computer instruction, and the processor is configured to execute a computer program to enable the electronic device to: determine, on the basis of each pre-stored text block, a target text block matched with a question to be answered; obtain, if non-text data including a picture and / or a table is pre-stored for the target text block in advance, stored summary text of the non-text data; and input the question to be answered, the target text block, and the summary text into a first large model on the basis of a preset format to obtain answer information. Since the summary text is text that summarizes all content in the non-text data, the first large model does not need to process the picture and / or the table and still can ensure that the content recorded in the picture and / or the table is taken into consideration during generation of the answer information, thereby improving the model-based question answering accuracy.

The invention relates to the field of knowledge graph completion, provides a knowledge graph completion method based on multi-modal visual angle perception and a deep neural network, and aims to solve the problems of weak multi-modal information expression ability, rough fusion mode and insufficient structural reasoning ability in the prior art. According to the method, structure information, text description and visual image information of an entity in a knowledge graph are obtained, structure, text and image modal input is constructed respectively, and a graph neural network, a pre-training language model and a visual encoder are adopted for feature coding; weighted fusion and semantic enhancement of multi-modal features are realized through a visual angle fusion mechanism and hierarchical attention processing; cross-modal contrast learning is introduced to improve modal consistency; and carrying out triple reasoning by using a uniform Transform encoder, and verifying a completion result by scores. According to the method, multi-modal semantics are effectively integrated, the entity representation capability and the triple prediction accuracy are improved, the model robustness is enhanced, and the method is suitable for application scenes such as intelligent question answering and recommendation systems and has remarkable practical value and popularization prospects.

The invention discloses a long video multi-modal understanding and question-answering method and system based on large model and retrieval enhancement generation. The method comprises the following steps: 1) a multi-modal feature extraction module; 2) a multi-modal synchronization and alignment mechanism; 3) constructing a structured memory pool; 4) querying a drive generation mechanism; 5) incremental updating and memory compression strategy; and 6) unifying the multi-modal representation space. The invention provides a long video multi-mode understanding method fusing a large language model and retrieval enhancement generation, and aims to break through the limitation of a traditional method in the aspects of single-mode processing and semantic fragmentation. According to the method, video image features are extracted through a visual model (such as YOLO and ViT), voice transcription and environment voice description are obtained in combination with an audio model (such as Whisper and Qwen-Audio), and unified coding of vision, voice and audio in a long video is achieved. Then, a structured memory pool is constructed through semantic consistency segmentation and timestamp alignment technologies to store time slice data of different modalities.

The invention relates to a multi-mode large language model fine tuning method, system and device and a medium, and belongs to the technical field of artificial intelligence and computer vision crossing. The fine tuning method comprises the steps that an original business scene image is acquired and preprocessed, and a preprocessed image is obtained; performing bounding box coordinate labeling and semantic label definition on the entity target in the preprocessed image through a labeling tool, and outputting a structured labeling file; based on the preprocessed image and the structured annotation file, constructing a training sample set comprising multiple rounds of image-text dialogues; loading the pre-trained multi-modal large language model, configuring low-rank matrix decomposition parameters, and generating a fine tuning instruction set; and inputting the training sample set into a pre-trained multi-modal large language model, carrying out joint training operation based on the fine tuning instruction set, and outputting the fine-tuned multi-modal large language model. According to the method, the identification accuracy, the interaction capability and the system availability of the visual question-answering system in an actual application scene are improved.

The invention provides a consensus decision question answering system based on multi-AI agent game, and relates to the technical field of artificial intelligence. The system comprises a multi-domain information aggregation module, an interaction effect deduction module, a strategy fusion calibration unit, a distributed behavior adaptive mechanism and an aggregation strategy discrimination module. The multi-domain information gathering module is used for unifying multi-source strategy information and environment situation data, the interaction effect deduction module is used for analyzing and quantifying the mutual influence relation of strategies between intelligent agents, and the strategy fusion calibration unit generates correction suggestions based on a game deduction and optimization method. The distributed behavior self-adaptive mechanism is used for locally and progressively executing a correction path in an intelligent agent; and the aggregation strategy judgment module dynamically evaluates the overall strategy state. The multi-agent consensus decision-making question-answering method realizes consensus decision-making question-answering of multiple agents in a complex environment, can effectively identify and correct non-collaborative strategy deviation, and improves the coordination, stability and immunity of a system.

The invention discloses a question and answer method and system based on a knowledge graph, and the method comprises the steps: outputting a structured query graph of which nodes comprise entities, relationships and semantic weights according to a natural language question input by a user; on the basis of the structured query graph, outputting candidate entity sub-graphs of which the ambiguity is eliminated; outputting a reasoning path set with the highest probability according to the candidate entity subgraph; based on the reasoning path set, outputting candidate answers which conform to logic and are coherent in grammar; and according to the topological consistency of the candidate answers and the knowledge graph, calculating an answer credibility score by using a causal reasoning model, and outputting a final answer and an interpretability verification report by analyzing a logic causal chain implied in the answers and verifying with the knowledge graph. By utilizing the embodiment of the invention, deep integration and value mining of park multi-source data can be realized, and powerful support is provided for fine management and intelligent decision-making of the smart park.

The invention discloses an RAG intelligent retrieval question-answering system and method based on enhanced metadata, and relates to the technical field of information processing and intelligent retrieval, multi-source heterogeneous knowledge data is preprocessed to obtain unified knowledge data, and structured metadata is extracted from the unified knowledge data based on different text forms; vectorizing a document text in the structured metadata by combining with embedding of the knowledge graph to obtain document representation, and outputting the document representation, the structured metadata and the enhanced keyword set as an enhanced metadata object; labeling a display relationship between different enhanced metadata objects, and constructing to obtain a knowledge database; according to the intelligent knowledge service system and method, restrictive conditions and question intentions are extracted from user questions, mixed retrieval is performed from a knowledge database based on the restrictive conditions and the question intentions, a candidate literature semantic set is output, then structured statistical visualization reports and structured answers are output, and accurate, explainable and multifunctional intelligent knowledge services are achieved.

The invention relates to an enhanced LLM-RAG multi-hop question and answer method based on logic tree reasoning, and belongs to the technical field of new-generation information, and the method comprises the following steps: inputting a multi-hop question and answer question into a computer system; the computer system calls a pre-training large language model LLM, the multi-hop question-answer question is decomposed into a hierarchical logic tree in a recursive mode, and each node of the logic tree comprises a sub-question and a corresponding hypothesis answer; performing image retrieval from a structured knowledge source Wikidata and performing text retrieval from an unstructured knowledge source Wikipedia on the basis of each node sub-question and the hypothesis answer to obtain corresponding evidence; traversing the logic tree, verifying the consistency between the hypothetical answer of each node and the evidence through LLM, if the contradiction exists, reconstructing the corresponding sub-tree, and dynamically correcting the reasoning path; and integrating the verified logic tree node information, and outputting an accurate answer to the multi-hop question and answer question.

The invention relates to the technical field of natural language processing and artificial intelligence, and discloses a silk path knowledge base intelligent question answering system based on a large language model, comprising a silk path data acquisition module used for acquiring multi-source silk path knowledge data; the silk path knowledge base construction module is used for processing the multi-source silk path knowledge data to construct a structured knowledge base and an unstructured knowledge base; the data storage system module is used for storing a structured knowledge base and an unstructured knowledge base and providing a structured retrieval interface and an unstructured retrieval interface; and the man-machine interaction module is used for identifying a user intention according to the user question and outputting an answer corresponding to the user question by adopting a corresponding answer generation mode based on the user intention. According to the method, efficient and accurate silk path knowledge questions and answers are realized by constructing the multi-modal knowledge base and optimizing a retrieval algorithm and a prompt engineering technology.

The invention discloses an intelligent interaction system based on a large language model and a knowledge graph, and relates to the technical field of artificial intelligence and intelligent interaction. According to the system, data processed by a data acquisition and preprocessing module is stored in a local knowledge warehouse in a three-layer nested structure; the multi-modal semantic understanding module constructs a knowledge system in which a triple knowledge graph and a vector database are complementary by optimizing a BERT model and performing dual-channel analysis; the intelligent interaction module realizes natural language interaction and business task automatic triggering based on an RAG technology and a dialogue memory mechanism; the information change identification and analysis module generates a personnel change risk report and performs early warning; and the summary report automatic generation module outputs a structured report. According to the method, the problems of data splitting, complex interaction and slow response in traditional enterprise management are solved, the functions of system intelligent question answering, personnel change risk analysis, structured report automatic generation and the like are realized, and the management efficiency and the information consistency are improved.

The invention discloses a multi-source heterogeneous knowledge fusion question and answer solution system, which relates to the technical field of computers and comprises a knowledge base layer, a recall layer, an analysis and pruning layer and an answer generation layer. The knowledge base layer is used for constructing a dynamic heterogeneous entity fusion engine and a self-adaptive knowledge slice storage mechanism, and the dynamic heterogeneous entity fusion engine comprises a cross-modal entity alignment algorithm, relation topology completion and an incremental entity evolution model; the self-adaptive knowledge slice storage mechanism is used for performing semantic density perception slicing on the RAG document and constructing a three-level index tree; according to the method, through the technologies of cross-modal entity alignment, dynamic recall weight adjustment, context sensing entity priority correction, RAG cross-block reasoning enhancement, double-encoder conflict detection, knowledge graph guide generation and the like, knowledge fusion reasoning is achieved, the complex question answering accuracy is effectively improved, the conflict recognition rate is increased, and the manual maintenance cost is reduced.

The invention relates to the technical field of artificial intelligence, and discloses a multi-agent collaborative data question-answering system and method based on a large model, and the system comprises an agent cluster module which is composed of five special agents, namely a data question-answering agent, a data extraction agent, a data analysis agent, a visualization agent and a quality examination agent, and achieves the task decomposition and collaborative execution through dynamic scheduling; the knowledge management module comprises a business knowledge base, a data element knowledge base and a user feedback base, and adopts a hierarchical knowledge fusion technology to provide domain knowledge support for the intelligent agent; and the supporting function module covers a front-end dialogue component and a verification and execution engine and is responsible for interactive interface rendering and result reliability verification. According to the method, the fine tuning requirement on the large model is remarkably reduced, the illusion of the large model is effectively intercepted through a dual verification mechanism, and the accuracy and reliability of question and answer results are improved.

A computer-implemented method of generating an answer from an input query and input documents, comprising extracting input query entities from the input query and input document entities from the input documents, sampling a schema of in-domain queries with the input query to generate a query sampled schema, generating an entity-document graph from the input documents and input document entities, generating a hyper-relational knowledge graph by extracting, for each input query entity, a document title and relation to an input document entity of the input document entities from the input documents in the entity-document graph, sampling the hyper-relational knowledge graph with the query sampled schema to generate a query focused hyper-relational knowledge graph, predicting an answer to the input query by inputting the query focused hyper-relational knowledge graph and input query into a pretrained neural network, outputting the answer.

The invention provides a highway intelligent operation and maintenance question-answering system based on a large language model, and belongs to the technical field of natural language processing. The system takes a large language model as a core reasoning engine and combines a domain knowledge base and an RAG technology to realize accurate question and answer of highway operation and maintenance; the method comprises the following steps: based on original knowledge data cutting, generating a title through a large language model, and customizing a knowledge base; receiving query, analyzing an intention by using a large language model, and matching to generate a function; the query is rewritten by using a large language model, dense and sparse vector query is generated, and a double-layer retrieval mechanism is formed; a two-step recall mode is utilized, coarse-grained recall is firstly carried out, then a recall result is subjected to fine-grained optimization through a screening mechanism, and a reasoning text is generated; and finally, inputting the query and reasoning text into the large language model, and generating an optimal answer through single-round and multi-round questions and answers. According to the method, the professionality and reliability of answers are enhanced, and the technical problem that answers are incomplete and inaccurate in an existing question and answer system is solved.

The invention provides a security event association analysis and question answering method and system and a medium, and the method comprises the following steps: context-aware query completion: receiving an original query input by a user, obtaining a historical record of a current dialogue, and forming a context enhanced query according to the original query and the historical record of the current dialogue; dynamic task identification: outputting a prediction task model according to the context enhancement query in combination with a dynamic task identification strategy; multi-dimensional retrieval: performing multi-dimensional retrieval on the prediction task model to obtain a final knowledge context packet; and knowledge-driven response generation: generating a knowledge-driven response based on the knowledge context packet, and outputting a final security analysis report after the generated content passes verification. According to the method, efficient, accurate and explainable intelligent association analysis of the multi-source heterogeneous security data is realized by constructing a multi-dimensional knowledge base, designing a dynamic task recognition mechanism and realizing context-aware query completion.

The invention discloses a document knowledge base LLM intelligent question and answer method, device and equipment and a storage medium. The method comprises the steps that dynamic partitioning is conducted on a to-be-processed document, and vectorization and index storage are conducted on knowledge blocks; vector retrieval and keyword retrieval are carried out according to the natural language question, a vector retrieval result and a keyword retrieval result are fused, an answer is obtained through LLM, and the answer is fed back to a user after being safely filtered; when it is detected that the to-be-processed document is updated, the vector library and the index are synchronously updated, and the cue word template and the partitioning strategy are periodically optimized, so that the problem of form picture information loss can be solved, the integrity of document information analysis is guaranteed, the situation that the partitioning strategy is single is avoided, the multi-hop recall rate is increased, and the problem of semantic missing is avoided; a partitioning mechanism is reasonable, retrieval precision is improved, updating cost is reduced, data security is improved, implementation is convenient, universality is good, and the speed and efficiency of LLM intelligent question answering of the document knowledge base are improved.

A method of question answering using enhanced retrieval-augmented generation according to an embodiment includes receiving, by a computing system, a user query, pre-processing, by the computing system, the user query to determine whether the user query is associated with malicious intent, retrieving, by the computing system, relevant data from a knowledge base by using a keyword index and a semantic index in response to determining that the user query is not associated with malicious intent, prompting, by the computing system, a large language model to generate an answer to the user query based on only the relevant data retrieved from the knowledge base, and receiving, by the computing system, the answer to the user query from the large language model in response to the prompt.

The invention provides a complex question and answer method and system based on adaptive task deconstruction and multi-modal evidence aggregation, belongs to the technical field of natural language processing, and designs a dynamic Few-shot prompt construction method based on dependency syntax fingerprints to ensure that a prompt template is matched with a question structure; the invention discloses a dynamic problem deconstruction method based on confidence evaluation and auto-reflection. The method comprises the following steps: recursively decomposing a problem tree by using a large language model; converting the problem tree into a standardized linear task execution sequence by a problem tree context dependence specification and task sequence generation method; obtaining a high-correlation evidence set of each task based on an evidence generation method of two-way recall and cross encoder rearrangement; and the task sequence is reasoned and dynamically optimized by a question answer extraction method based on double-strategy aggregation reasoning. According to the method, the accurate complex question and answer result can be provided on the premise of ensuring the question disassembling quality, restraining error propagation and comprehensively recalling evidences.

The invention relates to the technical field of operation and maintenance automation, and provides an operation and maintenance field professional question and answer and diagnosis Agent design method and system, and the method comprises the steps: receiving and structurally analyzing an original query request of a user, carrying out the parameter validity check and safety verification, and extracting the query content and a session identifier; identifying task types through an intention classification algorithm based on the pre-training language model and performing content risk assessment; performing semantic extension on the query to generate an extended query word, performing similarity matching in the operation and maintenance knowledge base by using a hybrid retrieval algorithm, and fusing related knowledge fragments; inputting the enhanced query information and the task type into an inference engine for intelligent inference to obtain a diagnosis result; the reasoning result is stored in a historical memory library, and session context state information is updated; and performing formatting processing and security check on the reasoning result, packaging the result and context information, and outputting a standard response result. According to the method, the accuracy and the intelligent level of operation and maintenance professional question answering and diagnosis are improved.

The invention provides a household appliance knowledge question-answering method and system based on retrieval enhancement generation. The method comprises the following steps: acquiring household appliance field multi-modal data from a multi-format document library; extracting text information, table information and chart information in the multi-modal data; performing domain term injection processing on the extracted information, and constructing a packet domain enhancement index; receiving a natural language question input by a user; the natural language problem is analyzed through a query optimizer, and semantic retrieval and keyword retrieval are executed in parallel; carrying out fusion processing on the semantic retrieval result and the keyword retrieval result; selecting matched document fragments by adopting a relevancy sorting algorithm; inputting the matched document fragments into a large language model to generate candidate answers; verifying the compliance and traceability of the candidate answers through a credibility evaluation module; outputting a final answer with a reference source; and storing the high-frequency questions and the final answers into a cache library to solve the problems that the answer accuracy of a knowledge question-answering system is reduced and the response efficiency is limited.

The invention provides a knowledge question and answer library agent construction method and system. Efficient knowledge management and question and answer are achieved through cooperation of multiple agents. According to the system, firstly, a multi-modal information extraction agent is constructed, and heterogeneous data such as texts, images and tables are converted into structured vectors and stored; meanwhile, the knowledge graph is dynamically constructed and continuously optimized by the self-adaptive knowledge graph construction agent, and a new relationship is derived through combination of symbolic logic and a graph neural network, so that an evolvable knowledge network is formed. In the question and answer stage, a query analysis agent deeply analyzes the intention of a user and generates sub-queries; retrieving the vector library and the knowledge graph in parallel by the retrieval enhancement generation agent; and the reasoning and synthesizing agent integrates multi-source information and generates an accurate answer with a complete source label through a large language model. Dynamic knowledge management, precise semantic analysis and system self-evolution are achieved, and the method is particularly suitable for professional field scenes needing high-reliability questions and answers.

Large language models (LLMs) are versatile in responding to user questions on a wide variety of topics. However, LLMs suffer from several drawbacks, such as hallucinations, incomplete information, and inability to cite original sources of information. Disclosed herein are systems and methods for using an LLM in a restricted manner to respond to queries regarding document corpora, e.g., documents related to a set of products, such that the impact of these drawbacks is minimized. Information retrieval is coupled with LLMs to build a question and answer (Q&A) system on the text corpora. Complex retrieved information, incorporating human feedback, and recommendations in the Q&A system are provided.

The invention discloses a universal scene retrieval analysis method and system based on multi-modal feature fusion, the method comprises a video analysis step and an application service step, and the application service step comprises the steps of receiving a user input request, describing a multi-dimensional standardized video tag based on a video summary, and obtaining a multi-dimensional standardized video tag; the steps of cross-modal video retrieval, dynamic knowledge enhancement question answering and interactive enhancement analysis can be executed, efficient video preprocessing is achieved by constructing an offline feature library, the retrieval precision is improved by adopting a cross-modal feature fusion technology, the analysis authority is enhanced in combination with a dynamic knowledge base, and the interactive enhancement analysis is supported to achieve abnormal early warning. The method has the advantages that the offline video processing efficiency is improved, cross-modal feature fusion retrieval is realized, and the authority of an analysis result is enhanced.