20466results about "Knowledge representation" patented technology

A portable agent package apparatus for coupling to one or more environment, energy or water infrastructure or water body sensors produce timestamped or temporal process data, includes a physics surrogate world model trained to predict at least one hydraulic, chemical, or biological state variable of the sensed water system, a connection memory that stores metadata describing data source identifiers, units, and sampling cadence, pointers to available analytical tools or peer agent packages, or streams of operational experience or a hierarchical options library, an emotion tensor continuously encodes normalized metrics comprising at least one of model accuracy, computational load, data quality, latency, and uncertainty, or further including an exploration bonus channel, a value estimate error, an anomaly score, or an alignment divergence flag, and a bidirectional, authenticated communication interface that receives the temporal or timestamped process data from the one or more sensors, transmits Memo updates, and accepts goal directives.

Provided in the present application is an intelligent question answering method based on a collaboration between a large language model and a knowledge graph, relating to the technical fields of artificial intelligence and natural language processing, the method comprising: decomposing a complex question into a plurality of simple questions, and analyzing the degree of association between the simple questions and a basic function so as to form a multi-hop reasoning path; automatically extracting structured information from the simple questions on the basis of a multi-task learning framework of a large model, so as to construct a knowledge graph; and constructing a cumulative reasoning learning framework on the basis of a logic reasoning large model, and performing iterative verification on a process result formed by the knowledge graph on the basis of the multi-hop reasoning path, so as to correct the reasoning path until a correct answer is inferred.

The present invention provides a system and method for causality-augmented generative intelligence capable of autonomously discovering non-obvious actionable insights from heterogeneous and multimodal data sources. The system integrates a data ingestion unit for semantic and temporal harmonization of structured and unstructured datasets, a causal inference processor for constructing a dynamically evolving directed causal knowledge representation using perturbation-based validation, a latent representation processor that combines multimodal semantic embeddings with causal parameters to generate fused latent vectors, and a generative insight processor utilizing causally constrained generative reasoning to synthesize hypotheses anchored to verified cause-effect dependencies. A validation processor performs counterfactual assessment and observational verification to ensure retention of only those insights that remain consistent with causal ground truth.

Disclosed in the present invention are an aviation equipment reliability evaluation method and system based on a knowledge graph and model inference. The method comprises: acquiring data of human factors, equipment systems, and a working environment of aviation equipment; carrying out preprocessing and text labeling on the acquired data; inputting the labeled text information into a constructed entity relationship joint extraction model to form a high-quality structured triple of the knowledge graph; constructing an elastic knowledge graph for the aviation equipment, wherein the elastic knowledge graph comprises an online knowledge graph and an offline knowledge graph which has aviation equipment reliability; and extracting semantic features, and analyzing the similarity between the extracted features to realize indirect inference of the aviation equipment reliability. The present invention fully fuses expert experience and knowledge data, and exerts respective advantages of a human brain and machine intelligence, so as to achieve accurate analysis and prediction of aviation equipment reliability, thereby providing intelligent risk analysis, early warning and optimization suggestions for command and control personnel, and reducing a fault occurrence rate.

The invention relates to the technical field of financial data processing, in particular to a multi-source heterogeneous fund data processing method and system, and the method comprises the steps: recording source information through building a data source registry, and marking a unique identifier for data; performing differential analysis on the fund data in different formats to generate standardized column type storage data; traversing column type storage data to extract statistical characteristics, performing field classification through metadata analysis and financial dictionary matching, analyzing business connotations of fields difficult to classify in combination with a localized large language model, and mapping the business connotations to a header fusion knowledge graph; generating a mapping rule from the source field to the enterprise-level data model by applying a rule engine template on the basis of field classification and semantic recognition results; converting the data structure according to the mapping rule and executing standardization processing; the quality is further optimized through data cleaning; and finally, the data are verified, standardized fund data supporting data traceability are output, and the strict requirements of financial supervision application are met.

The invention relates to the technical field of data analysis, in particular to an operation decision intelligent analysis method and system based on cross-domain data fusion. The method comprises the following steps: firstly, based on an enterprise multi-domain ontology knowledge base, performing entity identification and relation mapping on heterogeneous data from different business systems through a semantic mapping-based multi-source heterogeneous data dynamic fusion algorithm, and establishing a unified data model; then, a causal reasoning and deep learning fused hybrid intelligent decision engine is adopted to analyze and process the model; then, a multi-level causal relationship network among business variables is constructed through a causal relationship discovery algorithm by utilizing an analysis result of the hybrid intelligent decision engine, and an adaptive business scene analysis model based on reinforcement learning is used to dynamically adjust an analysis strategy according to business environment changes; generating a Pareto optimal decision scheme set through a multi-objective optimization algorithm, and outputting operation decision suggestions; according to the invention, the comprehensiveness and accuracy of intelligent analysis of enterprise operation decisions are improved.

The invention discloses a multi-modal medical image data intelligent processing system, relates to the field of medical image analysis, and is applied to multi-modal medical image whole-process analysis of CT, MRI, PET, ultrasound and the like. According to the system, different modal image features are extracted and fused through a cross-modal manifold fusion network; a semantic guidance dynamic registration engine optimizes registration parameters to ensure that the registration error is less than or equal to 1.5 mm; the multi-task collaborative diagnosis network realizes multiple tasks such as disease classification; the clinical knowledge embedding and interpretable module generates a structured report and is in butt joint with an HIS system. Meanwhile, the model is optimized through a federated learning architecture, the adaptability of newly added data is improved by more than or equal to 20%, and intelligent processing and analysis of multi-modal medical images are realized.

The invention provides a multi-source heterogeneous data integration and governance-oriented data weaving method, which comprises the following steps of: performing data acquisition from an accessed multi-source heterogeneous data source to generate an original multi-source heterogeneous data stream; performing standardization processing on the original multi-source heterogeneous data stream to generate a standardized multi-source heterogeneous data set; performing active content scanning processing on the standardized multi-source heterogeneous data set to determine business metadata, and performing consanguinity tracking processing on the business metadata to generate enhanced business metadata; calling a domain ontology framework to carry out standardized constraint on the enhanced service metadata to obtain standardized service metadata without cross-data source semantic ambiguity, and carrying out implicit association mining processing on the standardized service metadata based on a graph neural network to generate a semantic knowledge graph containing core entities and relationships; and performing logic abstraction processing on the distributed data resources according to the semantic knowledge graph to generate a unified data access interface.

The invention discloses a knowledge base enhancement generation method and system based on hybrid retrieval and fact verification. The method comprises the following steps: receiving an original query of a user; performing intention analysis and rewriting on the query, identifying an intention type and generating a sub-query adapted to retrieval; executing mixed retrieval of vector retrieval, keyword retrieval and selectable knowledge graph retrieval based on the sub-query, and recalling related knowledge fragments; performing deduplication clustering, fact conflict recognition processing and correlation reordering on the knowledge fragments; according to the intention type and the reordered knowledge fragment, dynamically selecting a prompt template to construct an enhanced prompt; and sending the enhanced prompt into the large language model, and generating a target response with the reference source. According to the method, knowledge recall comprehensiveness is improved through mixed retrieval, knowledge reliability is ensured through fact verification, generation logicality is enhanced in combination with dynamic prompt construction, and response accuracy and credibility are improved.

An example may receive at least one input via at least one device. An example may use the at least one input to determine an entity identity. An example may use the entity identity to create an automated agent and load context data associated with the entity identity into at least one layer of a multi-layer memory of the automated agent. An example may cause the automated agent to machine-learn a supervision level via the context data. The machine-learned supervision level may indicate a level of supervision of the automated agent by an entity associated with the entity identity. An example may configure the automated agent to execute a task on behalf of the entity and in accordance with the machine-learned supervision level.

The invention relates to the technical field of data center intelligent management, in particular to a data center construction and intelligent operation and maintenance management system, which comprises a dynamic environment sensing module, a heterogeneous equipment protocol adaptation module, a multi-dimensional resource dynamic scheduling module, a hidden fault prediction module and an energy efficiency optimization execution module. Physical environment data such as temperature gradient, current harmonic component and optical fiber strain rate are acquired by deploying a multi-mode sensor, and an environment characteristic matrix is constructed; standard semantic mapping of the heterogeneous protocol is realized by using a semantic slot migration algorithm; establishing a resource topological graph based on the hypergraph neural network and dynamically updating the resource topological graph; a dual-channel space-time convolutional network is adopted to realize fault prediction; and combining the fault probability matrix to generate a dynamic tuning strategy of dimensions such as cooling, electric power, network and the like, and forming closed-loop optimization control. According to the invention, integrated collaboration of multi-source information fusion, equipment intelligent control and energy efficiency adaptive optimization is realized, and the intelligence, reliability and energy efficiency level of data center operation and maintenance are improved.

The invention provides an intelligent SQL generation method and system for business query, and belongs to the technical field of artificial intelligence. Related data of query statements are acquired, and a corresponding query intention knowledge graph is constructed by semantic clustering; the method comprises the following steps: analyzing a historical SQL statement structure, extracting a natural language template and an SQL template, and expanding through a large language model to generate a feed-shot example set; and constructing a composite cue word template by combining task setting guidance, a feed-shot example and CoT chain thinking reasoning guidance. An intention completion module is arranged in a large language model, a natural language query statement of a user is combined with a composite cue word template context, a structured query statement is generated through entity recognition, semantic completion, parameter filling and fuzzy intention training, and the structured query statement is converted into a standard SQL statement through a knowledge graph and a template. According to the method, the use threshold of business personnel is remarkably reduced, and efficient conversion from natural language questions to SQL statements is realized.

Systems and methods for integrating generative artificial intelligence (AI) within Software-as-a-Service (SaaS) platforms to automate data operations, synchronize cross-platform workflows, and enable intent-based interactions. A platform displays table structures of items and characteristics linked to a common objective, provides input interfaces, and enrolls AI agents as credentialed users with read / write privileges. The system prompts agents with column types, structural relations, and role profiles to generate and execute editing instructions that progress workflow objectives, detect missing or inconsistent data, and notify users or request information as needed. Hierarchical access schemes permit multiple agent instances with inherited privileges and resource limits managed through an AI center. Agents can operate as autonomous team members, analyze outputs, and support natural-language explanation sessions. Additional embodiments coordinate inter-service updates, maintain deviation detection tools, and construct tailored products and platform elements. These capabilities improve robust automation, decision support, and operational efficiency in complex SaaS environments.

The invention discloses a multi-modal visual arrangement recommendation method, belongs to the technical field of artificial intelligence and data visualization crossing, and realizes visual arrangement recommendation based on multi-modal input analysis, a dynamic mixed recommendation model and an intelligent optimization algorithm. Comprising the following steps: multi-modal intention analysis: realizing intelligent analysis of multi-modal input through combined use of a base model and a fine tuning model, realizing high-precision intention classification in combination with a pre-training language model and a domain adaptation fine tuning technology, and triggering dynamic prompt word recommendation; performing intelligent layout generation: performing global optimization of component space allocation by adopting a genetic algorithm, performing business rule adaptation by combining a constraint solver, and modeling an interaction relationship between components by utilizing a graph neural network; and dynamic mixed recommendation: constructing a three-level recommendation architecture including collaborative filtering, content matching and reinforcement learning. According to the method, a closed-loop recommendation process of user intention-intelligent recommendation-feedback optimization is realized, and the intelligent level of visual arrangement and the user experience are remarkably improved.

The invention discloses an accounting data intelligent processing method and system for enterprise financial auditing, and relates to the technical field of accounting data intelligent processing, and the method comprises the steps: obtaining multi-mode enterprise financial data, and carrying out the preprocessing; carrying out multi-modal semantic understanding analysis on the unstructured text and image data; constructing an enterprise financial space-time knowledge graph containing time attributes; inputting into an anomaly analysis model, extracting spatial structure characteristics of the financial entity in the topological network, and extracting dynamic characteristics of the financial relationship evolved along with the time sequence; identifying an abnormal source, evaluating a systematic risk value and generating an abnormal propagation path; and integrating to generate a final audit report. According to the method, structured and bill images are fused, identifiers and time calibers are unified, abnormal source and propagation are positioned based on the space-time knowledge graph, closed-loop counter-knock and cross-period anomalies are identified, the auditing accuracy and coverage rate are remarkably improved, the workload of false report, missing report and manual recheck is reduced, and a traceable structured report is quickly generated.

The invention provides an industrial agent decision-making method and device, electronic equipment and a storage medium. The method comprises the following steps: loading multi-source industrial data to a knowledge graph, and constructing a domain ontology and an MCP ontology; performing parameter fine tuning on a preset base large language model; receiving an industrial process planning demand input by a user, and performing semantic analysis on the industrial process planning demand; processing the query result by utilizing an MCP context strategy to generate a prompt context; inputting the prompt context and the industrial process planning demand into a fine tuning large language model to generate a first process planning scheme; performing rule verification on the first process planning scheme based on the knowledge graph, and judging whether the first process planning scheme meets a preset rule or not according to a verification result; and converting the final process planning scheme into a control script or an interface calling sequence which can be analyzed by an industrial execution system, and outputting the control script or the interface calling sequence. According to the method, the cross-software system compliance process planning with unified knowledge, automatic generation and rule verification can be realized.

The invention discloses a dynamic intention recognition and GraphRAG fusion method and system for open domain questions and answers, and relates to the technical field of intelligent and natural language processing. The method comprises the following steps: constructing and dynamically updating a heterogeneous knowledge graph; performing dual-stage intention recognition on user query; subtasks are disassembled based on an intention result, and cooperative execution is carried out through multiple agents; service standardization integration is realized by means of a model context protocol; and closed-loop optimization is carried out in combination with user feedback. The system comprises an image knowledge base, an intention recognition module, an agent collaboration module, an MCP service integration module and a feedback optimization module. The system is a novel open domain question-answering system integrating structured knowledge modeling, dynamic intention understanding, intelligent collaborative reasoning and standardized service interaction, and through fusion of structured knowledge modeling and intelligent collaborative reasoning, question-answering accuracy and complex intention understanding ability are improved, system adaptability and efficiency are enhanced, multi-system collaboration is promoted, and the system has a wide application prospect. The method is suitable for scenes such as knowledge services and intelligent assistants.

The invention relates to a multi-modal data and RAG technology fused power design knowledge base construction method, and belongs to the technical field of power software development. The method comprises the following steps: carrying out collection and information extraction on multi-source heterogeneous original data; the method comprises the following steps of: constructing a multi-dimensional knowledge element structure containing parameters, specifications and case relationships by carrying out classification, specialized and precise processing and cross-modal association on data; based on a vector, graph and relational database mixed storage architecture, semantic vector efficient retrieval, knowledge graph relation management and business data synchronization are achieved respectively; and a dynamic optimization result is subjected to hybrid retrieval, a dual-drive reasoning mechanism outputs compliance conclusions and bases, and a retrieval enhancement generation service ensures that output contents conform to specifications. And systematic management and intelligent application of the electric power design knowledge are realized.

A portable agent package apparatus for coupling to one or more environment, energy or water infrastructure or water body sensors produce timestamped or temporal process data, includes a physics surrogate world model trained to predict at least one hydraulic, chemical, or biological state variable of the sensed water system, a connection memory that stores metadata describing data source identifiers, units, and sampling cadence, pointers to available analytical tools or peer agent packages, or streams of operational experience or a hierarchical options library, an emotion tensor continuously encodes normalized metrics comprising at least one of model accuracy, computational load, data quality, latency, and uncertainty, or further including an exploration bonus channel, a value estimate error, an anomaly score, or an alignment divergence flag, and a bidirectional, authenticated communication interface that receives the temporal or timestamped process data from the one or more sensors, transmits Memo updates, and accepts goal directives.

The invention relates to the technical field of safety monitoring and intelligent early warning, discloses a construction safety risk monitoring method and system, and aims to solve the problems that a traditional construction safety monitoring means is isolated, static and lagged. The method comprises the following steps: deploying a multi-modal sensing network to collect environment, personnel, equipment and structural data; constructing a risk factor time sequence matrix through space-time alignment and feature normalization; constructing a dynamic association graph in combination with the risk conduction rule base and historical cases; predicting risk propagation potential energy of each node by using a graph neural network; triggering early warning according to the multi-level threshold value and outputting a conduction path and a blocking suggestion; the field devices are linked to perform hierarchical suppression actions. The system comprises a sensing deployment module, a data fusion module, a map construction module, a potential energy prediction module and an early warning decision and execution linkage module. Through space-time modeling and intelligent deduction, active identification and second-level intervention of a risk link are realized, the transformation of construction safety from passive response to active prevention is promoted, and the accident probability and the loss scale are reduced.

The invention relates to the field of environmental data processing, in particular to a multi-source heterogeneous data collection and fusion method and system for the environmental governance industry, and the method comprises the following steps: obtaining multi-source heterogeneous environmental data, and carrying out the quality evaluation and restoration processing to obtain a standardized environmental data set; semantic mapping and space-time alignment are carried out on the standardized environment data set to obtain a semantic space-time unified data set, and block chain evidence storage is carried out to obtain a multi-source heterogeneous data collection result; performing multi-modal feature extraction on the multi-source heterogeneous data convergence result to establish an environment dynamic knowledge graph, and performing anomaly detection to obtain a knowledge enhancement environment data set; and constructing an environment data traceability model to perform traceability analysis on the knowledge enhanced environment data set to obtain a traceability inference result, and performing data fusion based on the traceability inference result to obtain a multi-source heterogeneous data fusion result. According to the method, efficient data collection fusion processing is realized, and accurate data support is provided for decision making of the environmental governance industry.

The invention discloses an industrial data analysis and mining system based on a knowledge graph, relates to the technical field of data mining, and aims to solve the problems of difficulty in cross-process parameter association and low abnormal traceability precision. The system calculates the correlation strength of the oven temperature in the coating process and the direct-current internal resistance of the battery cell in the formation and capacity grading process through a time-lag mutual information algorithm, generates an influence relation edge with a time-varying weight in combination with a temperature-internal resistance negative correlation process rule, and constructs an industrial knowledge graph; taking a direct-current internal resistance abnormal batch as a starting point, reversely traversing the knowledge graph along a process path, fusing a parameter Z-score deviation degree and a dynamic weight to generate a root cause parameter list, and realizing quality root cause positioning; instantiating abnormal parameters into event nodes, identifying star-type and chain-type propagation topologies through subgraph isomorphism detection, and extracting a standardized fault mode; based on an FCI causal discovery algorithm, a real causal structure is identified, the weight of the knowledge graph is dynamically adjusted, adaptive evolution of the graph is realized, and the accuracy and the intelligent level of complex process quality analysis are improved.

The invention relates to a graph-based network security event modeling method and system, and the method comprises the steps: obtaining topological data and security policy information of a network where network security equipment is located, and carrying out the hierarchical construction of a knowledge graph, and obtaining a multi-layer security graph; acquiring real-time monitoring data of the network security equipment, and performing graph adversarial learning association with the multilayer security graph to obtain a dynamic evolution graph sequence; obtaining alarm data of the network security device, and performing anomaly detection on the multilayer security map to obtain an anomaly propagation situation; performing security assessment construction on the dynamic evolution diagram sequence and the abnormal propagation situation to obtain an initial security assessment scheme; performing alarm identification and attack link prediction on the alarm data to obtain a link prediction result; and performing evaluation and prediction on the initial security evaluation scheme and the link prediction result to obtain a security situation evaluation strategy. According to the invention, the security condition of the current network can be evaluated more accurately.

The invention discloses a judicial scene-oriented multi-modal data fusion method and system. The method comprises the following steps: 1) collecting multi-modal data in a judicial application scene and converting the multi-modal data into data in a uniform format; 2) mapping the data to a unified semantic space to realize cross-modal alignment; then associating the multi-modal data to obtain the text description of the same case and the corresponding image evidence as the multi-modal features of the corresponding case; 3) constructing a knowledge graph of a judicial application scene based on the multi-modal features; driving multi-modal data fusion based on the knowledge graph and constructing a multi-modal evidence chain of each entity; 4) quantifying the integrity of the knowledge graph and the reliability of the multi-modal evidence chain according to a preset index, marking abnormal nodes in the knowledge graph according to a quantification result, and adjusting the abnormal nodes; 5) generating a structured knowledge graph according to the knowledge graph and creating a dynamic desensitization report; edges in the structured knowledge graph represent relationships between legal entities, and each relationship is bound with a multi-modal evidence chain.

The invention relates to the technical field of image data processing, and discloses a power grid drawing intelligent review method and system based on a knowledge graph, and the method comprises the steps: driving a multi-mode large language model based on a domain specific prompt project, extracting a power grid domain knowledge triple from structured text data, and then carrying out the quality evaluation and conflict detection, performing automatic resolution on the conflict knowledge to obtain a candidate knowledge set; checking and confirming the candidate knowledge set through a man-machine cooperation verification mechanism, and constructing a power grid design specification knowledge graph; and identifying to-be-reviewed elements in the to-be-reviewed power grid drawing through the multi-modal large language model, querying the power grid design specification knowledge graph according to the generated structured query statement, performing compliance judgment on the to-be-reviewed power grid drawing based on the obtained query data packet, and generating a review report. According to the method and the device, the efficiency and the reliability of automatic drawing review can be improved, and meanwhile, the interpretability and the traceability of review results are ensured.

The invention relates to the technical field of intelligent retrieval and matching, in particular to a property intelligent retrieval and matching system based on a knowledge graph. The method comprises the following steps: a data acquisition and processing unit acquires property right data and preprocesses the property right data; the knowledge modeling and graph construction unit constructs the preprocessed property right data into a knowledge graph based on entity extraction, relation extraction and attribute labeling; the retrieval analysis and semantic understanding unit is used for receiving a retrieval request input by a user, converting the retrieval request into a structured retrieval statement matched with the knowledge graph based on a dynamic multi-hop reasoning intention path discovery scheme, and analyzing a retrieval intention of the retrieval request through a context modeling and semantic disambiguation method. According to the method, a semantic understanding mechanism combining a dynamic multi-hop reasoning intention path discovery scheme with context modeling and semantic disambiguation is introduced, so that a complex retrieval request input by a user in a natural language form can be accurately analyzed.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a decision-making method, device, equipment and medium based on multi-modal semantic alignment. Executing cross-modal alignment by taking the voice semantic map as a reference to generate associated information, fusing the voice features, the visual features, the action features and the associated information to generate a fusion feature vector, inputting a decision network to generate a decision feature vector and generate a task execution instruction, obtaining execution feedback information of the task execution instruction, and updating the decision network. According to the method, input is dominated by voice instructions, visual features, action features and semantic map depth alignment and fusion are combined, input naturalness and multi-modal data analysis and decision-making efficiency are improved, and interaction adaptability and decision-making accuracy of the model in a complex scene are improved.

The invention belongs to the field of artificial intelligence, particularly relates to an intelligent regulation and control system for an injection molding process of an industrial control system, and aims to solve the problem that high-precision cooperative regulation and control are difficult under material batch fluctuation, mold state change and environmental disturbance. The system comprises a multi-source sensing module, a dynamic modeling module, a self-adaptive decision-making module, an execution feedback module and a knowledge evolution module, and high-stability and high-adaptability intelligent regulation and control of the injection molding process are achieved through a mixed digital twin model integrating a physical mechanism and data driving, confidence-guided multi-objective optimization and continuous evolution of a process knowledge graph.

The invention discloses a power equipment fault diagnosis method and system based on a dynamic knowledge graph and large model collaborative reasoning, and the method comprises the steps: achieving the automatic extraction of an entity relationship through a weak supervision entity relationship extraction mechanism in combination with a power field dictionary and a remote supervision technology, and obtaining a weak supervision entity relationship; constructing a time sequence knowledge graph to capture a dynamic evolution rule of the fault propagation chain; structured knowledge graph embedded representation is fused with a large model input layer through a knowledge injection layer, a two-stage reasoning process is generated by adopting a graph retrieval enlarged model, and finally a diagnosis conclusion containing a structured evidence chain is generated. According to the method, the fusion of weak supervised learning and sequential relation modeling is realized, and the automatic extraction and dynamic updating capability of the knowledge in the electric power field is remarkably improved; through a knowledge injection layer and a two-stage joint reasoning mechanism, the structured reasoning advantage of a knowledge graph and the semantic generation capability of a large model are effectively combined, and the diagnosis accuracy, the time sequence reasoning capability and the interpretability are greatly enhanced.

The invention discloses a method for constructing a cross-modal knowledge graph, and relates to the technical field of knowledge graphs, and the method comprises the steps: obtaining multi-source heterogeneous data, and carrying out the collection, structural analysis, modal recognition and classification, cleaning and standardization processing, so as to form structured multi-modal data; extracting entities and relationships of the identified modals from the structured multi-modal data, and summarizing the entities and relationships to form a multi-modal knowledge element set; mapping different modal entities in the multi-modal knowledge element set to a unified semantic space, and generating a unified entity relationship set through semantic matching, alignment and fusion; and normalizing the data into knowledge triples, and storing and organizing the knowledge triples through a graph database to form a cross-modal knowledge graph. According to the method, the problems of difficulty in multi-modal heterogeneous information alignment and difficulty in entity relationship extraction can be relieved, semantic association is enhanced, and knowledge graph integrity and multi-scene adaptability are improved.