191531results about "Biological models" patented technology

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.

The invention discloses an auditing decision support system and method based on a dynamic knowledge graph, relates to the technical field of computers, and aims to solve the problems that auditing data are heterogeneous and complex, risk identification is not timely and causal interpretation is lacked. According to the system, multi-modal audit data is collected in real time through a streaming event processing framework, and a dynamic audit knowledge graph with timeliness weight is constructed. Based on a graph calculation engine and cross-domain rule mining, identifying a high-frequency risk mode, and generating a risk conduction path graph; further fusing a multi-modal graph attention network, identifying and positioning abnormal entities, and outputting abnormal nodes and risk links thereof; and finally, the abnormal node embedding representation is dynamically updated through the time sequence diagram attention network, an interpretable audit causal map is generated in combination with a structural causal model, and closed-loop support from data acquisition and risk identification to interpretive audit decision is realized. The intellectualization and transparency of audit decision making are improved, and an efficient and traceable decision making basis is provided for a complex audit scene.

A system and method for extending AI-enhanced decision platforms with deontic and normative reasoning capabilities that enhance adjustably autonomous decision-making through a novel integration of symbolic and neural approaches. The invention uses hierarchical and fuzzy deontic logic implementations alongside connectionist AI / ML to manage obligations, permissions, and prohibitions while maintaining observer awareness to achieve goals while incorporating knowledge across multiple expert domains. The system employs dynamic event and spatio-temporal knowledge graphs along with debate mechanisms, enabling high-assurance automated reasoning while preserving explainability through neuro-symbolic integration. In at least one embodiment, the invention operates through a federated distributed computational graph architecture that allows for arbitrary scaling while maintaining coherence, consistency and supporting compound workflows. The invention provides a framework for AI systems to make logically consistent, ethically-aware decisions by combining deontic reasoning with multi-agent coordination, token space communications and knowledge, including on intermediate results, enabling automated decision-making for a variety of applications.

A scalable platform for orchestrating networks of specialized AI multi-agent networks that enables secure collaboration through token-based protocols and real-time result streaming with advanced dynamic chain-of-thought pruning. The central orchestration engine manages domain-specific agents, implementing sophisticated multi-branch reasoning with contribution-estimation layers that evaluate each agent's utility using Shapley value-inspired metrics. The system employs information-theoretic and gradient-based surprise metric to guide memory updates and dynamic reasoning expansion, preventing local minima stagnation while preserving valuable insights through adaptive forgetting mechanisms. The platform unifies Monte Carlo tree search with contribution-aware estimation to detect high-synergy expert combinations while maintaining privacy through partial data approaches. It scales across distributed computing environments, enabling complex collaborative tasks like materials discovery, product engineering and manufacturing process design, biomedical research, and drug development. The system supports multi-party economic rewards through systematic contribution effort, cost and importance tracking, while standardized interfaces manage security, privacy, and policy constraints across heterogeneous agents.

An advanced model management platform for optimizing and securing generative artificial intelligence systems such as large language models (LLMs) and diffusion models. The platform incorporates various techniques to address the limitations of current generative AI systems, such as hallucination, lack of validation, security vulnerabilities, and inadequate model management. The system employs reinforcement learning algorithms for model optimization, retrieval augmented generation (RAG) for hallucination mitigation, domain-specific validation against expert knowledge, model distillation and similarity scoring for security, adversarial training for robustness, and attention mechanism search and model blending for advanced management and neuro symbolic AI routine combinations. By integrating these techniques, the platform significantly improves the performance, reliability, and security of generative AI across a wide range of tasks and domains leveraging the best elements of symbolic and connectionist techniques alongside automated planning and modeling simulation.

Disclosed in the present invention are an adaptive deep transfer fault diagnosis method and system, an apparatus and a medium. The method comprises the following steps: S1: collecting vibration acceleration signals of industrial equipment under different working conditions, and dividing same into a source domain data set and a target domain data set; S2: building a self-tuning universal domain adaptive fault diagnosis model, which comprises a shared feature extractor, a known classifier and a plurality of unknown classifiers; S3: separately calculating a classification loss of known faults of the source domain, a discriminative loss of the plurality of unknown classifiers, a target domain soft consistency regularization loss and an information entropy maximization loss; S4: introducing a dynamic weighting strategy based on model uncertainty assessment to optimize the model parameters; and S5: using the model for diagnosis. The present invention can fully mine valid information in data, can establish reliable class decision boundaries, and in addition, uses the self-tuning dynamic update strategy to adjust weightings corresponding to different loss functions, thus allowing for quick generalization of the model to different industrial diagnosis scenarios.

The invention discloses a multi-modal AI-based power equipment anomaly detection method and system, and the method comprises the steps: synchronously collecting electrical, mechanical and thermal modal data of power equipment through an edge computing node, carrying out the load adaptive dynamic preprocessing, and uploading the data to a cloud end; the cloud constructs a multi-modal feature extraction network based on a structural causal model, analyzes a causal path between modals through a Bayesian network and performs weighted fusion on feature vectors; capturing device state mutation by using a gating attention mechanism, and updating the feature vector; executing time-space consistency verification of the equipment group to identify regional group abnormality and suppress single-point misinformation; generating an interpretable report containing an abnormal root cause analysis and priority ranking maintenance strategy; and establishing a closed-loop feedback mechanism to correct the cause and effect probability distribution of the Bayesian network model. The system comprises a multi-modal sensor array, an edge computing node and a cloud analysis platform, wherein the cloud analysis platform is integrated with a causal reasoning engine, a space-time consistency verification module and the like. According to the invention, by analyzing the multi-modal deep causal association, the method adapts to the dynamic change of the equipment, reduces the false alarm rate, generates an interpretable report, supports closed-loop self-optimization, and improves the anomaly detection accuracy and operation and maintenance decision efficiency of the power equipment.

The invention discloses an aerospace intelligent manufacturing large model construction method, which comprises the steps of collecting original data, performing preprocessing and data association, and constructing an aerospace intelligent manufacturing database; establishing a knowledge acquisition and structured conversion assembly line, a multi-dimensional associated domain knowledge graph, a knowledge quality control system and a dynamic updating mechanism, and constructing a professional knowledge base; aligning the cross-modal manufacturing data to generate a corpus; combining base general large model pre-training, injecting terminology semantics and multi-modal association capability, and completing knowledge migration; based on the pre-trained aerospace intelligent manufacturing large model, constructing an aerospace manufacturing cognitive agent, and forming a complex engineering problem solving framework; professional ability is optimized through a two-stage progressive multi-task training strategy, and dynamic adaptation of a production environment is realized in combination with an online learning and incremental updating mechanism. The intelligent level of aerospace intelligent manufacturing is remarkably improved.

The invention discloses a network equipment integrated monitoring method and system. The method comprises the following steps: collecting multi-source heterogeneous data, constructing a protocol compatible layer, and supporting multi-protocol adaptation; data fusion and intelligent analysis: constructing a dynamic topology, analyzing an equipment configuration file, and generating a network topological graph; performing time sequence prediction according to a root cause analysis model, and predicting an abnormal trend; mining association rules, analyzing historical data, and extracting fault association rules; constructing an equipment fault knowledge base under the assistance of a knowledge graph, and accelerating root cause positioning; self-adapting an alarm threshold, analyzing historical data distribution, and dynamically adjusting the threshold; visual decision making and automatic processing are carried out, a 3D topological map is provided, and layered display is supported; and performing fault grading processing, comprehensively calculating a fault influence degree score, mapping to a fault grade and a work order type according to an influence degree score interval, and formulating a dynamic work order generation rule. A protocol compatible layer is constructed by deploying a lightweight agent program, multi-protocol adaptation is supported, and various network devices can be fully covered.

The invention discloses a smart park full life cycle management system and method based on digital twinning and Internet of Things, and relates to the technical field of smart park management, and the system comprises a sensing edge module, a data governance module, an intelligent analysis module, a life cycle module and a twinning modeling module. According to the invention, multi-protocol access and edge computing capability are supported, and the data transmission efficiency and stability are greatly improved; the intelligent analysis module outputs an accurate analysis result by constructing a multi-class feature matrix and deep multi-task joint modeling mechanism, and provides data support and model guidance for dynamic management and intelligent decision making of the park; the life cycle module integrates a Kepler optimization algorithm and a multi-agent reinforcement learning and simulated annealing algorithm, establishes a collaborative optimization mechanism, realizes combination of global search and local fine tuning of resource scheduling, and effectively optimizes energy consumption, response time, space utilization and safety risks; and the twin modeling module constructs a park three-dimensional model, so that the interactivity and operability of the system are improved.

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.

The invention discloses a method for enhancing dynamic knowledge retrieval based on a large language model, belongs to the field of knowledge retrieval, and aims to solve the problems of knowledge solidification, insufficient timeliness and illusion of a traditional LLM (Logistics Language Model). A multi-granularity knowledge base is dynamically constructed, and a rule and semantic partitioning technology is combined, so that a text is converted into a normalized vector, and a hybrid index is established; a two-channel retrieval triggering mechanism is adopted, keyword matching scores and BERT semantic probability analysis are fused, and retrieval requirements are intelligently judged; vectorization retrieval is realized through a BGE-M3 model, and candidate results are reordered in combination with a cross encoder to improve the precision. The system supports multi-language adaptive processing, dynamic switching of word segmentation strategies and cross-language retrieval, and introduces real-time knowledge updating and version control. According to the method, the answer timeliness and accuracy are remarkably improved, the context coherence of multiple rounds of dialogues is optimized, the method can be widely applied to the fields of intelligent customer service, professional questions and answers and the like, the LLM illusion risk is effectively reduced, and the knowledge traceability is enhanced.

The invention discloses a computing resource scheduling method based on user demands and task priorities, which relates to the technical field of resource scheduling, and comprises the following steps: receiving a computing task request submitted by a user, analyzing and verifying explicit demand parameters and implicit demand parameters, and generating a standardized demand description object; acquiring cluster state data and external environment parameters in real time, constructing a user-task-environment three-dimensional feature tensor, and outputting a standardized feature vector group; and collecting a performance data flow of the container instance group, triggering an elastic scaling decision based on a pre-trained LSTM prediction model, dynamically adjusting cluster resource configuration and executing abnormal task rescheduling. According to the method, a user-task-environment three-dimensional feature tensor is constructed, and a dynamic mixed weighted priority score is generated in combination with a reinforcement learning model, so that space alignment and time sequence cumulative effect fusion of multi-dimensional features is realized.

The invention provides a multi-modal enterprise credit risk assessment method based on a knowledge graph, which integrates data such as enterprise relationships, industry policies and supply chain information by constructing an enterprise financial knowledge graph, processes entity static attributes and associated information by using a multi-modal embedding technology, captures the associated information in combination with a heterogeneous graph neural network, and evaluates the credit risk of an enterprise. And the dynamic space-time attention mechanism mines time and space features of the time series data, identifies a core risk conduction path based on an attention weight, and finally fuses graph-level features, dynamic space-time features and business rules to output a structured evaluation result. According to the method, multi-modal data is effectively integrated, the problem of incidence relation modeling deficiency is solved, deep fusion of enterprise multi-source data and accurate extraction of risk features are realized, and the accuracy and interpretability of enterprise credit risk assessment can be effectively improved.

The invention discloses a multi-modal fusion AGV dynamic path planning and cluster scheduling system, and relates to the technical field of multi-modal perception and data fusion, and the system comprises a multi-modal perception module which generates a dynamic obstacle confidence map through multi-source data fusion in combination with a hardware-level time synchronization and Transform feature fusion network; the dynamic path planning module adopts an improved rolling window algorithm, integrates an LSTM space-time conflict prediction model and an adaptive weight cost function, and realizes dynamic obstacle trajectory prediction and non-oscillation global path generation; the cluster scheduling control module is used for optimizing multi-AGV task allocation and conflict resolution in combination with a dynamic priority preemption mechanism and digital twinborn simulation rehearsal based on a distributed contract network protocol of edge computing; and the data conflict resolution module is used for triggering a multi-modal re-calibration process through confidence weighting and sliding window time sequence verification. According to the system, in logistics storage and intelligent manufacturing scenes, the dynamic obstacle avoidance success rate and the robustness and operation efficiency of an AGV cluster are improved.

The invention belongs to the technical field of earthquake disaster scene recognition, and discloses an earthquake disaster scene recognition method based on deep learning. The method comprises the following specific steps: S1, data acquisition and preprocessing; S1.1, multi-source heterogeneous data acquisition and establishment of a comprehensive database containing seismic waveform data, surface deformation data, building structure data, geographic information data and historical disaster record data; through fusion of a 3D convolutional network, a graph attention mechanism, a space-time LSTM and an adaptive cross-modal attention fusion technology, combined modeling of a seismic waveform space-time evolution law, an earth surface deformation space distribution characteristic, a building group topology vulnerability and disaster chain time sequence association is realized, the characterization capability of a complex nonlinear disaster mode is effectively improved, and the method has the advantages of high adaptability and high reliability. And disaster assessment response time is shortened to a sub-second level through mixed precision quantification and edge computing deployment, and high recognition accuracy is still kept in a scene with strong noise and data missing in combination with a multi-task classifier and a physical constraint verification mechanism.

A system and method for adaptive edge-cloud data processing dynamically distributes computational tasks between edge devices and cloud infrastructure in response to changing conditions. The system continuously monitors resource availability, network parameters, and workload characteristics while predicting future conditions using hierarchical forecasting models. A multi-objective optimization approach determines optimal task distribution, balancing processing latency, energy consumption, bandwidth utilization, and result quality. The system implements a partitionable processing pipeline that enables seamless task migration through state synchronization protocols and checkpoint mechanisms. During migration, the system preserves processing continuity by establishing dependencies, creating execution checkpoints, and verifying successful state transfer. Performance metrics may be continuously collected and analyzed to improve future decision-making. The system maintains operational resilience during connectivity disruptions through local decision-making capabilities and eventual consistency protocols, making it suitable for diverse applications including industrial IoT, connected vehicles, healthcare wearables, and smart city infrastructure.

The invention belongs to the technical field of automobile parts, and discloses an automobile part enterprise supply chain risk early warning method based on artificial intelligence. Comprising the steps that supply chain data are collected and processed, and a graph is constructed; evaluating the suppliers based on the atlas to generate a portrait matrix; on the basis of the portrait matrix and in combination with the production parameters, model training is performed, a prediction engine is constructed, and a part quality risk prediction result is generated; performing anomaly detection on the nodes to form a monitoring network, and generating a risk assessment result; constructing a supply chain network topology model based on the map, and performing risk propagation path analysis to generate a risk conduction map; establishing a risk assessment model, integrating the risk prediction result, the risk assessment result and the risk conduction diagram, and performing integrated assessment on the risk of each link of the supply chain to form a scoring system; based on a scoring system, a dynamic risk early warning threshold is generated, a risk response decision tree is constructed, intelligent risk response suggestions are provided, and the enterprise risk disposal efficiency is improved.

The present invention provides a system and method for causality-augmented generative intelligence capable of autonomously discovering non-obvious actionable insights from heterogeneous and multimodal data sources. The system integrates a data ingestion unit for semantic and temporal harmonization of structured and unstructured datasets, a causal inference processor for constructing a dynamically evolving directed causal knowledge representation using perturbation-based validation, a latent representation processor that combines multimodal semantic embeddings with causal parameters to generate fused latent vectors, and a generative insight processor utilizing causally constrained generative reasoning to synthesize hypotheses anchored to verified cause-effect dependencies. A validation processor performs counterfactual assessment and observational verification to ensure retention of only those insights that remain consistent with causal ground truth.

The invention relates to the technical field of cable operation state detection, and particularly discloses a multi-source data driven cable operation state comprehensive evaluation method, which comprises the following steps of S1, adopting a layered distributed sensing network architecture, and deploying three types of core sensors at key nodes of a cable, through space-time calibration of the multi-source heterogeneous sensor, data consistency is improved, fusion deviation is eliminated, the problem of data islands of a traditional system is solved, and a precise evaluation foundation is laid; noise suppression and dynamic correlation modeling are adopted, environmental interference is stripped, a vibration and displacement coupling relation is quantified, limitation of a single parameter is broken through, heterogeneous fault features are captured, and evaluation comprehensiveness and sensitivity are improved; a self-adaptive threshold mechanism is constructed based on environment weight and historical data, the bottleneck of a fixed threshold is broken through, an evaluation standard is corrected along with equipment aging and environment change, misjudgment is avoided, and diagnosis robustness in different scenes is enhanced.

The invention discloses a dynamic sensitive data outbound risk assessment method and system based on multi-source risk information in the technical field of data cross-border. The system is mainly composed of a multi-source risk information acquisition module, a dynamic security identifier generation module, a risk collaborative assessment engine, a dynamic weight adjustment module, a disposal range dynamic calculation module and a flexible emergency disposal module, and an acquisition-identifier-assessment-calculation-disposal full-process closed-loop architecture is formed. A full-process closed-loop processing framework of collection-identification-evaluation-calculation-disposal is innovatively proposed, and by combining a dynamic risk evaluation model, a reinforcement learning intelligent technology and a block chain evidence storage technology, the problems of insufficient dynamic nature, lack of collaboration and lack of closed-loop capability in the prior art are systematically solved; and high-precision evaluation, real-time response and traceable management and control of the cross-border data flow risk are realized.

The invention relates to the technical field of data security management, in particular to a self-adaptive data security management and risk early warning system based on intelligent analysis under a cloud platform. Comprising a multi-dimensional data acquisition module; an intelligent analysis module; a self-adaptive strategy generation module; a risk early warning module; and a user behavior portrait construction module. In the design, the security policy can be dynamically adjusted along with the risk situation of the cloud platform, the problem that a static policy cannot adapt to real-time change is solved, and dynamic mapping of risk characteristics-policy parameters is realized; according to the design, the one-sidedness of single-dimension analysis is broken through, multi-modal feature association modeling of user behaviors is achieved, an abnormal behavior triggering threshold value is accurately recognized, and the integrity and accuracy of risk feature analysis are improved; the security policy can be continuously optimized through historical event data, so that protection efficiency attenuation caused by long-term static operation is avoided, and an autonomous lifting link of data driving, algorithm optimization and policy evolution is realized.

The invention relates to the technical field of information data analysis. The invention provides a public policy case analysis knowledge graph fusion reasoning method and system. The method comprises the following steps: generating standardized preprocessing data; performing extraction processing on the standardized pre-processed data to generate a structured triple set; processing the structured triple set to generate a multi-dimensional knowledge graph; constructing a hybrid inference engine, and processing the multi-dimensional knowledge graph to generate inference result data; performing incremental updating processing of nodes and relationships on the multi-dimensional knowledge graph, and performing parameter optimization processing on the hybrid inference engine to generate an updated knowledge graph and an optimized inference engine; and reasoning result data are processed, and a visual analysis result is output, so that the problems of limitation of a rule engine on causal reasoning, semantic fuzziness and logic illusion of a large language model in the policy field and insufficiency of a single-field knowledge graph on cross-field interaction influence revelation are solved.

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.

The invention discloses a knowledge base system construction method and device for multi-source heterogeneous data and a medium, and relates to the technical field of artificial intelligence and natural language processing. The method comprises the following steps: integrating a dynamic graph convolutional network and a hierarchical attention mechanism to construct a multi-modal document analysis engine; performing semantic structure analysis on the original heterogeneous document on the basis of a multi-modal document analysis engine to extract document structure features and content semantic features, and constructing an original document relationship model on the basis of the document structure features and the content semantic features; based on the original document relationship model, performing classification fusion on heterogeneous data in the original heterogeneous document to obtain a to-be-stored heterogeneous data corpus, and processing the to-be-stored heterogeneous data corpus by using a graph neural network to establish a cross-modal semantic association index; and based on the cross-modal semantic association index, performing classified storage on the to-be-stored heterogeneous data corpora by utilizing a preset heterogeneous database so as to complete knowledge base system construction of the multi-source heterogeneous data.

The invention discloses a wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision-making and early warning method, and relates to the technical field of intelligent misoperation prevention of a power system, and the method comprises the following steps: collecting multi-source heterogeneous data, obtaining the data through a distributed sensor network, and carrying out the edge calculation preprocessing; performing data space-time alignment and fusion, performing equipment state evaluation, and constructing a deep belief network and Bayesian network hybrid model to calculate a health index; anti-misoperation rule modeling is carried out, and operation logic verification is carried out based on a Petri network and an expert knowledge base; risk early warning decision making: fusing multi-source early warning information to divide risk levels; intelligent locking control is carried out, and a locking strategy is optimized through reinforcement learning; and performing decision support and visualization, constructing a three-dimensional digital twinborn model, and displaying operation guidance and risk early warning in combination with an AR technology. Through multi-source data fusion and intelligent decision making, the anti-misoperation locking accuracy and efficiency are improved, and the safety and the operation and maintenance level of the booster station are remarkably enhanced by equipment fault early warning three months ahead of time.

The invention discloses an electromechanical system fault pre-diagnosis method and system based on digital twinning. The method comprises the following steps of obtaining multi-source data in an electromechanical system operation process; preprocessing the acquired multi-source data, wherein the preprocessing comprises data cleaning, normalization processing and feature extraction; and on the basis of the preprocessed multi-source data, an electromechanical system design drawing, a three-dimensional geometric model, material attributes and a kinetic equation are fused, and a digital twin model is constructed. According to the invention, through a digital twin model dynamic calibration and prediction algorithm, early abnormity of the equipment is identified in advance, the fault probability and the residual life are output, and non-planned shutdown is reduced; by constructing a cross-physical domain fault feature system and fusing model simulation and actual measurement data, the potential fault identification accuracy is improved, and the missed diagnosis rate is reduced; by calibrating parameters of the digital twin model in real time, the method adapts to nonlinear changes of equipment, ensures high-fidelity mapping of the model, and improves fault prediction precision.

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.

The invention relates to a knowledge graph construction method and system based on a large language model, and the method and system achieve the automatic construction and dynamic maintenance of a knowledge graph through multi-modal data fusion, reinforcement learning and comparative learning joint optimization, teacher-student model knowledge migration, time sequence dynamic analysis and an incremental updating mechanism. Constructing a reinforcement learning framework, and taking accuracy and integrity as reward indexes to train a large model to extract an entity relationship; a large-scale knowledge graph is used as a teacher model, and conflict resolution and semantic alignment of newly added knowledge and an existing graph are realized through a graph attention network; a verification rule is dynamically generated based on historical data and domain knowledge, and relation periodicity and mutation points are detected in combination with Fourier transform and a CUSUM algorithm; and finally, generating a traceable knowledge graph through incremental updating and version control. And the multi-modal data processing precision, the entity relationship extraction dynamic adaptability and the knowledge graph maintenance efficiency are improved.

The invention discloses a power plant intelligent maintenance method and system based on multi-modal dynamic graph learning. The method comprises the following steps: acquiring structured sensor data, unstructured data and equipment physical topology data of equipment operation in real time through a multi-source sensor cluster and an industrial terminal; the method comprises the following steps: preprocessing multi-modal data, and fusing multi-modal features by using a double-flow Transform architecture and a gated attention mechanism to generate a joint embedded representation; constructing a dynamic causal graph based on equipment physical topology data and sensor time sequence characteristics, updating an edge weight through a GraphSAGE algorithm, fusing domain rule constraints, and outputting equipment state information; generating a maintenance strategy through an improved near-end strategy optimization algorithm according to the state and the equipment health index; and finally, the maintenance strategy triggers third-level early warning of the DCS through an OPC UA protocol, and a maintenance instruction is accurately issued. According to the method, the defects of a traditional method in the aspects of data fusion, fault modeling and decision making are overcome, and the safety, the economical efficiency and the operation and maintenance intelligent level of power plant equipment are remarkably improved.