1289 results about "Semantic enhancement" patented technology

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.

The invention provides an unstructured text data calculation method and system, and relates to the technical field of natural language processing, and the method comprises the steps: carrying out the multi-level processing of input unstructured text data, dynamically adjusting the word segmentation granularity according to the word frequency distribution, constructing a part-of-speech co-occurrence matrix in combination with context semantic information, and extracting entity information. And fusing the part-of-speech co-occurrence matrix and the entity information to generate a hierarchical semantic tag sequence. Feature extraction units with different convolution kernel sizes are adopted to extract feature representation, and cosine similarity between different semantic hierarchies is calculated to establish an association weight matrix. A semantic enhancement vector is constructed based on entity information, and adversarial training is carried out to obtain a multi-modal semantic feature matrix. And calculating the semantic similarity between the fusion feature vectors for clustering, setting difficulty weight sorting according to the complexity, consistency and ambiguity of class clusters, then inputting the class clusters into a classifier, and iteratively optimizing a classification result to obtain a calculation result.

The invention discloses a multi-source data fusion method and system based on cloud computing, and particularly relates to the technical field of multi-source data fusion, and the method comprises the steps: obtaining the real-time information of multi-source data, generating a health score and a label through a health evaluation model, and marking a data state and an abnormality type; performing format conversion and semantic enhancement processing on the health data to generate structured data; based on a knowledge graph reasoning technology, extracting a logical relationship to generate a fusion rule, and calculating a rule weight and confidence in combination with a health label, a data source confidence and a semantic feature; a fusion result of conflict data is judged through a semantic consistency index, if the fusion result does not conform to expectation, historical data and rules are loaded according to a verification model, a verification score is calculated, an optimization process is triggered after the verification score is compared with a threshold value, health assessment model parameters, a semantic embedding model and fusion rule logic are optimized, and fusion accuracy and reliability are improved.

The invention provides a configuration method and system for an overall electrical scheme of a machine room, and relates to the technical field of electrical planning, and the method comprises the steps: collecting multi-source heterogeneous data, carrying out feature extraction and semantic mapping, constructing a high-dimensional semantic association network, carrying out semantic enhancement, semantic modeling and logic association, extracting an abnormal mode, and obtaining a machine room operation state portrait; determining a machine room energy consumption rule and high-energy-consumption equipment, carrying out composite characteristic analysis to obtain a machine room electrical load curve, carrying out hierarchical progressive prediction in combination with exogenous variables, constructing a target function, solving to obtain optimal configuration parameters, and generating a power distribution system design scheme; a self-learning controller is added in a power distribution unit, the electrical load of a machine room is optimized, a power distribution equipment degradation mechanism model is constructed, service life prediction is performed, a power distribution equipment service life management strategy is output, equipment running abnormally is identified, abnormal reasons are judged by referring to historical abnormal data, and an abnormal report is generated and sent to equipment maintenance personnel.

The invention discloses an image-text matching method based on progressive semantic aggregation and structured cognitive enhancement, and relates to the technical field of image-text matching, comprising the following steps: S1, multi-modal feature extraction; s2, introducing a hierarchical self-enhanced semantic perception pooling mechanism; s3, introducing a structured knowledge auxiliary learning module; s4, introducing a cross-modal semantic alignment mechanism; s5, introducing a multi-scale semantic association matrix; according to the method, through multi-level semantic enhancement and fine-grained level self-adaptive feature aggregation, a significant word field is enhanced, and consistency and unification between local representation and global representation are achieved; extracting structured semantics between entities from an image title corpus, mining high-order relationships in long and short sentences, and expanding concepts missed in text global embedding by utilizing the priori knowledge; a cross-modal relation interaction mechanism is introduced, semantic embedding is enhanced, and more consistent semantic understanding is promoted; a multi-scale semantic association matrix is introduced, and a more comprehensive and accurate similarity measurement matrix is generated.

The invention relates to the technical field of intelligent operation and maintenance monitoring and self-adaptive rule engines, in particular to a monitoring strategy system and method based on a rule base. The method comprises the following steps: constructing a unified state vector model through multi-source heterogeneous data collection, enhancing state representation in combination with context semantics, and verifying the validity of the state representation; a dynamic rule cutting mechanism is adopted, a graph structure is constructed based on semantic redundancy and conflict relations between rules, and an optimal non-redundant rule subset is screened in combination with a greedy cutting algorithm; generating a strategy graph through rule semantic fusion, aggregating semantics by using a graph neural network, constructing a directed acyclic graph to solve action conflicts, and generating a safe and efficient response sequence; a cross-scene migration mechanism is introduced, and source scene strategy semantics are projected to a target scene through a mapping matrix, so that lightweight migration and self-evolution of a knowledge base are realized. According to the method, the dynamic adaptability of the rule base is improved, the redundancy execution risk is reduced, and multi-scene seamless migration is supported.

The invention discloses a Transform-CNN medical image segmentation method and system based on multi-scale fusion semantic enhancement, and relates to the technical field of image segmentation, and the method comprises the steps: collecting medical image data, and constructing a medical image data set; constructing a medical image segmentation network model; training the medical image segmentation network model through the medical image data set; and inputting real-time acquired data into the trained medical image segmentation network model to obtain a medical image segmentation result. According to the invention, double encoders, LGDA modules and the like are adopted to capture multi-scale global features of kidney tumors and enhance representation, and the LGDA module is used for adapting to size and form changes of the kidney tumors; the MLCF module is used for supplementing information of the main encoder; the PSE module captures multi-scale global semantic information and integrates local context information, local features are fused through the SAM module, and kidney tumor positioning in an endoscope image is achieved.

The invention belongs to the field of safety research of advanced persistent threat detection, and particularly relates to an APT detection method based on semantic enhancement and an attention mechanism. The method comprises the following steps: collecting and analyzing a system log, and constructing a traceability graph according to the analyzed system log; obtaining a summary sentence of each node according to attributes of the nodes of the traceability graph and types of edges, inputting the summary sentences into a BERT model, and extracting attribute semantic feature vector representation of the nodes in the traceability graph; generating a sub-graph of each node according to the nodes in the traceability graph, extracting a feature matrix of each sub-graph by using the self-attention graph convolutional network, and taking the feature matrix as a node feature vector representation of each sub-graph; and inputting the node feature vector representation of the to-be-detected node into the lightweight classifier, and carrying out anomaly detection. According to the method, the semantic information of the log is deeply mined and understood, the coding structure and causal information of the traceability graph are deeply mined, and the accuracy and efficiency of APT attack detection are improved.

The invention provides a large language model fact verification method, system and device based on retrieval enhancement and a medium, and belongs to the technical field of natural language process.The method comprises the following steps that document retrieval is conducted from a credible knowledge base based on an input task, screening is conducted according to a document evaluation result, and a file is obtained; performing deletion and compression according to the relevance between the retrieved document and the user input task to obtain a document set; extracting a fact unit from the original output of the large language model and performing semantic enhancement; labels are set for the fact units based on the document set, and scoring is carried out according to the similarity between the fact units and the document set; correcting, processing and optimizing the fact unit according to the label; and revising the output of the large language model by using a fact unit on the basis of a user input task, and outputting after consistency verification. According to the method, by introducing a document retrieval and fact verification mechanism of the credible knowledge base, the accuracy and reliability of the generated content of the large language model are improved.

The invention discloses a BIM model feature extraction-based unmanned aerial vehicle intelligent inspection path generation method for the interior of a building. The method comprises the steps of extracting a spatial geometric feature set, a spatial topological feature set and a semantic feature set from original BIM model data; constructing a basic space graph representing a space structure and a semantic enhancement graph representing a function relationship based on the feature set, and generating a multi-level semantic graph; task targets and dependency relationships are extracted from the inspection task description and the multi-level semantic graph, and a task weight matrix is generated; generating an optimized path set based on the multi-level semantic graph and the task weight matrix; performing multi-dimensional scoring and real-time optimization on the optimized path set to generate an emergency adjustment strategy; and finally verifying the inspection path. According to the method, through multi-level feature extraction and multi-level semantic graph construction, accurate understanding of the building space is realized, and the intelligent level and reliability of routing inspection path planning are improved.

The invention relates to the technical field of knowledge graph retrieval, in particular to a genuine medicinal material intelligent retrieval method and system based on a graph. The method comprises the following steps: performing semantic granularity analysis on a retrieval request input by a user, constructing a multi-level semantic edge and generating a hierarchical semantic graph structure; semantic enhancement is carried out on the map relation through semantic annotation, and a multi-condition intention is extracted in combination with dimensions such as regions, drug properties and channel tropism; further, the system executes multi-hop path combination, a structured semantic path conforming to the composite intention is mined, edge nodes in the path are inferred and complemented, and a genuine medicinal material retrieval result with a closed structure and complete semantics is generated. Compared with a traditional keyword matching and static field retrieval mode, the method has higher semantic perception ability and reasoning intelligence, and the accuracy and adaptability of the system in processing fuzzy, composite and path-incomplete retrieval scenes are remarkably improved.

The invention relates to the technical field of agricultural meteorological prediction, in particular to an agricultural meteorological disaster time sequence prediction system and method based on multi-modal data fusion, and the method comprises the steps: collecting and preprocessing agricultural meteorological disaster related data, constructing a dynamic semantic association graph, carrying out the multi-layer feature abstraction processing, and generating a semantic enhancement feature vector; the dual-branch prediction network processes time sequence dependence and local mode features, multi-granularity attention processing identifies key feature information, multi-scale feature fusion extracts different time scale feature information, and cascade fusion is carried out; the multi-target optimization module carries out model training based on the comprehensive feature representation and optimizes a plurality of targets; the multi-time scale prediction output module generates short-term accurate prediction, medium-term trend prediction and long-term risk assessment results, and provides prediction confidence, error range and risk level information; a dynamic semantic association graph and a multi-layer feature mapping mechanism are constructed, and deep fusion of multi-modal data on the semantic level is achieved.

The invention discloses a rule base dynamic construction method and device based on a large language model and a medium, and relates to the field of rule base construction.The method comprises the steps that on the basis of a preset layered template structure, meta-knowledge injection is conducted through a field knowledge graph corresponding to standard data, and dynamic cue words are generated; outputting a corresponding semantic triple through the large language model, and performing semantic enhancement on the semantic triple; performing symbolization processing and vectorization processing to obtain a rule vector, and generating a corresponding specified rule; and locally and dynamically updating the rule subset in the rule base through data updating of an external specified knowledge base, and dynamically updating the rule weight of the specified rule determined through the confidence coefficient. Through deep collaboration of the large language model and the symbol system, a logic verification layer is introduced through local dynamic updating to carry out formalized constraint on a large language model generation result, and the rule logic completeness is ensured while the generation capability is reserved.

The invention relates to the technical field of telecommunication, in particular to a switch automatic configuration method and system and a medium. The method comprises the following steps: obtaining switch resource configuration data, and carrying out semantic enhancement topological graph modeling to obtain a network environment digital twinborn model; performing configuration instruction analysis based on the network environment digital twin model and a preset configuration management database to obtain an intention configuration semantic set; performing multi-manufacturer semantic mapping arrangement based on the configuration strategy path of the intention configuration semantic set to obtain a native configuration command set; performing identity path integrity auditing on each configuration command in the native configuration command set to obtain a signature command set passing verification; uploading the verified signature command set to a switch management platform to execute the command; and acquiring real-time behavior state data of the switch, and performing semantic deviation calculation to obtain a configuration result report. According to the invention, the effectiveness and adaptability of switch configuration can be improved.

The invention discloses a large model enhanced cross-modal retrieval method and system and related equipment. The cross-modal retrieval method comprises the following steps: acquiring an image-text pair; based on the image-text pair, obtaining large model enhancement information of the image-text pair, combining an original image, a text and the enhancement information, adopting a multi-branch encoder of a pre-training CLIP model to obtain a plurality of feature vectors, constructing a multi-stage collaborative alignment loss function, and performing collaborative alignment on an image mode and a text mode in a public semantic space; and training a model through the multi-stage collaborative alignment loss function and a pre-constructed training database, and performing retrieval through the trained model. According to the method, collaborative learning is carried out on the image-text features obtained by the encoder, auxiliary semantic enhancement information is added, and collaborative alignment is carried out on the image modality and the text modality in the public semantic space, so that a better retrieval network is trained, and the accuracy of image-text retrieval is improved.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as agent autonomous decision making, financial science and technology and medical health, and discloses a multi-modal hierarchical feature fusion and decision making method, device, equipment and medium, and the method comprises the steps: obtaining vision, language and motion data, and carrying out the hierarchical feature extraction to generate a multi-modal initial feature set; feature importance is analyzed, screening and dimension reduction are carried out, and screened multi-modal features are obtained; performing semantic enhancement on the screened multi-modal features to generate multi-modal semantic enhancement features; executing cross-modal attention fusion on the multi-modal semantic enhancement features to obtain cross-modal fusion features; and inputting the cross-modal fusion features into a semantic reasoning network to generate a decision result. According to the method, through multi-level screening dimension reduction, semantic enhancement and cross-modal attention fusion, the model can accurately utilize key feature relationships among multi-modal data, redundant interference is reduced, and semantic reasoning accuracy and decision-making efficiency are improved.

The invention provides a semantic enhancement and dynamic completion method and system for a power market data graph. The method comprises the following steps: acquiring target entity information and external data of a power market data graph by responding to a data query instruction; converting external data into structured semantic tags, then traversing the topological structure, establishing a mapping relationship between the tags and entity attributes, and combining query instruction influence logic to calculate topological integrity indexes and mark missing entities or correlate to form a missing tag set; establishing attribute mapping based on a target entity and external data, generating a semantic vector fusing cross-domain features, and projecting the semantic vector to a topological space according to a missing mark set to form cross-domain feature topological nodes and connections; embedding a missing position to reconstruct a topological structure, and checking logic connectivity; the dynamic conduction chain is analyzed, and a feedback interface containing the semantic relation and the completion structure is generated to respond to query. According to the method, conduction logic closed-loop verification of the missing elements in the power market data graph is realized.

The invention provides a question and answer system construction method and system based on a large language model, and the method comprises the steps: obtaining multi-modal data, constructing a question and answer knowledge base and a knowledge graph, and carrying out the dynamic updating of the question and answer knowledge base; obtaining a query text, and respectively carrying out vectorization processing on the query text and the multi-modal data to generate a corresponding query semantic vector and a multi-modal vector; an entity in the query text is extracted by using the recognition model, a triple associated with the entity is extracted from the knowledge graph, the query text and the triple are spliced and vectorized, and a query semantic enhancement vector is generated; according to the method, through a dynamic knowledge base incremental updating mechanism, a context-aware hybrid retrieval strategy, a cross-modal semantic enhancement technology and a user feedback-driven continuous optimization method, real-time processing requirements of various modal data such as texts, images and voices can be effectively met, and accurate semantic understanding and answer generation of complex queries are achieved.

The invention provides a text sentiment analysis method based on dynamic semantic segmentation and feature perception, and belongs to the field of natural language processing. Inputting the semantic vector sequence into a knowledge retrieval and dynamic graph construction model for multi-path context enhancement through the knowledge retrieval and dynamic graph construction model to obtain semantic features, semantic knowledge and graph structure information; the semantic vector sequence is subjected to multi-path context enhancement, the complex relation between different parts in the text can be comprehensively considered, and more comprehensive and deep semantic features and knowledge can be mined. Unified representation of semantic features is combined with heterogeneous graph features, an antagonism training strategy is adopted to train a knowledge retrieval and dynamic graph construction model, an improved ATOSS + module is introduced to carry out hierarchical attention fusion, and multi-granularity semantic enhancement features are obtained; therefore, emotion clues and semantic association hidden in the text can be captured, and the accuracy and integrity of semantic understanding of the text are improved.

The present disclosure relates to a system and method for vulnerability localization based on deep learning, which comprises, at a minimum, a processor configured to: analyze a code file under detection to obtain a first abstract syntax tree devoid of semantic information; build upon the first abstract syntax tree by incorporating data-flow edges and / or control-flow edges, thereby forming a second abstract syntax tree with semantic-flow enhancement; split the second abstract syntax tree to obtain a plurality of second abstract syntax sub-trees; and input these second abstract syntax sub-trees into a pre-established vulnerability detection and localization model. Compared with existing code vulnerability detection methods, the present disclosure employs a semantically-enhanced abstract syntax tree and finely-grained segmentation thereof, enabling both the efficient detection and accurate localization of code vulnerabilities, characterized by swift detection rates, low false positive rates, and commendable interpretability of the detection results.

The invention provides a mobile robot operation efficiency evaluation method and system based on the industrial internet, and relates to the technical field of operation efficiency evaluation, and the method comprises the steps: collecting multi-mode operation data, selecting a transmission channel, uploading the data to an edge calculation node, carrying out the preprocessing, completing the information, and carrying out the filtering operation, generating a first semantic feature and an operation feature descriptor; selecting an optimal transmission path and a service function chain, uploading the operation characteristic descriptor to a cloud server, carrying out real-time analysis on the operation characteristic descriptor, generating an initial operation efficiency evaluation result, carrying out analysis and comparison, determining an efficiency bottleneck, and generating an initial optimization improvement suggestion; sending an initial operation efficiency evaluation result to an edge computing node, performing semantic enhancement and logical reasoning, generating a refined efficiency evaluation report, analyzing an incidence relation and an influence mechanism among different evaluation indexes, determining key efficiency bottleneck factors, generating a comprehensive optimization suggestion, collecting operation data in real time, and generating a comprehensive efficiency evaluation report.

The invention discloses a retrieval generation method and system based on multi-agent collaboration, a terminal and a medium, and relates to the field of artificial intelligence. Performing semantic analysis on the input word embedding converted by the natural language query instruction through a query analysis agent, and determining a semantic intention vector; performing reinforcement learning and meta learning on the semantic intention vector through a strategy construction agent, and determining a retrieval strategy; performing semantic enhancement on the semantic intention vector according to knowledge graph node embedding to obtain a semantic enhancement vector; determining a data channel according to the semantic enhancement vector, a retrieval strategy and a real-time system load, and calling the data channel for retrieval to obtain candidate documents; and generating a target answer according to each candidate document based on an adaptive reflection feedback mechanism in combination with an auto-encoder and a generative adversarial network. The problems that the prior art depends on a fixed retrieval strategy, has limitation when facing complex query, multi-round interaction and cross-modal data fusion, is easily interfered by noise and is not accurate enough in semantic matching are effectively solved.

The invention discloses an automatic label labeling and classifying method and system oriented to unstructured system documents, and relates to the technical field of artificial intelligence. The method comprises the steps that semantic structure pre-analysis is conducted on an original system text, and a system semantic structure tree is constructed; establishing a system semantic enhancement vector space based on the semantic units and the logic relationship thereof; performing semantic deconstruction on the preset tag and extracting a feature vector; realizing cross-space semantic matching of the document and the tag through a system semantic attention mechanism; a confidence evaluation module is introduced to screen high-confidence labels from the three dimensions of structural integrity, coverage and logic consistency; and outputting a final label and a score through semantic conflict detection and resolution. According to the method, the problems that in the prior art, unstructured system text labeling accuracy is low and large-scale labeling samples are dependent on polysemy ambiguity, high context dependency, complex semantic structure and the like are solved, and labeling accuracy and robustness are remarkably improved.

The invention relates to the field of knowledge graph completion, provides a knowledge graph completion method based on multi-modal visual angle perception and a deep neural network, and aims to solve the problems of weak multi-modal information expression ability, rough fusion mode and insufficient structural reasoning ability in the prior art. According to the method, structure information, text description and visual image information of an entity in a knowledge graph are obtained, structure, text and image modal input is constructed respectively, and a graph neural network, a pre-training language model and a visual encoder are adopted for feature coding; weighted fusion and semantic enhancement of multi-modal features are realized through a visual angle fusion mechanism and hierarchical attention processing; cross-modal contrast learning is introduced to improve modal consistency; and carrying out triple reasoning by using a uniform Transform encoder, and verifying a completion result by scores. According to the method, multi-modal semantics are effectively integrated, the entity representation capability and the triple prediction accuracy are improved, the model robustness is enhanced, and the method is suitable for application scenes such as intelligent question answering and recommendation systems and has remarkable practical value and popularization prospects.

The invention discloses an AI-based conference record data searching method and system, and the method comprises the steps: carrying out the feature extraction and alignment through a multi-mode fusion neural network according to the voice, text, image and video data collected in a conference process, and obtaining a semantic representation vector; according to the semantic representation vector, combining context information of the conference scene, and utilizing a pre-trained context perception model to perform semantic enhancement processing to generate an enhanced semantic vector with context association; according to the enhanced semantic vector, combining with an external knowledge base, and utilizing a dynamic knowledge graph construction algorithm to generate a knowledge graph related to the conference theme in real time; and according to the knowledge graph, intelligent retrieval and recommendation of conference record data are carried out by using a graph neural network. By utilizing the embodiment of the invention, the intelligent retrieval efficiency and accuracy of the conference record can be improved.

The invention discloses a semantic enhancement auxiliary inquiry system and method based on a medical knowledge graph, and the system comprises a patient information receiving module, a theoretical knowledge graph storage library, an evidence-based knowledge graph storage library, a double-track diagnosis path construction module, a medical knowledge conflict judgment module, and a semantic enhancement report generation module. The double-track diagnosis path construction module inquires the received patient information in a theoretical knowledge graph storage library and an evidence-based knowledge graph storage library which are independent from each other in parallel, and a theoretical diagnosis path and an evidence-based diagnosis path are generated respectively; the medical knowledge conflict judgment module dynamically compares the two paths in real-time interaction, and performs priority judgment according to a preset medical judgment rule; finally, the semantic enhancement report generation module presents the two paths and the conflict judgment result to the user at the same time. Transparency and interpretability of the whole interrogation process are assisted, and reliable semantic enhancement decision support is provided for doctors when the doctors face complex medical knowledge conflicts.

The invention provides a semantic enhancement adaptive partitioning method and system for natural resource large model questions and answers, and aims to solve the problems of difficulty in term boundary recognition, damage to semantic integrity and the like. According to the method, three core technologies including theme perception coarse-grained paragraph division, self-adaptive sliding window theme hierarchy division and embedded perception context self-adaptive text segmentation are fused. The system firstly analyzes a natural resource long text structure, identifies titles and theme levels and aligns associated contents; paragraphs are extracted according to a theme perception strategy and are subdivided into sentence sets according to grammar rules; an improved sliding window mechanism is adopted to divide sentences into window sentence block groups. The method is characterized in that a dynamic aggregation threshold mechanism is introduced, the semantic association degree between adjacent sentence blocks is calculated through an embedded perception context semantic segmentation technology, whether the sentence blocks are combined or not is judged by combining a similarity distribution change trend and a dynamic adjustment threshold, self-adaptive delimitation of semantic boundaries is achieved, and text blocks which are clear in structure and coherent in semantics are generated.

The invention relates to the technical field of program similarity, in particular to a source code similarity analysis method and system based on semantic enhancement AST, and the method comprises the steps: respectively generating corresponding abstract syntax trees AST for two functions using different programming languages; enabling nodes with the same type but different names in different programming languages AST to have the same representation by utilizing a node vocabulary, and shielding the node representation difference of the different programming languages AST; a control flow edge and a data flow edge are expanded for the AST after node standardization processing, a semantic enhancement AST is generated, and the semantic enhancement AST integrates grammar, structure and semantic information of a function; a function similarity analysis network is designed, semantic enhancement AST is converted into graph vectors in combination with a graph convolutional network and an attention mechanism, the two graph vectors are spliced and then input into a full-connection neural network, and the similarity of different programming language functions is judged. According to the method, similarity judgment of different programming language functions can be realized, and the detection efficiency is improved while high accuracy of the detection effect is achieved.

The invention relates to the technical field of intelligent decision making, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a multi-modal data-based event analysis method, which comprises the following steps of: obtaining attribute data, monitoring data, environment data and biological characteristic data of a user, and performing standardization processing on the attribute data, the monitoring data, the environment data and the biological characteristic data; combining semantic analysis and structured fusion of the text records to form a unified input data set; and performing multi-modal fusion modeling on the unified input data set by using an intelligent decision model, generating a potential event analysis result of an individual state, generating a visual report containing potential event levels, main influence factors and intervention suggestions based on the result, and finally sending the report to a user terminal. According to the method, the multi-source structured data and the multi-source unstructured data are integrated, and the intelligent decision-making model is introduced to realize feature level fusion and semantic enhancement modeling, so that the accuracy and timeliness of individual state analysis are effectively improved, and the personalized expression of an analysis result is enhanced.

The invention relates to the technical field of multi-modal data processing and semantic retrieval, in particular to a multi-modal heterogeneous knowledge fusion construction and semantic enhancement retrieval system based on a large model, which comprises a data acquisition module, a semantic analysis module, a knowledge fusion module and a retrieval optimization module. Multi-modal data such as texts, images and audios are uniformly expressed and deeply analyzed by introducing a large model technology, a knowledge graph is dynamically constructed, a structure is optimized in combination with a user query intention, and meanwhile accurate sorting and screening are achieved through a semantic enhancement algorithm. According to the method, the semantic comprehension capability and the intelligent level of the system can be improved, the real-time and diversified scene requirements are met, and the accuracy and the adaptability of a retrieval result are remarkably enhanced.