1095 results about "Semantic consistency" patented technology

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.

The invention discloses a dynamic visual content collaborative generation method based on a cognitive logic chain, and belongs to the technical field of visual content generation, and the method comprises the following steps: S1, user intention analysis and data input; s2, dynamically constructing a cognitive logic chain; s3, intelligent scheduling of the multi-modal generation module; s4, cross-modal content collaborative generation is carried out; s5, collaborative editing and real-time feedback are carried out; s6, iterative optimization of logic chain driving; s7, multi-dimensional quality evaluation: constructing an evaluation matrix containing semantic consistency, visual attraction and user participation degree, predicting a content propagation effect in combination with a deep learning model, and generating a quantitative improvement suggestion report; and S8, updating the self-adaptive knowledge reversely marking the cognitive logic chain according to the finally adopted content version, extracting a new association rule, and injecting the new association rule into the rule base. Through deep semantic analysis and dynamic logic chain construction, the system accurately captures a core creation target of a user and converts the core creation target into an executable visual strategy.

The invention relates to the technical field of power plant management and control, and discloses an intelligent power plant management and control system based on the Internet of Things, and the system comprises the steps: when a plurality of labels related to the same equipment or parameter exist in different subsystems, according to a similarity index between the labels and an equipment association relationship; on the basis of the detected conflict label group, combining equipment historical operation and maintenance data and an upstream and downstream parameter flow relationship, constructing a label semantic evolution graph, and performing reasoning analysis on label equipment through a fusion rule engine and a graph neural network; through mapping knowledge domain fusion and semantic embedding comparison, matching and clustering among conflict labels are completed based on structural similarity and semantic relevancy, and a label alignment rule is constructed; according to a label coordination result, designing a mapping rule of a data field; and performing inter-system synchronous verification on a result after structure conversion and label standardization processing, and writing a standardized label into a unified semantic database. The method has the advantage of improving data semantic consistency.

The invention discloses a multi-modal semantic and physical law driven remote sensing image generation method, belongs to the technical field of computer vision and remote sensing image generation, and aims to solve the problems of insufficient cross-modal semantic alignment, low reliability of a generation result and insufficient physical mechanism fusion. The four-stage method comprises the following steps: firstly, rejecting low-quality samples from original data and unifying a spatial scale; then, extracting a multi-modal semantic vector by adopting a BLIP model and a CLIP model, and introducing a remote sensing physical rule to carry out vector optimization; then position coding and physical constraint conditions are embedded in the submerged space, and multi-source information joint modeling is achieved through a cross-modal encoder; and finally, by taking text description, physical priori knowledge and diffusion time steps as joint conditions, performing de-noising reasoning based on a Transform architecture, and completing back diffusion reconstruction by means of a trans-attention mechanism. According to the method, physical rationality and semantic consistency are improved, and a more reliable technical normal form is provided for remote sensing image generation in the fields of disaster monitoring, military simulation and the like.

The invention discloses a data query method and system based on a natural language text. The method comprises the following steps: dynamically shielding the natural language text to generate a semantic vector sequence; key entities and association relationships thereof in the semantic vector sequence are extracted, and a structured entity relationship set is obtained; matching the structured entity relationship set with knowledge graph nodes to generate a heterogeneous semantic graph; performing heterogeneous fusion on the heterogeneous semantic graph and text syntactic features to generate intermediate query representation; processing the intermediate query representation to generate an executable statement carrying a semantic association identifier; and verifying the semantic consistency of the response content of the executable statement and the original input, and iterating to regenerate the executable statement when the semantic consistency does not pass the verification. And efficient and accurate natural language query conversion and response generation are realized through dynamic shielding enhanced semantic robustness, knowledge graph path extension and weight iterative optimization, heterogeneous feature fusion and a multi-modal verification mechanism.

The invention provides a training data synthesis method and device based on error extrapolation and inference chain analysis, a medium and a program product. The method comprises the steps of obtaining an initial sample set; performing multiple sampling reasoning on the problem of each task sample by using a small language model to generate a plurality of reasoning chains; calculating an overall error score of each reasoning chain based on a preset error evaluation rule, and determining a to-be-corrected reasoning chain; the inference chain to be corrected and the corresponding question are input into the large language model together, and a corrected answer is generated; forming a new task sample by the question and the corrected answer, and finely adjusting partial parameters of the small language model; repeatedly executing the process until the performance index change rate of the model on the task evaluation set is lower than a preset threshold value, and outputting a final task sample; and forming a training sample set by a plurality of final task samples, and performing all-parameter fine tuning on the small language model. According to the method, the training data self-optimization path is constructed by taking the model error as guidance, so that the semantic consistency and the data validity are improved.

The invention discloses a SysML model automatic generation system based on mixed AI and domain knowledge, and the system comprises a preprocessing module which is used for carrying out the text preprocessing and structural enhancement of an engineering document of a PDF or Word version; the NLP extraction module is used for identifying six types of core entities by adopting aviation corpus fine tuning BERT, constructing a document-level relational graph by utilizing GNN, modeling a cross-paragraph dependency relationship, calling LLM for semantic fuzzy sentences to generate a thinking chain, extracting a reasoning path and solving ambiguity; the rule conversion engine module is used for mapping the entity relation graph into a SysML memory object tree; and the controllable generation module is used for carrying out limited decoding on the LLM by utilizing a Guidance framework. The invention further discloses an automatic SysML model generation method based on the mixed AI and domain knowledge. According to the method, the problems of low manual modeling efficiency and poor semantic consistency in traditional MBSE implementation are solved.

The invention discloses a multi-source heterogeneous data synchronization system, and relates to the field of computer information management application. The system fuses key technologies such as flow dynamic regulation and control, self-adaptive load balancing and intelligent semantic mapping. Through a real-time network state monitoring and self-adaptive flow regulation and control algorithm, the data transmission rate is dynamically adjusted according to the server resource utilization rate, the data priority and the network bandwidth, data backlog and system overload are avoided, and the robustness and the real-time performance of a synchronization task are remarkably improved. The intelligent field mapping engine is based on semantic analysis, word vector representation and a machine learning model, automatically recognizes field semantic consistency of heterogeneous data sources, generates an optimal mapping rule and dynamically optimizes a mapping result, the manual configuration cost is reduced, and the mapping accuracy rate reaches 98% or above. The system has high expandability and self-learning ability, is suitable for a large-scale multi-source heterogeneous data integration scene, and provides an efficient, intelligent and self-adaptive full-stack solution for a data synchronization task.

The invention discloses a multi-modal fused intelligent question answering and knowledge retrieval method and system, and the method comprises the steps: building a multi-modal data index model oriented to a heterogeneous knowledge source, carrying out the feature mapping of text, image, table, chart, audio and video contents through a unified semantic embedding space, and generating a cross-modal index set; after a query request is received, performing semantic matching and structure matching on the cross-modal index set by using a multi-channel retriever to obtain candidate evidence fragments; and based on an evidence granularity decomposition strategy, performing minimum evidence unit division on text statements, table units, chart data points and multimedia frame contents in the candidate evidence fragments, and establishing a semantic consistency graph among the units. According to the method, high-credibility traceable generation of question and answer results is realized through multi-modal fusion and space-time consistency constraint, and the retrieval precision and interpretation transparency in a complex knowledge scene are remarkably improved.

The invention discloses a cross-modal interactive image restoration method fusing text semantic guidance and visual structure priori, which comprises the following steps of: firstly, acquiring natural language description input by a user and an image to be restored, and generating a semantic segmentation map of the image through a semantic segmentation model; encoding the text and image semantics by using a pre-trained cross-modal encoding model to obtain text and semantic features; guiding a semantic alignment attention module through Prompt to realize deep fusion of multi-modal semantic features and image space features; structural enhancement and regulation of image features are realized by constructing a text guide weight graph, performing element-level modulation on the text guide weight graph and the optimized semantic segmentation graph, constructing a cross-modal structure semantic feature graph and generating a structural modulation factor; a four-stage image restoration network is adopted, and a high-quality restoration image conforming to semantic guidance and structure prior is generated step by step. According to the method, the semantic consistency, the structural integrity and the visual reality sense of an image restoration result are improved.

The invention discloses a long video multi-modal understanding and question-answering method and system based on large model and retrieval enhancement generation. The method comprises the following steps: 1) a multi-modal feature extraction module; 2) a multi-modal synchronization and alignment mechanism; 3) constructing a structured memory pool; 4) querying a drive generation mechanism; 5) incremental updating and memory compression strategy; and 6) unifying the multi-modal representation space. The invention provides a long video multi-mode understanding method fusing a large language model and retrieval enhancement generation, and aims to break through the limitation of a traditional method in the aspects of single-mode processing and semantic fragmentation. According to the method, video image features are extracted through a visual model (such as YOLO and ViT), voice transcription and environment voice description are obtained in combination with an audio model (such as Whisper and Qwen-Audio), and unified coding of vision, voice and audio in a long video is achieved. Then, a structured memory pool is constructed through semantic consistency segmentation and timestamp alignment technologies to store time slice data of different modalities.

The invention discloses a large-model multi-scene antagonism dynamic evaluation system and method based on context perception strategy optimization, relates to the technical field of artificial intelligence safety evaluation, and aims to solve the problems of lack of multi-round context modeling, poor confrontation sample semantic consistency and lack of a feedback-driven optimization mechanism in the prior art. According to the method, a state space and an action space are constructed, an adversarial sample is dynamically generated by adopting a reinforcement learning strategy network, a high-quality sample set is expanded in combination with a semantic disturbance and screening mechanism, and a vulnerability knowledge base is constructed based on an interaction log to guide strategy optimization and security evaluation. The method can effectively improve the security evaluation coverage and vulnerability discovery capability of the model in a high-risk multi-round interaction scene, and is mainly used for security reinforcement and deployment support of large language models in the fields of medical treatment, customer service and the like.

The invention relates to the technical field of data fusion, in particular to a multi-source heterogeneous data fusion method and system based on cloud computing, and the method comprises the steps: carrying out the feature extraction of multi-source heterogeneous data, and generating standardized metadata comprising a data type, a transmission protocol and a semantic tag; an adaptive interface is dynamically generated based on the metadata, the adaptive interface comprises a data format conversion module, a protocol packaging module and a semantic analysis module, and cross-domain compatible data streams are output; performing data fragment encryption and priority marking on the cross-domain compatible data stream to generate a secure transmission block carrying a transmission feature vector; incremental fusion is executed at the cloud fusion node, semantic conflicts are detected by constructing a knowledge graph, and a fusion intermediate state is generated; and performing dynamic verification on the fusion intermediate state based on the credibility evaluation model, and outputting final fusion data with a credibility label. According to the method, the dynamic verification and hierarchical labeling of the fusion result are realized, and the semantic consistency and expandability of the fusion intermediate state are ensured.

The invention relates to the technical field of data processing, and discloses a multi-protocol fusion Internet of Things equipment intelligent gateway data conversion method and system. The method comprises the following steps: collecting a multi-protocol equipment data packet, and extracting protocol features to construct a vector library; protocol types are identified based on the vector library, data are analyzed, and a data object set containing semantic tags is constructed; semantic correlation is analyzed through an adaptive learning algorithm, and a dynamic protocol semantic mapping matrix is established; converting the data into a standard format according to the mapping matrix and recording a matching degree to form a target data pool; and extracting fusion data from the data pool, recoding according to a target protocol format, and outputting a data frame. The problem that an existing multi-protocol fusion data conversion method lacks protocol semantic understanding and self-adaptive learning ability is solved, and semantic consistency and conversion quality of data conversion among multi-protocol equipment are improved.

A system and method for persistent cognitive computation with temporally synchronized multimodal processing implements a geometric approach to artificial intelligence through typed latent entities within a dynamic manifold substrate. The system maintains a latent manifold incorporating heterogeneous data modalities where local curvature reflects semantic density and typed entities are stratified according to structural properties. Temporal synchronization coordinates asynchronous multimodal data streams through generation of temporal alignment fields within the manifold that preserve semantic coherence across modal boundaries. Type-aware geometric operations enforce operation legality based on entity type and local manifold geometry, enabling structured recombination, compression, and traversal while preventing semantic distortion. The system executes synchronized manifold reorganization during idle periods through coordinated optimization operations including perturbation analysis and topological surgery. This architecture enables persistent memory through geometric encoding where frequently accessed concepts develop high-curvature regions and cognitive patterns emerge from usage-based manifold evolution.

The invention relates to the technical field of computer aided design, in particular to a text-driven CAD modeling method and system based on a diffusion and visual language model.The method comprises the steps that natural language text description is obtained, and CAD semantic features of the natural language text description are extracted; carrying out geometric standardization on the CAD semantic features by adopting a fine-tuning diffusion model, and generating a CAD view image conforming to engineering specifications; carrying out fusion by adopting a fine-tuned visual language model to generate a parameterized CAD construction sequence; a three-mode alignment mechanism is adopted, and the semantic consistency of the CAD semantic features, the CAD view images and the CAD construction sequences is checked; performing verification and post-processing on the CAD construction sequence, and outputting an executable Python code or STEP file; the CAD modeling method disclosed by the invention performs explicit modeling based on flexible modal description, and has the characteristics of high geometric constraint and high usability.

The invention belongs to the technical field of multi-source heterogeneous data quality and analysis, and relates to a data management and intelligent analysis method oriented to power multi-source heterogeneous. According to the method, ontology model alignment, temporary ontology generation and multi-mode semantic embedding technologies are adopted, semantic unification of cross-data types is achieved, meanwhile, a spatio-temporal joint indexing mechanism is established, geographic coordinates and timestamps are bound and stored, efficient multi-dimensional query is supported, and data integration efficiency and semantic consistency are improved; the problem of poor adaptability of a fixed threshold value is solved by dynamically adjusting the operation data safety threshold value and evaluating the abnormal confidence coefficient, the detection precision and credibility of the power multi-source heterogeneous data anomaly are improved, the anomaly detection accuracy is improved, and the false alarm rate is reduced; by constructing an abnormity confirmation logic and combining equipment parameters, environment data and communication states, reasons such as equipment faults, environment interference and communication abnormity can be accurately positioned, root causes can be quickly positioned, and time can be shortened.

The invention discloses an intelligent log retrieval and analysis system based on a model context protocol MCP, and relates to the technical field of log analysis. The system comprises an MCP log semantic conversion and retrieval engine, a log format irrelevant feature extraction and indexer, a dynamic log format recognition and context enhancement system, a real-time retrieval analysis and aggregation controller and a multi-level semantic retrieval and visualization engine. According to the context enhancement system, unknown formats can be identified, semantic tags can be complemented, and semantic consistency and behavior tracking capability can be improved. The retrieval analysis controller supports semantic expression analysis, strategy generation and feedback closed loop, and strategy scheduling and multi-dimensional aggregation analysis are achieved. And finally, outputting a structured semantic result by the system, and visually displaying the structured semantic result through components such as a semantic composition device and a context expander. All the modules are managed in a unified mode through a capability registration mechanism, dynamic arrangement and upstream and downstream closed-loop linkage are supported, and a log intelligent analysis framework with high semantic driving and a clear structure is formed.

The invention relates to the technical field of document processing, in particular to a knowledge graph-based document intelligent writing and analysis system, which comprises a graph dynamic updating module, an entity recognition and mapping module, a context connection analysis module, a semantic structure rearrangement module and a semantic coherence verification module. According to the method, the real-time data source is adopted, the knowledge graph is dynamically updated and expanded, synchronization of document content and the current information trend is ensured, noun phrases and entity distribution in a text are accurately analyzed through intelligent entity recognition, the accuracy of information extraction is improved, the coincidence degree of keywords between paragraphs is calculated, and synonymous entities are intelligently inserted, so that the information extraction efficiency is improved. According to the method, the context connection quality of the document is improved, the document structure is automatically rearranged according to the correlation of the content, the logic presentation of the information is optimized, the reading experience is enhanced, and the overall semantic consistency of the document is ensured and the interpretation ambiguity is reduced through complex semantic coherence verification.

The invention discloses a multi-source remote sensing image zero sample change detection method, and relates to the technical field of remote sensing image processing, and the method comprises the following steps: obtaining remote sensing images collected by two or more remote sensing sensors at different time points in the same geographic area, the image types including optical images and radar images; preprocessing each source image, unifying the spatial resolution and the registration precision, and denoising and standardizing the image; according to the method, the cross-modal shared semantic embedding space is constructed and unsupervised comparative learning is introduced, so that the semantic consistency of the multi-source remote sensing image is effectively improved, and the change recognition capability of the model under the zero sample condition is enhanced; and meanwhile, a difference fusion calculation and structure consistency constraint module is adopted, so that the boundary judgment precision of a change region and the overall structure consistency are improved, and the accuracy and stability of a detection result are remarkably improved.

The invention belongs to the technical field of bridge health monitoring, and discloses a multi-modal fusion bridge disease detection and three-dimensional point cloud registration method, which specifically comprises the following steps: S1, constructing a bridge disease data set by adopting four public data sets CFD, CrackTree200, Crack500 and CrackSeg9k and autonomously acquired data samples; a bridge disease semantic segmentation result is introduced as a semantic clue, a multi-level semantic consistency registration frame is constructed, intra-class mismatching is inhibited in combination with a scene semantic consistency mask matching module, and the three-dimensional point cloud registration precision is improved; a multi-radius annular region semantic feature extraction and clustering optimization strategy is adopted, the feature integrity of sparse point cloud data is enhanced, RGB-D multi-scale features are fused based on a lightweight encoder-decoder framework, accurate segmentation of complex diseases is realized through a double-branch attention module and an adaptive pyramid context module, and the accuracy of segmentation of the complex diseases is improved. And semantic information is deeply fused with the three-dimensional point cloud to form closed-loop feedback.

The invention discloses a natural language-to-SQL (Structured Query Language) method and system based on RAG (Random Access Gateway) enhancement, and the method comprises the steps: constructing a query intention graph through dependency syntax analysis, recognizing and complementing semantic missing components, and forming complete semantic representation; vector representation is carried out on the business term segments by adopting vectorization coding, accurate definitions of business terms are obtained from a factory structured knowledge base, and an enhanced context set is formed through expansion retrieval in a low-confidence region; an SQL template mapping network is established based on historical query records, a mapping relation matrix is generated through field candidate matching, mapping conflict positions are identified, and multiple SQL candidate sequences are generated; grammar verification is carried out on the candidate sequence to identify grammar errors, semantic consistency verification is carried out to calculate the intention alignment degree, and an optimal SQL statement is selected through a deviation correction factor; and performing formatting processing and statistical abstract on an execution result, and providing data query capability for scenes such as factory quality management and equipment maintenance.

The invention relates to a multi-mode intention recognition method and system based on consistency and difference decoupling, and the method comprises the steps: carrying out the consistency modeling and difference modeling of the features of text, video and audio modes, and enabling the consistency modeling to be used for extracting common information expressing similar meanings in each mode; the difference modeling is used for retaining information which is unique in each mode but possibly has important supplementary value; by constructing a shared-private feature space, carrying out explicit modeling on common information in the consistency features and specific information in the difference features, and fusing the consistency features and the difference features; and based on the fused feature representation, judging the real intention of the user through a classifier, and outputting a result. Through consistency and difference collaborative modeling, in combination with a shared-private feature space, semantic consistency and difference among all modalities are explicitly modeled, and the accuracy and robustness of intention recognition are fundamentally improved.

The invention discloses a Tibetan language multi-dialect real-time semantic conversion method based on a cross-language BERT model, and the method comprises the following steps: S1, collecting original text corpora of each dialect of the Tibetan language, and constructing a standardized training corpus set; s2, performing parameter initialization on the mBERT model, and preliminarily training the mBERT model; s3, constructing a semantic modeling model, and performing fine adjustment on the semantic modeling model; s4, receiving to-be-converted text input, and encoding; s5, obtaining an intermediate semantic representation vector of the text through a semantic coding sub-module; s6, inputting the intermediate semantic representation vector into a semantic generation sub-module, and generating target text output; and S7, executing syntactic consistency correction and language fluency correction. According to the method, mBERT modeling and an adversarial optimization mechanism are fused, real-time semantic consistency conversion of multiple dialects of the Tibetan language is achieved, and the method has the advantages of being high in accuracy, high in robustness and low in response delay.

The invention relates to document verification, in particular to a heterogeneous document set-oriented cross-modal semantic alignment and logic consistency verification system, which is used for heterogeneous document input, supports multi-format document input and comprises multi-modal elements including texts, pictures, tables and charts. The document analysis module is used for carrying out structured extraction on document contents; extracting multi-modal elements, identifying and classifying various elements in the document, and establishing position and type labels of a foundation; the knowledge graph construction module is used for uniformly modeling heterogeneous elements into a multi-modal knowledge graph; the graph neural network semantic alignment module is used for realizing accurate cross-modal semantic alignment by using a specially designed graph neural network based on the multi-modal knowledge graph; the hybrid consistency verification engine is used for performing logic consistency verification in combination with a symbol logic verification mechanism and a semantic consistency verification mechanism; according to the method, the defect that accurate cross-modal semantic alignment and logic consistency verification are difficult to carry out on professional documents with multi-modal elements can be effectively overcome.

The invention belongs to the technical field of mine ventilation monitoring, and aims to solve the problems that a traditional knowledge system based on a rule base has bottlenecks in the aspects of dealing with sudden working conditions, knowledge updating and semantic reasoning, and is high in construction cost and complex to maintain. The invention provides a mine ventilation knowledge graph construction method based on a large model, and the method comprises the following steps: S100, obtaining and cleaning a multi-source heterogeneous text related to mine ventilation, and obtaining a JSON format knowledge fragment of a unified structure; s200, constructing an ontology model and defining a semantic structure; s300, constructing four types of knowledge extraction tasks, and extracting entities, attributes and relationships; s400, constructing an entity alignment module; and S500, constructing a graph database structure. According to the method, automatic structured expression, semantic consistent fusion and intelligent visual query of knowledge in the mine ventilation field can be realized, and an interpretable, extensible and reasonable intelligent support platform is provided for a mine ventilation system.

The invention discloses an electronic medical record LLM generation method based on animal injury, which realizes dialogue structuring and timestamp synchronization through multistage speech recognition and role affiliation. Using standardized medical term mapping and coding to align the free text to a standardized medical entity, and constructing a high-confidence medical entity network based on a semantic anchor point pool; according to the method, context-sensitive entity relationship extraction is realized by combining a large language model and a semantic enhancement template, a high-accuracy structured relationship chain is generated through clinical logic rule set verification, and finally, an electronic medical record template under diagnosis and treatment specifications is automatically filled and privacy desensitization processing is completed. The semantic consistency, the structural accuracy and the data security of automatic generation of the electronic medical record are improved, and standardization and intelligent circulation of medical information are effectively promoted.

The invention discloses a large-model-driven automatic knowledge graph construction method based on a confidence feedback mechanism, and aims to improve the structural accuracy and semantic consistency in a structured triple generation process, and perform structural constraint guidance by using a few-sample prompt mechanism and a cross validation mechanism of a heterogeneous large model. And the control capability of the large language model on the triple format is enhanced, so that format offset and semantic redundancy in the generation process are reduced. And meanwhile, a multi-dimensional confidence evaluation system is constructed, model consensus judgment, semantic rationality analysis and knowledge consistency verification are fused, and refined quantification and screening of triple quality are realized. According to the method, a confidence backtracking feedback strategy is introduced, a generation-verification-optimization closed-loop process is constructed, the expression and correction capability of the system on a complex knowledge structure is enhanced, the dependence on an external API is effectively reduced, the consumption of computing resources is reduced, and the operation efficiency of the system and the feasibility of engineering deployment are remarkably improved.

The invention belongs to the technical field of artificial intelligence and multi-modal information processing, and discloses an open vocabulary audiovisual segmentation method based on semantic consistency. By designing the audio semantic enhancement module, the audio semantic discrimination capability is explicitly enhanced, the cross-modal alignment and semantic recognition accuracy of the model is improved, and the robustness and precision of audio-visual semantic segmentation are enhanced. A symmetric cross-modal attention guidance module and a hierarchical modal fusion decoder are proposed. Through refined cross-modal interaction and multi-modal decoding, space-time semantics in audiovisual information are fully mined, audiovisual features are promoted to be gathered in space and time dimensions, and accurate positioning and classification of sounding objects are ensured. By jointly using the CLIP and the CLAP and aligning the audio-visual features based on the shared real label, the segmentation performance of the sounding object of the known category is enhanced, and the segmentation and classification capability of the unknown category and the generalization capability of the model in an open vocabulary scene are remarkably improved by pre-training the knowledge of the basic model.

The invention discloses an archive data management labeling method and device based on computer application, and relates to the technical field of archive information management and intelligent labeling, and the device comprises a semantic analysis module, an allogenic character normalization module, a context modeling module, a historical semantic alignment module, a context feedback module, a processing module and a model optimization module. The device can automatically monitor file input, clean and segment texts, quickly and normatively replace foreign characters and intelligently convert simple and traditional Chinese characters; a semantic vector is generated based on a Transform model, semantic consistency is detected, and if semantic drift is found, rollback adjustment is carried out; the processing module is combined with a rule engine and a depth model to complete entity labeling and multi-label reasoning; and the optimization module dynamically records and feeds back annotation data, and supports self-learning and continuous improvement of the model. By continuously optimizing the judgment logic, the system has self-learning and evolutionary capabilities, so that the archive labeling process is more and more intelligent, and the labeling result is more and more accurate.