1222 results about "Semantic consistency" patented technology

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.

The invention relates to the technical field of computer systems for natural language processing or semantic processing, and discloses an enterprise-level schedule planning and knowledge base-oriented intelligent collaborative question-answering system and an enterprise-level schedule planning and knowledge base-oriented intelligent collaborative question-answering method. The system comprises a vectorization processing module, an RAG knowledge base module and the like. The system converts natural language input of a user and enterprise knowledge data into semantic vectors, and retrieves related enterprise knowledge fragments from a vector database based on semantic similarity. The large language model core module analyzes the user intention, generates a preliminary answer and identifies whether a schedule type operation request is included or not; and if the schedule operation request exists, the system splits the request through the multi-agent cooperation module and distributes the request to the corresponding agent to obtain a task processing result. And finally, semantic consistency fusion is carried out on the preliminary answer and a task processing result through a context fusion module, a comprehensive answer is generated by a large language model and is returned to a user side, and unified intelligent response of enterprise knowledge and schedule service is realized.

The invention discloses a self-adaptive software vulnerability repair system based on deep learning. The self-adaptive software vulnerability repair system comprises a multi-modal feature fusion engine, a spatio-temporal joint modeling module, a vulnerability repair strategy generator and a cross-language representation model. The multi-modal feature fusion engine generates a mixed feature vector of a code, inputs the mixed feature vector into the spatio-temporal joint modeling module, captures code structure and time sequence dependence, and identifies risk features; the vulnerability repair strategy generator generates a repair scheme based on the risk features and optimizes the repair scheme through static verification; and the cross-language representation module performs feedback training by using the newly added sample and outputs a final detection result and a repair scheme. According to the method, the vulnerability trigger points can be accurately positioned, all the associated code snippets are extracted, a solid foundation is provided for subsequent vulnerability analysis, and the repaired codes conform to grammatical rules and keep original semantic consistency.

The invention discloses a multi-source data fusion method and system based on cloud computing, and particularly relates to the technical field of multi-source data fusion, and the method comprises the steps: obtaining the real-time information of multi-source data, generating a health score and a label through a health evaluation model, and marking a data state and an abnormality type; performing format conversion and semantic enhancement processing on the health data to generate structured data; based on a knowledge graph reasoning technology, extracting a logical relationship to generate a fusion rule, and calculating a rule weight and confidence in combination with a health label, a data source confidence and a semantic feature; a fusion result of conflict data is judged through a semantic consistency index, if the fusion result does not conform to expectation, historical data and rules are loaded according to a verification model, a verification score is calculated, an optimization process is triggered after the verification score is compared with a threshold value, health assessment model parameters, a semantic embedding model and fusion rule logic are optimized, and fusion accuracy and reliability are improved.

The invention discloses a dynamic visual content collaborative generation method based on a cognitive logic chain, and belongs to the technical field of visual content generation, and the method comprises the following steps: S1, user intention analysis and data input; s2, dynamically constructing a cognitive logic chain; s3, intelligent scheduling of the multi-modal generation module; s4, cross-modal content collaborative generation is carried out; s5, collaborative editing and real-time feedback are carried out; s6, iterative optimization of logic chain driving; s7, multi-dimensional quality evaluation: constructing an evaluation matrix containing semantic consistency, visual attraction and user participation degree, predicting a content propagation effect in combination with a deep learning model, and generating a quantitative improvement suggestion report; and S8, updating the self-adaptive knowledge reversely marking the cognitive logic chain according to the finally adopted content version, extracting a new association rule, and injecting the new association rule into the rule base. Through deep semantic analysis and dynamic logic chain construction, the system accurately captures a core creation target of a user and converts the core creation target into an executable visual strategy.

The invention discloses a real-time health risk prediction method and system based on a dynamic knowledge graph, and relates to the technical field of medical information. The method comprises the following steps: carrying out multi-modal fusion and privacy protection preprocessing on medical and nursing heterogeneous data, and realizing semantic consistency of cross-mechanism data based on an entity alignment method of a cross-modal graph neural network; based on a hierarchical federated learning framework, local model parameters are subjected to hierarchical encryption and aggregation through a secure multi-party computing protocol to generate an initial global model, and prediction distribution of the global model is optimized in combination with knowledge distillation of differential privacy constraints; designing a gradient difference dynamic updating trigger mechanism of noise robustness, smoothing noise interference through a sliding window mean value, and realizing adaptive threshold calibration through linkage model performance verification; and light-weight deployment real-time reasoning is realized based on redundant edge pruning of confidence and 8-bit symmetric quantization. On the premise of protecting data privacy, the real-time performance and accuracy of health risk prediction are remarkably improved, and the method is suitable for a cross-institution medical care collaborative decision-making scene.

The invention relates to the technical field of power plant management and control, and discloses an intelligent power plant management and control system based on the Internet of Things, and the system comprises the steps: when a plurality of labels related to the same equipment or parameter exist in different subsystems, according to a similarity index between the labels and an equipment association relationship; on the basis of the detected conflict label group, combining equipment historical operation and maintenance data and an upstream and downstream parameter flow relationship, constructing a label semantic evolution graph, and performing reasoning analysis on label equipment through a fusion rule engine and a graph neural network; through mapping knowledge domain fusion and semantic embedding comparison, matching and clustering among conflict labels are completed based on structural similarity and semantic relevancy, and a label alignment rule is constructed; according to a label coordination result, designing a mapping rule of a data field; and performing inter-system synchronous verification on a result after structure conversion and label standardization processing, and writing a standardized label into a unified semantic database. The method has the advantage of improving data semantic consistency.

The invention discloses a multi-modal semantic and physical law driven remote sensing image generation method, belongs to the technical field of computer vision and remote sensing image generation, and aims to solve the problems of insufficient cross-modal semantic alignment, low reliability of a generation result and insufficient physical mechanism fusion. The four-stage method comprises the following steps: firstly, rejecting low-quality samples from original data and unifying a spatial scale; then, extracting a multi-modal semantic vector by adopting a BLIP model and a CLIP model, and introducing a remote sensing physical rule to carry out vector optimization; then position coding and physical constraint conditions are embedded in the submerged space, and multi-source information joint modeling is achieved through a cross-modal encoder; and finally, by taking text description, physical priori knowledge and diffusion time steps as joint conditions, performing de-noising reasoning based on a Transform architecture, and completing back diffusion reconstruction by means of a trans-attention mechanism. According to the method, physical rationality and semantic consistency are improved, and a more reliable technical normal form is provided for remote sensing image generation in the fields of disaster monitoring, military simulation and the like.

The invention discloses a data query method and system based on a natural language text. The method comprises the following steps: dynamically shielding the natural language text to generate a semantic vector sequence; key entities and association relationships thereof in the semantic vector sequence are extracted, and a structured entity relationship set is obtained; matching the structured entity relationship set with knowledge graph nodes to generate a heterogeneous semantic graph; performing heterogeneous fusion on the heterogeneous semantic graph and text syntactic features to generate intermediate query representation; processing the intermediate query representation to generate an executable statement carrying a semantic association identifier; and verifying the semantic consistency of the response content of the executable statement and the original input, and iterating to regenerate the executable statement when the semantic consistency does not pass the verification. And efficient and accurate natural language query conversion and response generation are realized through dynamic shielding enhanced semantic robustness, knowledge graph path extension and weight iterative optimization, heterogeneous feature fusion and a multi-modal verification mechanism.

The invention discloses an image-text content auditing method and system based on a multi-modal large model, and the method achieves the deep semantic understanding and cross-modal integration of unstructured data through the cooperative work of all modules. A semantic association graph is generated through a multi-modal large model, the association recognition precision of the system on situations and information of images, texts, audios and videos is improved, and the problem that an existing system is inaccurate in semantic understanding is solved; the multi-modal data integration module realizes unified alignment of cross-modal data and layered mapping of information density, situation correlation and semantic consistency, and constructs an image-text association vector space, so that data splitting in an auditing process is eliminated; the content abnormity quantification module is combined with the intelligent control module, multi-level auditing decision is carried out through quantitative calculation and comparison of an auditing weight value Hqwz and a content abnormity index Cxzs, manual rechecking is automatically triggered, automatic issuing is directly carried out, the auditing efficiency is effectively improved, and the manual auditing burden is reduced.

The invention discloses a high-quality pseudo-annotation data set construction method based on a complex task, and relates to the technical field of multi-modal learning, and the method comprises the steps: constructing a cross-modal causal graph based on multi-modal original data, loading a domain knowledge graph, recognizing an inter-modal confusion variable, and generating an initial pseudo-tag; an anti-fact sample is generated by forcibly cutting off a non-causal path in the cross-modal causal graph, and a cross-modal depolarization pseudo-label is generated by comparing the pseudo-label difference between the original sample and the anti-fact sample; and in combination with the cross-modal depolarization pseudo-labels and the semantic consistency pseudo-labels, a standardized pseudo-annotation data set with multi-modal alignment, clear entity relationship and semantic consistency is generated through fusion. According to the method, an anti-fact intervention framework is adopted, non-causal path influence in cross-modal interaction is identified and eliminated by analyzing probability distribution difference, and false association is effectively inhibited.

The invention provides a large model scientific and technological problem generation method fusing external knowledge, which comprises the following steps: dynamically solving an optimal knowledge fusion strength parameter in a current environment by adopting a gradient descent algorithm through designing and optimizing an objective function according to association representation and difference representation between knowledge units, the knowledge unit balancing module is used for balancing correlation and complementarity among knowledge units; on the basis of real-time updating of knowledge fusion strength parameters, heuristic search is carried out in the knowledge unit association map by utilizing an ant colony optimization algorithm, and candidate fusion knowledge units which achieve target correlation and target complementarity with the current knowledge unit are selected by combining semantic similarity, association degree and difference among the knowledge units; a knowledge mapping ontology is used for guiding fusion of cross-domain knowledge, an ontology inference engine based on description logic is adopted to infer a semantic consistency relationship between fused knowledge units, and potential semantic conflicts are identified and eliminated through a consistency check algorithm.

The invention provides a training data synthesis method and device based on error extrapolation and inference chain analysis, a medium and a program product. The method comprises the steps of obtaining an initial sample set; performing multiple sampling reasoning on the problem of each task sample by using a small language model to generate a plurality of reasoning chains; calculating an overall error score of each reasoning chain based on a preset error evaluation rule, and determining a to-be-corrected reasoning chain; the inference chain to be corrected and the corresponding question are input into the large language model together, and a corrected answer is generated; forming a new task sample by the question and the corrected answer, and finely adjusting partial parameters of the small language model; repeatedly executing the process until the performance index change rate of the model on the task evaluation set is lower than a preset threshold value, and outputting a final task sample; and forming a training sample set by a plurality of final task samples, and performing all-parameter fine tuning on the small language model. According to the method, the training data self-optimization path is constructed by taking the model error as guidance, so that the semantic consistency and the data validity are improved.

The invention relates to the technical field of artificial intelligence, and discloses a rapid labeling method based on an artificial intelligence large model, which comprises the following steps of: 1, extracting an entity set and a relationship set of a specific field through a document set of a target field, identifying nouns, terms and keywords related to the field in a document by using an entity identification technology to form an entity set, and marking the entity set and the relationship set; the method comprises the following steps of: establishing an entity set, analyzing logic and semantic relevance among entities by utilizing a relation extraction technology, generating a relation set, combining the entity set with the relation set to construct a knowledge triad, and the knowledge triad comprises an association relation among the entities. By introducing the domain knowledge graph, the entity and relation information extracted from the target domain document is structured into the knowledge triad, and the knowledge triad is matched with the to-be-annotated data to optimize the annotated semantic information, so that the domain adaptability and semantic consistency of the annotation result are realized, and higher accuracy and consistency effects of the annotation data in the professional field are obtained.

The invention discloses a SysML model automatic generation system based on mixed AI and domain knowledge, and the system comprises a preprocessing module which is used for carrying out the text preprocessing and structural enhancement of an engineering document of a PDF or Word version; the NLP extraction module is used for identifying six types of core entities by adopting aviation corpus fine tuning BERT, constructing a document-level relational graph by utilizing GNN, modeling a cross-paragraph dependency relationship, calling LLM for semantic fuzzy sentences to generate a thinking chain, extracting a reasoning path and solving ambiguity; the rule conversion engine module is used for mapping the entity relation graph into a SysML memory object tree; and the controllable generation module is used for carrying out limited decoding on the LLM by utilizing a Guidance framework. The invention further discloses an automatic SysML model generation method based on the mixed AI and domain knowledge. According to the method, the problems of low manual modeling efficiency and poor semantic consistency in traditional MBSE implementation are solved.

The invention relates to the technical field of agent construction, and discloses an agent construction method and system based on agentive workflow, and the method comprises the following steps: defining an agent core function module and distributing a unique identifier, building an inter-module communication protocol standard, and determining a message format and a priority rule; the method comprises the following steps: distributing computing resources for each module, setting an elastic capacity expansion and contraction strategy, generating a module dependency graph and an architecture metadata file, detecting the loss and delay of multi-modal input data, generating compensation characteristics based on historical context, calculating the quality confidence of each modal, and carrying out dynamic weighted fusion. According to the invention, a three-level alignment architecture is provided to realize cross-modal semantic consistency, and the generated content is ensured to accord with real scene logic; a double-layer decision-making mechanism is designed to drive workflow dynamic optimization, and the system agility under a complex task is remarkably enhanced; a privacy-efficiency balanced federated architecture is constructed, and differential content generation is supported while enterprise data sovereignty is protected.

The invention discloses a multi-source heterogeneous data synchronization system, and relates to the field of computer information management application. The system fuses key technologies such as flow dynamic regulation and control, self-adaptive load balancing and intelligent semantic mapping. Through a real-time network state monitoring and self-adaptive flow regulation and control algorithm, the data transmission rate is dynamically adjusted according to the server resource utilization rate, the data priority and the network bandwidth, data backlog and system overload are avoided, and the robustness and the real-time performance of a synchronization task are remarkably improved. The intelligent field mapping engine is based on semantic analysis, word vector representation and a machine learning model, automatically recognizes field semantic consistency of heterogeneous data sources, generates an optimal mapping rule and dynamically optimizes a mapping result, the manual configuration cost is reduced, and the mapping accuracy rate reaches 98% or above. The system has high expandability and self-learning ability, is suitable for a large-scale multi-source heterogeneous data integration scene, and provides an efficient, intelligent and self-adaptive full-stack solution for a data synchronization task.

The invention discloses a multi-modal fused intelligent question answering and knowledge retrieval method and system, and the method comprises the steps: building a multi-modal data index model oriented to a heterogeneous knowledge source, carrying out the feature mapping of text, image, table, chart, audio and video contents through a unified semantic embedding space, and generating a cross-modal index set; after a query request is received, performing semantic matching and structure matching on the cross-modal index set by using a multi-channel retriever to obtain candidate evidence fragments; and based on an evidence granularity decomposition strategy, performing minimum evidence unit division on text statements, table units, chart data points and multimedia frame contents in the candidate evidence fragments, and establishing a semantic consistency graph among the units. According to the method, high-credibility traceable generation of question and answer results is realized through multi-modal fusion and space-time consistency constraint, and the retrieval precision and interpretation transparency in a complex knowledge scene are remarkably improved.

The invention discloses a knowledge construction method and system based on a large model and an RAG technology, and belongs to the technical field of large models.According to the knowledge construction method and system based on the large model and the RAG technology, through cross-text-block mutual information calculation and RAG enhanced reasoning, the system can quantify statistical correlation between entities, and in combination with context information of an external knowledge base, potential incidence relations of cross-paragraphs or documents are mined, so that the knowledge construction efficiency is improved. A dynamic semantic segmentation strategy is adopted to ensure that semantics in text blocks are consistent, context continuity is maintained by retaining overlapped parts, multiple expressions of the same entity are comprehensively judged through a multi-dimensional anaphora resolution mechanism, the error resolution rate is reduced, dynamic segmentation and mixed retrieval are combined, and the problem of large model input length limitation is solved. And through semantic retrieval and keyword matching complementation, the recall rate is improved, and the key problems of semantic fracture, cross-text association missing, low entity alignment precision and the like in traditional knowledge construction are remarkably solved.

The invention discloses a market supervision data asset management method and system based on compliance and privacy protection, and relates to the technical field of data asset management. According to the method, the privacy compliance strategy is generated according to the metadata label and is packaged into the data capsule, so that the binding of the data and the compliance strategy is realized; the privacy compliance knowledge graph is constructed, and semantic matching and compliance verification are performed in combination with a large language model, so that the semantic consistency and matching degree between a privacy compliance strategy and a supervision regulation are improved, and manual intervention is reduced; a privacy protection processing mechanism is called according to a compliance verification result, and a proper data protection technology is dynamically applied to reduce the risk of data leakage; anonymization processing parameters are optimized before data are published, data distortion processing is implemented, and the privacy disclosure risk is effectively controlled on the premise that data availability is guaranteed; and a data asset value dynamic evaluation model is constructed, the data comprehensive value and the risk level are evaluated, and refined and differentiated management of data assets is supported.

The invention discloses a cross-modal interactive image restoration method fusing text semantic guidance and visual structure priori, which comprises the following steps of: firstly, acquiring natural language description input by a user and an image to be restored, and generating a semantic segmentation map of the image through a semantic segmentation model; encoding the text and image semantics by using a pre-trained cross-modal encoding model to obtain text and semantic features; guiding a semantic alignment attention module through Prompt to realize deep fusion of multi-modal semantic features and image space features; structural enhancement and regulation of image features are realized by constructing a text guide weight graph, performing element-level modulation on the text guide weight graph and the optimized semantic segmentation graph, constructing a cross-modal structure semantic feature graph and generating a structural modulation factor; a four-stage image restoration network is adopted, and a high-quality restoration image conforming to semantic guidance and structure prior is generated step by step. According to the method, the semantic consistency, the structural integrity and the visual reality sense of an image restoration result are improved.

The invention discloses a long video multi-modal understanding and question-answering method and system based on large model and retrieval enhancement generation. The method comprises the following steps: 1) a multi-modal feature extraction module; 2) a multi-modal synchronization and alignment mechanism; 3) constructing a structured memory pool; 4) querying a drive generation mechanism; 5) incremental updating and memory compression strategy; and 6) unifying the multi-modal representation space. The invention provides a long video multi-mode understanding method fusing a large language model and retrieval enhancement generation, and aims to break through the limitation of a traditional method in the aspects of single-mode processing and semantic fragmentation. According to the method, video image features are extracted through a visual model (such as YOLO and ViT), voice transcription and environment voice description are obtained in combination with an audio model (such as Whisper and Qwen-Audio), and unified coding of vision, voice and audio in a long video is achieved. Then, a structured memory pool is constructed through semantic consistency segmentation and timestamp alignment technologies to store time slice data of different modalities.

The invention discloses a large-model multi-scene antagonism dynamic evaluation system and method based on context perception strategy optimization, relates to the technical field of artificial intelligence safety evaluation, and aims to solve the problems of lack of multi-round context modeling, poor confrontation sample semantic consistency and lack of a feedback-driven optimization mechanism in the prior art. According to the method, a state space and an action space are constructed, an adversarial sample is dynamically generated by adopting a reinforcement learning strategy network, a high-quality sample set is expanded in combination with a semantic disturbance and screening mechanism, and a vulnerability knowledge base is constructed based on an interaction log to guide strategy optimization and security evaluation. The method can effectively improve the security evaluation coverage and vulnerability discovery capability of the model in a high-risk multi-round interaction scene, and is mainly used for security reinforcement and deployment support of large language models in the fields of medical treatment, customer service and the like.

The invention relates to the technical field of data fusion, in particular to a multi-source heterogeneous data fusion method and system based on cloud computing, and the method comprises the steps: carrying out the feature extraction of multi-source heterogeneous data, and generating standardized metadata comprising a data type, a transmission protocol and a semantic tag; an adaptive interface is dynamically generated based on the metadata, the adaptive interface comprises a data format conversion module, a protocol packaging module and a semantic analysis module, and cross-domain compatible data streams are output; performing data fragment encryption and priority marking on the cross-domain compatible data stream to generate a secure transmission block carrying a transmission feature vector; incremental fusion is executed at the cloud fusion node, semantic conflicts are detected by constructing a knowledge graph, and a fusion intermediate state is generated; and performing dynamic verification on the fusion intermediate state based on the credibility evaluation model, and outputting final fusion data with a credibility label. According to the method, the dynamic verification and hierarchical labeling of the fusion result are realized, and the semantic consistency and expandability of the fusion intermediate state are ensured.

The invention relates to the technical field of data processing, and discloses a multi-protocol fusion Internet of Things equipment intelligent gateway data conversion method and system. The method comprises the following steps: collecting a multi-protocol equipment data packet, and extracting protocol features to construct a vector library; protocol types are identified based on the vector library, data are analyzed, and a data object set containing semantic tags is constructed; semantic correlation is analyzed through an adaptive learning algorithm, and a dynamic protocol semantic mapping matrix is established; converting the data into a standard format according to the mapping matrix and recording a matching degree to form a target data pool; and extracting fusion data from the data pool, recoding according to a target protocol format, and outputting a data frame. The problem that an existing multi-protocol fusion data conversion method lacks protocol semantic understanding and self-adaptive learning ability is solved, and semantic consistency and conversion quality of data conversion among multi-protocol equipment are improved.

A system and method for persistent cognitive computation with temporally synchronized multimodal processing implements a geometric approach to artificial intelligence through typed latent entities within a dynamic manifold substrate. The system maintains a latent manifold incorporating heterogeneous data modalities where local curvature reflects semantic density and typed entities are stratified according to structural properties. Temporal synchronization coordinates asynchronous multimodal data streams through generation of temporal alignment fields within the manifold that preserve semantic coherence across modal boundaries. Type-aware geometric operations enforce operation legality based on entity type and local manifold geometry, enabling structured recombination, compression, and traversal while preventing semantic distortion. The system executes synchronized manifold reorganization during idle periods through coordinated optimization operations including perturbation analysis and topological surgery. This architecture enables persistent memory through geometric encoding where frequently accessed concepts develop high-curvature regions and cognitive patterns emerge from usage-based manifold evolution.

The invention relates to a multi-modal sentiment analysis method based on deep decoupling and cross-modal semantic alignment. The method comprises the following steps: carrying out preprocessing and feature extraction on input video data; the three modes are decoupled through a feature decoupling mechanism based on the HSIC criterion; performing cross-modal alignment on the three modal semantics; hierarchically predicting emotion categories; and finally outputting a prediction result. According to the method, by decoupling features of three modes of text, audio and vision, unique attributes of each mode are separated from shared emotional semantics, and the problem of redundancy and conflict information between modes in an existing multi-mode emotional analysis method is solved. On the basis, a cross-modal alignment mechanism based on text guidance is provided, shared features are aligned through a cross-modal attention mechanism, and semantic consistency among different modals is enhanced. Meanwhile, the decoupled unique features and the aligned shared features are effectively fused through a hierarchical fusion strategy, and the accuracy of emotion prediction is improved.

The invention discloses an optical remote sensing image salient target detection method based on double-branch progressive interaction and multi-direction feature enhancement. The method comprises the following steps: preprocessing an original data set; inputting the preprocessed image into a double-branch progressive interaction encoder for feature extraction, inserting a large windmill into a CNN branch to capture complex shape features, and realizing cross-branch interaction and weight adjustment by using a progressive interaction mechanism; inputting the extracted features into a semantic association enhancement module, generating a semantic association weight through a context awareness attention mechanism, and enhancing the semantic consistency of the significant target; inputting the enhanced features into a multi-scale adaptive fusion module, dynamically adjusting a feature fusion proportion, and introducing a deformable pooling operation to avoid loss of key features; and finally, inputting the fusion features into a decoder, recovering the image resolution through cross-layer connection, and generating a salient target detection result. According to the method, the problems of insufficient feature fusion and poor multi-scale target adaptability are effectively solved.

The invention belongs to the technical field of robot learning, and particularly discloses a robot continuous imitation learning method and system based on a double diffusion model. Comprising the following steps: generating old task data in a submerged space by utilizing a pre-trained latent diffusion model, generating a model through guidance of a task identifier in combination with conditional diffusion, generating an image and state data related to an old task, modeling to construct a diffusion model, realizing multi-modal mapping from a state to an action, and generating a diversified action sequence; high-quality images and state data are generated through a pre-trained variational auto-encoder and a conditional diffusion model, and the consistency of the generated data in time and the accuracy of global semantics are ensured through time sequence continuity constraint and semantic consistency constraint; and performing feedback optimization training on the latent diffusion model. According to the method, the loss weight is dynamically adjusted, and the model is ensured to show good generalization ability and stability in a complex task in combination with collaborative training of an imitation learning strategy and a generator.

The invention relates to the technical field of computer aided design, in particular to a text-driven CAD modeling method and system based on a diffusion and visual language model.The method comprises the steps that natural language text description is obtained, and CAD semantic features of the natural language text description are extracted; carrying out geometric standardization on the CAD semantic features by adopting a fine-tuning diffusion model, and generating a CAD view image conforming to engineering specifications; carrying out fusion by adopting a fine-tuned visual language model to generate a parameterized CAD construction sequence; a three-mode alignment mechanism is adopted, and the semantic consistency of the CAD semantic features, the CAD view images and the CAD construction sequences is checked; performing verification and post-processing on the CAD construction sequence, and outputting an executable Python code or STEP file; the CAD modeling method disclosed by the invention performs explicit modeling based on flexible modal description, and has the characteristics of high geometric constraint and high usability.