70results about How to "Bridging the Semantic Gap" patented technology

The invention provides a remote sensing image road segmentation method combining bidirectional multi-level road feature dynamic fusion and double-context dynamic extraction, and belongs to the field of road segmentation. The problems of shielding and difficulty in distinguishing road levels existing in the current road segmentation network are solved; comprising the following steps of data set production, model construction, model training and result prediction. The invention designs a bidirectional multi-level road feature dynamic fusion and double-context dynamic extraction module. The bidirectional multi-level road feature dynamic fusion module effectively compensates the problem of spatial information and edge detail loss caused by continuous down-sampling through bidirectional interactive transmission of multi-level feature information, and enhances the understanding of the model for complex scenes and multi-level road structures. The double-context dynamic extraction module realizes dynamic fusion of long-distance and local multi-scale context information, is helpful for suppressing background interference, shielding effect and confusion of similar road structures, and ensures the integrity and continuity of extracted roads.

The invention discloses a prompt learning and alignment strategy-based dialogue recommendation model training method and a dialogue recommendation method. The training method comprises the following steps: inputting a dialogue history and a knowledge graph into a pre-training language model and a graph convolutional network to respectively obtain feature embedding of a text and an entity; performing semantic alignment on the features through multi-granularity contrast learning, and performing semantic fusion by using a linear cross interaction method to obtain multi-modal feature embedding; pre-training a soft prompt template shared by multiple tasks by using the features, and guiding a dialogue model to complete dialogue generation and recommendation tasks; according to the method, the semantic consistency between the models can be effectively improved, the context understanding ability of the pre-trained language model in the subtask of the dialogue recommendation system is remarkably enhanced, and the multi-granularity contrast learning is carried out, so that the multi-granularity contrast learning efficiency is improved. And a semantic gap between the text information and the knowledge graph is effectively reduced.

The invention discloses a data processing method and device based on a visual database and electronic equipment, and relates to the field of data processing. The method comprises the following steps: acquiring a data processing request of a user; analyzing the data processing request to obtain a corresponding key field and a logic conjunction; according to the key field, performing semantic matching in a preset data model library to obtain a corresponding target data table and a target field; synthesizing the logic conjunction, the target data table and the target field to generate a corresponding database processing statement; executing the database processing statement, and obtaining a result data set generated after the database processing statement is executed; and transmitting the result data set to a visual database terminal, and displaying the result data set on the visual database terminal according to a preset visual template. By implementing the technical scheme provided by the invention, the data query efficiency is improved.

The invention discloses a cross-modal pedestrian search implementation method based on a large-scale pre-training model, and relates to the technical field of computer vision, natural language processing and machine learning. The method comprises the following steps: firstly, dividing images in a certain cross-modal pedestrian search data set into a training data set and a verification data set in proportion, and filling pedestrian image attributes in the training data set and the verification data set according to self-defined sentence templates to obtain two corresponding texts; and randomly masking attributes in the text data of the training data set to obtain a masked text. And then constructing a cross-modal pedestrian search algorithm based on the large-scale pre-training model, importing the image, the text and the mask text of the training data set into the cross-modal pedestrian search algorithm, and generating a cross-modal pedestrian search algorithm model through training iteration. And finally, testing the search accuracy of the trained cross-modal pedestrian search algorithm model through the test data set.

The invention discloses a semantic perception intention-driven network guarantee method and a framework. S101, in the intention translation process, verification and conflict resolution are firstly carried out on the original intention of a user, and the processed intention is backed up in an intention library before and after a flow table is prepared to be issued; s102, periodically extracting a network intention from the network switch by adopting a bottom-up network intention extraction method; s103, comparing the backed-up original intention with the advanced intention, performing consistency comparison through consistency verification, screening out the intention which cannot be correspondingly matched with any user intention, and judging the intention as a failure intention; and S104, aiming at the failure intention marked in the S103, re-adopting intention translation from top to bottom, and carrying out installation on the failure intention. The method has the functions of automatically detecting and repairing network configuration errors, the problem that advanced intention is inconsistent with underlying configuration semantics due to network changes is relieved, the efficiency and accuracy of network operation and maintenance are improved, and meanwhile cost and time consumption are reduced.

The invention discloses a medical image segmentation method, system and device based on multi-attention and multi-scale fusion, and relates to the technical field of image segmentation, and the method comprises the steps: constructing an MAMF-Net model which comprises an encoder and a decoder which are in multi-layer jump connection; the encoder adopts a hybrid architecture of convolution and Transform, and is integrated with a self-adaptive expansion convolution method; the decoder integrates dual-channel attention gating and a multi-scale global channel feature enhancement method to enhance features transmitted by jump connection, and combines features extracted by the encoder to fuse and reconstruct a segmentation result; training the MAMF-Net model by adopting the historical medical image sample set to obtain a medical image segmentation model; and obtaining any medical image to be identified and inputting the medical image to the medical image segmentation model, and determining a corresponding segmentation result. The problem of insufficient fusion of global semantics and local details in medical image segmentation is solved.

The invention discloses a control and defense graph decision-making method and system based on defined organization attack preferences, and the method comprises the steps: collecting attack information from a log server of a honey point, attributing and defining a behavior mode of an attack organization through the combined search of a threat intelligence knowledge graph and an external threat intelligence library, and determining the attack preference of the attack organization; the attack preferences of the attack organizations are sorted; from the perspective of attackers, an attack graph is generated through topological information, asset information and configuration information in a target network, mapping from defined organization attack preferences to attack graph nodes is carried out, a control and defense graph is generated, and a control and defense matrix used for quantitatively calculating the influence of attack mode preferences on the attack graph is generated; on the basis of analysis of a control and defense matrix of an attack graph on defined organization attack preferences, honey point services are generated emphatically, and decision support is provided for deployment of defense measures. According to the method, the honey point service type can be more flexibly, quickly and automatically generated, and manpower and time cost is greatly saved for analysis and deployment of deception defense.

The invention discloses a medical image treatment method and system for multi-source heterogeneous data, and relates to the field of medical image treatment, and the method comprises the steps: firstly, respectively extracting an image embedding vector and a text embedding vector from original medical image data and a description text thereof through a deep learning model; then, the vectors of the two different modes are fused, and a unified semantic embedding vector is formed; based on the unified vector, through semantic similarity calculation with a standard term library, candidate mapping can be automatically generated, and dependence on rigid artificial rules is eliminated. More importantly, a closed-loop mechanism of manual auditing-feedback learning is introduced in the scheme, high-confidence mapping is adopted automatically, low-confidence mapping is audited by experts, and an auditing result is absorbed into a mapping knowledge base, so that the system has continuous learning and self-evolution capabilities, and a semantic gap of cross-mechanism data can be eliminated more intelligently and more accurately.

The application discloses a kind of unmanned aerial vehicle target detection methods based on feature fusion DINO, belong to target detection technical field. Including the following steps: obtaining original unmanned aerial vehicle image and pre-processing;The data after pre-processing is sent into feature extraction network Backbone and image feature extraction is carried out, output multi-scale feature map, and it is input into integrated collection feature Neck module to strengthen spatial feature and semantic feature fusion, output enhanced feature map;Fusion enhanced feature map is sent into encoder, and global feature information is highlighted through the multi-scale receptive field of hollow convolution path, finally, the class and boundary box prediction of unmanned aerial vehicle target are generated after decoder generation.The present application is based on DINO architecture, and a high-precision unmanned aerial vehicle target detection model is constructed by a multi-scale hollow convolution fusion method.The detection accuracy and robustness of small-size unmanned aerial vehicle targets are improved by effectively extracting multi-scale features and recursively fusing.

This application discloses a multi-source fusion log compression method and apparatus for anomaly detection, belonging to the field of anomaly detection technology. The multi-source fusion log compression method for anomaly detection includes: generating an audit origination graph corresponding to the system audit log, an application origination graph corresponding to the application log, and a domain name origination graph corresponding to the domain name system log based on the system audit log corresponding to the electronic device, the application log corresponding to the target application in the electronic device, and the domain name system log corresponding to the electronic device; fusing the domain name origination graph into the application origination graph based on the domain name nodes in the application origination graph to obtain a sub-fused origination graph; fusing the audit origination graph into the sub-fused origination graph based on the event nodes in the audit origination graph to obtain a fused origination graph; and performing anomaly detection based on the fused origination graph. The multi-source fusion log compression method for anomaly detection in this application can alleviate the problems of semantic gap and dependency explosion.

The invention discloses a fence structure-oriented small target double-stage detection and defect assessment method, which comprises the following steps of: inputting preprocessed RGB image data of a fence into a trunk convolution module of a defect risk assessment model to obtain first feature maps with different scales, fusing the first feature maps with polarization physical feature maps of the fence respectively, and obtaining a defect risk assessment result through a plurality of FPN modules; performing feature fusion on the fused feature map by adopting a cross-level feature fusion strategy and a cascade connection strategy, and sequentially outputting a fused second feature map to a channel attention module, a space attention module, a texture attention module and a region candidate module to obtain a candidate box set; when a candidate frame meeting the image reconstruction requirement exists, candidate frame reconstruction is carried out through an image super-resolution reconstruction module, RGB image data and a polarization physical feature map, then a bounding box, a defect category and a pixel mask are determined through an RoI feature processing module and a defect detection and segmentation module, and defect risk assessment information is obtained in combination with a geometric model of a fence.

The application discloses a deep network structure abrasive plate joint detection method and system, and a built-in multi-dimensional adaptive feature enhancement module of the detection method, which comprises a multi-scale feature extraction unit, a channel adaptive attention unit, a spatial adaptive attention unit and a residual connection unit. The multi-scale feature extraction unit is responsible for capturing feature information under different granularities. The channel adaptive attention unit strengthens the expression of key feature channels through weight distribution. The spatial adaptive attention unit is used for highlighting the spatial region related to the abrasive plate joint in the feature map. The residual connection unit fuses the enhanced features and the original input, which not only guarantees the effective propagation of the gradient, but also simplifies the learning process of the model. Through the synergistic effect of multi-scale perception and channel spatial double attention mechanism, the module can effectively enhance the weak and irregular feature performance of the abrasive plate joint in the complex background, thereby significantly improving the recognition ability and robustness of the detection system.

The invention belongs to the technical field of artificial intelligence, and particularly relates to a mixed identifier generation type recommendation method and system based on local collaborative context, and the method comprises the steps: obtaining a user historical interaction sequence, and carrying out the multi-granularity clustering of users, and obtaining a group of each user; constructing a static identifier based on the article content, constructing a dynamic identifier in combination with the user group information and the local interaction sequence, and fusing to generate a mixed identifier of each article; constructing an instruction fine tuning task, embedding group information into an instruction prompt word, and learning by using a large language model to generate a mixed identifier of a next article from a historical sequence; and generating a recommendation result based on the optimized large language model according to the historical sequence of the target user and the group information thereof. According to the method, the local collaborative context is fused through multi-granularity group estimation, and the mixed article representation is constructed in combination with static and dynamic identifiers, so that the problems of single user interest modeling and semantic deficiency of article representation are effectively solved, and the accuracy and personalized level of generative recommendation are improved.

The invention discloses a user circle selection method and a related product. In the scheme, a user circle selection instruction in a natural language form is obtained, and the user circle selection instruction is converted into a query vector; based on the query vector, performing semantic retrieval in a user vector library to obtain a target user set; the user vectors in the user vector library are constructed based on the user behavior data and the brand knowledge base. Compared with the prior art that the user circle selection has the problems of label semantic deficiency and sparse behavior data, and the accuracy of the user circle selection result is low, the user circle selection method and device have obvious advantages.

This invention relates to a lightweight service-aware SRv6 satellite routing method for smart grids. It includes: at the service semantic encapsulation layer, classifying grid service flows and generating structured metadata, encapsulating them into SRv6 data packets carrying Power Service Identifiers (PSIDs); at the intelligent policy control layer, parsing the PSIDs and calling a dedicated path calculation engine based on the service type, combining predicted topology to calculate the end-to-end path, encoding it into a PSID list for distribution; at the policy execution and forwarding layer, satellite nodes parse the PSID list for forwarding and execute corresponding policies based on the service semantic domain; simultaneously, satellite nodes monitor link status in real time, triggering local fast rerouting in case of faults, and feeding back the status to the control layer to form a closed-loop optimization. This invention achieves direct mapping between service requirements and forwarding policies through PSIDs, and combined with "one policy per category" path calculation and a local fast self-healing mechanism, solves the challenges of reliability and accurate QoS assurance for differentiated grid service transmission in highly dynamic satellite networks.

The present application relates to a code search method based on contrastive learning of reinforced multimodal semantics, and belongs to the field of natural language processing and machine learning. Firstly, the code snippet is represented as token sequence, abstract syntax tree and program expression graph three modalities, and BERT model is used to generate the feature vectors of each modality and splice them into joint code feature vectors. Then, a contrastive loss function is constructed to reduce the distance between the query statement and the corresponding code snippet in the feature space. Finally, the cosine similarity is used to calculate the distance between the query statement feature vector and the joint code feature vector and sort them, and the code search result is output. The present application proposes a code search method based on contrastive learning of reinforced multimodal semantics to solve the problem that the existing method does not fully extract the code structure features and there is a semantic gap between the query statement and the code snippet, thereby improving the accuracy of code search.

The invention discloses an anomaly detection-oriented multi-source fusion log compression method and device, and belongs to the technical field of anomaly detection. The anomaly detection-oriented multi-source fusion log compression method comprises the following steps of: compressing a multi-source fusion log based on a system audit log corresponding to electronic equipment, an application log corresponding to a target application program in the electronic equipment and a domain name system log corresponding to the electronic equipment; generating an audit traceability graph corresponding to the system audit log, an application traceability graph corresponding to the application log and a domain name traceability graph corresponding to the domain name system log; based on domain name nodes in the application traceability graph, fusing the domain name traceability graph into the application traceability graph to obtain a sub-fusion traceability graph; based on event nodes in the audit traceability graph, fusing the audit traceability graph into the sub fusion traceability graph to obtain a fusion traceability graph; and performing anomaly detection based on the fused traceability graph. According to the multi-source fusion log compression method for anomaly detection, the problems of semantic gaps and dependency explosion can be relieved.

The application provides a kind of digital resource retrieval system and method based on multi-modal and AI intelligent agent, it is related to electric digital data processing technical field, its method includes obtaining multi-modal query data and pre-processing, feature extraction and cross-modal semantic alignment, generates query vector set;Identify user category and accordingly the query vector set is semantically enhanced, and generates enhanced query vector;The enhanced query vector is matched with knowledge graph to determine the target node, and the extended query vector is generated along the semantic diffusion of knowledge graph;Based on the agent collaborative mechanism, the extended query vector is sequentially executed, and the parallel retrieval, fusion and sorting and confidence correction are carried out, and the modified sorting result is obtained;According to the scene adaptation factor, the modified sorting result is reordered, and the digital resource retrieval result is output in combination with the user category, so that user perception, semantic expansion and multi-agent collaborative retrieval for multi-modal education scene can be realized, and the accuracy and personalized adaptation degree of digital resource retrieval are improved.

The present invention discloses a cross-modal image rotation target recognition method and system based on knowledge distillation. The present invention includes constructing and training a teacher network model with infrared modal images and visible light modal images as inputs, a student network model with visible light modal images / infrared modal images as inputs, training the student network model with samples of visible light modal images, inputting samples of visible light modal images and their corresponding infrared modal images into the teacher network model, performing knowledge distillation using features extracted from a multi-modal backbone network and a multi-scale aggregation layer in the teacher network model, and calculating feature and relational distillation losses to train and optimize network parameters of the student network model, until the training of the student network model is completed for rotating target recognition of the input visible light modal image. The present invention aims to improve the detection accuracy of the student network model while having cross-modal detection functions.

The invention discloses a task decomposition system and method for an intelligent robot with a body based on physical state deduction, and relates to the technical field of artificial intelligence robots. The system comprises a task instruction receiving and initial decomposition module, a state sensing and formatting input module, a task feasibility deduction module, a feedback and optimization closed loop module and a decision and output module. According to the method, a technical framework of sensing, deducing and optimizing a closed loop is constructed, so that the robot can perform virtual rehearsal on a task sequence before executing actual physical actions, thereby identifying environment state conflicts and execution path risks in advance, and fundamentally improving the task execution mode from passive response depending on trial and error, and improving the task execution efficiency. The method is converted into active reliable planning based on physical state deduction, and the adaptability, the safety and the deployment efficiency of the robot for executing complex tasks in an open environment are remarkably improved.

The present application relates to the field of computer technology, and provides a summary generation method and related devices for improving the accuracy of summary generation, wherein the method includes: based on the acquired multiple modal information, after obtaining at least one candidate modal node corresponding to each modal information, respectively, constructing a corresponding target node association relationship, and then, based on the target node association relationship, using a bidirectional iterative update method to obtain the target feature representation corresponding to each candidate modal node, in each round of iteration, based on the candidate feature representation of the adjacent candidate modal node, the candidate feature representation is updated, and then based on the obtained target feature representations, the target modal node is determined, and based on the target modal node, the target summary information is generated. In this way, through the bidirectional iterative update method, the interaction between multiple modal information can be enhanced, the accuracy of the feature representation can be improved, and the accurate recommendation of the target summary information can be achieved.

This application discloses a training method, apparatus, device, and storage medium for a self-supervised learning model, belonging to the field of computer and internet technology. The method includes: acquiring a sample set; for a target text sample in the sample set, concatenating the target text sample with other text samples in the sample set to generate a first negative sample corresponding to the target text sample; and using the first negative sample to perform self-supervised training on a text feature extraction model; wherein the text feature extraction model is used to obtain feature information of the input text based on the input text, in order to match retrieval text with semantically similar characteristics to the input text. This application improves the text feature extraction model's ability to distinguish text information with small semantic differences, thereby enhancing the retrieval capability of the text feature extraction model.

The application relates to the technical field of electric digital data processing, and discloses a cargo automatic classification method and system based on bilateral semantic mapping and mixed retrieval, which comprises the following steps: obtaining original cargo name data and a standard name database, carrying out text cleaning and structured splitting, reconstructing semantics of the two ends of data by using a large language model, projecting semantic features into a high-dimensional vector space by a vector coding model to calculate similarity and recall a candidate set, extracting fine-grained interaction features by using a cross encoder, combining character matching statistics to calculate a reordering score, verifying consistency of a target item based on a logical mutual exclusion matrix, and outputting classification data. The application effectively suppresses the semantic reconstruction illusion of a generative model, enhances the matching certainty of heterogeneous data through a hidden feature fusion and a logical verification mechanism, and ensures the industrial-level reliability of model-sensitive cargo classification.

This invention relates to the field of medical image analysis technology, specifically to a method and system for dry eye detection based on multimodal prior and generalized contrastive learning. The method includes: first, acquiring typical images, descriptive text, and relationship graphs of various dry eye diseases; extracting and stitching multimodal features to construct a medical prior knowledge base; second, extracting visual features from the anterior segment of the eye image and retrieving corresponding semantic features from the knowledge base according to disease labels, then projecting and aligning the two; third, constructing a medical similarity matrix based on multimodal features, mining difficult negative samples, and performing generalized contrastive learning on positive and ordinary negative samples to train a visual feature extraction network; finally, inputting the test image into the network for tear river segmentation, calculating the tear river height and pupil-tear river distance, and combining the cosine similarity of visual features and various semantic projection features to output the probability that the test image belongs to each dry eye disease level. This invention improves the accuracy of dry eye detection.

This invention discloses a method for anomaly detection in meteorological satellite observation data based on a multimodal semantic enhancement network. The method includes: acquiring multi-channel observation samples from meteorological satellites; constructing a multimodal semantic enhancement network, which includes a feature extraction network and a semantic mining network; training the multimodal semantic enhancement network; preprocessing the meteorological satellite multimodal observation data to be detected and inputting it into the multimodal semantic enhancement network to generate reconstruction errors for each modality corresponding to the feature extraction network and semantic reconstruction errors corresponding to the semantic mining network; determining the anomaly score of the meteorological satellite multimodal observation data to be detected based on the reconstruction errors of each modality and the semantic reconstruction errors; and outputting the anomaly channel, anomaly area heatmap, and alarm level if an anomaly is confirmed. Therefore, without relying on the labeling of anomaly samples or prior knowledge of anomaly types, this method can identify not only known anomaly types but also unknown anomaly types not seen during the training phase.

This application discloses a method, apparatus, device, and storage medium for evaluating large language models, relating to the field of artificial intelligence technology. The method includes: acquiring task configuration information and candidate evaluation model information; determining target evaluation model information based on stability evaluation index information and alignment evaluation index information of the candidate evaluation model information; injecting corresponding semantic evaluation elements into the model prompt word template of the target evaluation model information based on the task configuration information to determine semantic enhancement information of the target evaluation model; and generating corresponding evaluation results based on the semantic enhancement information of the target evaluation model. This application dynamically determines the optimal evaluation model through stability evaluation index and alignment evaluation index, and injects semantic evaluation elements of the business scenario into the corresponding model prompt word template to obtain evaluation results. It coordinates model selection and prompt enhancement, eliminates the semantic gap between general templates and business requirements, and improves the model evaluation's discriminative power, semantic consistency, and reproducibility.

The application belongs to the technical field of recommendation systems, and particularly relates to a hierarchical latent inference recommendation based on a large language model and a model training method. A category level and an item identification level hierarchical representation are constructed for items, a recommendation model is built based on a large language model, the recommendation model performs hierarchical latent inference according to a user historical interaction sequence, generates a category level latent state, and then generates a user collaborative filtering vector matching an item identification level representation; a phased progressive training strategy is adopted, and real category level representations and model self-generated category level latent state supervision vectors are used to generate vectors respectively. In the recommendation stage, the user historical interaction sequence is input into the trained model, the hierarchical latent inference is performed to output the user collaborative filtering vector, similarity calculation is performed between the user collaborative filtering vector and an item library identification level collaborative representation, and recommended items are determined.

The application relates to the cross field of information security and computer-aided design, and particularly discloses a GPU-based anti-quantum cryptographic algorithm hardware description language acceleration core design method.The method comprises the following steps: constructing a semantic analysis model based on a Transformer to extract key computation logic of an algorithm; establishing a hardware template rule library containing basic, composite and control units; matching algorithm features and templates and planning an interconnection topology through a graph neural network; automatically generating Verilog / VHDL code with pipeline optimization; and simulating and verifying on a GPU acceleration platform and optimizing in a closed loop.The application realizes end-to-end automatic generation from algorithm text to safe and efficient hardware cores, shortens the design cycle, improves performance and anti-side channel attack capability, and supports cross-process node migration.

The invention discloses a cross-modal video time sequence content positioning method and system based on a situation memory prompt, and relates to the technical field of cross-modal understanding, a group of situation memories are dynamically generated through a first stage, and various behavior instances occurring in an input video are explicitly summarized; an unsupervised memory learning normal form is formulated by applying discriminative and diversity constraints, and dependence on extra behavior instance annotation is eliminated. Secondly, in the second stage, enhanced memory prompts are obtained based on frame-level detail content supplementation and language query interaction and further serve as anchor frames, and accurate and efficient regression of target moment fragment boundaries is achieved. Compared with a traditional strategy based on a sliding window or a multi-scale anchor frame, the cross-modal video time sequence content positioning method provided by the invention better conforms to cognitive habits, and has performance and efficiency advantages when processing a long video.

The application relates to an athlete action biomechanics evaluation method, system, device and medium based on deep learning, the method comprising: obtaining a motion signal sequence by time synchronization and cycle segmentation of a multi-modal technical action signal of an athlete, generating a joint representation tensor by kinematics and dynamics feature fusion, obtaining a bottom feature map by spatiotemporal coding of fused individual morphological parameters, performing cross-attention decoding based on a pre-constructed biomechanics semantic knowledge space to generate a semantic state matrix and a concept activation sequence with a concept node as a query vector, generating an evaluation result along a causal topological structure, and outputting an interpretable biomechanics evaluation report through natural language generation. The method can improve the interpretability, causal tracing ability and training guidance value of the athlete action biomechanics evaluation.