Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

196 results about "Semantic relationship" patented technology

Semantic relationships are the associations that there exist between the meanings of words (semantic relationships at word level), between the meanings of phrases, or between the meanings of sentences (semantic relationships at phrase or sentence level). Following is a description of such relationships.

Analyzable anti-attack network security method and system based on AI unified model

The invention provides an analyzable anti-attack network security method and system based on an AI unified model. The method comprises the following steps: S1, carrying out attack source tracing and attack mode identification on an input data stream; s2, performing protocol structure analysis and grammar element extraction on the input data stream in a grammar verification layer, and starting a grammar rule matching process to obtain a grammar exception perception set; s3, fusing attack vector information on the basis of a grammar anomaly perception set in a semantic analysis layer, constructing a semantic relation graph, and outputting a semantic risk vector; s4, taking the semantic risk vector as input, combining a business scene, resource constraint and strategy preference, modeling a defense target, and outputting an optimal response path; and S5, forming a model evolution path based on local feedback and global collaboration. Through a three-layer full-information analysis mechanism and behavior feedback driving, interpretable recognition of attack intentions and collaborative optimization of defense paths are realized, attack recognition is comprehensive, response decision is accurate, and strategy evolution is controllable.
Owner:SHENZHEN CESTBON TECH CO

Knowledge graph construction method and system based on large model technology

The invention relates to the technical field of artificial intelligence, in particular to a knowledge graph construction method and system based on a large model technology, and the method comprises the following steps: carrying out large model enhanced data annotation; performing entity extraction, relationship extraction, event extraction and causal relationship extraction by utilizing the large model; performing entity type extraction, relation type extraction, event type extraction and knowledge system extraction by utilizing the large model; the knowledge graph data is complemented by using a large model, so that the knowledge complementing capability is improved; performing relation reasoning and event reasoning by using the large model; the knowledge graph construction method and system based on the large model technology have the beneficial effects that the large model masters strong semantic understanding and context reasoning capabilities through deep learning and wide corpus training. Therefore, the knowledge graph can more accurately analyze the complex semantic relationship in the text and identify important entities and relationships hidden in the text, so that the information is effectively classified and integrated.
Owner:BEIJING INSPUR CLOUD COMPUTING CO LTD

Data risk management system and method based on large model

The invention discloses a data risk management system and method based on a large model, and relates to the technical field of data risk identification, and the data risk management method specifically comprises the following steps: obtaining data; the obtained data is preprocessed; analyzing data by using a large model, constructing a data relation graph, and identifying a potential hidden relation; performing association rule mining to obtain semantic association among the data; obtaining time sequence dependence among the data through dynamic time warping; carrying out correlation analysis through multi-modal fusion by taking the hidden relationship, the semantic association and the time sequence dependence as references; introducing a sensitivity dynamic grading and confidence correction mechanism to fit a risk assessment function; constructing a dynamic threshold function according to time, space and confidence feedback of the large model as elements; and providing coping suggestions according to the risk assessment result. According to the method, the hidden association between the data is identified, semantic analysis and time sequence dependency are combined, a risk assessment function is fitted, and the risk identification accuracy is improved.
Owner:上海市大数据中心

Intelligent dialogue method, system and device based on big language model illusion relief and medium

The invention relates to the technical field of artificial intelligence, and provides an intelligent dialogue method, system and device based on big language model illusion alleviation and a medium, and the method comprises the steps: outputting multiple rounds of heuristic answer results, stimulation thinking results and self-reflection results based on an input question through a big language model; generating a reasoning chain based on the heuristic answer result, the stimulation thinking result and the self-reflection result of the same round; performing logic semantic relationship detection on each reasoning chain through a small language model to obtain a target reasoning chain with a correct relationship; and extracting and outputting a target answer of the input question from the target reasoning chain. According to the intelligent dialogue method based on big language model illusion relief, the big language model is used for forming an inference chain, the small language model is used for analyzing the output of the big language model, inaccurate information can be accurately recognized and filtered out, staged cooperation between the two models is achieved, the limitation that the big language model conducts illusion detection in a self-reflection mode is overcome, and the intelligent dialogue efficiency is improved. And a result can be accurately output.
Owner:BEIJING NORMAL UNIVERSITY

AI Systems and Methods for Automated Dispute Resolution, Semantic Analysis, and Predictive Decision-Making

An AI-driven system for automated dispute resolution employs natural language processing to analyze claims and arguments, extracting semantic relationships to construct a structured data model. A reasoning module evaluates this model against a database of precedents and legal principles, generating decision scores for potential outcomes. The user interface presents visual representations of the analysis, allowing decision-makers to interactively explore and modify inputs. A decision recommendation module proposes resolutions based on criteria such as novelty, legal sufficiency, and compliance with jurisdictional laws.
Owner:OMALLEY MATT

Urban rainstorm flood disaster chain affair map construction method and system

The invention belongs to the technical field of knowledge graph construction, and discloses an urban rainstorm flood disaster chain affair graph construction method and system, and the method comprises the steps: firstly obtaining a research document, a first historical event and a secondary event, constructing a disaster chain directed network graph, and constructing an ontology model according to the disaster chain directed network graph; acquiring a second historical event and a secondary event, preprocessing, and inputting into the ontology model to obtain an event corpus; extracting event trigger words from a corpus to build a database by using a multi-modal dynamic fusion model MDF-Net; performing event extraction in a corpus according to the trigger word to obtain an event type and an argument; extracting a time sequence, a spatial relationship and a semantic relationship of a trigger word by using an improved ELCTRA-BiLSTM model; and finally, constructing a disaster chain affair map by taking the event type, the argument, the time sequence and the spatial relationship as nodes and taking the semantic relationship as an edge. According to the method, multi-source data and complex disaster information can be effectively integrated, and the integrity and accuracy of the urban rainstorm flood disaster chain affair map are improved.
Owner:NANCHANG INST OF TECH

Lightweight multi-modal content identification system based on double-track migration framework

The invention discloses a lightweight multi-modal content recognition system based on a double-track migration framework, and relates to the technical field of content recognition, and the system comprises a data collection module which is used for synchronously collecting multi-source content of a text and an image and carrying out standardization processing and tensor construction to form a fusion tensor X; and the model construction module is used for inputting the fusion tensor into a dual-track migration structure constructed based on a Transform backbone network, and the dual-track migration structure realizes task semantic alignment and structure migration under parameter freezing through Prompt Learning embedding and Adapter-Tuning insertion, and outputs an intermediate representation of modal alignment. According to the method, the training and deployment cost of multi-modal content recognition is remarkably reduced, the semantic expression ability in the modal is enhanced, the cross-modal alignment precision and fusion depth are effectively improved, and the perception and recognition ability of the model to the complex semantic relationship is enhanced.
Owner:CCTV INT NETWORK CO LTD

Large model defense method based on multi-view image-text conversion

The invention discloses a large model defense method based on multi-view image-text conversion, and relates to the technical field of artificial intelligence security. The method comprises the steps of obtaining an image-text dialogue prompt word text, extracting syntactic structure parameters and semantic parameters of statements, splicing the syntactic structure parameters and the semantic parameters into a multi-modal tensor, and expanding a spliced vector into a plurality of structure vectors according to semantic relationship density to form a semantic structure vector group. According to the method, semantic density splitting and image space mapping of the multi-modal tensor are utilized, the cross-modal correlation analysis capability is enhanced, the image-text mixed attack path is accurately identified, and the entity mapping relation between the pixel gradient and the regional mask is combined, so that two-way verification of image-text semantic consistency is realized, and semantic fault vulnerabilities of single-modal detection are eliminated; a path intensity and instruction word dynamic weight fusion mechanism is adopted, the abnormal risk level of a statement structure is quantified, the adaptive limitation of a static rule to semantic variation is broken through, and the illegal content output probability is reduced.
Owner:UNIV OF SCI & TECH BEIJING +2

Techniques for learning co-engagement and semantic relationships using graph neural networks

One embodiment of a method for training a machine learning model includes generating a graph based on one or more semantic concepts associated with a plurality of entities and user engagement with the plurality of entities, and performing one or more operations to train an untrained machine learning model based on the graph to generate a trained machine learning model.
Owner:NETFLIX INC

A multi-channel short text matching method integrating external knowledge and syntactic structure

The invention discloses a multi-channel short text matching method integrating external knowledge and syntactic structure, belonging to the field of deep learning technology, the method is based on the acquired text to be matched, based on the semantic relationship of the semantic original in the external knowledge base HowNet, the semantic similarity between words is calculated by topological distance, and the semantic original similarity matrix between words is determined; the attention weight of each word in the text is obtained by calculating the attention score of the text; according to the semantic original similarity matrix between words and the attention weight of each word in the text, the semantic feature vector of the text pair integrating the semantic original information is generated; by parsing the dependency relationship of the text and constructing a dependency structure graph, the nodes, edges and features of the graph are encoded as vector representations, and the syntactic structure feature vector of the text is obtained; the semantic feature vector and the syntactic structure feature vector are fused to obtain a comprehensive feature vector and input it into a classifier, and the text matching result is output. The method can achieve accurate matching of short texts.
Owner:CHANGAN UNIV

Rapid cross-modal retrieval method and system fusing fine-grained semantics

The invention belongs to the technical field of cross-modal information retrieval, and provides a quick cross-modal retrieval method and system fused with fine-grained semanteme, multi-modal data to be retrieved are obtained, a trained cross-modal retrieval model is used for learning to obtain continuous Hash features, discrete Hash codes are generated according to the continuous Hash features, and the multi-modal data to be retrieved are retrieved according to the discrete Hash codes. Performing cross-modal matching and retrieval based on Hamming distance matching, and feeding back a retrieval result; in the training process of the cross-modal retrieval model, the fusion loss function, the cross-modal alignment loss function and the shared subspace loss function are subjected to weighted fusion, and corresponding parameters are optimized with the purpose of minimizing the total loss function after weighted fusion until training requirements are met. According to the method, the cross-modal semantic consistency among different modal features is optimized, so that the generated Hash code can reflect semantic association among multi-modal data more accurately, and the precision and efficiency of cross-modal retrieval are improved.
Owner:SHANDONG UNIV

Camouflage target detection method and system based on dual-domain fusion enhanced network

The invention discloses a camouflage target detection method and system based on a double-domain fusion enhanced network, and relates to the technical field of target detection. Through the nonlinear double-domain fusion module, in combination with nonlinear mapping of a spatial domain and a frequency domain, key difference characteristics of a frequency domain amplitude spectrum and a phase spectrum are captured, the problem that the detection performance is reduced in a scene of low contrast and the like depending on an RGB spatial domain is solved, and the target discrimination degree is improved; based on a lightweight scale perception modulation converter and a double-feature fusion module, multi-scale features are extracted, aligned and fused, a semantic relation is integrated by means of cross attention, and the problems of detail loss and boundary fuzziness caused by scale diversity are solved; the context feature enhancement module integrates cross attention and edge auxiliary injection, accumulates multi-layer feature integration, gives consideration to a global boundary and a local structure, effectively reduces false detection, missing detection and edge roughness, and further enhances robustness through multi-layer auxiliary supervision.
Owner:XIHUA UNIV

Enterprise knowledge graph automatic construction and intelligent retrieval method

The invention provides an enterprise knowledge graph automatic construction and intelligent retrieval method, which comprises the following steps: collecting multi-source data from a heterogeneous enterprise information system, and carrying out data cleaning and standardization processing; on the basis of a comprehensive scoring mechanism of field similarity and behavior semantic vectors, entities from different systems are merged, and a standard entity set with a unique identifier is generated; based on the standard entity set, in combination with a scoring mechanism of a task-type relationship and a collaborative relationship, extracting a semantic relationship from a behavior record, and constructing an enterprise knowledge graph structure; extracting representative semantic paths from the knowledge graph structure, screening high-quality paths through a path scoring model, and organizing the high-quality paths into a structured path index set; and receiving a natural language query statement, encoding the natural language query statement into a semantic vector, matching the semantic vector with the path index set, executing query in the atlas in combination with an authority control mechanism, and returning a result.
Owner:SHANGYANG TECH CO LTD

Multi-modal video sequence segmentation method based on multi-scale codec

The invention discloses a multi-modal video sequence segmentation method based on a multi-scale codec. The method comprises the following steps: extracting image features and text features; joint feature representation containing image and language semantic information at the same time is obtained; extracting a multi-scale fusion feature sequence under different spatial resolutions; obtaining a feature representation sequence after space-time modeling; cross-scale fusion feature representation in a unified semantic space is obtained; foreground features are obtained; and performing visual visualization on the segmentation mask to generate a semantic segmentation map. According to the multi-modal video sequence segmentation method, deep interaction of image and language semantics can be realized, a context and semantic relationship is established, cross-modal information interaction is introduced through a multi-modal cooperation mechanism, the robustness and stability of a model in a complex dynamic scene are enhanced, and the segmentation efficiency is improved. And the segmentation effect and generalization ability of the image sequence segmentation model in the segmentation task are effectively improved.
Owner:HARBIN INST OF TECH AT WEIHAI +1

Extensible remote sensing deep learning sample library construction method based on target region planning

The invention provides an extensible remote sensing deep learning sample library construction method based on target region planning, which is applied to the technical field of remote sensing image processing, and comprises the following steps: determining target region ranges of a plurality of target regions based on image resolution and a plurality of target region center points; performing cutting and coding naming on the target region remote sensing image based on the vector boundary of the target region range and a preset coding rule to obtain coarse samples corresponding to the plurality of target regions respectively; inputting the coarse sample subjected to feature enhancement processing into a large language model to obtain corpus data of the coarse sample output by the large language model; performing feature alignment with the coarse sample based on the semantic relationship to obtain a feature semantic mapping result of the coarse sample; constructing a coarse sample knowledge graph based on the semantic relationship information and the feature semantic mapping result; and inputting the coarse sample knowledge graph into the open vocabulary target detection model to obtain potential samples output by the open vocabulary target detection model. According to the invention, dynamic extensible labeling of large-scale remote sensing samples can be realized.
Owner:AEROSPACE INFORMATION RES INST CAS

Text classification method and system based on semantic analysis

The invention relates to the technical field of text processing, in particular to a text classification method and system based on semantic analysis, and the method comprises the following steps: segmenting semantic units, constructing a direction change sequence, positioning mutation nodes, generating a consistency section, forming a convergence section, and outputting a classification result. According to the method, a continuous change sequence is formed by constructing a semantic embedding vector and calculating a direction difference, a semantic mutation point can be anchored and divided into sections by combining mutation intensity identification and local jump tracking, and a semantic closed structure and a convergence section are extracted by means of context direction consistency judgment and generic label comparison; precise recognition of a semantic relation chain is realized, semantic jump and conflict starting points can be dynamically sensed, the semantic boundary recognition capability is improved, and the understanding and classification capability of a model on semantic attribution in a complex context is enhanced on the premise of not depending on a fixed dictionary and shallow statistics. The problems that a traditional model is slow in response to an abrupt change structure and weak in semantic convergence recognition are effectively solved.
Owner:上海笑聘网络科技有限公司

Anti-fact multi-mode dialogue emotion causal reasoning method based on double-branch hypergraph

The invention discloses an anti-fact multi-mode dialogue emotion causal reasoning method based on a double-branch hypergraph. The method comprises the following steps: respectively extracting sentence level feature vectors of three modes of text, voice and vision from input multi-mode dialogue data; carrying out modeling on a high-order relationship in the modals and between the modals by utilizing a hypergraph structure, and constructing a dialogue hypergraph containing multi-modal nodes and emotion nodes; introducing a hypergraph attention network on the hypergraph, learning contribution weight of each modal node to a target emotion node, and selecting a candidate reason node set; the candidate reason nodes are intervened, an anti-fact branch is constructed, a fact situation and final node feature representation under the anti-fact situation are calculated, and a causal effect vector is obtained; and designing a joint optimization objective function, and carrying out joint training on emotion recognition loss and causal consistency loss to realize synchronous prediction of emotion categories and emotion reasons. According to the method, a high-order semantic relationship can be effectively modeled in a multi-modal dialogue scene, and a key reason for emotion formation is reasoned.
Owner:JIANGSU UNIV

Generation graph diffusion model concept erasing method based on semantic enhancement and collaborative retention

The invention provides a text graph diffusion model concept erasing method based on semantic enhancement and collaborative retention. The method comprises the steps that a target concept needing to be erased is defined, an erasure model is initialized based on a pre-trained diffusion model, preheating training is conducted on the initialized erasure model through the target concept, and a preheated erasure model is obtained; through word embedding in a predefined template library, generating an aggressive prompt capable of triggering a target concept by using the preheated erasing model; updating the preheated erasure model by utilizing aggressive prompt through a self-check and self-erasure mechanism in the erasure model to obtain an updated erasure model; and through global semantic relation alignment and local prediction noise retention, the generation capability of the updated erasing model on the non-target concept is optimized. According to the method, through a semantic enhancement erasing mechanism, erasing of the conceptual words is effectively expanded to the whole conceptual domain from a single vocabulary, and therefore the generalization ability of the model in different situations is remarkably improved.
Owner:BEIJING JIAOTONG UNIV

Cultural symbol transmission method and system based on Sichuan opera facial makeup art patterns

The invention provides a culture symbol transmission method and system based on Sichuan opera facial makeup art patterns, and particularly relates to the field of facial makeup digital transmission. According to the method, multi-level modeling of a Sichuan opera facial makeup pattern from a pixel layer to a component layer and then to a semantic layer is realized by fusing image processing, component contour matching, image structure modeling and an image neural network technology; according to the method, main and auxiliary color block areas and component information in an image can be automatically identified and structurally stored, a spatial semantic relationship of the image is learned through a graph neural network, a structural semantic code is output, and finally a multi-dimensional cultural label index capable of being filed, clustered and classified is generated; the method effectively overcomes the limitation that in the prior art, only stays at an image level and is lack of structure and semantic modeling, enables the Sichuan opera facial makeup pattern to have machine-readable component structure representation and semantic feature representation, and lays a foundation for cultural inheritance and intelligent propagation.
Owner:CHENGDU UNIVERSITY OF TECHNOLOGY

Multi-mode knowledge representation learning method fusing multi-attention mechanism and semantic enhancement

The invention relates to a multi-modal knowledge representation learning method fusing a multi-attention mechanism and semantic enhancement, and aims to solve the problems that the multi-modal knowledge representation method is insufficient in multi-modal feature fusion and difficult to effectively model complex semantic relationships such as symmetric and anti-symmetric. The method comprises the following steps: firstly, extracting entity image and text features from a multi-modal knowledge graph by using a CLIP model, and extracting entity audio features by using a VGGish model; then image features are enhanced through spatial attention, and image-text feature fusion is realized through cross attention; designing a cross-modal fusion module to dynamically fuse the image-text features and the audio features to obtain multi-modal fusion features; and finally, extracting structured features based on a ComplEx model, integrating the structured features with multi-modal fusion features through an adaptive dual-channel scoring function, and optimizing a training process by adopting a contrast learning loss function. The multi-modal features can be fully fused, the semantic expression ability is enhanced, and the performance of downstream tasks such as intelligent question and answer is improved.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

AI medical information accurate retrieval method based on knowledge graph

The invention discloses an AI medical information accurate retrieval method based on a knowledge graph, and belongs to the field of medical information, and the method comprises the steps: collecting and integrating multi-source medical data, employing an entity recognition and relation extraction technology, accurately extracting medical entities and semantic relations, and constructing a complete and accurate medical knowledge graph; according to the method, the medical knowledge graph is constructed, query is converted into a query sub-graph structure in combination with a natural language processing technology, and the FFGR algorithm is applied to fuse attributes, structures and semantic features of nodes to calculate a comprehensive score, so that the correlation between the nodes and the query can be accurately evaluated; the potential relationship can be deeply mined when the complex disease query is processed; the DKU algorithm utilizes a deep learning model to carry out feature extraction and relation prediction on new data, and the structure and content of the knowledge graph are updated in real time. And new diseases, medicines and relationships can be timely reflected in the knowledge graph, so that the retrieval result is always based on the latest medical knowledge.
Owner:HARBIN YIXUN TECHNOLOGY CO LTD

Multi-modal data fusion modeling method and system based on multi-task learning

The invention relates to the technical field of artificial intelligence, and provides a multi-modal data fusion modeling method based on multi-task learning, and the method comprises the steps: respectively extracting image and text features in data, and carrying out the fusion to obtain first fusion data; respectively inputting the fused data into a Transform decoder and at least two weight layers for processing, and fusing the fused data with the original fused data again through a self-adaptive gating layer to obtain second fused data; and finally, based on the second fusion data, respectively calculating classification loss and comparison loss, and when the two types of loss meet preset conditions, outputting a final multi-modal data fusion model. The invention further discloses a system. According to the method and the system, the semantic alignment between the image and the text is enhanced, the cross-modal semantic problem is effectively solved, and the understanding ability of the model to the complex semantic relationship is improved. The model is enhanced to have adaptability in different task scenes, the generalization ability and robustness of the model are remarkably improved, and data noise is reduced.
Owner:SHANDONG COMP SCI CENTNAT SUPERCOMP CENT IN JINAN

Method and system for constructing sparse visual angle three-dimensional Gaussian language field for humanoid robot grabbing

The invention discloses a sparse view angle three-dimensional Gaussian language field construction method and system for humanoid robot grabbing. Comprising the following steps: acquiring an RGB image set and a user natural language instruction under a sparse view angle; reconstructing a three-dimensional point cloud through stereo matching, and initializing a three-dimensional Gaussian primitive field after noise elimination and measurement alignment; two-dimensional semantic features are embedded into the field, joint optimization is carried out through a double-path semantic supervision module, and a three-dimensional Gaussian language field with consistent semantics is constructed; wherein the dual-path semantic supervision comprises an object perception path and a global context path, the local semantic consistency and the overall semantic relationship are constrained respectively, and the final semantic representation of each Gaussian primitive is obtained through weighted fusion; and finally, candidate grabbing postures are generated, semantic reordering is carried out in combination with a language instruction, and the optimal grabbing posture is screened through geometric-semantic joint scoring. Under the sparse image set input condition, the execution accuracy of a robot grabbing task under a complex instruction can be improved.
Owner:HUNAN UNIV

Intelligent dialogue memory management method and system based on logistics field

The invention discloses an intelligent dialogue memory management method and system based on the logistics field, and relates to the technical field of logistics intelligent dialogues, and the method comprises the steps: obtaining the historical logistics dialogue data of a target user, generating a user feature-interactive entity-semantic relationship initial knowledge graph based on a QWen2.5-32B large language model, and constructing a Milvus semantic vector library; monitoring a logistics dialogue flow in real time, and starting an adaptive memory management mechanism by taking three rounds of dialogue as a judgment threshold value; extracting user dialogue content attribute features and behavior preferences, and dynamically updating a user feature-interactive entity-semantic relationship initial knowledge graph and a Milvus semantic vector library; and triggering a logistics dialogue according to a target user, starting a multi-modal memory recall mechanism, cooperatively retrieving a user feature-interactive entity-semantic relationship knowledge graph and a Milvus semantic vector library, generating a personalized intelligent dialogue response, and realizing a logistics intelligent dialogue memory management closed loop. The beneficial effect of the invention is that the intelligent and personalized capabilities of the system are enhanced.
Owner:SHANGHAI YUANQING INFORMATION TECH CO LTD

Method and system for searching questions and answers in combination with ElasticSearch and AI

The invention relates to the technical field of data search, and particularly discloses a search question and answer method combining ElasticSearch and AI. Comprising the steps of classifying questions in advance, then obtaining the questions input by a user, preprocessing the questions to obtain question text feature data, then calculating the question text feature data to obtain question classification values, and judging whether the question classification values are within a preset threshold interval or not; according to the method, the BERT model and the internal neural network structure thereof can be utilized to calculate the question classification probability and determine the final classification result, and compared with a relatively simple question classification mode in an RAG technology, the method has obvious advantages; the deep semantic relationship of the question cannot be fully considered during classification by the RAG technology, so that the classification is inaccurate, and the phenomenon that the question is difficult to answer or is not answered can occur, so that the user experience can be effectively improved, and the user stickiness is improved.
Owner:REACH24H CONSULTING GRP CO LTD

Coal geology field sentence semantic embedding modeling method based on multi-task learning

The invention discloses a coal geology field sentence semantic embedding modeling method based on multi-task learning. The method comprises the following steps of coal geology corpus collection and preprocessing; constructing and marking a geological entity dictionary, and generating a geological domain exclusive entity data set; establishing a multi-task learning model structure based on a Chinese BERT model; performing sentence vector generation vector extraction and evaluation on statements in the coal geology field by using the trained model; the multi-task learning-based model provided by the invention is applied to a downstream scene. According to the coal geology field sentence semantic embedding modeling method based on multi-task learning, sentence vector modeling and entity recognition tasks are jointly optimized, so that the model can more accurately understand the semantic relation between key metal elements and minerals in coal, sentence representation with more field semantic features is output, and the sentence semantic embedding modeling efficiency is improved. And the understanding, classification and knowledge expression capabilities of the coal geology text are improved.
Owner:CHINA UNIV OF MINING & TECH (BEIJING)

A lightweight multimodal content recognition system based on a dual-track transfer framework

This invention discloses a lightweight multimodal content recognition system based on a dual-track transfer framework, belonging to the field of content recognition technology. It includes a data acquisition module for simultaneously acquiring multi-source content from text and images, performing standardization processing and tensor construction to form a fused tensor X; and a model construction module for inputting the fused tensor into a dual-track transfer structure built on a Transformer backbone network. This dual-track transfer structure achieves task semantic alignment and structural transfer under parameter freezing through Prompt Learning embedding and Adapter-Tuning insertion, outputting an intermediate representation of modality alignment. This invention significantly reduces the training and deployment costs of multimodal content recognition, enhances the semantic expression capabilities within modalities, effectively improves cross-modal alignment accuracy and fusion depth, and enhances the model's ability to perceive and recognize complex semantic relationships.
Owner:CCTV INT NETWORK CO LTD

A cross-modal image text retrieval method based on deep learning

The present invention discloses a cross-modal image text retrieval method based on deep learning, and proposes a novel cross-modal feature extraction and alignment framework. By learning the semantic representation of images and texts in a common feature space, efficient cross-modal retrieval is performed. The framework includes multiple modules. In the feature extraction stage, BERT Tokenizer and BERT Embedding are used for text encoding, and Faster R-CNN and ResNet-101 models are combined for image feature extraction to ensure the dimensional consistency of image and text features. In the feature alignment stage, fine-grained semantic alignment of image and text features is achieved through I2T Attention and T2I Attention modules, which significantly improves the accuracy of cross-modal matching. In the relevance scoring stage, the relevance scoring matrix is ​​generated by calculating the similarity scores between image features and text features, and the feature alignment effect is further optimized through normalization and attention redistribution. In the optimization stage, the system innovatively adopts the shared semantics and ranking loss strategy, and integrates the OpenCLIP model framework. By contrastive learning, the semantic relationship between images and texts is efficiently mined from large-scale unlabeled data, showing strong transfer learning capabilities and inference accuracy.
Owner:SOUTHEAST UNIV

Method and system for searching by combining user input information

The invention discloses a method and a system for searching by combining user input information, and particularly relates to the technical field of language paragraption.The method comprises the following steps: firstly, converting a plurality of user inputs into an input semantic structure containing keywords, semantic relationships and context tags; comparing the structures, extracting interactive focuses and generating a semantic consensus score; constructing a fusion path diagram according to the consensus score, the keyword weight and the semantic adaptation degree; semantic fusion and conflict mediation are executed according to the path diagram, and a unified expression structure is generated; and finally, sorting the keywords according to semantic levels and task orientation, and constructing a comprehensive search expression to finish query output. According to the method, through semantic analysis and cross comparison input by multiple users, the consensus content is extracted, the fusion path diagram is constructed, and it is ensured that the fusion sequence is reasonable and semantic consistency is achieved; and finally, a comprehensive semantic expression structure is generated and a search expression is constructed, so that accurate alignment of query contents and user intentions is realized, and representativeness and accuracy of search results are improved.
Owner:SHANGHAI LICHI MEDICAL TECHNOLOGY CO LTD

Intelligent processing method and system from structured data to text based on natural language

The invention provides an intelligent processing method and system from structured data to a text based on a natural language, and relates to the technical field of data processing.The method comprises the steps that the text chunk analysis process is optimized and adjusted according to analysis optimization parameters, sentences are segmented into non-overlapping phrases with syntactic function labels, and the text after chunk analysis is obtained; performing syntactic and semantic structure analysis on the text subjected to block analysis, and establishing a semantic association relationship between internal structures of sentences through component analysis, dependency analysis and semantic dependency graph analysis to obtain structured semantic information; performing multi-sentence logic association analysis on the structured semantic information on a chapter level to obtain semantic information of the whole chapter; and based on the semantic information of the overall chapter, obtaining a target natural language text by utilizing a pre-trained large language model. According to the method, the accuracy and fluency of conversion from the structured data to the text are improved.
Owner:厦门知链科技有限公司