Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2134 results about "Semantic representation" patented technology

Semantic representation is an abstract (formal) language in which meanings can be represented. Opinions differ about whether semantic representation is sufficient or necessary, about its form and about how it relates to syntactic representations.

Multi-source heterogeneous data fusion and processing method based on big data

The present invention relates to the technical field of big data processing, and discloses a multi-source heterogeneous data fusion and processing method based on big data, including the following steps: data preprocessing, cleaning, complementing and feature extraction of multi-source heterogeneous data, providing standardized and high-quality input for subsequent processing; dynamic knowledge graph modeling, constructing a dynamic knowledge graph based on the semantic relationship of multi-source data, and generating a unified semantic representation; cross-modal alignment and deep fusion, semantically aligning multi-modal data, and generating a unified comprehensive representation through deep fusion of features; real-time stream processing, dynamically updating and processing real-time updated stream data to achieve real-time fusion of data; adaptive optimization, dynamically adjusting fusion strategy parameters, and improving the adaptability and robustness of the fusion strategy. The present invention realizes efficient fusion, real-time processing and semantic consistency expression of multi-source heterogeneous data through dynamic knowledge graph modeling, cross-modal alignment, real-time stream processing and adaptive optimization.
Owner:CHENGDU BIG DATA GRP CO LTD

Method for constructing knowledge graph based on large language model and vector library

The invention discloses a method for constructing a knowledge graph based on a large language model and a vector library, and relates to the technical field of knowledge graphs, and the method comprises the following steps: carrying out word segmentation, part-of-speech tagging and semantic analysis processing on a collected natural language text by using a pre-trained RoBERTa model to obtain a semantic representation vector of the natural language text; through a Seq2Seq framework and an attention mechanism, obtaining association between the semantic representation vector and the corresponding named entity, and obtaining the named entity through the obtained association; constructing a knowledge graph; fusing the constructed knowledge graph with a relational database of a preset field to generate a fused knowledge graph; named entities and corresponding attributes are obtained through dependency syntax analysis, the entity relation of the named entities is obtained, and a structured triple fusing the named entities, the attributes and the entity relation of the knowledge graph is constructed. In order to solve the problem of high entity linking difficulty in the prior art, the knowledge graph is converted into low-dimensional dense vector representation, and an inverted index database and the like are constructed, so that the difficulty is reduced.
Owner:北京长河数智科技有限责任公司 +1

Long text information extraction and association analysis method and system based on large model

The present invention provides a method and system for extracting and analyzing long text information and association based on a large model, which relates to the technical field of natural language processing, including determining sliding window parameters based on semantic density values ​​to divide long text into blocks, extracting feature vectors of text blocks and calculating semantic relevance, and constructing a hierarchical clustering feature matrix to merge text blocks to obtain semantic fragments. Afterwards, the semantic fragments are syntactically analyzed to construct a semantic dependency tree, and the semantic network is extracted and the entity relationship strength value is calculated to construct a semantic association graph. Finally, the node features are extracted using a pre-trained large model, the semantic representation is fused through a hierarchical attention mechanism, the features are enhanced by propagating an adaptive graph network, and candidate paths are generated through a hierarchical decision network, the optimal path is selected, and the associated path and probability distribution are output. The present invention can effectively extract key information from long texts and analyze the association relationship between entities, thereby improving the accuracy and efficiency of information extraction.
Owner:BEIJING FEIRUI XINGTU TECH CO LTD

Simulation system intelligent decision-making method and system based on knowledge graph and federated learning

The invention relates to the technical field of intelligent decision making, in particular to a simulation system intelligent decision making method and system based on a knowledge graph and federated learning, and the method comprises the steps that each simulation node constructs a knowledge graph sub-graph based on local dynamic data, and multi-modal semantic representation is generated through space-time modeling and event chain reasoning; the federal center initializes a simulation decision model architecture and issues the simulation decision model architecture to each node; each node uses a local knowledge graph to train a time sequence diagram network, extracts an equipment degradation path and abnormal propagation characteristics, and uploads gradient parameters in combination with homomorphic encryption; the federation center fuses the multi-node model through a dynamic weight aggregation algorithm to generate a global decision model; and driving knowledge graph evolution based on real-time data, and performing causal reasoning and decision optimization on an event chain through a federal model. According to the method, the problem of insufficient dynamic decision adaptability in a multi-source data island and privacy sensitive scene in a simulation system is solved.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Knowledge graph construction method and system based on large language model technology

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.
Owner:NAVAL AVIATION UNIV

Intelligent Internet of Things public security management and control system and method based on multi-source data fusion

The invention provides an intelligent Internet of Things public security management and control system and method based on multi-source data fusion, and belongs to the technical field of Internet of Things security. According to the system, unified collection and standardized processing of multi-source data are achieved by recognizing a system operation scene and loading corresponding model parameters and response strategies, and a unified semantic representation structure is constructed. And the system executes anomaly detection at an edge node, completes risk scoring and grading alarm judgment in combination with a semantic structure and anomaly feature information, and generates a control response instruction based on strategy matching. Meanwhile, dynamic optimization of the scoring model and identity authentication, behavior auditing and data compliance export in the operation process are supported. The system has intelligent identification, adaptive analysis and response closed loop capabilities, and improves the precision and credibility of public security management in the Internet of Things environment.
Owner:诚创智能科技(江苏)有限公司

Commodity information processing and querying method and system

The invention provides a commodity information processing and querying method and system. Belongs to the technical field of information processing. The method comprises the steps of collecting text information of commodities, preprocessing the text information of the commodities through natural language processing information, and constructing a structured commodity text database; based on the high-definition image of the commodity, key features of the commodity are extracted through machine vision and are associated with information in the text database to form multi-modal commodity information representation; the method comprises the following steps: encoding a commodity text by adopting a BERT model based on Transform, and obtaining a deep semantic representation of the text; performing feature extraction on the commodity image by using a pre-trained convolutional neural network to obtain an advanced visual feature of the image; through natural language processing and machine vision technologies, the text information and the image information of the commodity are subjected to structured and multi-modal fusion, so that the processing efficiency of the commodity information is greatly improved.
Owner:万联易达物流科技有限公司

Intelligent question-answering system optimization method and device based on knowledge graph

The invention relates to an intelligent question-answering system optimization method and device based on a knowledge graph, and the method comprises the steps: obtaining original knowledge data of a target knowledge domain, and constructing a knowledge graph structure model; extracting term information of entity nodes in the knowledge graph structure model, and constructing an entity term set; receiving a natural language question input by a user, executing a semantic understanding operation based on the standardized expression set to obtain a structured question semantic representation, and matching the question semantic representation with the case training set to obtain context semantic features; constructing a cue word template, and executing a query instruction generation operation to obtain a target query statement of the graph database; submitting the target query statement to a graph database to execute data retrieval operation, and obtaining query result data corresponding to the question semantic representation; and performing personalized rendering processing on the query result data based on the user portrait information to generate final question and answer return content. The method has the effect of improving the query accuracy.
Owner:PENGHUA FUND MANAGEMENT CO LTD

Content recommendation method and system based on semantic recognition

ActiveCN119089398AAccurate semantic representation of dataEfficient learning processSemantic analysisBiological modelsPersonalizationProcessing
The invention discloses a content recommendation method and system based on semantic recognition, and the method comprises the steps: analyzing the text, voice or video input of a user through a natural language processing technology, and generating user semantic representation data; the method comprises the following steps: dynamically constructing a user interest graph by combining user historical behavior data, and performing representation learning of nodes and edges through a multilayer graph convolutional network to generate time sequence user interest graph representation data; a self-attention mechanism and a multi-head attention mechanism of a Transform model are utilized, the matching degree of user interest representation and recommended content is optimized in combination with a contrast learning module, and personalized recommended content data are generated; collecting multi-modal information of the user, fusing the multi-modal information with the personalized recommendation content data, and generating optimized multi-modal recommendation content data through a multi-modal fusion algorithm; and collecting user feedback feature data, and dynamically adjusting and optimizing a generation strategy of recommended content through an adaptive learning algorithm. According to the invention, efficient, accurate and personalized recommendation of the recommendation system is realized, and the user experience is improved.
Owner:HANGZHOU SCENE INNOVATION CENTER CO LTD

Large model enhanced code security detection method

The invention discloses a large model enhanced code security detection method. The method comprises the following steps: dynamically associating CVE vulnerability features with code semantic representation through a knowledge graph construction module; extracting vulnerability features from a CVE vulnerability library by utilizing a knowledge graph construction module, and dynamically associating the vulnerability features with code semantics; based on the CodeQL standard, a query language is generated by adopting a large model and input into CodeQL for AST analysis, and code structure features are extracted; the large model generates a query language meeting the CodeQL standard, codes are analyzed through CodeQL, and key structure features are extracted; integrating a static analysis tool chain to carry out multi-dimensional credible verification on model output; integrating an SAST tool and a symbolic execution tool, and verifying the model output from different dimensions; and summarizing and fusing detection results of the enhancement layers, and determining a final detection result by adopting a decision optimization method. According to the method, through technical fusion and dynamic optimization, the problems of rule stiffness, one-sided detection and low result credibility are systematically solved.
Owner:SOUTHWEST JIAOTONG UNIV

Multi-agent task cooperation method, device and equipment and storage medium

The invention provides a multi-agent task collaboration method, device and equipment and a storage medium, and the method comprises the steps: carrying out the deep fusion and unified semantic coding of a collected multi-modal data set through a multi-modal large language model, and obtaining a high-dimensional cross-modal feature embedding and semantic representation file, the task requirement mapping module is used for enabling local task requirements of multiple agents to correspond to cross-modal semantics to obtain task requirement semantic mapping, and task division and time arrangement are carried out; when multiple agents execute tasks, key data and operation results are sampled in real time and compared with high-dimensional semantic representation, a concept offset detection result is obtained, and when it is detected that the concept drifts progressively, the multi-modal large language model is dynamically adjusted. According to the method, the communication and cooperation efficiency among multiple agents is enhanced by using a large language model, and task allocation and collaborative decision are optimized through task demand semantic mapping; and concept drift detection and a dynamic adjustment mechanism are introduced, so that the long-term adaptability in a complex dynamic environment is improved.
Owner:SHENZHEN FUTURE QINGYAN INTELLIGENT TECHNOLOGY CO LTD

Multi-layer semantic understanding large model agent construction and application method

The invention discloses a multi-layer semantic understanding large model agent construction and application method. The method comprises the following steps: S1, preprocessing input data; s2, analyzing the preprocessed data by using a large language model and dialogue history, identifying user intentions and extracting deep semantic features; s3, key information is extracted from data intending to be recognized, structured representation is carried out, and model configuration is adjusted through dynamic hyper-parameter optimization; s4, querying the knowledge graph, associating and organizing the extracted key information with the existing data, and generating a structured knowledge representation; s5, vectorizing the structured knowledge representation, and storing the vectorized structured knowledge representation in a vector database to support rapid similarity search; and S6, in combination with the generated unified semantic representation and the large model, performing deep analysis on user input, generating coherent and logical personalized answers, and returning the personalized answers to the user. The method can support various application scenes such as intelligent question and answer, content generation, sentiment analysis and multi-modal search.
Owner:SHANGHAI ENTROPY INFORMATION TECH CO LTD

Multi-data standard definition conflict resolution method based on large model and knowledge graph

The invention relates to a multi-data standard definition conflict resolution method based on a large model and a knowledge graph, and belongs to the field of public data governance and data standardization. The method comprises the following steps: extracting and preprocessing a multi-data standard definition; defining semantic representation and large model analysis: performing semantic analysis on the definition of each data item by using a large model, and generating a semantic embedding vector and a key feature; knowledge graph construction and entity alignment: constructing a knowledge graph containing all data items, and connecting data item nodes with similar semantics in different standards by adopting an entity alignment algorithm to form a candidate alignment relationship; conflict detection and type identification: aiming at the aligned data item definition, comparing attributes and values, identifying definition conflict points, and classifying and marking conflict types; and carrying out conflict resolution and unified definition generation by using a globally optimized conflict resolution algorithm. According to the method, the problems of data islands and semantic conflicts caused by inconsistent data standard definitions in the prior art are solved.
Owner:YUNNAN PROVINCIAL BIG DATA CO LTD

Video timestamp event identification and reasoning method based on multi-modal large model

The embodiment of the invention relates to the technical field of video processing, and particularly discloses a video timestamp event identification and reasoning method based on a multi-modal large model. According to the embodiment of the invention, an input video is processed, and visual information and text information are extracted; performing interaction and fusion on the visual information and the text information to generate a video event semantic representation; and performing event identification on the semantic representation of the video event to obtain an event timestamp mark and event logical reasoning. According to the method, deep fusion and semantic association understanding of multi-modal information such as vision and texts can be realized, the problem that a traditional method is insufficient in semantic consistency and feature expression ability among modals is solved, and deep fusion of multi-modal features and accurate understanding of semantic association are realized; and the frame-level time information can be used as a visual code and a text feature to perform visual text feature alignment, and then video-level modeling is performed, so that the problem that a traditional model cannot directly capture an accurate time frame when a visual event occurs is solved.
Owner:GUANGZHOU INSTITUTE OF TECHNOLOY XIDIAN UNIVERSITY +1

Intelligent law data processing method and system based on big data

The invention discloses an intelligent legal data processing method and system based on big data, and the method comprises the steps: S1, constructing a legal data collection framework, and carrying out the unified coding and representation of different data forms through a multi-modal fusion technology; s2, performing hierarchical semantic analysis on the cross-domain legal clauses to generate a high-dimensional semantic representation vector with context sensing capability; s3, performing node embedding, association analysis and reasoning optimization on the constructed legal knowledge graph to generate a dynamically updated multi-domain legal association network; s4, mapping and optimization among terms are realized through semantic comparison and multi-level rule verification; s5, performing modeling analysis on the dynamic trend and the potential risk factors of the legal data, and outputting a risk prediction and early warning strategy of the legal event; and S6, improving cross-data-source cooperative computing capability and data analysis efficiency through a distributed optimization strategy. The method has the advantages of high semantic understanding depth, high risk prediction accuracy and high privacy protection and cooperative computing efficiency.
Owner:GUIZHOU DAIMA TECH CO LTD

Intelligent monitoring management method and system based on archive digitization

The invention discloses an intelligent monitoring management method and system based on archive digitization, and relates to the technical field of data management, and the method comprises the steps: collecting and preprocessing multi-source archive data, employing a multi-mode BERT model to carry out the feature fusion of different data sources, and generating a unified semantic representation; semantic labeling is performed on archive data through a multi-label classification model, a semantic graph of archive content is constructed by using a graph database, an association relationship between archives is represented, a semantic index tree is constructed based on the semantic graph, and rapid positioning and calling of the archive content are optimized; and recording the change of each file version, positioning the change position based on a semantic index tree, identifying the semantic change of the file through a semantic difference comparison algorithm, recording hash, carrying out granularity division on the file content through the semantic boundary of each level of node in the index tree, and generating a user access strategy. According to the invention, dynamic perception and risk early warning of user behaviors are realized, and the intellectualization and safety of the archive management system are effectively improved.
Owner:XIAN XINCHUANG TECH CO LTD

Digital human interaction control method and device fusing emotional semantics and logical reasoning and storage medium

The invention provides a digital human interaction control method and device fusing emotion semantics and logical reasoning and a storage medium. The method comprises the following steps: analyzing multi-modal input data of a user, constructing emotion-semantics joint representation, and generating a logic decision path; and through a cognitive fusion module, emotion-semantic representation and a logic decision path are fused, and an interaction response adapting to emotion and logic consistency is generated. The system optimizes an emotion semantic model and a logical reasoning rule on line according to user feedback and interaction history, and real-time interaction of emotion dynamic and logical rules is achieved. The system can dynamically adjust the logic decision path based on the multi-mode emotional state of the user, and improves the naturalness and situation adaptability of interaction. A dynamic time warping algorithm and a factorization machine are introduced to process a multi-modal feature fusion problem, and the accuracy and robustness of emotional state recognition are improved. The online optimization mechanism enables the model and the rule to be evolved continuously, and reasoning errors are corrected automatically through user feedback, so that error circulation is avoided.
Owner:HANGZHOU DIGITAL SPACE TECHNOLOGY CO LTD

Drug-disease relation prediction method and system based on dual-channel fusion knowledge graph

The invention relates to a drug-disease relationship prediction method and system based on a dual-channel fusion knowledge graph. The method comprises the following steps: S1, constructing a biomedical fusion knowledge graph; s2, constructing a drug-disease sub-graph based on the biomedicine fusion knowledge graph; s3, constructing a dual-channel adaptive fusion feature module, and embedding a drug-disease sub-graph; s4, performing enhanced splicing on the drug-disease sub-graphs in the dual-channel fusion knowledge graph pre-embedded network, importing an edge-node iterative updating learning mechanism, training a spliced sub-graph relation perception learning network, and obtaining enhanced sub-graph feature embedding; and S5, utilizing the trained enhanced subgraph features to embed, calculate and output the prediction probability of the drug-disease relationship. According to the method, the semantic representation capability of the knowledge graph and the topological modeling advantages of the graph neural network are integrated, and efficient and accurate prediction of the drug-disease relationship is realized through multi-modal feature interaction, sub-graph enhancement and a dynamic sub-graph learning mechanism.
Owner:CENT SOUTH UNIV

Adaptive learning question-answering system and method based on multi-modal interaction

The invention discloses a self-adaptive learning question answering system and method based on multi-modal interaction, and particularly relates to the technical field of self-adaptive learning question answering. By constructing a modal recognition and preprocessing module, standardization and structuralization of multi-modal input of texts, voices, images and the like are realized; establishing a cross-round modal memory map through time sequence coding and map modeling; dynamically updating a user portrait in combination with user interaction history and current modal characteristics; in the question and answer generation process, current input, a user portrait and a historical graph are fused, intermediate semantic representation is generated through a context enhancement module, and the intermediate semantic representation is combined with a knowledge base to generate answers; meanwhile, a modal confidence degree dynamic evaluation mechanism is introduced, and weights are distributed according to the input quality, the user adaptation degree and the context correlation; and finally, incremental optimization is carried out on the graph structure, the user portrait and the question and answer strategy through a user feedback driving system, and multi-round, multi-mode and self-adaptive intelligent question and answer interaction is realized.
Owner:LIAOCHENG UNIV

Intelligent finance and tax question answering method based on artificial intelligence question answering system

The invention discloses an intelligent finance and tax question answering method based on an artificial intelligence question answering system, and the method comprises the steps: S1, generating a structured semantic representation through a natural language processing technology, and generating an intention tag through a machine learning algorithm; s2, constructing and maintaining a knowledge graph containing finance and tax field related information, storing the information in the knowledge graph in a structured manner, and reasoning by using a logical reasoning algorithm to generate a preliminary answer; s3, designing a document retrieval and indexing mechanism, and verifying and supplementing the preliminary answer; s4, training the system based on the finance and tax related data and question and answer pairs, and continuously updating the model; s5, identifying common finance and taxation question modes by using a mode identification technology, and providing standardized answers; and S6, supporting multiple rounds of dialogues with the user, and generating more detailed and accurate answers by gradually clarifying the questions of the user. The method has the advantages of high accuracy, high response speed and capability of continuously learning and adapting to new problems.
Owner:ANHUI XIAOZHU INFORMATION TECH CO LTD

Multi-modal named entity recognition method based on cross-modal guide interactive fusion

The invention relates to a multi-modal named entity recognition method based on cross-modal guide interactive fusion, which comprises the following steps: constructing a data set, designing a cross-modal contrast aggregation mechanism, respectively extracting image features and text features, and constructing a contrast learning mechanism to screen out image features with high association degree with text semantics for dynamic aggregation; a DINO model is introduced to extract image features, a dynamic similarity matching method is constructed, a dynamic similarity matching weight is generated based on text features and an image feature correlation matrix, a dynamic gating mechanism is utilized to adaptively select image features related to text feature context, and a cross-modal fusion and guide interaction strategy is constructed. Outputting an enhanced semantic representation vector, and mapping the semantic representation vector after multi-modal fusion into a final entity tag sequence by adopting a conditional random field decoder to complete entity recognition; the method has the advantage of remarkably improving the robustness and accuracy of multi-modal entity recognition.
Owner:ZHENGZHOU UNIVERSITY OF LIGHT INDUSTRY

Non-performing asset cross-scene question and answer framework based on knowledge graph

The invention provides a non-performing asset cross-scene question and answer framework based on a knowledge graph, and relates to the field of artificial intelligence and legal science and technology, and the framework comprises a framework, a knowledge fusion layer is provided with a multi-source data access module which is used for obtaining heterogeneous data of a law and regulation database, a judicial case library, an enterprise financial statement system and an asset transaction platform; configuring a legal entity analysis engine, and converting the unstructured legal text into an entity-relationship-attribute triple which can be represented by a knowledge graph based on an ontology mapping technology; setting a financial data standardization component, and converting the financial data in different formats into unified semantic representation through a predefined financial index mapping rule; the knowledge fusion layer of the framework can integrate multi-source heterogeneous data such as laws and regulations, financial data, business processes and the like through a multi-source data access module, a legal entity analysis engine, a financial data standardization component and the like.
Owner:SHANGHAI BAICHANG TECH GRP CO LTD

Enhanced generation method based on question matching retrieval

The invention provides an enhanced generation method based on question matching retrieval, and belongs to the field of matching generation, and the method comprises the following steps: S1, a semantic feature coding stage: carrying out real-time feature extraction and vector space mapping on a natural language query input by a user by adopting a deep neural network model, generating high-dimensional distributed representation with semantic representation capability; s2, a knowledge base intelligent retrieval stage: executing multi-dimensional semantic matching in the vectorized knowledge base based on an approximate nearest neighbor search algorithm, and screening out a candidate knowledge set highly related to query semantics through a similarity measurement function; s3, retrieval matching results are automatically associated to the structured knowledge base through the established semantic-knowledge mapping relation, the preprocessed standardized response content is directly obtained, and the response content adopts a multi-modal data organization form and comprises a structured data entity and retains a rich text expression form.
Owner:北京致链科技有限责任公司

Multi-modal user intention understanding and personalized shopping guide generation method and system

The invention relates to the technical field of shopping guide, in particular to a multi-mode user intention understanding and personalized shopping guide generation method and system, and the method integrates vision, voice and touch screen data to construct a commodity and user intention knowledge graph. Through a cross-modal contrast learning architecture and deep feature learning of user intentions, precise commodity matching and sorting are realized; and in combination with a knowledge-enhanced semantic alignment model, generating a personalized recommendation verbal skill, and making a shopping guide strategy by using a sequence-to-sequence neural network. Complementary information among different modal data can be captured, a unified semantic representation space can be learned, and the accuracy of user intention understanding is greatly improved; the system breaks through the technical barriers, significantly improves the intelligent shopping guide capability of the e-commerce platform, rebuilds the shopping experience of the user, shows huge commercial value, and injects new power for industry development.
Owner:谷明康

AI-based airport intelligent service question and answer method and system

The invention discloses an airport intelligent service question answering method and system based on AI, relates to the technical field of artificial intelligence, and comprises the steps of performing combined modeling by using a time sequence and a multi-head attention mechanism, extracting key behavior characteristics, fusing intention recognition and behavior prediction, and improving the answer reasoning accuracy. The method comprises the following steps: selecting a semantic knowledge base, constructing deep semantic representation and accurately matching the deep semantic representation with the semantic knowledge base, extracting high-weight phrases in combination with a sliding window mechanism, generating unique semantic fingerprints by utilizing a Karp-Rabin hash function, improving the speed and accuracy of answer matching, and performing fuzzy control and redundant information elimination on candidate answers by adopting a rough set tolerance model. Semantic similarity judgment is carried out according to the intersection and union set proportion between the upper and lower approximate sets, the problems of semantic drift and repeated candidates in traditional matching are effectively relieved, and through reinforcement learning and A / B testing, the question and answer strategy is continuously optimized, and the response effect of the system and the user satisfaction degree are enhanced.
Owner:SHANGHAI TEN YEARS INTELLIGENT TECH CO LTD

Speech recognition and natural language processing integration method and system

The invention discloses a speech recognition and natural language processing integration method and system, and the method comprises the steps: carrying out the multi-modal data fusion according to a speech signal of a user, context text information and environment sensor data, and obtaining a fused multi-modal feature vector; inputting the multi-modal feature vector into a speech recognition model based on an adaptive deep neural network, and performing speech-to-text processing to obtain text output; inputting the text output into a semantic analysis model based on a graph neural network, and performing context semantic analysis and user intention recognition to obtain semantic representation of the user intention and a confidence score of the semantic representation; and according to the semantic representation and the confidence score thereof, dynamically adjusting parameters of the speech recognition model and the semantic analysis model by using a feedback optimization technology based on reinforcement learning, and generating a model optimization strategy. According to the embodiment of the invention, the accuracy of speech recognition and the semantic comprehension capability of natural language processing can be improved.
Owner:GUANGZHOU JIUSI INTELLIGENT TECH CO LTD

Multi-agent dynamic arrangement method based on multi-modal analysis and adaptive retrieval

The invention discloses a multi-agent dynamic arrangement method based on multi-modal analysis and adaptive retrieval, and relates to the technical field of artificial intelligence and information retrieval. Comprising the steps of S1, converting a text, an image, structured data and voice content input by a user into a unified multi-mode semantic representation, S2, converting the unified multi-mode semantic representation into a specific execution process, and S3, automatically scheduling a reasoning agent, a knowledge obtaining agent and an execution agent according to DAG nodes, task elements and available resources, and obtaining the task elements and the execution agent according to the reasoning agent, the knowledge obtaining agent and the execution agent. S4, after task process construction and agent arrangement are completed, dynamic retrieval, evidence convergence and strategy optimization are carried out on information requirements related to a user task, so that a reasoning agent obtains complete knowledge support with consistent context, and S5, knowledge evidence is combined with a task process, so that the task process is completed. The method comprises the following steps: step S6, implementing problem solving, strategy generation and task closed-loop execution through a reasoning agent, step S6, performing actual operation on a target task by an execution agent according to an executable instruction sequence output by the reasoning agent, and outputting a result, and step S7, performing result verification according to an output result returned by the execution agent, and the correctness, integrity and consistency of an output result are examined through rule verification, model evaluation and evidence alignment.
Owner:INSPUR GROUP CO LTD +1

Semantic alignment method for infrared image and microwave non-image information fusion

The invention discloses a semantic alignment method for infrared image and microwave non-image information fusion. The method comprises the steps that infrared image and microwave non-image information fragments in the same scene are collected; carrying out preprocessing operation on the acquired infrared image and microwave non-image information; extracting spatial and semantic features of the infrared image, and extracting frequency domain features of microwave non-image information; embedding the infrared image features and the microwave non-image features into the same high-dimensional semantic space; calculating the similarity in semantic representation; and carrying out global optimal matching by adopting a Hungary algorithm. Respectively performing wavelet decomposition on the infrared image and the microwave features by adopting a wavelet transform fusion algorithm, and extracting low-frequency and high-frequency coefficients under different resolutions; by constructing a unified semantic representation space and an efficient feature fusion mechanism, the difference between the infrared image and the microwave data in the feature expression form and the semantic level is effectively solved, complementary information of two modes is fully mined, and the target recognition and environment perception ability in a complex environment is improved.
Owner:CHINA UNIV OF MINING & TECH +1

Multi-feature fusion rumor detection method, system and device based on knowledge distillation

The invention provides a multi-feature fusion rumor detection method, system and device based on knowledge distillation, and mainly solves the problems that an existing model is high in calculation overhead, insufficient in feature fusion and insufficient in emotion utilization. The method comprises the steps of firstly obtaining multi-dimensional data such as social media original texts and comments; extracting deep semantic representation by using a pre-training model, and analyzing comment emotion features in combination with a hybrid neural network; then, features such as semantics, emotions, emoticons and populations are input into a hierarchical gating interactive fusion network (GIFN), and weights are dynamically adjusted to achieve effective fusion of multi-granularity features; in order to reduce complexity, a knowledge distillation framework is designed: a deep GIFN is used as a teacher network to generate a soft label, and a lightweight student network (LSTM) is guided to perform training. According to the trained student model, the parameter quantity is remarkably reduced, meanwhile, good detection performance is kept, the student model can be conveniently deployed in an actual content auditing system or edge equipment, and social content rumors can be efficiently recognized and judged.
Owner:CHONGQING UNIVERSITY OF SCIENCE AND TECHNOLOGY +1

Multi-modal entity and relation extraction method and system based on cross-modal alignment and fusion

The invention discloses a multi-modal entity and relation extraction method and system based on cross-modal alignment and fusion, and the method comprises the steps: carrying out the processing and coding of an input text and an image, and obtaining a plurality of types of image and text features; performing feature alignment on the fine-grained and coarse-grained text features and the pixel-level image representation by taking the semantic representation of the image as an anchor point, and mapping the image and the text features to the same semantic space; performing multi-granularity feature fusion through text-guided dynamic gating aggregation, visual prefix cross-modal fusion and cross-modal image-text matching, modeling association between noun phrases and image objects in a text while increasing feature complementarity, and obtaining multi-granularity multi-modal feature representation; fusing multi-granularity multi-modal features through entity guidance attention gating, and gathering visual information related to a text entity to obtain final multi-modal fusion representation; according to the multi-modal fusion representation, task prediction of multi-modal named entity recognition and multi-modal relation extraction is carried out.
Owner:YANBIAN UNIV