Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5229 results about "Semantic feature" patented technology

Semantic features represent the basic conceptual components of meaning for any lexical item. An individual semantic feature constitutes one component of a word's intension, which is the inherent sense or concept evoked. Linguistic meaning of a word is proposed to arise from contrasts and significant differences with other words. Semantic features enable linguistics to explain how words that share certain features may be members of the same semantic domain. Correspondingly, the contrast in meanings of words is explained by diverging semantic features. For example, father and son share the common components of "human", "kinship", "male" and are thus part of a semantic domain of male family relations. They differ in terms of "generation" and "adulthood", which is what gives each its individual meaning.

AI intelligent customer service response method and system based on remote digital service

The invention provides an AI intelligent customer service response method and system based on a remote digital service, and the method comprises the steps: firstly receiving a session request data flow inputted by a user through a remote session terminal, and extracting a dynamic semantic feature sequence containing a grammatical structure, an emotional tendency and a context dependence feature; inputting the data into an intention recognition model trained based on a historical session data multi-dimensional semantic relationship, and outputting an intention category label and confidence; matching a target dialogue stream node from a preset dialogue process library according to the label and the confidence coefficient; dynamic response content is generated based on the node response logic rule, and a response data stream is returned; and finally, collecting user feedback behavior data, updating the association weight of the intention recognition model according to an interaction validity index, optimizing the semantic mapping precision of the intention recognition model to similar session requests, and realizing more accurate, intelligent and adaptive customer service response.
Owner:CHUANGYU INTELLIGENT (CHANGSHU) NETLINK TECH CO LTD

Multi-source heterogeneous data knowledge base system construction method, equipment and medium

The invention discloses a knowledge base system construction method and device for multi-source heterogeneous data and a medium, and relates to the technical field of artificial intelligence and natural language processing. The method comprises the following steps: integrating a dynamic graph convolutional network and a hierarchical attention mechanism to construct a multi-modal document analysis engine; performing semantic structure analysis on the original heterogeneous document on the basis of a multi-modal document analysis engine to extract document structure features and content semantic features, and constructing an original document relationship model on the basis of the document structure features and the content semantic features; based on the original document relationship model, performing classification fusion on heterogeneous data in the original heterogeneous document to obtain a to-be-stored heterogeneous data corpus, and processing the to-be-stored heterogeneous data corpus by using a graph neural network to establish a cross-modal semantic association index; and based on the cross-modal semantic association index, performing classified storage on the to-be-stored heterogeneous data corpora by utilizing a preset heterogeneous database so as to complete knowledge base system construction of the multi-source heterogeneous data.
Owner:INSPUR GENERSOFT CO LTD

Automatic test script dynamic generation method and system based on multi-modal AI identification

The invention relates to the technical field of computers, provides an automatic test script dynamic generation method and system based on multi-modal AI recognition, and is used for remarkably improving the coverage dimension and execution robustness of test cases while reducing the manual maintenance cost. The method comprises the following steps: acquiring target test interface data, extracting dynamic interaction characteristics in the test interface data, calling a trained target detection network to carry out element positioning processing on the test interface data, generating an interface element coordinate set, and generating a target test interface based on the interface element coordinate set. Calling a character recognition network to carry out multi-modal feature analysis on the interface element distribution information, and generating a feature fusion result containing character semantic features and icon classification features; the feature fusion result is input into a script generation model for dynamic path planning processing, automatic test script elements are output, and the automatic test script elements comprise logic control instructions generated based on the element operation sequence and coordinate self-correction parameters.
Owner:CHINA RONGXIN CLOUD TECH CO LTD

Intelligent question-answering system optimization method and device based on knowledge graph

The invention relates to an intelligent question-answering system optimization method and device based on a knowledge graph, and the method comprises the steps: obtaining original knowledge data of a target knowledge domain, and constructing a knowledge graph structure model; extracting term information of entity nodes in the knowledge graph structure model, and constructing an entity term set; receiving a natural language question input by a user, executing a semantic understanding operation based on the standardized expression set to obtain a structured question semantic representation, and matching the question semantic representation with the case training set to obtain context semantic features; constructing a cue word template, and executing a query instruction generation operation to obtain a target query statement of the graph database; submitting the target query statement to a graph database to execute data retrieval operation, and obtaining query result data corresponding to the question semantic representation; and performing personalized rendering processing on the query result data based on the user portrait information to generate final question and answer return content. The method has the effect of improving the query accuracy.
Owner:PENGHUA FUND MANAGEMENT CO LTD

Vision generation method and device based on semantic association modeling, equipment and medium

The invention relates to the technical field of voice semantics, can be applied to business scenes of financial science and technology, medical health, poster design and the like, and discloses a visual sense generation method and device based on semantic association modeling, equipment and a medium. Generating a demand text containing theme and style parameters; semantic features in the demand text are extracted, semantic association weights are constructed, and element layout coordinates are optimized in combination with spatial distribution constraints; and encoding the layout information into a control matrix, fusing the control matrix with the initial noise, adjusting a noise reduction process through an encoding and decoding network, and generating target visual content highly matched with the semantic meaning of the user instruction. According to the method, the layout optimization function is constructed, the diffusion model is guided to focus the semantic salient region in space, language model output and the visual generation process are closely combined, structured response and space mapping of user semantic requirements are achieved, and the expression consistency and personalized adaptation capacity of visual content generation are improved.
Owner:SHENZHEN PINGAN COMM TECH CO LTD

Multi-source heterogeneous corpus fusion method and system based on government affair service data

The invention provides a multi-source heterogeneous corpus fusion method and system based on government affair service data, and the method comprises the steps: obtaining an original corpus set of a plurality of data sources in government affair service, carrying out the cross-modal semantic alignment processing of each corpus unit in the original corpus set, generating a normalized data block corresponding to each corpus unit, and carrying out the fusion of the data blocks; carrying out multi-modal semantic coding on the standardized data blocks to obtain semantic feature vectors of all corpus units, carrying out topological structure coding on association attribute sets among the standardized data blocks to generate a global structure relation graph, and carrying out dynamic weight distribution on the semantic feature vectors based on node connection weights in the global structure relation graph to obtain semantic feature vectors of all corpus units; and generating a fusion weight matrix, performing cross-modal feature fusion on the semantic feature vector to obtain a target semantic embedding representation, and generating a standardized corpus associated with the government affair service. According to the method, the semantic aggregation problem of the non-uniformly distributed corpus units is solved, and the government affair data governance efficiency and the cross-department cooperation capability are greatly improved.
Owner:GUANGDONG YIQI DATA IND CO LTD

AIGC content generation method and system based on multi-modal fusion

The invention relates to the technical field of AIGC content generation, discloses an AIGC content generation method and system based on multi-modal fusion, and aims to solve the problems of decentralization, low efficiency and insufficient originality of a traditional content generation tool. Multi-modal data such as texts, images, videos and audios are integrated, user intentions are analyzed in combination with intelligent retrieval and a domain knowledge base, automatic generation from multi-modal input to high-quality creative content is achieved, a cross-modal collaborative generation technology is adopted, semantic features are dynamically aligned, and logically coherent content is generated. The content emotional value is enhanced through an emotional analysis and dynamic optimization strategy, the homogenization bottleneck is broken through, meanwhile, an automatic quality evaluation and format adaptation mechanism is integrated, deep application of scenes such as text travel, advertisement, e-commerce and interactive network television service is supported, marketing copywriting, short videos and cross-platform distribution schemes can be efficiently generated, and the market competitiveness is improved. And the content production efficiency and the creativity transmission are obviously improved.
Owner:HANGZHOU WANDIAN TECHNOLOGY CO LTD

AI-driven multilingual intelligent document abstract and mind map generation system

The invention relates to the technical field of artificial intelligence, in particular to an AI-driven multilingual intelligent document abstract and mind map generation system, which realizes unified representation of data such as multilingual texts, images and tables through a multi-modal semantic feature generation module, and constructs a dynamically optimized causal semantic map; generating a semantic flow path with clear logic based on a dynamic semantic flow modeling method, wherein the semantic flow path is used for multi-language abstract generation; the structure of the mind map is optimized by using the generative adversarial network, and the content of the map is further perfected through user interaction adjustment and logic consistency verification. The system supports a user to efficiently extract document core information, a logic structure is displayed in a visual mode, the accuracy, logicality and efficiency of document generation are remarkably improved, and the system is suitable for generation and decision support of complex multi-modal documents.
Owner:BEIJING SOIN TECH CORP LTD

Vision-text collaborative abstract generation method and system based on multi-modal learning

The invention belongs to the field of natural language processing crossing, and particularly relates to a visual-text collaborative abstract generation method and system based on multi-modal learning, and the system comprises a multi-modal data receiving module which is used for receiving multi-modal input data in parallel, and the multi-modal input data comprises text data and visual data; the visual semantic understanding module is used for extracting high-level semantic features of the image by adopting a visual semantic understanding model and generating text description; the semantic fusion module is used for carrying out semantic fusion on the original text and the generated image description by adopting a vision-text semantic fusion method based on direction consistency and self-adaptive semantic completion; and the abstract optimization module is used for carrying out semantic reconstruction on the fusion features by adopting a multilayer deep fusion hybrid neural network architecture, and generating an abstract text conforming to context semantics and accurate expression. The method has the advantages that visual and text information is accurately aligned, high-quality abstracts are generated, and the method is particularly suitable for news reports, conference records, video content analysis and other scenes needing cross-modal information fusion.
Owner:SHANDONG UNIV +1

Operation and maintenance log event association analysis method and system based on artificial intelligence

The invention provides an operation and maintenance log event association analysis method and system based on artificial intelligence, and the method comprises the steps: firstly obtaining an original operation and maintenance log set of a target system, the original operation and maintenance log set comprising a plurality of operation and maintenance log fragments; secondly, performing feature extraction processing on the original operation and maintenance log set to obtain context semantic features and time sequence behavior features of each operation and maintenance log fragment, and then calling a pre-trained association analysis model to perform association rule matching processing on the features to generate an association rule set among the operation and maintenance log fragments; the association rule set comprises a causal relationship definition and an event propagation path description, generating an operation and maintenance event optimization strategy based on the association rule set, and finally feeding back the operation and maintenance event optimization strategy to an operation and maintenance management interface of a target system to trigger system optimization operation. And the system operation and maintenance efficiency and stability are improved.
Owner:SHANGHAI QINGCHUANG INFORMATION TECH CO LTD

Multi-modal content compliance auditing method and system

The invention provides a compliance auditing method and system for multi-modal content. The method comprises the following steps: performing feature extraction on unstructured to-be-audited multi-modal content to obtain a structured feature vector; performing image-text semantic association on the text semantic feature vector and the image visual feature vector to obtain a fusion feature vector involving image-text semantic contradiction; constructing a domain knowledge graph based on the compliance guidance data of the domain to which the to-be-audited multi-modal content belongs; inputting the fusion feature vector into a domain knowledge graph, and performing compliance rule retrieval by adopting a sub-graph matching algorithm to determine a violation type corresponding to the fusion feature vector and a violated compliance term; and generating an interactive compliance audit report. The system comprises functional modules for realizing the steps in a one-to-one correspondence manner. According to the technical scheme, the problem that cross-modal semantic analysis of an existing multi-modal content compliance auditing method is not accurate can be solved.
Owner:SHANGHAI CAIYUE XINGCHEN INTELLIGENT TECHNOLOGY CO LTD

Marketing video auditing method based on AI

The invention provides an AI-based marketing video auditing method, and relates to the technical field of AI marketing video auditing, and the method comprises the steps: obtaining a multi-modal data original structure set, and extracting image semantic features, voice expression features, text semantic features and scene label information, and obtaining an image semantic feature set, a visual rhythm feature set, a voice expression feature set, a voice and picture synchronous association vector structure, a text semantic feature set and a subtitle semantic and image main body linkage relation graph. By constructing an image semantic feature set, a voice expression feature set, a text semantic feature set and a visual rhythm feature set and fusing the image semantic feature set, the voice expression feature set, the text semantic feature set and the visual rhythm feature set into a multi-modal content fusion feature tensor, unified modeling of an AI marketing video at visual, auditory and semantic levels can be realized; and subsequent microscopic consistency detection, compliance knowledge graph and emotion semantic conflict identification are effectively performed, so that full-link risk perception and accurate auditing of video contents are realized.
Owner:SHANGHAI WANGMAI INFORMATION TECH GRP CO LTD

Unmanned aerial vehicle flight control system vulnerability detection method based on data flow analysis and LLM

The invention discloses an unmanned aerial vehicle flight control system vulnerability detection method based on data flow analysis and LLM, and belongs to the technical field of intelligent software testing. Comprising the following steps: extracting a code function module associated with user operation in an unmanned aerial vehicle flight control system through a data flow analysis method, and establishing an operation-code mapping relation library; generating a structured natural language semantic description for each function module code by adopting a large language model LLM, and forming a multi-dimensional semantic feature vector; based on correlation analysis of multi-module semantic features, a combined test scene is constructed, and a natural language test case is generated; the natural language test case is converted into an executable test code through reverse semantic mapping, and coding reconstruction of test logic is completed; and executing a test code and capturing a runtime log in an unmanned aerial vehicle simulation environment, and performing vulnerability feature extraction and root cause positioning by using a large language model. According to the method, the efficiency is improved, and meanwhile, the deep coverage test of a complex interaction scene is supported.
Owner:HUAZHONG UNIV OF SCI & TECH

Intelligent digital operation and maintenance management system and method for charging pile

The invention discloses an intelligent digital operation and maintenance management system and method for a charging pile, and relates to the technical field of new energy infrastructure operation and maintenance, and the system comprises an information obtaining module which determines a delay information circulation channel, obtains real-time discussion content, processes a discussion text through employing a word segmentation technology, and carries out the operation and maintenance of the charging pile. If the confidence coefficient of the semantic feature vector is higher than a preset threshold value, the semantic feature vector is judged to be a specific question type through state space definition, classified question labels are obtained, the historical matching module obtains features associated with a historical question library, historical question records are matched, and the matching precision is evaluated through reward function design. Determining a historical solution most similar to the current problem; according to the intelligent digital operation and maintenance management system and method for the charging pile, the accuracy of problem classification and solution matching is continuously improved, and intelligentization and high efficiency of operation and maintenance management of the charging pile are achieved.
Owner:YANTAI STATE GRID ZHONGDIAN ELECTRIC CO LTD +1

Intelligent contract auditing method and device based on multi-modal large model and medium

The embodiment of the invention discloses an intelligent contract auditing method and device based on a multi-modal large model and a medium, and relates to the technical field of contract auditing, the method comprises the steps that a to-be-audited target contract document is acquired, multi-modal data in the target contract document is analyzed, and the multi-modal data comprises text data, table data and image data; performing feature extraction on the multi-modal data to obtain multi-modal feature data, mapping the multi-modal feature data to a unified dimension space so as to calculate an association weight between each modality through a cross-modal attention mechanism, establishing cross-modal bidirectional link data, and obtaining multi-modal data; the multi-modal feature data comprises any one or more of text semantic features, table relation maps and image visual features; and based on the multi-modal feature data and the cross-modal bidirectional link data, performing single-modal self-consistency verification and cross-modal contradiction detection on the target contract document to generate auditing information of the target contract document.
Owner:INSPUR GENERSOFT CO LTD

Large-model complaint intention recognition method based on sentiment analysis

The invention discloses a large-model complaint intention recognition method based on sentiment analysis, and the method comprises the steps: obtaining call voice data of a customer, and converting the call voice data into text data; preprocessing the text data, and removing noise and marking components; performing emotion feature analysis on the text data, extracting an emotion feature value, and generating an emotion vector; the emotion vectors and the text data are input into a large model together, and the large model combines the emotion feature values and context semantics to generate intention feature vectors; constructing an emotion-intention state vector, inputting the emotion-intention state vector into an asynchronous dominant actor commentator algorithm model, and generating a corresponding complaint intention probability value; judging a complaint intention probability, and generating risk early warning; and preferentially distributing high-risk customers and responding to customer demands. Through combination of voice data preprocessing, text semantic feature extraction, emotion intensity quantitative analysis and a multi-modal fusion algorithm and efficient risk assessment based on an asynchronous dominant actor reviewer model, the early warning and response capabilities of customer complaint risks are significantly improved.
Owner:HENAN ZHONGYUAN CONSUMER FINANCE CO LTD

Remote sensing image semantic change detection method and device based on Mamba model

The invention belongs to the technical field of image processing, and relates to a remote sensing image semantic change detection method and device based on a Mama model, and the method comprises the steps: obtaining paired dual-time remote sensing images, and carrying out the preprocessing of the dual-time remote sensing images; inputting the preprocessed dual-time remote sensing image into a Mama encoder branch for feature extraction to obtain a multi-scale feature; processing the multi-scale features by adopting a difference feature extraction module to obtain multi-scale difference features; inputting the multi-scale features and the multi-scale difference features into a feature fusion enhancement module for fusion to obtain semantic features; respectively decoding the semantic features and the multi-scale difference features by adopting a Mamba decoder branch; inputting the decoded semantic features and the multi-scale difference features into a classifier, and carrying out masking operation to obtain a semantic change graph of the dual-temporal remote sensing image; according to the method, the changed area of the dual-time-phase remote sensing image and the specific change category of the changed area can be accurately detected.
Owner:CHONGQING ZHONGKE SURVEY & DESIGN CO LTD +1

Unmanned aerial vehicle intelligent inspection path generation method for interior of building based on BIM model feature extraction

The invention discloses a BIM model feature extraction-based unmanned aerial vehicle intelligent inspection path generation method for the interior of a building. The method comprises the steps of extracting a spatial geometric feature set, a spatial topological feature set and a semantic feature set from original BIM model data; constructing a basic space graph representing a space structure and a semantic enhancement graph representing a function relationship based on the feature set, and generating a multi-level semantic graph; task targets and dependency relationships are extracted from the inspection task description and the multi-level semantic graph, and a task weight matrix is generated; generating an optimized path set based on the multi-level semantic graph and the task weight matrix; performing multi-dimensional scoring and real-time optimization on the optimized path set to generate an emergency adjustment strategy; and finally verifying the inspection path. According to the method, through multi-level feature extraction and multi-level semantic graph construction, accurate understanding of the building space is realized, and the intelligent level and reliability of routing inspection path planning are improved.
Owner:CHINA RAILWAY CONSTRUCTION ENGINEERING GROUP

Enhanced generation method based on question matching retrieval

The invention provides an enhanced generation method based on question matching retrieval, and belongs to the field of matching generation, and the method comprises the following steps: S1, a semantic feature coding stage: carrying out real-time feature extraction and vector space mapping on a natural language query input by a user by adopting a deep neural network model, generating high-dimensional distributed representation with semantic representation capability; s2, a knowledge base intelligent retrieval stage: executing multi-dimensional semantic matching in the vectorized knowledge base based on an approximate nearest neighbor search algorithm, and screening out a candidate knowledge set highly related to query semantics through a similarity measurement function; s3, retrieval matching results are automatically associated to the structured knowledge base through the established semantic-knowledge mapping relation, the preprocessed standardized response content is directly obtained, and the response content adopts a multi-modal data organization form and comprises a structured data entity and retains a rich text expression form.
Owner:北京致链科技有限责任公司

Voice generation method and device, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of medical health, financial science and technology and the like, and discloses a voice generation method which comprises the following steps: constructing a multi-language voice synthesis model, obtaining plain text data and paired voice text data, and constructing an expansion vocabulary; updating a language perception embedding layer and model parameters, and converting an input text into a mark sequence; and the encoder extracts context semantic features, extracts pronunciation rule features, and the decoder fuses the features to generate an acoustic feature sequence, and converts the acoustic feature sequence into target voice data. According to the invention, the multi-language speech synthesis model is combined with the language perception embedding layer, so that the speech generation capability of a low-resource language is improved; the text conversion accuracy is improved by expanding the vocabulary, the target language learning ability is enhanced by unsupervised training, the low data environment adaptability is optimized by supervised training, and the speech naturalness and fluency are improved by feature fusion.
Owner:PING AN TECH (SHENZHEN) CO LTD

Large language model construction method fused with spatial semantic understanding

The invention relates to a large language model construction method and system fused with spatial semantic understanding, and the method comprises the steps: obtaining a multi-source heterogeneous corpus, and extracting an entity, an attribute and a business rule; extracting a semantic feature vector set based on the multi-source heterogeneous corpus, and constructing an entity relationship network and an enhanced knowledge graph; generating an enhanced training sample, and training the general large language model to obtain a primary large language model; generating a verification sample set and performing verification; identifying a specific weakness pattern, and generating a corresponding confrontation sample and a knowledge enhancement sample; training the primary large language model to obtain an optimized large language model; in conclusion, the enhanced knowledge graph fusing the spatial semantic features and the business rules is constructed, and the gradient training samples are generated based on the graph to perform multi-stage model training and optimization, so that the method has the effects of improving the internalized understanding ability of the model for the spatial semantics and the business rules and enhancing the reliability of multi-step spatial reasoning.
Owner:URBAN PLANNING & DESIGN INST OF SHENZHEN UPDIS

An intelligent prediction system for social public opinion risk

This application relates to the field of home kitchens, and discloses a social public opinion risk intelligent prediction system, including: a data collection module, which is used to collect text, image and video data from multi-source heterogeneous data sources in real time, including social media, news websites, forums, blogs and self-media; a data preprocessing module, which is used to clean, normalize, segment and tag the collected data to form a structured data set; an advanced natural language processing module, which is used to use the pre-trained Transformer model and graph neural network to perform deep semantic analysis on the pre-processed text data, and extract entity, relationship and context semantic features. By integrating advanced natural language processing, deep learning and multimodal data fusion technology, the system can monitor and accurately predict social public opinion in real time, quickly capture emergencies and public opinion changes, and deeply analyze complex semantics and emotional tendencies.
Owner:吉林警察学院

Domain-specific prompt processing and answering via large language models and artificial intelligence planners

Certain aspects of the disclosure provide techniques for prompt processing. A method generally includes generating a representation of a prompt using a large language model (LLM), the representation comprising semantic features of the prompt, wherein the prompt requests a state change from an initial state to a desired goal state; generating a task description based on using the representation and a domain description; generating an execution plan for the task description, the execution plan comprising a sequence of steps used to transform the initial state to the desired goal state; executing the sequence of steps; and generating a natural language response to the prompt after completing the execution of the sequence of steps, wherein the natural language response is based on the information obtained or the desired goal state.
Owner:INTUIT INC

Digital information traceability management system

The invention relates to the technical field of information traceability, in particular to a digital information traceability management system. The system comprises an information fingerprint extraction module, an origin node consensus module, a circulation path mapping module, an information integrity verification module and a behavior consensus feedback module, and can be used for acquiring original information; performing text semantic feature extraction on the original information to obtain semantic features; performing information fingerprint extraction on the semantic features to obtain semantic fingerprints; performing consensus processing on the semantic fingerprint based on an origin node to obtain a consensus result; generating a source point voucher according to the consensus result to obtain the source point voucher; performing circulation behavior triggering according to the source point voucher to obtain a to-be-recorded behavior; and performing content change analysis according to the to-be-recorded behavior to obtain a changed semantic fingerprint. According to the method, through fusion of semantic hash and behavior consensus, the source tracing robustness, safety, efficiency and applicability are improved.
Owner:BEIJING LIUSHEN DATA TECH CO LTD

Multi-round dialogue intention recognition method and system based on adaptive semantic understanding

The invention provides a multi-round dialogue intention recognition method and system based on self-adaptive semantic understanding, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a natural language dialogue text of a current round of a user, and taking the natural language dialogue text as original input data; based on original input data, multi-level semantic features are extracted through a dynamic semantic coding algorithm, and semantic vector representation of a current round of dialogue is generated; setting three fixed anchor points in a semantic vector space based on a current round semantic vector and a historical dialogue state vector to form a triangular analysis structure; performing gridding segmentation on the triangular analysis structure, and generating a feature adjustment value according to distribution characteristics of segmented grids; and dynamically correcting the extraction process of the context-related features by using the feature adjustment value to obtain the corrected context-related features. According to the method, end-to-end optimization is realized in multiple rounds of interaction scenes such as customer service and intelligent assistants through full-process design.
Owner:MEGAVIEW INTELLIGENCE TECH LTD

Large language model-based antagonism prompt detection method and device, and medium

The invention discloses an antagonism prompt detection method and device based on a large language model and a medium, and belongs to the technical field of artificial intelligence safety. The technical problem to be solved by the invention is how to overcome the defects of static rule lagging, high manual maintenance cost and insufficient context understanding in the security protection process of a large language model in the prior art, and dynamic, real-time and high-precision antagonism prompt detection is realized. According to the technical scheme, the method comprises the following steps: feature extraction: comprehensively analyzing semantic information, structural information and context information in a user text, extracting semantic features, structural features and context features, performing Min-Max normalization on the semantic features, the structural features and the context features, and splicing the semantic features, the structural features and the context features into a 128-dimensional joint vector, performing feature selection on the joint vector through an L1 regularization logistic regression model, compressing to 10-dimensional core features, and removing redundant information; carrying out resistance scoring; and dynamically defending.
Owner:SHANDONG INSPUR DIGITAL BUSINESS TECHNOLOGY CO LTD

Material identification method based on multi-modal large model

The invention discloses a material identification method based on a multi-modal large model, and particularly relates to the technical field of data processing. The method comprises the following steps: inputting image data and associated text data of advertisement materials into a multi-modal large model, and carrying out preliminary preprocessing and feature extraction; respectively extracting visual features and semantic features of the image and the text by using a convolutional neural network and a natural language processing technology, and optimizing a fusion effect of the image and text features through a multi-modal contrast learning strategy; the feature alignment condition is verified by comparing a loss function, and the recognition precision of the model is improved by combining a double-path fine adjustment mechanism and multi-label classification supervision; finally, an improved cue word mechanism is adopted to carry out accurate classification on the advertisement materials, a putting engine and a feedback mechanism are combined, the auditing effect of the advertisement materials is monitored and optimized in real time, the accuracy of advertisement compliance management is remarkably improved, auditing errors are reduced, and the customer satisfaction degree is improved.
Owner:SHANGHAI WANGMAI INFORMATION TECH GRP CO LTD

Multi-modal fusion rumor detection method and system based on dynamic graph convolutional neural network

The invention discloses a multi-modal fusion rumor detection method and system based on a dynamic graph convolutional neural network. According to the method, a dynamic feature graph of a language propagation path is constructed, and potential features in the language propagation process are extracted and analyzed by utilizing time sequence changes and key node relations between nodes in a propagation graph. A neural network is adopted to extract and enhance image data, text semantic features are extracted in combination with a text feature modeling network, text feature vectorization expression is achieved based on a BERT model, and rich semantic information is obtained. And a gating mechanism is introduced to dynamically adjust fusion weights of different modal features, and an information fusion strategy is optimized. A collaborative attention mechanism is further adopted for deep fusion, interactive learning of text, image and propagation path features is enhanced, and the relevance of cross-modal and time series data is improved. And finally, inputting the fused feature vectors into a classifier for accurate classification, thereby realizing accurate detection of the social media rumors. According to the method, the multi-modal features are effectively integrated, and the false information identification efficiency is remarkably improved.
Owner:CHONGQING UNIVERSITY OF SCIENCE AND TECHNOLOGY +1

Text sentiment analysis method and system based on dynamic semantic segmentation and feature perception

The invention provides a text sentiment analysis method based on dynamic semantic segmentation and feature perception, and belongs to the field of natural language processing. Inputting the semantic vector sequence into a knowledge retrieval and dynamic graph construction model for multi-path context enhancement through the knowledge retrieval and dynamic graph construction model to obtain semantic features, semantic knowledge and graph structure information; the semantic vector sequence is subjected to multi-path context enhancement, the complex relation between different parts in the text can be comprehensively considered, and more comprehensive and deep semantic features and knowledge can be mined. Unified representation of semantic features is combined with heterogeneous graph features, an antagonism training strategy is adopted to train a knowledge retrieval and dynamic graph construction model, an improved ATOSS + module is introduced to carry out hierarchical attention fusion, and multi-granularity semantic enhancement features are obtained; therefore, emotion clues and semantic association hidden in the text can be captured, and the accuracy and integrity of semantic understanding of the text are improved.
Owner:SHAANXI UNIV OF SCI & TECH

Video content semantic understanding and text description generation method based on deep learning

The invention discloses a video content semantic understanding and text description generation method based on deep learning, and relates to the technical field of multimedia information processing.The method comprises the steps that the semantic similarity of a text and a video frame is calculated through a CLIP model, related key frames are selected, and features are aggregated; respectively extracting audio, visual and semantic features; aligning different modal features by using self-attention, unifying dimensions of the LSTM, and then splicing and fusing; attention weights are calculated at a video level, a frame level and a channel level, and key information expression is enhanced; swin Transform encodes fusion features, and LSTM (Long Short Term Memory) decodes step by step to generate natural language description; and a text-video index database is constructed, and rapid retrieval is realized based on semantic similarity. According to the method, the mapping relation between the video features and the natural language is learned end to end through the deep learning model, dependence on a fixed template can be eliminated, and semantic description with various sentence patterns and coherent logic is generated.
Owner:CHINA UNIV OF MINING & TECH YINCHUAN COLLEGE