Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

832 results about "Semantic enhancement" patented technology

Multi-modal hierarchical feature fusion and decision-making method, device, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as agent autonomous decision making, financial science and technology and medical health, and discloses a multi-modal hierarchical feature fusion and decision making method, device, equipment and medium, and the method comprises the steps: obtaining vision, language and motion data, and carrying out the hierarchical feature extraction to generate a multi-modal initial feature set; feature importance is analyzed, screening and dimension reduction are carried out, and screened multi-modal features are obtained; performing semantic enhancement on the screened multi-modal features to generate multi-modal semantic enhancement features; executing cross-modal attention fusion on the multi-modal semantic enhancement features to obtain cross-modal fusion features; and inputting the cross-modal fusion features into a semantic reasoning network to generate a decision result. According to the method, through multi-level screening dimension reduction, semantic enhancement and cross-modal attention fusion, the model can accurately utilize key feature relationships among multi-modal data, redundant interference is reduced, and semantic reasoning accuracy and decision-making efficiency are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Question answering system construction method and system based on large language model

The invention provides a question and answer system construction method and system based on a large language model, and the method comprises the steps: obtaining multi-modal data, constructing a question and answer knowledge base and a knowledge graph, and carrying out the dynamic updating of the question and answer knowledge base; obtaining a query text, and respectively carrying out vectorization processing on the query text and the multi-modal data to generate a corresponding query semantic vector and a multi-modal vector; an entity in the query text is extracted by using the recognition model, a triple associated with the entity is extracted from the knowledge graph, the query text and the triple are spliced and vectorized, and a query semantic enhancement vector is generated; according to the method, through a dynamic knowledge base incremental updating mechanism, a context-aware hybrid retrieval strategy, a cross-modal semantic enhancement technology and a user feedback-driven continuous optimization method, real-time processing requirements of various modal data such as texts, images and voices can be effectively met, and accurate semantic understanding and answer generation of complex queries are achieved.
Owner:HUBEI ZHONGKE NETWORK ENG

Automatic label labeling and classifying method and system for unstructured system documents

The invention discloses an automatic label labeling and classifying method and system oriented to unstructured system documents, and relates to the technical field of artificial intelligence. The method comprises the steps that semantic structure pre-analysis is conducted on an original system text, and a system semantic structure tree is constructed; establishing a system semantic enhancement vector space based on the semantic units and the logic relationship thereof; performing semantic deconstruction on the preset tag and extracting a feature vector; realizing cross-space semantic matching of the document and the tag through a system semantic attention mechanism; a confidence evaluation module is introduced to screen high-confidence labels from the three dimensions of structural integrity, coverage and logic consistency; and outputting a final label and a score through semantic conflict detection and resolution. According to the method, the problems that in the prior art, unstructured system text labeling accuracy is low and large-scale labeling samples are dependent on polysemy ambiguity, high context dependency, complex semantic structure and the like are solved, and labeling accuracy and robustness are remarkably improved.
Owner:WUXI XINENG REAL ESTATE MANAGEMENT CO LTD

Knowledge graph completion method based on multi-mode visual angle perception and deep neural network

The invention relates to the field of knowledge graph completion, provides a knowledge graph completion method based on multi-modal visual angle perception and a deep neural network, and aims to solve the problems of weak multi-modal information expression ability, rough fusion mode and insufficient structural reasoning ability in the prior art. According to the method, structure information, text description and visual image information of an entity in a knowledge graph are obtained, structure, text and image modal input is constructed respectively, and a graph neural network, a pre-training language model and a visual encoder are adopted for feature coding; weighted fusion and semantic enhancement of multi-modal features are realized through a visual angle fusion mechanism and hierarchical attention processing; cross-modal contrast learning is introduced to improve modal consistency; and carrying out triple reasoning by using a uniform Transform encoder, and verifying a completion result by scores. According to the method, multi-modal semantics are effectively integrated, the entity representation capability and the triple prediction accuracy are improved, the model robustness is enhanced, and the method is suitable for application scenes such as intelligent question answering and recommendation systems and has remarkable practical value and popularization prospects.
Owner:DALIAN NATIONALITIES UNIVERSITY

Semantic enhancement auxiliary inquiry system and method based on medical knowledge graph

The invention discloses a semantic enhancement auxiliary inquiry system and method based on a medical knowledge graph, and the system comprises a patient information receiving module, a theoretical knowledge graph storage library, an evidence-based knowledge graph storage library, a double-track diagnosis path construction module, a medical knowledge conflict judgment module, and a semantic enhancement report generation module. The double-track diagnosis path construction module inquires the received patient information in a theoretical knowledge graph storage library and an evidence-based knowledge graph storage library which are independent from each other in parallel, and a theoretical diagnosis path and an evidence-based diagnosis path are generated respectively; the medical knowledge conflict judgment module dynamically compares the two paths in real-time interaction, and performs priority judgment according to a preset medical judgment rule; finally, the semantic enhancement report generation module presents the two paths and the conflict judgment result to the user at the same time. Transparency and interpretability of the whole interrogation process are assisted, and reliable semantic enhancement decision support is provided for doctors when the doctors face complex medical knowledge conflicts.
Owner:SHANGHAI BAYES HEALTH TECH CO LTD

Semantic enhancement adaptive partitioning method and system for natural resource large model questions and answers

The invention provides a semantic enhancement adaptive partitioning method and system for natural resource large model questions and answers, and aims to solve the problems of difficulty in term boundary recognition, damage to semantic integrity and the like. According to the method, three core technologies including theme perception coarse-grained paragraph division, self-adaptive sliding window theme hierarchy division and embedded perception context self-adaptive text segmentation are fused. The system firstly analyzes a natural resource long text structure, identifies titles and theme levels and aligns associated contents; paragraphs are extracted according to a theme perception strategy and are subdivided into sentence sets according to grammar rules; an improved sliding window mechanism is adopted to divide sentences into window sentence block groups. The method is characterized in that a dynamic aggregation threshold mechanism is introduced, the semantic association degree between adjacent sentence blocks is calculated through an embedded perception context semantic segmentation technology, whether the sentence blocks are combined or not is judged by combining a similarity distribution change trend and a dynamic adjustment threshold, self-adaptive delimitation of semantic boundaries is achieved, and text blocks which are clear in structure and coherent in semantics are generated.
Owner:HUBEI PROVINCIAL DEPT OF NATURAL RESOURCES INFORMATION CENT +1

Multi-modal data dynamic fusion method and system based on distributed edge cloud collaboration

The invention provides a multi-modal data dynamic fusion method and system based on distributed edge cloud collaboration, and relates to the technical field of data processing, and the method comprises the steps: building a domain knowledge graph, carrying out generative adversarial completion, carrying out cross-modal semantic alignment based on an attention mechanism, carrying out knowledge reasoning, dynamically adjusting a sampling strategy, and cooperatively scheduling a sensor. According to the method, through semantic enhancement and dynamic sampling strategy optimization, the accuracy and the real-time performance of multi-modal data fusion are improved, the system resource consumption is reduced, and efficient data processing under edge-cloud collaboration is realized.
Owner:BEIJING YIZHUANG INTELLIGENT CITY RES INST GRP CO LTD

Land space planning multi-source data fusion processing method and system

The invention relates to the technical field of space planning, and discloses a territorial space planning multi-source data fusion processing method and system, and the method comprises the steps: carrying out the format analysis and semantic annotation of multi-source territorial space data, and obtaining the standard territorial space data of territorial planning; performing hierarchical feature extraction on the standard territorial spatial data to obtain spatial features and attribute features of territorial planning; performing adaptive feature fusion on the spatial features and the attribute features to obtain a multi-semantic fusion feature map of territorial planning; constructing a spatial constraint rule base of territorial planning based on a use control rule and an ecological protection red line of territorial planning; based on a spatial constraint rule base, resolving conflict pattern spots in the multi-semantic fusion feature map, and performing semantic enhancement on the resolved multi-semantic fusion feature map to obtain an optimized fusion result; performing visual rendering on an optimization fusion result to obtain an auxiliary decision graph; according to the invention, the efficiency of data fusion processing in territorial space can be improved.
Owner:JINAN RUIFENG LAND TECH SERVICE CO LTD

Context-aware SQL generation method based on table field semantic enhancement

The invention relates to the technical field of semantic processing, in particular to a context-aware SQL (structured query language) generation method based on table field semantic enhancement, which comprises the following steps of: acquiring financial management and investment combination data of a user and mode information of a background database, constructing a mixed semantic index database, receiving natural language query input by the user, and generating a query result. Performing intention judgment on the query by utilizing the lightweight intention classification model, and if the intention is judged to be matched, calling a parameterized SQL template bound with the query intention and filling parameters to generate a final SQL query; if it is judged that the query intention is an exploration type intention, executing a two-stage SQL generation process, including generating an SQL skeleton according to the query intention, performing target type field recall based on the SQL skeleton, and filling the recalled field into the SQL skeleton to generate a final SQL query; and monitoring the execution performance of the final SQL query, and updating the query popularity metadata and the calculation cost metadata. According to the method, the SQL generation efficiency is improved through intelligent shunting and self-optimization.
Owner:ZHEJIANG FULIN TECH CO LTD

Fault reasoning analysis method and system based on large language model

The invention provides a fault inference analysis method and system based on a large language model, and the method comprises the steps: firstly obtaining a multi-source operation and maintenance data set of a to-be-diagnosed system, including a structured performance index, a semi-structured service log and unstructured text description data, carrying out the semantic enhancement of the multi-source operation and maintenance data set, and carrying out the semantic enhancement of the multi-source operation and maintenance data set; obtaining a semantic data unit containing entity, relation and attribute semantic tags, constructing a semantic association network based on the semantic data unit, calling a pre-trained large language model to carry out root cause reasoning analysis on the network, generating a candidate root cause set sorted according to confidence, and carrying out root cause reasoning analysis on the candidate root cause set; and finally, according to the candidate root cause set, generating an operation and maintenance decision instruction containing an entity operation sequence and a priority sequence, and sending the instruction to a system management terminal to trigger an automatic repair process. Therefore, the operation and maintenance efficiency and reliability of the system can be improved.
Owner:CHENGDU PVIRTECH TECH

Large model driving type API document automatic generation system oriented to legacy system

PendingCN121092211AProgram documentationBiological modelsPython (programming language)Model extraction
The invention provides a legacy system-oriented large-model-driven API document automatic generation system, belongs to the crossing field of artificial intelligence and software development, and provides a multi-modal data fusion and closed-loop verification mechanism aiming at the defects of a traditional API document generation method in the aspects of semantic comprehension, dynamic context capture and multi-technology stack adaptation. A code static feature and a dynamic track during operation are analyzed through a multi-source data acquisition module, and an interface semantic feature is extracted in combination with a field self-adaptive large model of a semantic enhancement analysis module; deducing an implicit service rule by fusing static / dynamic characteristics through a graph neural network, and generating a standardized document conforming to an OpenAPI specification through a parameterized template generative adversarial network (PT-GAN); and finally, performing three-level verification and closed-loop optimization through a sandbox environment. The method supports a heterogeneous system of 16 programming languages such as Java / C + + / Python, interface version changes can be automatically recognized, document patches are generated, the problems of missing and outdated system documents and low maintenance efficiency are solved, and maintainability and integration efficiency of enterprise-level systems are remarkably improved.
Owner:SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD

Multi-mode fusion product document and source code association retrieval method based on knowledge graph

The invention discloses a multi-mode fusion product document and source code association retrieval method based on a knowledge graph, and relates to the technical field of software engineering and artificial intelligence. The method comprises the steps that source codes are preprocessed, and code structure information and business semantics are mapped in combination with a predefined business term dictionary; performing controlled induction on a code file and a product document by utilizing a large model, extracting business terms, logic intentions and a subject relationship, fusing with original codes, and establishing a vector retrieval index system; further analyzing a code structure by using an abstract syntax tree, and extracting an entity and a calling relationship; semantic enhancement and relation normalization are performed in combination with the large model, entities and relations are stored in a graph database, and a knowledge graph is formed; and performing parallel processing on user query based on a full-text retrieval index, a vector retrieval index system and a knowledge graph, and finally generating a product concept. According to the method, the retrieval speed, the semantic depth and the logical reasoning ability can be considered at the same time, and the retrieval accuracy is improved.
Owner:MARCO POLO TRAVEL TECH CO LTD

Method, device and equipment for generating SQL (Structured Query Language) statement based on natural language and storage medium

According to the method and device for generating the SQL statement based on the natural language, the equipment and the storage medium provided by the invention, the query instruction input by the user is received, and the query instruction is the natural language; performing semantic analysis on the query instruction; performing semantic vector coding on the query instruction, and performing similarity retrieval in a preset vector database to obtain semantic enhancement information related to the query instruction; filling a preset structured prompt template with the semantic analysis result and the semantic enhancement information to obtain prompt input information; and inputting the prompt input information into a large language model to generate an SQL statement. According to the method, semantic analysis and vector coding are performed on the natural language instruction of the user, and semantic enhancement is performed in combination with the preset vector database, so that the generation process has context semantic support, and the integrating degree of the generation result and the intention of the user is effectively improved.
Owner:GUANGZHOU SYC TECH CO LTD

Electronic medical record LLM generation method based on animal injury

The invention discloses an electronic medical record LLM generation method based on animal injury, which realizes dialogue structuring and timestamp synchronization through multistage speech recognition and role affiliation. Using standardized medical term mapping and coding to align the free text to a standardized medical entity, and constructing a high-confidence medical entity network based on a semantic anchor point pool; according to the method, context-sensitive entity relationship extraction is realized by combining a large language model and a semantic enhancement template, a high-accuracy structured relationship chain is generated through clinical logic rule set verification, and finally, an electronic medical record template under diagnosis and treatment specifications is automatically filled and privacy desensitization processing is completed. The semantic consistency, the structural accuracy and the data security of automatic generation of the electronic medical record are improved, and standardization and intelligent circulation of medical information are effectively promoted.
Owner:GUANGZHOU WUCHUAN ELECTRONIC TECHNOLOGY CO LTD +1

Semantic consistency-based open vocabulary audiovisual segmentation method

The invention belongs to the technical field of artificial intelligence and multi-modal information processing, and discloses an open vocabulary audiovisual segmentation method based on semantic consistency. By designing the audio semantic enhancement module, the audio semantic discrimination capability is explicitly enhanced, the cross-modal alignment and semantic recognition accuracy of the model is improved, and the robustness and precision of audio-visual semantic segmentation are enhanced. A symmetric cross-modal attention guidance module and a hierarchical modal fusion decoder are proposed. Through refined cross-modal interaction and multi-modal decoding, space-time semantics in audiovisual information are fully mined, audiovisual features are promoted to be gathered in space and time dimensions, and accurate positioning and classification of sounding objects are ensured. By jointly using the CLIP and the CLAP and aligning the audio-visual features based on the shared real label, the segmentation performance of the sounding object of the known category is enhanced, and the segmentation and classification capability of the unknown category and the generalization capability of the model in an open vocabulary scene are remarkably improved by pre-training the knowledge of the basic model.
Owner:DALIAN UNIV OF TECH

Multi-modal emotion fusion analysis method and system

The invention discloses a multi-modal emotion fusion analysis method and system, and the method comprises the steps: carrying out the feature extraction of multi-modal emotion data modal by modal through a feature extraction module, and generating a text original feature, an audio original feature and a visual original feature; performing cross-modal alignment interactive fusion on the original text features, the original audio features and the original visual features based on a unified semantic alignment module, and constructing collaborative fusion features; performing mode and channel double-layer dynamic fusion optimization by adopting a dynamic fusion regulation and control module according to the text original feature, the audio original feature, the visual original feature and the collaborative fusion feature, and determining a unified fusion feature; performing hierarchical residual semantic gating enhancement based on the unified fusion features according to a high-order semantic abstraction module to generate semantic enhancement features; and inputting the semantic enhancement features into an emotion prediction module, and outputting an emotion analysis result. Based on the above scheme, a more stable, accurate and reliable emotion recognition result can be provided.
Owner:GUANGDONG UNIV OF TECH

Multi-modal fusion and semantic enhancement train positioning method and system

The invention provides a multi-modal fusion and semantic enhancement train positioning method and system, and belongs to the technical field of rail transit, and the method comprises the steps: carrying out the time-space alignment of data, obtaining a dense point cloud, constructing a dense semantic point cloud, and dynamically estimating the confidence coefficient weight of each type of sensors; a set residual error and a Manhattan structure constraint residual error of a plane are constructed, laser radar point cloud parameters are obtained, and visual projection constraints are constructed at the same time; constructing a comprehensive degradation scoring function to carry out degradation judgment on the current environment; when the degradation result is yes, introducing a structure and motion information independent of an external environment, maintaining trajectory estimation, and constructing a compensation constraint; introducing a prior semantic constraint and a large model semantic factor constraint; and constructing a global optimization objective function, dynamically adjusting the weight of each modal factor, obtaining an optimal estimation state, and outputting a high-precision train positioning result. According to the method, high-precision and robust track estimation in an extreme scene is realized, so that the continuity, safety and intelligence of train positioning are guaranteed.
Owner:TONGJI UNIV

Deep learning-driven smart home scene dynamic adaptation method

The invention belongs to the technical field of intelligent control, particularly relates to a deep learning-driven intelligent home scene dynamic adaptation method, and aims to solve the problem that an existing intelligent home system is difficult to realize high-precision personalized scene adaptation in a multi-user and multi-device environment due to dependence on a static rule. The method comprises the steps of collecting multi-source heterogeneous user behavior data and performing semantic enhancement preprocessing, constructing a hierarchical time sequence behavior coding model to extract local time sequence dependence and cross-equipment long-range association features, clustering to generate a dynamic scene prototype and mapping the dynamic scene prototype into an executable condition-action rule, after the rules are deployed, a closed-loop optimization mechanism is constructed through explicit and implicit user feedback, and online incremental updating and self-adaptive evolution of the behavior model and the scene rules are achieved. According to the technical scheme, the user complex behavior mode can be deeply understood, the scene adaptation precision is continuously optimized, the individuation level, logic consistency and system robustness of intelligent services are improved, and meanwhile privacy safety and real-time response are guaranteed through edge calculation.
Owner:NINGXIA HUIWAN NETWORK TECH CO LTD

Code generation and evaluation method and system based on RAG and multilevel decision tree

The invention provides a code generation and evaluation method and system based on RAG and a multilevel decision tree, and the method comprises the steps: integrating project related design documents, and constructing a knowledge base capable of semantic retrieval through a vectorization technology; associating business demand description with related documents in the knowledge base based on an RAG technology, and performing demand semantic enhancement to generate a technology demand cue word; receiving the technical requirement cue word by adopting a large language model so as to generate a complete code conforming to business logic; constructing a four-level decision tree evaluation system, and sequentially executing code quality scanning, deployability verification, dynamic test verification and demand satisfaction verification through an evaluation assembly line to generate an evaluation result; and generating an optimization suggestion according to the evaluation result so as to trigger an iteration generation process when the code does not pass the verification, thereby solving the problems of disjunction between code generation and business requirements, low verification efficiency and insufficient iteration optimization.
Owner:SHANDING YUNKE INFORMATION TECHNOLOGY CO LTD

Semantic sensing analysis system

A semantic sensing analysis system comprising a processor, a memory and at least one sensing element having a plurality of stored semantic routes and / or semantic rules wherein the processor is configured to use semantic factorization to apply a quantifiable factor or indicator based on semantic inference or analysis which is inferred based on at least one of the stored semantic routes and / or semantic rules to cause the system to perform semantic augmentation towards a user in relation with an inferred semantic identity.
Owner:LUCOMM TECHNOLOGIES INC

Large model SQL (structured query language) generation method, system and equipment based on business domain semantic enhancement and multi-round voting

The invention relates to a method, a system and equipment for generating a large model SQL (Structured Query Language) based on business domain semantic enhancement and multi-round voting. The method comprises the following steps: acquiring a natural language input by a user to recognize and judge a business field related to user query; performing semantic annotation and expansion on the input query; organizing related information into Prompt, inputting the Prompt into a large language model, and generating an SQL statement; generating a plurality of candidate SQL statements, and selecting the candidate SQL statements with the highest occurrence frequency as output; and submitting the finally output SQL statement to an actual database system for execution, and returning and displaying a query result. Through the technologies of business domain division, data structure semantic annotation, multi-round candidate generation, voting screening and the like, SQL generation accuracy and system robustness of natural language query are remarkably improved, query intentions and field constraints in business scenes of enterprises such as banks and the like can be accurately recognized, field matching errors are avoided, and the query efficiency is improved. And through multi-round iterative generation and consistent voting screening, the correctness and stability of the output SQL statement are ensured.
Owner:ZHIWEI (SUZHOU) INFORMATION TECH CO LTD

Scientific and technological intelligence deep analysis method and system based on cross-modal semantic enhancement

The invention provides a science and technology information deep analysis method and system based on cross-modal semantic enhancement, and relates to the technical field of science and technology information analys.The method comprises the steps that firstly, a cross-modal semantic anchor point set is constructed, and the cross-modal semantic anchor point set comprises text theme anchor points extracted from science and technology information texts, visual object anchor points extracted from images and the association mapping relation of the text theme anchor points and the visual object anchor points; constructing a semantic conduction path between anchor points based on the cross-modal semantic anchor point set, realizing bidirectional information transmission, generating a cross-modal semantic enhanced representation, performing hierarchical semantic analysis on the enhanced representation to obtain a topic association rule, a technical element dependency relationship and a concept evolution sequence, and integrating the topic association rule, the technical element dependency relationship and the concept evolution sequence into an analysis conclusion; the analysis conclusion is reversely mapped to adjust the association mapping relation strength, an updated set is obtained, finally, a structured science and technology information analysis report is generated based on the updated set, logic connection of all modules is achieved, and comprehensive and accurate science and technology information analysis is provided for users.
Owner:BEIJING SCI & TECH PATENT OFFICE

Intelligent marketing document generation device and method based on multi-source data fusion

The invention discloses an intelligent marketing document generation device and method based on multi-source data fusion. The method comprises four processes of user instruction analysis, regular cleaning, model parameter extraction, Neo4j knowledge graph verification and structured parameter output. External data acquisition: calling a Baidu large model to acquire data according to parameters, and screening high-quality data through duplicate removal, semantic enhancement and weighting; internal cases are processed, timed slicing cases are stored in a library, filtering, propagation calculation and multi-dimensional scoring are combined, and a CoT inference chain report is generated; and performing multi-modal output, adapting formats, integrating data by means of a BART model and outputting a document with metadata. The device and the method cooperate with each other, through multi-source fusion, knowledge graph association and multi-mode conversion, high-quality marketing documents adaptive to multiple industries are efficiently generated, support is provided for decision making, and enterprises are assisted to improve market response and output efficiency.
Owner:SHIQU INTERACTIVE (BEIJING) TECH CO LTD

Document interpretation and report generation method and device, equipment and medium

The invention relates to the technical field of natural language processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a document interpretation and report generation method, device, equipment and medium, which comprises the following steps: receiving an original document set to generate a structured document object, executing optical character recognition on an image content set to generate a recognition text set, the recognition text set and the text content set are combined into a unified text sequence, element item extraction is executed based on the interpretation template parameter set to generate an interpretation element set, a retrieval enhancement context is retrieved and generated from the domain knowledge base, and the unified text sequence, the interpretation template parameter set and the retrieval enhancement context are input into a language model to generate an interpretation result. And generating report content based on the historical report template set. According to the method, automatic closed loop of document interpretation and report generation is realized through multi-modal unified processing and semantic enhanced reasoning, the efficiency is improved, and the manual dependence and compliance risk are reduced.
Owner:CHINA PING AN PROPERTY INSURANCE CO LTD

Collaborative filtering recommendation method for large language model semantic enhancement based on comparative learning

The invention discloses a large language model semantic enhancement collaborative filtering recommendation method based on comparative learning, and belongs to the field of recommendation systems.The method comprises the steps that a user-item bigraph is constructed, user-item semantic information collaborative information is provided through GNN, user-item semantic information is extracted through cue words, a deterministic topology view enhancement strategy is adopted, and user-item semantic information collaborative filtering recommendation is achieved. According to the method, a semantic neighbor extension view is generated, a semantic neighbor reconstruction view is generated, collaboration and semantic information alignment are performed, double-view structure alignment is performed, and a loss function is integrally trained, so that the accuracy and the cold start capability of a recommendation system are remarkably improved through collaborative graph structure learning and semantic enhancement.
Owner:YANSHAN UNIV

Document retrieval method and system based on electric power semantic enhancement and electronic equipment

The invention relates to a document retrieval method and system based on electric power semantic enhancement and electronic equipment, belongs to the technical field of natural language processing, and solves the problem of low retrieval accuracy caused by low complex knowledge utilization rate and insufficient electric power professional semantic understanding in the prior art. Comprising the following steps: receiving user query content, and obtaining a query embedding vector by utilizing a modal joint embedding model; based on the electric power knowledge graph, utilizing a large language model and a text embedding model to obtain a structured query vector of user query content; according to the query embedded vector and the structured query vector, obtaining a plurality of candidate documents and document-level similarity scores and page-level similarity scores thereof, and further obtaining a comprehensive similarity score of each candidate document by using a double-path prediction model; and obtaining a total score according to the document-level similarity score, the page-level similarity score and the comprehensive similarity score of each candidate document, and selecting a plurality of candidate documents with the highest total score as a retrieval result. And the retrieval precision is improved.
Owner:STATE GRID SHANGHAI MUNICIPAL ELECTRIC POWER CO

Landslide classification method and system based on visual language model and cross attention mechanism

The invention provides a landslide classification method and system based on a visual language model and a cross attention mechanism. The method and the system specifically comprise the following steps: data preprocessing: carrying out Canny edge detection on an RGB image, and calculating terrain attributes such as a gradient and a slope direction for a DEM (Digital Elevation Model); feature extraction: capturing local features by adopting a reflection filling convolution layer and multi-scale residual connection; a visual language model is introduced, wherein semantic enhancement features are extracted through image-text alignment by means of the visual language model; cross self-attention fusion: capturing a global context through self-attention, and focusing heterogenous data complementary information by cross attention; and classifying and outputting: outputting a result by using global average pooling and a linear classifier. Through the visual language model and the cross self-attention mechanism, the landslide recognition capability under the complex terrain is effectively improved, an efficient and reliable technical means is provided for geological disaster monitoring, and the method can be widely applied to the fields of landslide recognition, risk assessment and the like.
Owner:福州海洋研究院 +3

Video training data generation method based on multi-modal semantic alignment

The invention discloses a video training data generation method based on multi-modal semantic alignment, and relates to the technical field of audio and video processing. The method specifically comprises the following steps: (1) carrying out multi-modal time alignment on audio, image frames and text information in a video, and establishing a cross-modal time sequence mapping relation; (2) semantic enhancement processing is carried out based on the time alignment result, and the identification accuracy of the terminology is improved; (3) dynamically grading the training samples according to the semantic density and the confidence coefficient; and (4) outputting the graded structured training data to adapt to different training stages. The method aims at improving the quality of training data from a video data source and avoiding occurrence of a large amount of redundant data and missing of key nodes.
Owner:江淮前沿技术协同创新中心

Multi-view zero sample anomaly detection method and system based on cross-modal prompt reasoning

The invention belongs to the related technical field of product detection, provides a multi-view zero sample anomaly detection method and system based on cross-modal prompt reasoning, and aims at solving the problem of multi-view zero sample anomaly detection by constructing core technologies such as multi-view pose estimation and alignment, static-dynamic prompt collaboration, vision-language progressive fusion, feature space semantic enhancement and the like. And a set of end-to-end anomaly detection and reasoning system is formed. Particularly, a collaborative mechanism of a dynamic learnable prompt pool and a static attribute prompt library is designed, deep fusion of prompts is realized through cross attention, and multi-view feature compression and semantic decoding are performed by adopting a visual angle self-adaptive hybrid expert model. Zero sample anomaly detection and visual question and answer performance is further improved on multiple industrial public data sets, and the method can be widely applied to industrial precision part quality inspection, intelligent manufacturing and other complex scenes needing high-precision and multi-view perception and semantic reasoning.
Owner:UNIV OF JINAN

Intelligent text report automatic generation method and system based on safety production data

The invention discloses an intelligent text report automatic generation method and system based on safety production data, and belongs to the technical field of big data and artificial intelligence, and the method comprises the steps: multi-source heterogeneous data collection and structured processing: collecting safety production event data including violation operation, violation command and violation of labor discipline, carrying out structured processing on the data; semantic enhancement prompt engineering and large language model reasoning: constructing prompt words, inputting structured data into a large language model, and performing semantic understanding and text generation on the data by utilizing a prompt engineering technology guide model; and dynamic report template adaptation and multi-format output: realizing structured report output through template matching, outputting a structured text report by the model, filling the structured text report into a preset template, and exporting the structured text report. The enterprise safety management efficiency is remarkably improved, the manual writing burden is reduced, informatization, standardization and intelligent processing of safety production data is achieved, and the safety management digitization and automation level of enterprises is improved.
Owner:INSPUR QILU SOFTWARE IND