2368 results about "Semantic similarity" patented technology

The invention discloses a traffic engineering large model intelligent question answering system and method based on a knowledge graph, and the method comprises the steps: extracting a structured degree feature, a semantic ambiguity feature and a context association feature through receiving and analyzing a natural language query statement inputted by a user, generating a retrieval intention vector, and carrying out the retrieval of the retrieval intention vector; and dynamically selecting a retrieval path according to the intention classification model. And according to the retrieval path, constructing a structured query statement or a semantic vector, and respectively retrieving in the knowledge graph and the vector database to obtain a first retrieval result and a second retrieval result. Further performing bidirectional verification through entity consistency, semantic similarity and relation connectivity indexes, screening a candidate result set, and constructing a reasoning chain; if the inference chain is broken, a large model inference gap complementation mechanism is adopted to generate relay nodes, a complete inference chain is formed, and inference type answer output is generated based on the complete chain. According to the method, the retrieval accuracy and reasoning continuity of the question-answering system are improved.

The invention belongs to the technical field of knowledge retrieval, and discloses a multi-modal large model-based dynamic vector knowledge base construction and retrieval method, which comprises the following steps of: obtaining a multi-source heterogeneous modal data set, and carrying out preprocessing and modal standardization processing on the multi-source heterogeneous modal data set to obtain a standardized multi-modal data set; performing feature extraction and semantic vector representation generation by using the pre-trained multi-modal large model, and constructing a multi-modal knowledge vector set; semantic association analysis and hierarchical clustering are carried out on the multi-modal knowledge vector set, and a structured vector knowledge base is constructed; performing semantic similarity calculation and relation modeling on the vector knowledge base to form a vector relation network; intention analysis and vector representation are performed based on mixed modal query information input by a user, and efficient similarity retrieval is realized in combination with a vector relation network; dynamic optimization is carried out through user feedback, personalized retrieval result adjustment is achieved, and the problem of limitation of a traditional retrieval system during multi-modal data processing is effectively solved.

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.

The invention provides a cross-modal retrieval method for semantic and vector fusion in a data space, which belongs to the field of cross-modal information retrieval, and comprises the following steps: firstly, collecting and preprocessing multi-modal data; generating modal embedding and storing by utilizing the pre-training model; a shared semantic space is constructed, cross-modal vector alignment is optimized through comparative learning, and a modal mapping network is designed to enhance the embedding projection effect; storing the aligned embedding by using a Milvus database, and constructing an HNSW index; user text or image query is processed, text query analyzes limiting conditions to generate enhanced embedding, and image query extracts characters through OCR and fuses the characters with image features to generate embedding; in a database, through condition screening and semantic similarity calculation, a Top-K candidate item is retrieved; performing multi-modal correlation sorting on the candidate results and returning the results; according to the method, the shared semantic space is constructed, the alignment effect of different modal embedding is optimized, efficient storage and index management of multi-modal embedding are carried out, and real-time retrieval of large-scale cross-modal data is achieved.

The invention relates to the technical field of computer systems for natural language processing or semantic processing, and discloses an enterprise-level schedule planning and knowledge base-oriented intelligent collaborative question-answering system and an enterprise-level schedule planning and knowledge base-oriented intelligent collaborative question-answering method. The system comprises a vectorization processing module, an RAG knowledge base module and the like. The system converts natural language input of a user and enterprise knowledge data into semantic vectors, and retrieves related enterprise knowledge fragments from a vector database based on semantic similarity. The large language model core module analyzes the user intention, generates a preliminary answer and identifies whether a schedule type operation request is included or not; and if the schedule operation request exists, the system splits the request through the multi-agent cooperation module and distributes the request to the corresponding agent to obtain a task processing result. And finally, semantic consistency fusion is carried out on the preliminary answer and a task processing result through a context fusion module, a comprehensive answer is generated by a large language model and is returned to a user side, and unified intelligent response of enterprise knowledge and schedule service is realized.

The invention discloses an intelligent question answering system construction method and system based on an LLM large language model, and the method comprises the steps: carrying out the corpus aggregation from a plurality of heterogeneous data sources, and dynamically capturing the text data related to a target domain; preliminarily screening the text data, and based on semantic similarity and a text quality scoring rule, removing redundant and low-quality text data or text data irrelevant to a target field; performing diversity analysis on the text data, and generating diversified text data with high similarity with real data through an adversarial generation technology; performing multi-level semantic annotation on the text data, and generating a training sample by analyzing context information in the annotated corpus; and converting the training sample into a standard format sample, and training an LLM large language model by using the standard format sample to serve as an intelligent question-answering system of a target domain. By utilizing the embodiment of the invention, the intelligent level of the intelligent question-answering system in various application scenes can be effectively improved, and further development of the intelligent question-answering technology is promoted.

The invention discloses a large language model knowledge base question answering system based on a multi-path fusion recall retrieval algorithm, and relates to the technical field of artificial intelligence application, and the system comprises the steps of S1, data collection, S2, data preprocessing, S3, knowledge base construction, S4, analysis and clustering, S5, knowledge recall, S6, weight adjustment, and S7, weight fusion. According to the method, a dynamic weight distribution module is arranged, so that various paths of recall weights such as keyword matching, semantic similarity and a knowledge graph can be flexibly adjusted according to different semantic scenes such as a technical scene and a product query scene, a recall result can be effectively optimized, knowledge related to problems can be accurately screened, and the method is high in practicability and high in practicability. And irrelevant information interference is reduced, the answer quality and the system efficiency are improved, and the user satisfaction is improved.

The invention relates to the technical field of intelligent recommendation, and discloses a hybrid retrieval RAG-based resource recommendation method and system, and the method comprises the steps: collecting resource text data, and constructing a vector library and a tag library; expanding the user question based on the language model to obtain a plurality of semantic extension questions; performing intention recognition, judging whether the user question is a resource recommendation question, and if yes, determining a target classification type; screening the data according to the field definition in the tag library to obtain a candidate knowledge fragment set; obtaining candidate vectors, mapping the user question and the semantic extension question into query vectors, calculating the similarity between the query vectors and each candidate vector, and selecting knowledge supplement content; and performing resource splicing on all the knowledge supplement contents to generate resource recommendation answers. According to the method, a structured label screening mechanism and a semantic vector fine arrangement mechanism are fused, and the problems of recall redundancy, matching deviation and the like caused by the fact that an existing RAG system only depends on semantic similarity retrieval are solved.

The invention discloses a knowledge graph-based large language model intelligent teaching aid question-answering system and an implementation method thereof. The knowledge graph-based large language model intelligent teaching aid question-answering system comprises a knowledge base module, a question-answering module and a graph visualization module. And the knowledge base module divides the subject resources into documents to be stored as a local knowledge base of a large language model, and performs related vector base construction for the local knowledge base, so that subsequent retrieval enhancement generation tasks are facilitated. The question and answer module converts user questions into embedded vectors, retrieves most relevant documents in a local knowledge base through semantic similarity to serve as context filling of a large language model, and through prompt word engineering construction, the large language model generation effect is enhanced, the professional degree is enhanced, and the illusion problem is reduced. And the graph visualization module returns the context generated by interaction between the user and the large language model to the large language model again, knowledge nodes in the context are extracted through prompt word engineering, so that a context knowledge graph is constructed and visually presented to the user, an inquiry node and an inquiry relationship are set for interaction, and the interaction experience of the user is improved. According to the method, the knowledge graph and the big language model application are combined and landing in the education field, the text generation and semantic understanding ability of the big language model and knowledge graph visualization are utilized, the question and answer enthusiasm of the user is enhanced, and the learning effect of the user is improved. Meanwhile, a novel man-machine collaborative normal form is provided for an education mode, and a new insight is provided for the technical field of education.

The embodiment of the invention discloses a context-based big language model dialogue processing method and device and electronic equipment, and can solve the problem of how to provide a dynamic management method based on context similarity analysis and intelligent screening to optimize big language model interaction. The method comprises the steps of obtaining current text information input by a user; coding the current text information and a plurality of pieces of pre-stored historical dialogue information to obtain a current text vector and a plurality of historical dialogue vectors; according to the semantic similarity between each historical dialogue vector and the current text vector, screening the plurality of historical dialogue vectors to obtain screened target historical dialogue information; splicing the current text information and the screened target historical dialogue information to obtain a target input text; the target input text is input into a target language model, target output response information is obtained, and the target language model comprises a large language model.

The invention discloses a cockpit active recommendation system and method based on a knowledge graph and semantic reasoning, and relates to the technical field of intelligent cockpits. The system receives natural language voice input of a user, executes voice recognition and semantic analysis, extracts user intention, keywords and slot entities, generates structured semantic information, constructs or calls a knowledge graph structure with semantic relation edges in combination with environment context information, and obtains the knowledge graph structure with the semantic relation edges. Semantic path reasoning is carried out based on the path dependence weight and the semantic similarity, a semantic edge label guided graph attention mechanism is introduced to calculate a path consistency score, a candidate recommendation set is generated, the semantic fitting degree and the path score are fused to sort and output recommendation content, and the graph edge weight and the user portrait are updated based on user feedback. According to the method, semantic understanding precision, recommendation path interpretability and system adaptive capacity are improved, and the method is suitable for personalized voice recommendation, man-machine interaction and scene linkage control tasks in an intelligent cockpit.

The invention discloses a high-accuracy threat intelligence assisted network threat tracing method, which comprises the following steps: S1, collecting and preprocessing multi-source network security data, and constructing a time-marked event sequence set; s2, constructing an optimized Transform network model, and processing an attack event sequence by using position coding and time embedding; s3, a black swan optimization algorithm is initialized, and a Transform structure hyper-parameter is dynamically optimized; s4, outputting an attack event semantic vector, and constructing an attack path semantic map; s5, the intelligence information vector is embedded into a Transform hidden space; s6, calculating semantic similarity and dependency intensity, and generating an attack source candidate set and a traceability path; s7, outputting an attack traceability path, a starting point node and an information label, and generating a structured traceability report; and S8, according to the traceability result feedback, updating the black swan algorithm and the Transform model. The method is used for realizing intelligent modeling of multi-source network attack events and high-accuracy traceability analysis of attack source nodes.

The invention discloses a dynamic authority management system and method based on multi-source salary data integration, and relates to the technical field of salary data management, and the method comprises the following steps: collecting role names, authority boundaries and operation granularity information from a plurality of business systems, and generating structured role semantic ontology entries based on a field-level semantic annotation mode; and disassembling the to-be-mapped role according to the authority dimension, calculating a semantic similarity index between the to-be-mapped role and the standard role based on the role semantic ontology library, and outputting a role consistency scoring matrix. According to the method, the authority difference is identified through the role semantic ontology and the similarity score, the minimum authorization judgment is realized in combination with the rule engine and reinforcement learning, the audit traceability and anomaly detection are guaranteed by using the block chain and the dynamic graph, and finally a strategy self-evolution closed loop is constructed. And the problems of permission mismatching and data leakage caused by role semantic inconsistency are effectively solved.

The invention relates to the technical field of information resource fusion management, and particularly discloses a fusion and management system for multi-source heterogeneous science and technology information resources. Analyzing an equipment fault chain from an unstructured text of a historical operation and maintenance log, extracting a rated parameter constraint from a structured table of an equipment manual, and collecting an operation feature vector from a real-time sensing data stream to generate a knowledge graph containing N entity relationships; based on an entity attribute constraint rule of the knowledge graph, designing a bidirectional attention mapping network to calculate semantic similarity weights of multi-source data and knowledge nodes, and generating a graph embedding vector set with weight marks through Hadamard product operation; according to the method, the embedded vector set is input into the pre-trained graph neural network model, and the root cause equipment set causing feature offset is positioned, so that efficient fault diagnosis and positioning are realized, decision support is provided for a subsequent preventive maintenance strategy, and the reliability and the operation and maintenance efficiency of the system are improved.

An intelligent multi-modal component search and procurement system is provided. The system enables users to search for industrial components through multiple input modalities, including keyword queries, BOM (Bill of Materials) file uploads, and natural language interactions. The system dynamically refines search results using a combination of structured filtering, semantic similarity analysis, and machine learning. Key features include a chat interface for natural language processing (NLP), a selection panel for real-time filtering, and a product listing that adapts to user inputs. The invention improves efficiency in industrial procurement by integrating contextual understanding, schema validation, and embedding vector conversions.

The invention discloses an airport intelligent service question answering method and system based on AI, relates to the technical field of artificial intelligence, and comprises the steps of performing combined modeling by using a time sequence and a multi-head attention mechanism, extracting key behavior characteristics, fusing intention recognition and behavior prediction, and improving the answer reasoning accuracy. The method comprises the following steps: selecting a semantic knowledge base, constructing deep semantic representation and accurately matching the deep semantic representation with the semantic knowledge base, extracting high-weight phrases in combination with a sliding window mechanism, generating unique semantic fingerprints by utilizing a Karp-Rabin hash function, improving the speed and accuracy of answer matching, and performing fuzzy control and redundant information elimination on candidate answers by adopting a rough set tolerance model. Semantic similarity judgment is carried out according to the intersection and union set proportion between the upper and lower approximate sets, the problems of semantic drift and repeated candidates in traditional matching are effectively relieved, and through reinforcement learning and A / B testing, the question and answer strategy is continuously optimized, and the response effect of the system and the user satisfaction degree are enhanced.

The invention discloses an electronic medical record automatic quality control system and method based on a large language model, and the method comprises the steps: extracting medical record data from a medical information system, and carrying out the data preprocessing; and performing deep semantic analysis on the medical text by utilizing a large language model, and extracting key diagnosis and operation information. And performing semantic representation on the medical terms by fine tuning the pre-training language model and combining with a multi-layer attention mechanism. And constructing an ICD coding knowledge graph, and calculating the semantic similarity between the diagnosis terms and the ICD coding terms in the electronic medical record by using an embedded vector technology to realize automatic matching. And according to a predefined quality control rule, automatically checking the electronic medical record through the logic expression, and generating a quality control report and an improvement suggestion. And finally, visually displaying quality control and coding results, and outputting a quality control report. The electronic medical record quality control efficiency and accuracy are improved, and standardization and automation of quality control work are achieved.

The invention discloses an LLM capability enhancement method of a hybrid enhancement strategy, and particularly relates to the technical field of natural language processing. The method comprises the following steps: obtaining corpus data and external literature data of a target application field, carrying out denoising, word segmentation and semantic indexing processing, and establishing a searchable heterogeneous knowledge base; secondly, classifying the corpus data by adopting a topic analysis and word vector clustering method to form a basic corpus set; performing multi-round parameter updating on the large language model by using a domain fine tuning algorithm based on the basic corpus set, and setting a fusion threshold value between a new parameter and an original parameter; and retrieving related literature fragments from the heterogeneous knowledge base through a matching algorithm, screening content conforming to field correlation by utilizing semantic similarity evaluation, fusing the content with the fine-tuned model, processing a fusion result by adopting a context fusion algorithm and an entity linking method, completing syntactic analysis, and generating a precise solution oriented to the target application field.

The invention provides a large model scientific and technological problem generation method fusing external knowledge, which comprises the following steps: dynamically solving an optimal knowledge fusion strength parameter in a current environment by adopting a gradient descent algorithm through designing and optimizing an objective function according to association representation and difference representation between knowledge units, the knowledge unit balancing module is used for balancing correlation and complementarity among knowledge units; on the basis of real-time updating of knowledge fusion strength parameters, heuristic search is carried out in the knowledge unit association map by utilizing an ant colony optimization algorithm, and candidate fusion knowledge units which achieve target correlation and target complementarity with the current knowledge unit are selected by combining semantic similarity, association degree and difference among the knowledge units; a knowledge mapping ontology is used for guiding fusion of cross-domain knowledge, an ontology inference engine based on description logic is adopted to infer a semantic consistency relationship between fused knowledge units, and potential semantic conflicts are identified and eliminated through a consistency check algorithm.

The invention relates to the technical field of artificial intelligence and big data analysis, in particular to a data operation system and method based on a knowledge graph, and the method comprises the steps: extracting an entity and semantic relationship from multi-source business data, and constructing a dynamic evolvable initial knowledge graph; node features are aggregated, and multi-dimensional situation state vectors are generated in combination with gating loop unit modeling behavior path dependence; through a structure-semantic coupling attribution scoring mechanism, a statistical information gain and semantic similarity are fused to identify a core driving factor, and a causal regression model of the factor and an operation target is established; dynamically adjusting the edge weight and the structure of the atlas in real time, and triggering a new path discovery mechanism to continuously optimize the atlas; and according to a quantitative business target, reversely extracting a high-confidence influence path from the atlas, and generating a personalized strategy combination through intervention simulation and multi-target Pareto optimization, thereby realizing intelligent recommendation and decision closed loop driven by an operation target. According to the invention, higher-precision operation situation awareness and strategy generation are realized.

The invention relates to a data processing method and device based on big data and advertisement pushing, and the method comprises the following steps: obtaining the historical behavior data of a user on a multi-channel platform, constructing a dynamic interest label map according to the historical behavior data, and depicting a user interest evolution process. Combining with a social relation network to analyze an interest propagation path, forming a user social interest diffusion trajectory, and introducing a time decay weighting mechanism to generate a dynamic interest decay curve. According to the method, user interests and advertisement materials are subjected to semantic similarity matching, a personalized advertisement recommendation list is generated, an optimal advertisement putting strategy is determined through multi-target optimization configuration and comprehensive consideration of display positions, opportunities and forms, accurate and efficient advertisement pushing is achieved, and the problems that a traditional user portrait method often depends on a static label system, and the user experience is poor are solved. The dynamic characteristic that the user interest changes along with time is difficult to reflect, so that the advertisement recommendation content lags behind the real intention of the user.

The invention discloses a video content semantic understanding and text description generation method based on deep learning, and relates to the technical field of multimedia information processing.The method comprises the steps that the semantic similarity of a text and a video frame is calculated through a CLIP model, related key frames are selected, and features are aggregated; respectively extracting audio, visual and semantic features; aligning different modal features by using self-attention, unifying dimensions of the LSTM, and then splicing and fusing; attention weights are calculated at a video level, a frame level and a channel level, and key information expression is enhanced; swin Transform encodes fusion features, and LSTM (Long Short Term Memory) decodes step by step to generate natural language description; and a text-video index database is constructed, and rapid retrieval is realized based on semantic similarity. According to the method, the mapping relation between the video features and the natural language is learned end to end through the deep learning model, dependence on a fixed template can be eliminated, and semantic description with various sentence patterns and coherent logic is generated.

The invention provides a method and a device for converting a natural language statement into an SQL (Structured Query Language) and a storage medium, relates to the technical field of data processing, and is used for improving the accuracy of converting the natural language statement into the SQL statement. The method comprises the steps that semantic analysis is conducted on a data query text, a target entity and at least one query field are obtained through extraction, and the target entity indicates a query intention corresponding to the data query text; determining a comprehensive similarity between each query field and each first candidate node according to a semantic similarity and a structural similarity between each query field in the at least one query field and each first candidate node in a pre-stored knowledge graph; determining a target node corresponding to each query field according to the comprehensive similarity between each query field and each first candidate node; according to the information, the data query text can be converted into the structured query statement.

The invention provides an intelligent retrieval matching method and system for multidimensional data of image-text features, and relates to the technical field of icon image retrieval. Comprising the following steps: extracting image features, text content and semantic features of an icon image by using a convolutional neural network, an image segmentation attention mechanism network, a converter optical character recognition model and a bidirectional semantic understanding model, constructing the extracted features into heterogeneous feature tensors, and performing singular value decomposition to obtain icon feature fingerprint vectors; and constructing a multi-level index based on locality sensitive hashing, realizing rapid retrieval, calculating visual, text and semantic similarities in combination with a deep metric learning model, weighting according to variances and discrimination coefficients of similarity features to obtain a comprehensive similarity score, and outputting a retrieval result with the highest similarity.

The invention relates to the technical field of artificial intelligence, and discloses a method for scoring question and answer pairs based on a reward mechanism to realize large model fine tuning, comprising the following steps: S1, screening initial question and answer pairs from historical chatting records of an artificial customer service; s2, scoring the initial question and answer pairs based on a reward mechanism; s3, screening high-score question and answer pairs and updating the business question and answer pair knowledge base; s4, performing fine tuning training on the large model based on the updated business question and answer pair knowledge base; s5, executing an intelligent customer service question and answer task by using the fine-tuned large model, the S1 comprising: performing data cleaning and preprocessing on historical chat records, and eliminating invalid question and answer pairs; using a semantic model to calculate the semantic similarity between the questions and the answers, and screening question and answer pairs with complete semantics; according to the invention, through the reward mechanism-based question and answer pair scoring method and dynamic knowledge base updating, high business adaptability and accurate question and answer ability of a large model are realized, and the service efficiency and individuation level of intelligent customer service are improved.

Aspects of the present disclosure relate to detecting hallucinations in language model outputs. Embodiments include receiving a user query. Embodiments further include prompting a language processing machine learning model to generate responses to the user query in each language of a set of multiple languages. Embodiments further include receiving the responses from the language processing machine learning model in response to the prompting. Embodiments further include creating embedding representations of the responses. Embodiments further include calculating, based on the embedding representations, a degree of semantic similarity between the responses. Embodiments further include determining that a response of the responses contains a model hallucination based on comparing the degree of semantic similarity between the responses to a threshold.

Database systems and methods are provided for managing usage of large language models (LLMs). One method involves determining a numerical representation of a conversational input to a user interface, identifying a semantically similar subset of prior conversational inputs based at least in part on the numerical representation of the conversational input, and determining numerical representations of respective conversational responses generated by a language model responsive to the respective prior conversational input of the semantically similar subset. When the numerical representations of the respective conversational responses satisfy a semantic similarity threshold, the method automatically generates an automated response to the conversational input based at least in part on one or more prior conversational responses and automatically provides the automated response to the user interface responsive to the conversational input.

Techniques for document recommendation based on conversational log for real time assistance are described. A first machine learning module identifies key phrases of a conversational log in real time. The first machine learning module executes multiple machine learning models trained to determine a probability that a portion of a conversation includes a key phrase. A second machine learning module identifies assistance pertaining to the identified key phrases of the conversational log. The second machine learning module executes a machine learning model trained to identify semantic similarity and word matching features of embedding representations of the key phrases and a knowledge base of assistance. The assistance is provided to a user during a conversation in real time.

The invention discloses a voice recognition model optimization method and device based on reinforcement learning, equipment and a medium, and relates to the technical field of voice recognition, and the method comprises the steps: determining a current optimization strategy of a current time step; randomly selecting one piece of enhanced speech training data and corresponding real text training data from the data training set as target training data, and inputting the target training data into the current automatic speech recognition model for prediction to obtain a plurality of prediction texts output by the current automatic speech recognition model; determining a text matching degree and a semantic similarity between each prediction text and real text training data to obtain a group of target reward values, updating an optimization strategy at the current moment based on the target reward values, and skipping to execute the step of determining the current optimization strategy of the current time step to obtain a target reward value; and outputting the corresponding optimized automatic speech recognition model until the current automatic speech recognition model meets the optimization ending condition. And reasonable optimization of the automatic speech recognition model is realized.

The invention relates to the technical field of knowledge graph construction, in particular to a node attenuation and edge similarity weight fused knowledge graph construction method and system, and the method comprises the steps: collecting multi-source heterogeneous data, and carrying out the preprocessing of the multi-source heterogeneous data; identifying entities in the preprocessed multi-source heterogeneous data, and extracting a relationship between the entities; establishing an initial graph structure based on the entities and the relationship between the entities, and determining the representation mode of nodes and edges in the graph; fusing time decay and space correlation factors to correct representation of nodes and edges in the constructed graph structure, and fusing semantic similarity on the basis of node and edge weight correction to further adjust an edge connection relation; after the graph structure is corrected and optimized, final knowledge graph data representation is organized and generated, and unified storage and graph calculation structured packaging are completed. According to the method, the defect that an existing map construction scheme only depends on time attenuation and neglects space factors can be effectively overcome.