Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

6226 results about "Index term" patented technology

An index term, subject term, subject heading, or descriptor, in information retrieval, is a term that captures the essence of the topic of a document. Index terms make up a controlled vocabulary for use in bibliographic records. They are an integral part of bibliographic control, which is the function by which libraries collect, organize and disseminate documents. They are used as keywords to retrieve documents in an information system, for instance, a catalog or a search engine. A popular form of keywords on the web are tags which are directly visible and can be assigned by non-experts. Index terms can consist of a word, phrase, or alphanumerical term. They are created by analyzing the document either manually with subject indexing or automatically with automatic indexing or more sophisticated methods of keyword extraction. Index terms can either come from a controlled vocabulary or be freely assigned.

Construction method and device of knowledge base question-answering system, equipment and storage medium

The invention relates to the technical field of database construction, in particular to a knowledge base question-answering system construction method and device, equipment and a storage medium. The method comprises the following steps: acquiring a user question instruction, and performing part-of-speech tagging and keyword vectorization on a target text to generate a retrieval text keyword vector; performing semantic linear embedding and spatial projection processing on the keyword vectors to obtain keyword semantic vectors; logic mining is conducted on the keywords, a logic relation set among the keywords is obtained, logic recognition is conducted on the target text based on the relations, and retrieval text logic is generated; performing matching retrieval with semantic vectors in a knowledge base to obtain a candidate semantic query data set; and performing coherent logic retrieval on the candidate data set according to the retrieval text logic and the keyword vector to generate a final retrieval target answer. According to the method and the system, more accurate and efficient knowledge base question-answering system construction is realized.
Owner:YINGZHI FUTURE (SHENZHEN) ARTIFICIAL INTELLIGENCE TECH CO LTD

Dynamic knowledge retrieval enhancement method based on large language model

The invention discloses a method for enhancing dynamic knowledge retrieval based on a large language model, belongs to the field of knowledge retrieval, and aims to solve the problems of knowledge solidification, insufficient timeliness and illusion of a traditional LLM (Logistics Language Model). A multi-granularity knowledge base is dynamically constructed, and a rule and semantic partitioning technology is combined, so that a text is converted into a normalized vector, and a hybrid index is established; a two-channel retrieval triggering mechanism is adopted, keyword matching scores and BERT semantic probability analysis are fused, and retrieval requirements are intelligently judged; vectorization retrieval is realized through a BGE-M3 model, and candidate results are reordered in combination with a cross encoder to improve the precision. The system supports multi-language adaptive processing, dynamic switching of word segmentation strategies and cross-language retrieval, and introduces real-time knowledge updating and version control. According to the method, the answer timeliness and accuracy are remarkably improved, the context coherence of multiple rounds of dialogues is optimized, the method can be widely applied to the fields of intelligent customer service, professional questions and answers and the like, the LLM illusion risk is effectively reduced, and the knowledge traceability is enhanced.
Owner:SICHUAN ZHONGTIAN YINGYAN INFORMATION TECH CO LTD +1

Multi-source and multi-mode fused knowledge reasoning method, system and device and medium

The invention discloses a knowledge reasoning method, system and device fusing multiple sources and multiple modes and a medium. The method comprises the steps that obtained multi-mode data are packaged to form RAG retrieval tool services; performing intention recognition, question rewriting and sub-question and keyword extraction on a user query question to form a sub-question list and a keyword list; matching the sub-question list with an RAG retrieval tool service, determining the RAG retrieval tool service, and determining a knowledge graph retrieval library according to the keyword list; inputting the sub-questions into a matched RAG retrieval tool service for retrieval, and inputting the keywords into a knowledge graph retrieval library for retrieval; and the retrieval results are subjected to deduplication, combination and sorting by using the large language model, and the response result of the large language model is used as the knowledge reasoning result. The method can support a multi-source and multi-modal data scene applied in the legal field, realizes matching reasoning of knowledge base tool services and user query sub-problems and keywords, and effectively supports retrieval enhancement of a multi-source data knowledge base in the legal field.
Owner:SHANGHAI ZHIHE NETWORK TECH CO LTD +1

Plasticizing product recommendation method and system based on user demands

The invention provides a plasticizing product recommendation method and system based on user demands, and relates to the technical field of plasticizing product recommendation, and the method comprises the steps: S1, constructing a plasticizing industry knowledge graph; s2, acquiring user historical data and current user requirements, including historical search data, historical browsing data, historical interaction data and historical transaction data; s3, preprocessing the historical data of the user, analyzing the preprocessed historical data of the user, and extracting historical demand features; s4, performing keyword extraction on the current user demand by utilizing the semantic understanding model, and generating an optimized query condition in combination with the chemical and plastic industry knowledge graph; s5, searching in a plasticizing product database by utilizing the optimized query condition to obtain a first list; and S6, carrying out personalized sorting on the first list by utilizing the chemical and plastic industry knowledge graph, generating a recommendation list from the first k lists, and presenting the recommendation list to the user. According to the invention, the relevance and accuracy of recommendation can be improved, so that the user experience is improved.
Owner:SHANGHAI DITABANK DATA TECHNOLOGY CO LTD

Retrieval generation method and device based on large language model and knowledge graph

The embodiment of the invention discloses a retrieval generation method and device based on a large language model and a knowledge graph. The problems that retrieval semantic relevance is weak, and recalled data lacks global knowledge can be solved. The method comprises the following steps: performing vector analysis on a plurality of preset domain documents, and constructing a vector database; constructing a knowledge graph according to the entity description information and the relationship description information extracted from the plurality of field documents, and storing the knowledge graph into a graph database; performing feature extraction on a target question input by a user to obtain a multi-dimensional keyword corresponding to the target question; retrieving the multi-dimensional keywords through a preset search engine, a vector database and a graph database to obtain a target retrieval result; and determining target input information according to the target retrieval result, and inputting the target input information into the target language model to obtain target output response information.
Owner:北京中科闻歌科技股份有限公司

Power document intelligent question and answer method and system based on large language model

The invention belongs to the technical field of artificial intelligence, and relates to a power document intelligent question and answer method and system based on a large language model. The method comprises the steps of obtaining document data according to a preset period; preprocessing the document data to obtain an adaptive document; constructing a vector retrieval library through an embedded model according to the adaptive document; obtaining a user query question, inputting the user query question into a vector retrieval library, performing retrieval based on a vector similarity retrieval method and a keyword retrieval method to obtain related text blocks, and screening out the most related text block from the related text blocks through a two-stage rearrangement technology; a user queries the question and the most relevant text block and inputs the question and the most relevant text block into the large language model to obtain preliminary intelligent answer information; and correcting the preliminary intelligent answer information based on a preset self-provincial inversion mechanism to obtain final intelligent answer information. Multiple rounds of questions and answers and context understanding are supported based on a correction mechanism, context consistency can be kept in continuous query of complex technical questions, and the accuracy of multiple rounds of questions and responses is ensured.
Owner:DATANG HYDROPOWER SCI & TECH RES INST CO LTD +2

Knowledge base enhancement generation method and system based on hybrid retrieval and fact verification

The invention discloses a knowledge base enhancement generation method and system based on hybrid retrieval and fact verification. The method comprises the following steps: receiving an original query of a user; performing intention analysis and rewriting on the query, identifying an intention type and generating a sub-query adapted to retrieval; executing mixed retrieval of vector retrieval, keyword retrieval and selectable knowledge graph retrieval based on the sub-query, and recalling related knowledge fragments; performing deduplication clustering, fact conflict recognition processing and correlation reordering on the knowledge fragments; according to the intention type and the reordered knowledge fragment, dynamically selecting a prompt template to construct an enhanced prompt; and sending the enhanced prompt into the large language model, and generating a target response with the reference source. According to the method, knowledge recall comprehensiveness is improved through mixed retrieval, knowledge reliability is ensured through fact verification, generation logicality is enhanced in combination with dynamic prompt construction, and response accuracy and credibility are improved.
Owner:HANGZHOU MEITENG TECH CO LTD

Intelligent retrieval method and system for unstructured asset content based on large model

The invention provides an intelligent retrieval method and system for unstructured asset content based on a large model, and relates to the technical field of data retrieval, and the method comprises the steps: carrying out semantic expansion on retrieval keywords through a knowledge graph enhancement module, obtaining asset feature vectors through a multi-modal feature extraction model, and constructing a hierarchical asset feature index database; the comprehensive similarity is calculated through a weighted fusion algorithm, and retrieval results are optimized and reordered through semantic comprehension and correlation analysis capacity of the pre-trained large model. According to the method, the retrieval precision and efficiency of the unstructured asset content are improved, and intelligent association analysis and semantic understanding of cross-modal assets are realized.
Owner:北京科杰科技有限公司

Hybrid enhanced indexing method and system based on vector retrieval and BM25 algorithm

The invention discloses a hybrid enhanced index and system based on vector retrieval and a BM2 algorithm, and the method comprises the steps: uploading a document by a user, analyzing the document by the system to obtain text content, segmenting the text content, converting the segmented text content into dense vectors, storing the dense vectors in a vector library, extracting keywords of segmented texts by using a large model, processing the keywords, and inserting the keywords into a word list. Word segmentation is carried out on the text based on the constructed word list and a word segmentation device; in response to the received user query, vectorizing the user query, and calculating the similarity with each vector in the vector library to obtain a preliminary query result; performing word segmentation on user query, performing keyword retrieval by using a BM25 algorithm according to a word list and a word segmentation device to obtain query results, and filtering the similarity of the two query results by the reordering model according to a set threshold value; selecting a result with the highest similarity according to large model parameter limitation and an upper limit set by business requirements; and splicing the document content corresponding to the result and the user query into a cue word, inputting the cue word into the large model, and analyzing a semantic relationship and a logic structure in the cue word to generate an answer.
Owner:XIAMEN MEIYABAIKE INFORMATION SECURITY RES INST CO LTD

Building electromechanical BIM model information rapid retrieval method and system

The invention discloses a building electromechanical BIM model information rapid retrieval method and system, and the method comprises the steps: generating composite retrieval parameters fusing semantic keywords and three-dimensional coordinate constraints according to a multi-mode retrieval instruction inputted by a user; on the basis of the composite retrieval parameters, constructing a dynamic search space by utilizing a hierarchical graph convolutional network, and generating a candidate model index structure of multi-dimensional feature coding; inputting the candidate model index into a multi-objective optimization engine, performing real-time optimization on a search path by adopting a dynamic pruning algorithm driven by reinforcement learning, and outputting a candidate model set of which the confidence coefficient is higher than a preset confidence threshold after pruning; and on the basis of the candidate model set, associated equipment nodes are expanded through a knowledge graph embedding and complementing technology, and an enhanced retrieval result set containing the hidden associated equipment is generated. By utilizing the embodiment of the invention, efficient, multi-dimensional and multi-modal information accurate positioning and quick retrieval can be realized in a large-scale complex BIM model.
Owner:杭州美屋美居数智科技有限公司

Archive information resource intelligent sharing method and system based on AI

The invention relates to the technical field of archive information query, and discloses an AI-based archive information resource intelligent sharing method and system, and the method comprises the steps: firstly constructing a multi-dimensional data module according to a business data type, and the multi-dimensional data module comprises an archive system database, a high-dimensional document vector database and an archive business knowledge graph; and performing deep analysis on user query through a natural language processing tool to form a structured keyword list. Then, performing semantic analysis on the keyword list by utilizing a pre-trained archive information resource understanding large model, and generating an enhanced query text; the query text is recalled from the data modules of the multiple dimensions, candidate answers are obtained, and the candidate answers are fused and optimized through the general large language model. And finally, returning the optimal answer to the user. By introducing the AI technology, the accuracy and comprehensiveness of file information resource sharing are improved, the retrieval result is optimized, and the retrieval efficiency is improved.
Owner:INST OF GEOLOGY CHINESE ACAD OF GEOLOGICAL SCI

Method and system for performing paragraph matching knowledge questioning and answering on air traffic control industry based on large model

The invention discloses a paragraph matching knowledge question-answering method and system for an air traffic control industry based on a large model, belongs to the technical field of natural language processing, and aims to solve the technical problem of how to realize efficient and accurate information retrieval for a scene of big data question-answering in work in the current air traffic control industry. According to the technical scheme, the method comprises the following steps of: initializing a knowledge base and optimizing a structure; according to the enhanced BGE retrieval mechanism, in the retrieval process, based on basic keyword matching, an advanced semantic retrieval technology BGE model is adopted; the BGE model and the Baichuan model are matched, so that the retrieval accuracy is improved, and the flow field experience is provided for a user; real-time feedback and interactive optimization are carried out; continuous learning and knowledge base iteration are carried out; and through a multi-level indexing and caching strategy, a retrieval result is optimized.
Owner:SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD

Multi-modal interview automatic quality analysis and evaluation method and system based on large model

The invention discloses a multi-modal interview automatic quality analysis and evaluation method and system based on a large model, and the method comprises the steps: collecting and storing multi-modal data, such as texts, audios, videos and behavior interaction, and carrying out the preprocessing of the multi-modal data to form a standardized data set; utilizing a preset interview structure and a large model to dynamically guide the process, adjusting the topic rhythm according to real-time feedback, and recording stage conversion information to form logic trajectory data for process coherence management; automatically coding text data through a large language model, extracting features such as keywords and performing topic clustering, performing cross validation and semantic fusion in combination with data analysis results of each modal, and generating deep analysis results such as psychological states; and generating a comprehensive assessment report containing qualitative description, quantitative score and psychological abnormality or cognitive disorder risk prompts based on a deep analysis result, thereby providing a basis for psychological health assessment and cognitive competence evaluation. According to the method, automatic analysis of multi-modal data is realized, and evaluation scientificity and efficiency are improved.
Owner:BEIJING NORMAL UNIVERSITY +1

Knowledge base generation and retrieval method based on RAG technology and intelligent question answering system

The invention discloses a knowledge base generation and retrieval method based on the RAG technology and an intelligent question answering system, and belongs to the technical field of natural language processing, and the knowledge base generation and retrieval method based on the RAG technology and the intelligent question answering system based on the RAG technology have the beneficial effects that the accuracy and the real-time performance of information processing are improved through efficient combination of retrieval and generation. High-dimensional vector representation is generated through text slicing and vectorization, a vocabulary index is constructed, and hierarchical retrieval and keyword matching are achieved; meanwhile, a question generation and question-question retrieval method is utilized, a result is optimized and generated in combination with a large language model (LLM), the reasoning ability of the large model is further improved through chain reasoning (COT) and a cue word optimization module, and it is ensured that the generated answer has high accuracy and logicality; the method can be widely applied to the fields of intelligent question answering, knowledge base construction, real-time information retrieval and the like.
Owner:ZHONGCARB PUHUI CLOUD TECHNOLOGY CO LTD

Method and system for processing data based on large language model

The invention relates to the technical field of data processing, in particular to a method and system for processing data based on a large language model.The method comprises the following steps that based on inter-sentence punctuation positioning and part-of-speech tagging, sentence blocks are divided to generate functional partitions, themes and relational words are extracted to judge semantic chain starting points, a trigger index sequence is constructed, and logic jump points and breakpoint positions are recognized; and mapping the label structure to the language model output analysis deviation, and generating a label mapping combination list. According to the method, semantic turning nodes can be captured by analyzing the semantic direction change trend, the relation between the semantic turning nodes and verb and noun combinations is judged, the position of a trigger point of an actual information transfer effect is extracted, and the break point area of a semantic path is recognized through the positioning of key word starting and stopping blocks and the logical judgment of noun group cross combination; the path integrity has a clear fracture identifier, a traceable semantic mapping structure path is established in a language model, and the accuracy, coherence and hierarchy clearness of semantic reconstruction are enhanced.
Owner:BEIJING SHENZHOU BANGBANG TECH SERVICE CO LTD

Document retrieval method based on multistage index and feature clustering

The invention relates to the technical field of document retrieval and information processing in the data processing technology, in particular to a document retrieval method based on multistage indexing and feature clustering, which comprises the following steps: performing high-dimensional space mapping on multi-modal features such as texts and images through a quantum embedding layer to generate cross-modal joint feature representation; a first-level index of a multi-level index architecture is dynamically initialized based on a meta-clustering algorithm, and semantic blocks of a second-level index are divided in combination with a multi-head self-attention mechanism. And an optimal transmission matrix is generated by using a Sinkhorn algorithm to align cross-node feature distribution. The multi-target mixed retrieval strategy is fused with vector retrieval, keyword retrieval and graph retrieval results, and weight distribution is dynamically adjusted. Through collaborative optimization of quantum calculation, federated learning and causal reasoning, a closed-loop technical architecture from feature analysis to dynamic index construction is formed, the problems of insufficient cross-modal fusion, static clustering deviation and semantic association deficiency are solved, and the precision, efficiency and dynamic adaptability of heterogeneous document retrieval are improved.
Owner:TAIJI COMPUTER CORPORATION LIMITED

Mine prospecting prediction method based on multi-agent technology

The invention provides a prospecting prediction method based on a multi-agent technology. The method specifically comprises the steps that S11, keyword extraction is conducted on mineral problems input by a user; s12, establishing a vector database of the mineral knowledge text and a graph database of the mineral knowledge graph, and optimizing the extracted keywords to generate cue words; s13, constructing a large prospecting model to think the cue words, expanding the cue words, and obtaining a complete statement for professional expression of the user question again; s14, performing multi-task decomposition on the complete statement to obtain a plurality of sub-tasks, and scheduling the plurality of sub-tasks to corresponding agents based on a graph database of the mineral knowledge graph to perform step-by-step prediction; and S15, integrating prediction results of the intelligent agents and feeding back the integrated prediction results to a user. According to the method, prospecting prediction is promoted to be converted from manual driving to intelligent driving, and emerging technical support is provided for prospecting breakthrough.
Owner:CHINA GEOLOGICAL SURVEY NATURAL RESOURCES COMPREHENSIVE SURVEY COMMAND CENT

Retrieval enhancement generation-based retrieval method, product, equipment and medium

The invention discloses a retrieval method based on retrieval enhancement generation, a product, equipment and a medium, and relates to the technical field of natural language processing. According to the scheme, an entity in initial query information is identified, so that a system can be helped to capture key information and a semantic structure in user query, and the accuracy of query understanding is improved; entities in the initial query information are expanded based on the knowledge graph, so that implicit background information can be supplemented, and a system can better process incomplete or fuzzy queries; due to the introduction of the knowledge graph, the system can better understand and process the query of the professional field by utilizing the specific structured knowledge of the field; and meanwhile, the knowledge graph can be conveniently expanded or replaced into professional knowledge bases in different fields, so that the adaptability of the system is improved. In the semantic matching process, keyword matching and semantic matching are combined, the query intention of the user and the content of the text block to be retrieved can be more comprehensively understood through multi-layer semantic matching, and the retrieval precision is remarkably improved.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Knowledge graph enhanced expert information retrieval prompt project self-generation method and device

The invention discloses a knowledge graph enhanced expert information retrieval prompt project self-generation method and device, and the method comprises the steps: extracting a keyword of a request input by a user through employing a pre-trained large language model, and carrying out the intention understanding analysis of the keyword based on a vertical domain expert knowledge graph, and obtaining a knowledge graph retrieval result; the search intention of the user is redescribed by utilizing a knowledge graph retrieval result, and a plurality of prompt statements for task execution are generated in combination with the calling capability of a large language model tool; scoring the accuracy of the plurality of prompt statements, and inputting a scoring result into a large language model agent for query and task execution response to obtain a query result containing expert information feature data; and generating a prompt statement capable of guiding multi-modal expert information fusion expression according to expert information feature data contained in the query result. According to the method, the vertical domain service capability of the general large language model is effectively expanded, and the method has an important value for promoting the application of a generative artificial intelligence technology in the field of experts.
Owner:STATE GRID HUBEI ELECTRIC POWER RES INST +1

Enterprise-level knowledge base construction method based on large model

The invention discloses an enterprise-level knowledge base construction method based on a large model. The enterprise-level knowledge base construction method comprises the following specific steps: acquiring original data of an enterprise and preprocessing the original data to obtain first target data; performing knowledge extraction and representation based on the first target data to obtain second target data; based on the random-degree large model and the second target data, performing knowledge graph construction and storage to obtain an enterprise-level knowledge base; performing knowledge retrieval and recommendation on the enterprise-level knowledge base by using a modular retrieval enhancement generation method; and periodically updating and maintaining the enterprise-level knowledge base. According to the method, keywords and concepts in various knowledge carriers such as internal documents, reports and communication records of enterprises can be automatically identified based on the strong analysis capability of the random-degree large model, and automatic association among knowledge elements is realized; the enterprise-level knowledge base is quickly constructed, the knowledge base is periodically updated and maintained in time, the content of the enterprise-level knowledge base is enriched, and a foundation is laid for subsequent enterprise knowledge search.
Owner:IOL WUHAN INFORMATION TECH CO LTD

Standard substance and standard substance retrieval and sorting method and system based on search engine

The invention provides a search engine-based standard substance and standard substance retrieval and sorting method, which relates to the technical field of data processing, and comprises the following steps: acquiring retrieval keywords input by a user, constructing a standard substance and standard substance knowledge base, mapping to a low-dimensional semantic space, calculating the semantic correlation between the retrieval keywords and the standard substance knowledge, and constructing a heterogeneous information network. Generating comprehensive relevancy measurement, and performing multi-granularity semantic matching to obtain candidate retrieval results; for structural features corresponding to the candidate retrieval results, adaptive feature weights are distributed, independent clustering is carried out, subspace clustering results are obtained, optimization is carried out, global optimal clustering results are obtained, high-order semantic association features are mined, cross-category semantic association is carried out, and high-quality retrieval results are generated; performing low-rank decomposition to obtain an initial comprehensive score, modeling a sorting problem as a Markov decision process, determining an action space and a state space, constructing a reward function, determining a sorting position, and obtaining an optimal sorting result.
Owner:TAN-MO TECH CO LTD

Data reordering retrieval method and system based on RAG

The invention provides a data reordering retrieval method and system based on RAG, and the method comprises the steps: carrying out the dynamic semantic partitioning processing of an original document, generating corresponding document blocks, storing the document blocks in a vector database, constructing a hierarchical index, analyzing a received query request, extracting keywords in the query request, and carrying out the retrieval of the query request. Boolean keyword matching is carried out through an inverted index in the hierarchical index, semantic retrieval of keywords is carried out in a vector database, an initial candidate set is generated after multi-source retrieval results are fused, a query request and the initial candidate set are input into a generative reordering model, and a query result is obtained; according to the method, the initial candidate set is selected, the corresponding score is generated through the cross-modal attention mechanism in the generative reordering model, the initial candidate set is reordered according to the score, the final retrieval result is obtained, and the reordered document blocks are displayed, so that the overall retrieval speed is increased, the limitation of a single retrieval mode is avoided, and the accuracy of the retrieval result is improved.
Owner:TAIJI COMPUTER CORPORATION LIMITED

Low-altitude intelligent question and answer construction method and system based on dynamic parameters

The invention relates to a low-altitude intelligent question and answer construction method and system based on dynamic parameters. The method comprises the following steps: collecting low-altitude domain data, cleaning the low-altitude domain data, generating a semantic vector index, and constructing a low-altitude domain knowledge base based on the semantic vector index; receiving a natural language query of a user, analyzing a query intention, extracting keywords in the natural language query, and matching a corresponding candidate word quantity based on query types of the natural language query of the user, the query types at least comprising high-frequency phrase query and low-frequency long-tail query; and respectively carrying out fusion semantic retrieval and keyword retrieval, carrying out secondary sorting on the candidate results based on a preset resorter, preferentially sorting the candidate results related to the query intention, and outputting the corresponding candidate results. By adopting the method, a combined domain retrieval enhancement generation mechanism is provided, so that the professionality and accuracy of answers are improved; and the retrieved knowledge base content is re-screened to increase the hit probability of the knowledge base.
Owner:CHINA TELECOM UNMANNED TECHNOLOGY (JIANGSU) CO LTD

RAG system optimization method and system, electronic equipment and storage medium

The invention discloses an RAG system optimization method and system, electronic equipment and a storage medium. The method comprises the following steps: converting a document into an image; analyzing the image, and identifying four coordinates and a target category of the anchor frame; text content in the image is extracted, and a document with a structured mark is generated; titles are sequentially extracted from the document with the structured marks, the titles are input into the large language model, and titles in hierarchical relation are generated; replacing the original title with the title with the hierarchical relationship to generate summary information; generating a plurality of document blocks by taking each hierarchical title as a segmentation point; converting each document block into a high-dimensional vector; and based on vector search and keyword search, determining a final result of retrieval. According to the method, the performance of an RAG system in a complex question and answer task is remarkably improved, similar documents can be effectively distinguished, the global semantics of the documents can be better understood, finally more accurate and comprehensive answers are provided, and the limitation of a traditional method in coping with a complex document scene is effectively relieved.
Owner:HANGZHOU HARMONYCLOUD TECH CO LTD

Model analysis method and device based on knowledge graph, equipment and medium

The invention relates to the technical field of data analysis, can be applied to business scenes of medical health, financial science and technology, culture research and the like, and discloses a knowledge graph-based model analysis method, which comprises the following steps of: acquiring and processing target domain data, extracting and labeling keywords, constructing a knowledge graph comprising domain entities, a relational network and attribute characteristics, and analyzing the knowledge graph. Establishing a professional corpus and generating an analysis task, constructing a multi-dimensional analysis index system, inputting the analysis task to a to-be-analyzed model, obtaining a task output result, performing knowledge verification according to the knowledge graph, evaluating the knowledge verification result based on a multi-dimensional analysis index, and generating a final analysis result. According to the method, by fusing the knowledge graph and the multi-dimensional analysis indexes, the accuracy and comprehensiveness of evaluation are enhanced, the evaluation effect of the model in the aspects of professional knowledge understanding, reasoning ability and standard integrating degree is improved, the evaluation result is more reliable, and the application ability of the large model in the specific field is optimized.
Owner:PING AN TECH (SHENZHEN) CO LTD

Multi-knowledge granularity text retrieval method and device for RAG

The invention provides a multi-knowledge-granularity text retrieval method and device for RAG, and the method comprises the steps: sorting an original text into a JSON file, carrying out the recursive character and semantic dicing processing, generating a target JSON file, and storing the target JSON file in a BM25 database and a vector database; when a user queries, preprocessing to generate a keyword list and a query embedded vector; searching for a target text in the BM25 database, and calculating a score of correlation with the keyword to determine a first to-be-selected text; determining a second to-be-selected text according to the query embedding vector; and performing duplicate removal processing on all the first to-be-selected texts and the second to-be-selected texts, and determining and outputting a final recommended text by utilizing a sorting model. By considering the problem of different search granularities, the keyword granularity is solved by adopting a BM25 algorithm. According to the semantic retrieval strategy combining sentence granularity and segment granularity, challenges of different text information lengths and different retrieval purposes are effectively handled, and therefore the advantages of traditional retrieval and semantic retrieval are fully utilized.
Owner:CHINA CONSTRUCTION BANK

Large model training data synthesis method, system and device and storage medium

The invention provides a large model training data synthesis method, system and device and a storage medium, and the method comprises the steps: carrying out the preprocessing of original military corpus data, generating a semantic vector through a pre-training language model, dividing the semantic vector into a plurality of topic clusters through clustering analysis, extracting the keyword and representative sample of each topic cluster, forming a theme ontology library; selecting associated topic pairs based on the topic similarity matrix, and generating a synthetic sample through a predefined template; controlling the language style of the synthetic sample through the cue word instruction, and generating a stylized sample; dividing difficulty grades of the stylized samples to obtain graded samples; performing multi-dimensional quality evaluation and screening on the graded samples to obtain screened samples; the screened samples are used for training a large language model, and according to the performance of the large language model in each theme task, theme weights are adjusted, a synthesis strategy is updated, and a sample structure is optimized. According to the method, high-quality and diversified training data can be provided for large model training.
Owner:XIAMEN YUANTING INFORMATION TECH CO LTD +1

Knowledge-enhanced large model data analysis agent visualization method

The invention relates to a knowledge-enhanced large model data analysis agent visualization method, which comprises the following steps of: performing syntactic analysis by using a PCFG algorithm, identifying syntactic components and relationships of sentences, and splitting the sentences into sub-sentences with complete logic; extracting keywords and entity words of the sentences by combining a word segmentation technology with a business word segmentation library; recommending and summarizing candidate segmented words through a recall strategy, carrying out rough arrangement, fine arrangement and fine arrangement on the candidate segmented words, and correcting and complementing a segmented word result; splitting and analyzing the natural language problem based on the fine-tuned large model, and generating SQL statements meeting business requirements; analyzing the data set generated by the SQL, extracting field information and business meanings, and identifying an association relationship between fields; and automatically recommending chart styles according to data features and user preferences, assembling an analysis report and distributing the analysis report according to a specified frequency. According to the method, knowledge enhancement and large model technologies are combined, so that the efficiency and effect of data analysis and visualization are remarkably improved.
Owner:WHALE CLOUD TECH CO LTD

Multi-modal literature data extraction method and device and medium

The invention discloses a multi-modal literature data extraction method and device and a medium. The method comprises the following steps: firstly, standardizing literatures to obtain a structured document comprising a literature directory, author information, a paragraph text, a paragraph layout, a table LaTeX code, a formula LaTeX code and / or image description; then, related retrieval of fragments is performed on texts, formulas, tables and images from the structured document according to keywords and / or vectorization retrieval strategies. The retrieved fragments are optimized through correlation sorting, and the number of the fragments needing to enter large model processing is reduced. And finally, performing question and answer configuration on the large language model based on a user extraction demand and a sorting fragment, generating a structured answer through a prompt engineering technology, ensuring that the results can be traced through an original fragment, ensuring the availability of question and answer results, and reminding the user to verify and process a part which cannot be traced when necessary.
Owner:ZHEJIANG LAB

Database AI question answering system and method based on large language model and retrieval enhancement

The invention discloses a database AI question-answering system and method based on a large language model and retrieval enhancement, and the method comprises the steps: firstly obtaining input information, and extracting keywords according to the input information; performing text data vectorization processing according to the keywords; performing retrieval in the database through a vector retrieval technology to obtain retrieval data; and finally, in combination with natural language answers and retrieval data generated by the large language model, answer information is generated and output. According to the method, the natural language processing capacity of the large language model and the vectorization retrieval technology are combined, and the problems related to the database can be efficiently and accurately answered. The system comprises a natural language processing module, a vectorization retrieval module, a question and answer generation module and a result verification module, and can understand questions proposed by a user, retrieve a related database, generate accurate answers, verify the correctness of a query result and improve the user experience. The problems that in the prior art, it is difficult to understand user intentions and the accuracy of generated answers is not high are solved.
Owner:RUIYU SPACE TIME TECH (CHONGQING) CO LTD