480 results about "Headword" patented technology

The invention discloses a large model knowledge base construction method based on multi-granularity retrieval. The method comprises the steps of obtaining a target text and analyzing a document structure, splitting and reorganizing text data according to three levels of titles, fragments and sentences, and constructing three levels of knowledge of the titles, the fragments and the sentences; using a large language model to construct a generative index as question-level knowledge according to the sentence-level knowledge; using a vector model to generate a first vector representing index keys of fragment-level knowledge and / or sentence-level knowledge, and a second vector representing index keys of title-level knowledge and / or question-level knowledge; and respectively storing the first vector and the second vector into a vector database, and storing the index values and the index types corresponding to the first vector and the second vector into a relational database. According to the method, multi-granularity document knowledge base construction is achieved, the expression modes of knowledge under different granularities are expanded, the accuracy of user query and knowledge matching is improved, and the problem that information is lost or incomplete in an existing method is solved.

The invention discloses a science and technology public text intelligent classification and service method and device based on deep learning. The method comprises the steps that multi-source science and technology public text data are acquired and preprocessed; extracting keywords by adopting a keyword extraction algorithm, and splicing the keywords with the public text title to form enhanced text features; constructing a multi-dimensional public text classification system and performing data annotation; performing feature extraction and fine adjustment by adopting a BERT pre-training model to obtain a classification model; automatically classifying the newly-added public texts and visually presenting the newly-added public texts; and generating a personalized recommendation result based on the user portrait and the public text feature index. The invention further relates to a technical scheme of multi-objective quality diversity optimization, heterogeneous resource allocation and fusion of the LPLC2 neural network and the BERT. The technical problems that a traditional method is limited in complex semantic understanding ability, single in classification dimension and lack of an integrated solution are solved, and the accuracy of science and technology public text classification and the intelligent level of service are improved.

The invention provides a semantic enhancement adaptive partitioning method and system for natural resource large model questions and answers, and aims to solve the problems of difficulty in term boundary recognition, damage to semantic integrity and the like. According to the method, three core technologies including theme perception coarse-grained paragraph division, self-adaptive sliding window theme hierarchy division and embedded perception context self-adaptive text segmentation are fused. The system firstly analyzes a natural resource long text structure, identifies titles and theme levels and aligns associated contents; paragraphs are extracted according to a theme perception strategy and are subdivided into sentence sets according to grammar rules; an improved sliding window mechanism is adopted to divide sentences into window sentence block groups. The method is characterized in that a dynamic aggregation threshold mechanism is introduced, the semantic association degree between adjacent sentence blocks is calculated through an embedded perception context semantic segmentation technology, whether the sentence blocks are combined or not is judged by combining a similarity distribution change trend and a dynamic adjustment threshold, self-adaptive delimitation of semantic boundaries is achieved, and text blocks which are clear in structure and coherent in semantics are generated.

The invention provides a document segmentation method and device and electronic equipment, relates to the technical field of artificial intelligence such as natural language processing, large language models, intelligent search and knowledge maps, and can be applied to scenes such as knowledge base construction, intelligent question and answer systems and document management systems. According to the specific implementation scheme, document analysis is conducted on a to-be-processed document, an analysis result of the to-be-processed document is obtained, and the analysis result comprises layout information and hierarchy information of a title; a title tree is constructed based on the hierarchical information of the titles, and the titles associated with nodes in the title tree are multi-level composite titles; and based on the layout information and the title tree, splitting and recombining the document region of the to-be-processed document according to a given maximum slice length to obtain document slices of the to-be-processed document. According to the method and the device, the document slicing precision and flexibility can be remarkably improved, and the document readability and the user experience are enhanced.

The invention provides a method and a system for generating an accurately referenced article based on a large model, and belongs to the technical field of article generation. The method comprises the following steps: acquiring an article generation demand input by a user, and generating an abstract of an article according to the demand by using a large model; retrieving knowledge related to the abstract in an RAG knowledge base based on the abstract; generating a series of question and answer pairs by utilizing a large model based on an RAG retrieval result; generating an outline of the article according to the title, the keyword and the question in the question-answer pair; performing importance evaluation on each chapter in the outline by using a scoring model, and calculating the number of words to be distributed to each chapter; splitting the generated outline according to the lowest-level title, combining the title, the keyword, the answer in the question and answer pair and the number of words allocated to the section, and inputting into a large model to generate corresponding text content; and combining the text contents according to an outline sequence to obtain a final article. According to the invention, word number control and accurate reference during article generation can be realized, the accuracy and reliability of article generation are improved, and the user experience is improved.

The invention discloses a short text clustering method and device based on a large language model, and belongs to the technical field of natural language processing, and the method comprises the steps: converting a short text into vector representation, and carrying out the preliminary clustering of the vector representation through a clustering algorithm, and obtaining an initial category; for all the corresponding short texts in each initial category, generating an abstract by using a large language model, generating a plurality of theme titles for summarizing the core meanings of the texts according to the abstract, respectively taking the theme titles as sub-titles, inputting the plurality of sub-titles into the large language model, and carrying out theme combination to obtain a parent title, constructing the parent title and the child titles into a hierarchical theme system; the large language model allocates to-be-classified short texts to one or more categories according to the hierarchical topic system to complete short text clustering; and performing quality evaluation and error pattern analysis on a short text clustering result to optimize a clustering algorithm and a large language model. According to the method, the theme of the short text can be automatically found and classified, and the classification accuracy and efficiency are improved.

The large model knowledge base retrieval method based on multi-granularity retrieval comprises the steps that a knowledge base based on three levels of knowledge of titles, fragments and sentences is constructed, and the knowledge base comprises a vector database storing first vectors and second vectors and a relational database storing index values and index types corresponding to the first vectors and the second vectors; generating a vector value queried by a user by using a vector model, respectively querying a plurality of query index vectors with the highest similarity with the query vector value in the first vector and the second vector, and obtaining query index values and query index types corresponding to the query index vectors from the relational database as candidate retrieval results; and jointly constructing a query prompt word by using a plurality of candidate retrieval results and user query, and inputting the query prompt word into the large model to obtain a final query reply. According to the method, the precision, the efficiency and the intelligent level of a retrieval system are remarkably improved, and the problems of low precision, poor query adaptability, slow knowledge base updating and the like in the prior art are solved.

The invention belongs to the technical field of document content extraction, and particularly discloses a document content extraction method and system based on multimodal model collaboration, a terminal and a medium. Comprising the following steps: identifying the type of an input to-be-processed document, and judging the document type; on the basis of the type identification result, calling a multi-modal model to analyze the document content, and outputting space coordinates, visual features and semantic features of document elements; generating a content sequence according with a reading habit through a semantic sequence reconstruction algorithm; paragraph boundary detection, paragraph recombination and semantic association modeling of charts and texts are completed based on the multilayer attention network and the graph neural network; grammar error correction, format optimization and title hierarchy generation are carried out by using a large language model and a hierarchical classification network; and converting the identification result into a structured output file. According to the method, the processing requirements of different types of documents can be considered, and high-precision analysis and efficient output are realized under the scenes of complex layouts, multiple languages and formula tables.

The invention belongs to the technical field of computer vision and natural language processing, and discloses a video authenticity detection method and system based on a large model and a retrieval enhancement generation technology. Jointly constructing a to-be-detected text by combining the video title, the brief introduction, the text obtained by audio conversion and the video description text; completing the construction of an external knowledge base; performing fact verification based on a retrieval enhancement generation technology (RAG); performing common sense reasoning based on a large model: constructing cue words, performing common sense and logic reasoning on the to-be-detected text by utilizing the large model ChatGLM, detecting whether common sense mistakes and logic conflicts exist or not, and judging whether news is true or false according to the common sense mistakes and the logic conflicts; and comprehensively judging the authenticity of the to-be-detected video according to the fact check and common sense reasoning. Through the combination of the large model and the RAG technology, the accuracy and interpretability of video content authenticity detection are improved; the detection efficiency is improved; false news videos can be found and processed in time, and the health of a network environment and public trust can be maintained.

The invention provides a highway intelligent operation and maintenance question-answering system based on a large language model, and belongs to the technical field of natural language processing. The system takes a large language model as a core reasoning engine and combines a domain knowledge base and an RAG technology to realize accurate question and answer of highway operation and maintenance; the method comprises the following steps: based on original knowledge data cutting, generating a title through a large language model, and customizing a knowledge base; receiving query, analyzing an intention by using a large language model, and matching to generate a function; the query is rewritten by using a large language model, dense and sparse vector query is generated, and a double-layer retrieval mechanism is formed; a two-step recall mode is utilized, coarse-grained recall is firstly carried out, then a recall result is subjected to fine-grained optimization through a screening mechanism, and a reasoning text is generated; and finally, inputting the query and reasoning text into the large language model, and generating an optimal answer through single-round and multi-round questions and answers. According to the method, the professionality and reliability of answers are enhanced, and the technical problem that answers are incomplete and inaccurate in an existing question and answer system is solved.

The invention relates to a PICO extraction method and device based on a large language model and a storage medium, and is applied to the technical field of medical information, and the method comprises the steps: obtaining and preprocessing titles and abstracts of a large number of medical literatures, then combining preset cues related to PICO with texts to construct an instruction data set, and storing the instruction data set in a database; a text in an instruction data set is subjected to word segmentation processing to be converted into an input sequence, a large language model framework is constructed, a false positive suppression loss function is set, the false positive rate of PICO element extraction by the model is remarkably reduced, the large language model framework is trained through the input sequence, and a trained PICO element extraction large language model is obtained. Preprocessing medical text data to be retrieved, inputting the preprocessed medical text data into the trained model, and outputting a PICO extraction text by the model; and finally, each PICO classification result is output through the PICO classifier. The data are data related to the crowd / problem, intervention, comparison and result in the to-be-retrieved data.

The invention belongs to the technical field of text processing, and particularly relates to a method and system for retrieving DOCX document content based on keywords, which comprises the following steps: analyzing an Office Open XML structure of a DOCX document, combining with multi-dimensional features such as style names, and utilizing a title classification score model to accurately distinguish a title and a text, so that a semantic hierarchical structure of the document is effectively reserved; and secondly, a multi-level semantic extension mechanism is introduced, and a Sension-BERT, a HowNet knowledge base and a Word2Vec model are fused, so that intelligent extension of synonyms and synonyms of keywords is realized, and the recall rate and semantic understanding ability of retrieval are remarkably improved. And in addition, a BM25 model is combined with paragraph length normalization and structure position weight to calculate a correlation score, so that retrieval results are sorted more accurately and reasonably. The construction of the reverse index is combined with the position coding and compression optimization strategy, and the retrieval efficiency and the storage performance are both considered.

The invention discloses a long text analysis method and device, a storage medium and a terminal. Identifying at least one title in the to-be-analyzed long text, and generating directory information of the to-be-analyzed long text based on each title; dividing the long text to be analyzed into a plurality of text paragraphs according to the titles and the input length requirement of the vector model; determining a target superior directory corresponding to each text paragraph from the directory information, and respectively integrating each text paragraph and the target superior directory corresponding to each text paragraph; and inputting the integrated text paragraphs into a vector model to obtain vector features output by the vector model for the text paragraphs. Due to the fact that the whole document is divided into the text paragraphs through the title of the long text, the text paragraphs are divided more reasonably. And continuously integrating the long text information according to the context information contained in the superior directory, so that the semantic information of the text paragraphs is richer, and the model can more accurately understand and process the text paragraphs on this basis.

The invention relates to the technical field of data processing, and provides a question and answer method and system based on paragraph splitting and a knowledge engine platform, and the question and answer method comprises the steps: carrying out directory and title recognition on an uploaded document, and generating a paragraph frame structure with a hierarchical relationship of the document; splitting the text content of the document according to the paragraph frame structure to obtain a document paragraph structure dictionary containing the corresponding text content; according to the document paragraph structure dictionary, text blocks are generated, and a knowledge base is constructed; performing text block vectorization on the text block by adopting a text vectorization model to generate a sparse vector and a dense vector, and storing the sparse vector and the dense vector in a knowledge base; performing keyword extraction and text vectorization processing on the obtained question to obtain a keyword list, a sparse vector and a dense vector of the question; retrieving the knowledge base, and selecting a plurality of text blocks most similar to the problem; and based on the to-be-queried question, a preset cue word and a plurality of text blocks most similar to the question, obtaining a question answer by adopting the large model.

The invention discloses a vehicle knowledge question-answering method based on a GraphRAG method and computer equipment, and the method comprises the steps: building a document tree structure based on the title hierarchy of a vehicle knowledge document, distributing a text identifier, and adding metadata information; converting the stored text units into text unit vectors by adopting a vector embedding model, and establishing a text vector index; calculating a similarity score between the query vector and the text unit vector, and determining a traditional RAG path text unit based on the similarity score; identifying entities and entity relationships of the text units according to the entity types and the relationship types by adopting a large language model so as to generate a vehicle knowledge graph; performing multi-level community division on the vehicle knowledge graph by adopting a Leiton community detection algorithm, and generating a structured community abstract according to each level of community; determining a GraphRAG path community abstract by adopting a large language model; and fusing the community abstract of the GraphRAG path with the text unit of the traditional RAG path and generating an answer.

The invention discloses an intelligent writing method based on multi-agent cooperation, and the method comprises the following steps: receiving documents of various formats uploaded by a user, extracting text and image resources, and understanding an image through a multi-modal large language model to generate a description text; constructing a cue word template by using a large language model, processing three types of input files, extracting key information, and constructing a knowledge model; receiving user input construction enhanced cue words, and calling a large language model to generate an article outline; chapter contents are generated one by one according to a title segmentation outline, and a writing execution agent generates a text according to requirements and automatically illustrates; and the MarkDown format output is converted into Word with a basic format. The method has the beneficial effects that intelligent writing is completed through multi-step cooperation, information is extracted from multiple sources, a model is constructed, an outline and content are efficiently generated, a diagram is automatically illustrated, finally, the format is converted, and convenient, efficient and functional intelligent writing services are provided for users.

The invention discloses a courseware content analysis method and device, equipment and a storage medium. The method comprises the following steps: acquiring a courseware picture; detecting each frame of courseware picture, and detecting a title and a text; inputting the detected title and text of each frame into a pre-trained character recognition model, and recognizing a title keyword set and a text keyword set of each frame of courseware picture; summarizing the title keyword set and the text keyword set of all frames of courseware pictures to obtain a courseware keyword set; obtaining a knowledge point set of a course corresponding to the courseware; obtaining a courseware integrity analysis result according to the matching-union ratio; and obtaining a courseware content analysis result according to the courseware integrity analysis result. According to the method, the teaching courseware content is analyzed and evaluated according to an objective specification standard, so that a scientific and objective evaluation conclusion is obtained.

The invention relates to a structured text analysis method and system based on title recognition and hierarchical abstracts, and the method comprises the steps: receiving a text, and obtaining sample data of a training language model; the vector database can perform vector dimension adjustment on the data of the stored text. The vector database takes vectors as basic storage units, and converts unstructured data into high-dimensional vectors through an embedding technology. And calling the data storage type information of the title text data set to determine the data storage type of the title text data set matched with the text storage mode. And obtaining a structure type of sample data of each text by utilizing a semantic segmentation script. And segmenting the document according to the identified chapter titles, and subdividing each chapter into a plurality of logic paragraphs to form structured text block units. The multi-level abstract generation model matched with the target model can fully mine level information and semantic association in the document. Therefore, the effect of analyzing the structured text by the intelligent question-answering system is improved.

The invention discloses a document segmentation method for large model retrieval enhancement generation, and relates to the technical field of document segmentation, the method comprises the following steps: taking any secondary title and text content under the secondary title as a to-be-analyzed object, and counting the number of characters in each to-be-analyzed object, when the number of the characters exceeds the preset number of the characters, paragraph splitting is carried out on the text content; and carrying out segmentation confidence calculation on each split part, and carrying out merging or segmentation processing on the adjacent parts based on the segmentation confidence corresponding to the adjacent parts. According to the method, the segmentation confidence coefficient of the adjacent parts is calculated, the document can be accurately and partially segmented, the segmentation effect is effectively guaranteed, and in addition, based on the segmentation confidence coefficient, the semantic integrity after segmentation and before and after segmentation can be effectively guaranteed.

The invention discloses a text segmentation method and device for retrieval enhancement generation, and the method comprises the steps: constructing a text tree for an original text, and enabling the text tree to take an original text attribute as a root node, a title of each level as a child node, and a non-title paragraph as a leaf node; according to the method, text blocks are segmented according to a text tree, so that each segmented text block starts from a directory structure, ends with a non-title paragraph and is constrained by preset text block word number limitation, and the directory structure included in each text block is as follows: starting from a head leaf node included in each text block, starting from a non-title paragraph included in each text block, and ending with a non-title paragraph included in each text block; according to the method and the device, the text can be segmented in a mode more suitable for a tree structure, and text information loss caused in the text segmentation process is reduced, so that the recall effect of an RAG system is improved.

The invention provides a document information extraction method and device, electronic equipment and a medium, and the specific implementation scheme comprises the steps: obtaining a to-be-processed document, the to-be-processed document being a document which does not contain a title identifier, and the title identifier being used for identifying the title level of each chapter title in the to-be-processed document; analyzing the to-be-processed document to determine text content information and text position information respectively corresponding to a plurality of chapter titles in the to-be-processed document; determining a title level corresponding to each chapter title according to the text position information corresponding to each chapter title; and calling the large language model to perform information extraction on chapter contents among the chapter titles in the to-be-processed document based on the text content information, the text position information and the title levels corresponding to the chapter titles to obtain an information extraction result.

The invention provides a long report generation method based on a large model, and belongs to the technical field of natural language processing and artificial intelligence, and the method specifically comprises the following steps: analyzing a report demand input by a user, extracting key information, and generating task description; automatically generating a report framework based on the large model and the domain knowledge base, wherein the report framework comprises chapter division, title generation and content summary; calling a large model to generate detailed contents in chapters, and introducing a context memory mechanism to ensure the continuity between the chapters; grammar check, logic check and style optimization are performed on the generated content, and the professionality and accuracy of the report are improved in combination with a domain term library; and finally, outputting the report content according to a format required by a user, and automatically generating auxiliary contents such as a directory, a chart and reference literature. The method has the advantages of high efficiency, high quality, flexibility, expandability and the like, and can be widely applied to long report generation tasks in the fields of medical treatment, law, finance and the like.

The embodiment of the invention provides a retrieval enhancement generation method and system based on multivariate fusion, and the method comprises the steps: firstly structuring a knowledge base document, generating a knowledge graph, and importing an ES to establish an index; inputting question sentences, carrying out word segmentation and other processing, querying instance nodes from the map, and outputting meeting conditions according to answer sentence patterns; if not, fragmenting and blocking the document according to a title level, obtaining candidate results through vector, ES and atlas retrieval, normalizing scores, merging and optimizing the scores of the candidate retrieval results according to a retrieval source, calculating comprehensive scores, and outputting the comprehensive scores in a descending order; and finally, carrying out semantic integrity aggregation on the combined candidate results, and inputting into a large language model to obtain a final answer. According to the method, the relevance of the retrieved content is greatly improved, the semantic integrity of the retrieved content is improved, the model magic view problem is reduced, and the question and answer accuracy and the answer quality of a knowledge base are improved.

The invention provides a method and system for optimizing a commodity title and computing equipment, and the method comprises the steps: obtaining commodity information which comprises an original title of a commodity and a commodity attribute; obtaining related flow words associated with the commodity by using an algorithm recommendation system; based on the commodity information, first candidate traffic words used for being added into the original title are selected from the related traffic words through a large language model; based on the commodity information and the first recommended traffic word, utilizing a large language model to generate a second candidate traffic word used for being added into the original title; based on the commodity information, the first candidate traffic word and the second candidate traffic word, determining excluded risk traffic words by using a large language model to obtain a third candidate traffic word; and selecting an optimized traffic word from the third candidate traffic words by utilizing a large language model based on the commodity information, and adding the optimized traffic word into the original title, thereby generating a new title. According to the technical scheme, merchants can be better helped to screen drainage keywords, commodity titles can be more conveniently optimized, and commodity competitiveness is improved.

A computing system for monitoring language model compliance with a rubric of one or more output characteristics. The computing system includes processing circuitry configured to interface with a trained generative language model that receives input of a prompt including natural language text input and, in response, generates an output that includes natural language text output. The processing circuitry is further configured to monitor compliance of the generative language model with the rubric, by feeding the output of the generative language model to a rubric classifier configured to generate a predicted classification for an output characteristic in the rubric, and output the predicted classification.

The invention belongs to the technical field of natural language processing, and discloses a knowledge retrieval-oriented government affair document enhanced generation method, electronic equipment and a medium, and the knowledge retrieval-oriented government affair document enhanced generation method comprises the following steps: identifying a title of a government affair document; segmenting the text according to titles to obtain a plurality of text blocks with complete semantics; semantic segmentation is carried out on the text blocks with complete semantics to obtain a plurality of medium-granularity text blocks, and the medium-granularity text blocks are text blocks conforming to a preset length; and establishing an index according to the plurality of medium-granularity text blocks. By identifying the title and segmenting the text according to the title structure, the text can be effectively subjected to first-level semantic segmentation according to the chapter structure, the internal semantic relevance and integrity are ensured, and the retrieval accuracy is improved.

The invention provides a method and system for automatically generating software codes, and the method comprises the steps: setting a menu table, a field table and an inter-table crossing relation, the menu table comprises column title content, module title content and module table name content, a plurality of column titles in the column title content are classified into one group and correspond to one module title, and the module title content corresponds to the module title; the module titles are in one-to-one correspondence with the module table names; the field table has user-defined field content and module table name content, and the user-defined field corresponds to a module table name; the inter-table crossing relationship is used for realizing crossing of the menu table and the field table; importing the menu table and the field table into an English-Chinese dictionary, performing statement decomposition, decomposing statements in the menu table and the field table into words and graphic icons, and realizing crossing of the menu table and the field table; and the data link model automatically generates codes according to the imported module menu and field paraphrasing. The invention also provides a system for realizing the method. The development efficiency can be improved, the error rate can be reduced, and the labor cost can be saved.

The invention provides a water conservancy knowledge structured extraction and verification method and device, and belongs to the technical field of artificial intelligence, and the method comprises the steps: carrying out the differential text processing of different formats of files, and generating an intermediate file; classifying the intermediate file into a regulation class or a non-regulation class based on a preset rule base; performing hierarchical title identification on the regulatory files to form entry knowledge blocks, and converting table contents into HTML (Hypertext Markup Language) knowledge blocks; performing semantic segmentation on the non-regulation file to generate knowledge blocks; performing knowledge block checking and filing, and marking an abnormal alarm block; converting the table knowledge blocks into natural language description by utilizing a large model; and positioning the context of the original text of the alarm knowledge block, and performing intelligent correction through a large model. According to the method, a traditional semantic analysis model and a large language model are creatively fused, a closed-loop process of preprocessing, extraction, verification and correction is formed, the problems of structured analysis and error correction of complex texts in the water conservancy field are solved, and the knowledge processing efficiency and accuracy are remarkably improved.

Embodiments of the present invention provide systems, methods, and computer storage media for identifying the relevant segments that effectively summarize the larger input video and / or form a rough cut, and assembling them into one or more smaller trimmed videos. For example, visual scenes and corresponding scene captions are extracted from the input video and associated with an extracted diarized and timestamped transcript to generate an augmented transcript. The augmented transcript is applied to a large language model to extract sentences that characterize a trimmed version of the input video (e.g., a natural language summary, a representation of identified sentences from the transcript). As such, corresponding video segments are identified (e.g., using similarity to match each sentence in a generated summary with a corresponding transcript sentence) and assembled into one or more trimmed videos. In some embodiments, the trimmed video is generated based on a user's query and / or desired length.

The invention relates to a similarity calculation-based scientific research topic selection recommendation method. The method comprises the steps of obtaining scientific and technical literature data and performing preprocessing; and extracting keywords from the abstract and the title by using a TextRank algorithm, and identifying technical keywords through experts. And carrying out vectorization on the keywords by using the trained word2vec algorithm. After keywords input by a user are obtained, vectorization is also carried out, and the cosine similarity between the keywords and each vector in the keyword vector table is calculated; and selecting the previous scientific and technical literatures and the corresponding scholars and technical keywords, and displaying the scientific and technical literatures and the corresponding scholars and technical keywords to the user through a visualization technology. According to the method, by calculating the cosine similarity between the keyword vectors, the theme in which the user is interested is determined, literatures, scholars, technologies and the like with high relevancy are recommended for the user, and the user is helped to quickly find high-quality literatures related to the theme in which the user is interested, leading figures in the field, possible research methods and the like.