54 results about "Document representation" patented technology

The invention discloses an RAG intelligent retrieval question-answering system and method based on enhanced metadata, and relates to the technical field of information processing and intelligent retrieval, multi-source heterogeneous knowledge data is preprocessed to obtain unified knowledge data, and structured metadata is extracted from the unified knowledge data based on different text forms; vectorizing a document text in the structured metadata by combining with embedding of the knowledge graph to obtain document representation, and outputting the document representation, the structured metadata and the enhanced keyword set as an enhanced metadata object; labeling a display relationship between different enhanced metadata objects, and constructing to obtain a knowledge database; according to the intelligent knowledge service system and method, restrictive conditions and question intentions are extracted from user questions, mixed retrieval is performed from a knowledge database based on the restrictive conditions and the question intentions, a candidate literature semantic set is output, then structured statistical visualization reports and structured answers are output, and accurate, explainable and multifunctional intelligent knowledge services are achieved.

The invention provides a full-text retrieval method and system fusing various types of documents, and relates to the technical field of information retrieval, and the method comprises the following steps: obtaining document representation through document content extraction and structure recognition, generating a cross-modal semantic vector by using word embedding and nonlinear transformation, constructing a hierarchical index and a cross-document association graph, and obtaining a full-text retrieval result; the basic correlation score is calculated after the query request is received, and the comprehensive score of the candidate content segments is calculated based on the association graph to determine the optimal retrieval result, so that unified representation and retrieval of heterogeneous documents are realized, the cross-document retrieval precision and relevance are improved, and the processing capability of a retrieval system on complex queries is enhanced.

The invention relates to the technical field of literature information retrieval, and particularly discloses a literature information retrieval analysis system and method based on AI intelligence. The system comprises a representation vector output module, a preliminary retrieval result output module, a retrieval result updating module, a dynamic knowledge graph construction module, an enhanced literature representation output module, a recommendation list output module and a knowledge graph feedback updating module. A representation vector output module extracts literature text features; a preliminary retrieval result output module executes semantic enhancement retrieval and query expansion; a retrieval result updating module optimizes a preliminary result; a dynamic knowledge graph construction module constructs a graph based on the retrieval result; the recommendation list output module provides personalized recommendation, and the knowledge graph feedback updating module updates the knowledge graph according to the user interaction flow data. According to the method, the accuracy, intelligence and dynamic adaptability of literature retrieval are comprehensively improved, and user requirements can be deeply met.

The present invention proposes a role semantics capture method and system based on dynamic event prompts, the method comprising: encoding a preprocessed document to obtain an encoded document representation; obtaining an event prompt embedding representation using an event prompt board and the encoded document representation; obtaining a role embedding representation based on the event prompt embedding representation; obtaining a role start span selector and an end span selector respectively according to the role embedding representation; obtaining a candidate span of the role using the encoded document representation and the role start span selector and the end span selector; obtaining a reconstructed event prompt template through the candidate span of the role; obtaining a role representation processed by a role interaction layer based on the reconstructed event prompt template; training a model based on the role representation processed by the role interaction layer to obtain an argument extraction result. The present invention enhances the richness of role semantics through a role interaction module, so that the model can understand the semantic connotation of the event more comprehensively.

The invention belongs to the technical field of medical data processing, and discloses an automatic ICD coding method and system based on fusion of various label information, and the method comprises the steps: carrying out the feature extraction of the description of a clinical text and an ICD label, and obtaining the representation of the clinical text and the representation of the label; performing interactive fusion on the ICD tag description and the ICD tag description to obtain tag-related context representation, extracting co-occurrence representation of the tag representation, and fusing the co-occurrence representation with the ICD tag description and the tag-related context representation to obtain enhanced tag representation; performing interactive fusion on the enhanced tag representation and the clinical text representation to obtain a document representation corresponding to each tag, and predicting an ICD code based on the document representation; and defining a loss function, and training the model. According to the method, information from three aspects of context, tag original semantics and tag correlation is fused, richer input features are provided for automatic ICD coding, the comprehensiveness and accuracy of coding are improved, and important support is provided for clinical decision making and medical resource allocation.

The present invention discloses a system and method for processing trade finance documents and performing automated compliance screening. The system comprises a computing device, and a database for storing trade finance documents. The system processes documents using OCR to extract text and positional data, generating structured document representations via a layout-aware AI model. An AI classifier module categorizes documents based on content, layout, and domain-specific roles, while a semantic verification module aligns document data with master Letter of Credit templates. A rule management module validates compliance against international trade standards, and a financial crime risk control module performs real-time checks against external sanctions, vessel, and dual-use goods databases. The system further determines and reports discrepancies, anomalies, and compliance issues. The system supports heterogeneous layouts, multi-language documents, and integration with banking APIs.

The invention relates to the technical field of mathematical modeling, and discloses a modeling method for a power business decision model, and the method comprises the steps: constructing a power corpus block library and a power vector knowledge library, and determining a power business problem text; performing mixed retrieval on the power business problem text by means of a power corpus block library and a power vector knowledge library to obtain a first similarity score corresponding to a candidate corpus block and a second similarity score corresponding to a candidate document representation vector; screening the candidate corpus blocks and the candidate document representation vectors based on the first similarity score and the second similarity score, and determining a target reference text; inputting the power business problem text and the target reference text into a target large language model to obtain a target decision model; the target decision model comprises a description text of the power business problem, a target function and constraint conditions thereof. The method has the beneficial effects that the reliability and the accuracy of the target decision model are remarkably improved based on standard output of the hybrid retrieval and the large language model.

Embodiments of the present disclosure provide methods, apparatus, systems, computing devices, computing entities, and / or the like for generating an inferred document representation for a multi-section document using a machine learning model. In accordance with one embodiment, a method is provided that includes: identifying a document corpus comprising the multi-section document and other multi-section documents; for each section of the document that is associated with a section type identifier: identifying a section batch that comprises common-type sections across the document corpus; and processing the section batch using the machine learning model to generate per-type section clusters for the section type identifier that comprise an inferred per-type section cluster for the current section; generating the inferred document representation based at least in part on each inferred per-type section cluster for a section of the document; and performing a prediction-based action based at least in part on the representation.

Systems and methods for document processing that can process and understand the layout, text size, text style, and multimedia of a document can generate more accurate and informed document representations. The layout of a document paired with text size and style can indicate what portions of a document are possibly more important, and the understanding of that importance can help with understanding of the document. Systems and methods utilizing a hierarchical framework that processes the block-level and the document-level of a document can capitalize on these indicators to generate a better document representation.

The invention discloses a multi-page bidding document-oriented classification and key information extraction method and system, and the method comprises the steps: obtaining bidding document image data containing a plurality of pages, and constructing a corresponding document representation data set; performing structured modeling on bidding document image data corresponding to each page in the document representation data set, extracting and fusing multi-modal features, and constructing unified page representation; based on the unified page representation, document module type classification is carried out on the pages, and structure category labels which all the pages belong to are obtained; on the basis of the structure category labels of the pages, in combination with the multi-modal features of the corresponding pages, key information extraction operation is executed, and target field information contained in the corresponding pages is extracted; and outputting a structured result, wherein the structured result comprises the structure category label to which each page belongs and the corresponding target field information. According to the method, accurate classification of the pages in the bidding and tendering document is realized, targeted key information extraction is performed, and the method has relatively high accuracy, maintainability and actual landing capability.

The invention relates to a personalized enterprise knowledge recommendation system and method for a smart office platform, and belongs to the technical field of data mining and knowledge recommendation. Comprising a user behavior perception type multi-source information embedded representation learning module which is used for calculating a personalized business portrait representation vector based on business platform data, user role data and user personalized data of a current user; the document attribute perception type enterprise document representation learning module is used for calculating a comprehensive document embedding representation vector of each knowledge document based on the enterprise knowledge documents and the document attributes; the knowledge recommendation module is used for recommending an enterprise knowledge document to the user based on the set similarity of the personalized business portrait representation vector and each comprehensive document embedded representation vector; and the training module is used for training and adjusting related parameters based on the recommended enterprise knowledge document. According to the system and the method, accurate and reasonable documents can be provided for users according to specific service information in an enterprise office platform.

The invention discloses a scientific literature topic discovery method and device based on LLM. The method comprises the following steps: 1) acquiring text representation of each scientific literature sample and encoding the text representation by using a text encoder to obtain a document representation matrix corresponding to the scientific literature sample; 2) clustering the scientific literature samples to obtain clustering results of different themes; calculating an entropy value of each scientific literature sample, and selecting a high-uncertainty sample; 3) calculating semantic similarity between each high-uncertainty sample and other scientific literature samples, and constructing a plurality of triple tasks; fine-tuning the text encoder by using each triple task through a comparative learning method; 4) encoding the text representation of each scientific literature sample by using a text encoder to obtain a document representation matrix corresponding to the scientific literature sample; and 5) performing topic clustering on each scientific literature sample by using the document representation matrix of each scientific literature sample, and generating a clustering tag and a topic division result of each scientific literature sample.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video storage optimization. One of the methods includes obtaining data for a plurality of video files of a content delivery system, wherein the plurality of video files corresponds to a set of video ladders, each video ladder identifying a respective transcoding version of video content represented by a video file of the plurality of video file and having different parameters; for each video file, executing one or more respective storage strategies to compute one or more respective output video scores, wherein each storage strategy uses trained models to evaluate characteristics of the respective video file and estimate future viewing of the video file; and in response to evaluating the output video scores computed for each of the plurality of video files, determining one or more actions to reduce storage for the plurality of video files.

A DNA-based storage system includes an error correction system operable to: (a) identify a DNA codeword from a DNA sequencing operation; (b) calculate an initial syndrome weight; (c) determine that the initial syndrome weight is greater than a predetermined threshold; (d) perform an alignment alteration in the information segment by: (i) selecting a skew point within the information segment; (ii) performing an indel operation on the information segment at the skew point; (iii) calculating a modified syndrome weight; (iv) comparing the initial syndrome weight with the modified syndrome weight; and (v) incorporating the indel operation into the information segment when the comparing indicates an improvement in the modified syndrome weight; (e) decode the modified codeword; and (f) transmit the contents of the output file to a computing device, the output file representing user data stored within the DNA molecule.

The invention discloses a multi-modal file label automatic generation method, and relates to the technical field of label generation, and the method comprises the steps: firstly constructing a multi-level file label category set as a label matching reference library, then uploading a target multi-modal file, preprocessing a text extracted according to the file, and constructing a file representation vector; finally, the computing power of the current equipment is judged, labels are generated according to scenes, if the computing power is limited, the labels are extracted step by step, and a multi-level candidate label set is generated; if the computing power is sufficient, combining the multi-level label category sets, and directly extracting a candidate label set; thirdly, modifying the word segmentation result by calculating the cohesion degree of adjacent words in the initial word segmentation result, and automatically extracting the multi-level file label again; and finally, calculating a comprehensive cosine similarity value of the generated candidate file tags, and outputting an optimal file tag. According to the invention, effective utilization of resources can be realized, and the accuracy of the generated file tag is improved.

The invention discloses an English reading understanding automation problem generation method, and relates to the technical field of problem generation, and the method comprises the following steps: S1, data collection and extraction, S2, dependency syntax graph generation, S3, document representation determination, S4, problem generator training, and S5, problem statement determination. According to the method, feature fusion is carried out on the document and the syntactic graph, so that the final document representation can better conform to semantics expressed by the document, when a decoder analyzes the document representation to generate problem statements, the actual content of the document can be more accurately known, and the user experience is improved. Meanwhile, a parameter fine tuning algorithm is used for continuously adjusting the problem generator, so that the problem generator can be optimized in continuous operation, the problem statements provided during specified document analysis can be adopted by most users, a manual auditing function is provided, and the user experience is improved. Problem statements and documents meeting conditions can be stored in the data set, and it is guaranteed that the data set can be updated on time.

The invention discloses a long text abstract generation method based on hierarchical graph comparison themes, which comprises the following steps of: 1, preprocessing an original document, dividing sentence sequences, and obtaining global context-aware sentence and document representation through a hierarchical encoder network; 2, deducing document-level and sentence-level topic distribution by using a neural topic model; and 3, constructing a supervision graph based on a standard abstract to perform graph comparison learning so as to close the topic representation of a document and a key sentence and push redundant information. According to the method, the deep semantic structure of the long document can be effectively captured, so that the theme consistency and the information coverage degree of the abstract can be improved, and the redundancy is reduced.

The present invention relates to a method for detecting the core events of news by integrating document graphs and event graphs, belonging to the technical field of natural language processing. First, the present invention models the global semantic features of news texts and the correlation features between events by constructing document graphs and event graphs. Then, the graph convolutional neural network is used to capture high-order neighborhood information to obtain document representations and event representations. Finally, the obtained document representations and event representations are further used with cross-attention to capture the global semantic information of events. The present invention can quickly and accurately obtain the core information of news, which is the basis for news event analysis and is also crucial for many downstream tasks such as news text summarization, intelligent question answering, reading comprehension, and generating event chains.

A document processing method and apparatus. The method comprises: determining the frequency x of the qth sentence in the N sentences in the i-th document based on the similarity between the sentence in the i-th document and N sentences in M ​​documents. i,q , where M and N are both integers greater than 1, q is a positive integer not greater than N, and i is a positive integer; based on the frequency x corresponding to the qth sentence in the i-th document i,q , determine the document representation of the i-th document. This can improve the efficiency of document representation.

This application relates to the field of mathematical modeling technology and discloses a modeling method for a power business decision-making model. The method includes: constructing a power corpus segmentation library and a power vector knowledge base to determine the power business problem text; performing a hybrid retrieval of the power business problem text using the power corpus segmentation library and the power vector knowledge base to obtain a first similarity score corresponding to candidate corpus segments and a second similarity score corresponding to candidate document representation vectors; filtering the candidate corpus segments and candidate document representation vectors based on the first and second similarity scores to determine the target reference text; and inputting the power business problem text and the target reference text into a target large language model to obtain the target decision model. The target decision model includes a description of the power business problem, an objective function, and its constraints. Its beneficial effect is that, based on hybrid retrieval and the standardized output of the large language model, the reliability and accuracy of the target decision model are significantly improved.

Systems and methods are provided for learning a classifier for annotating documents with predicted labels under an extreme classification where there are more than one million labels. The learning includes receiving a joint graph comprising documents and labels as nodes. A multi-dimensional vector representation of the documents (i.e., document representations) is generated based on graph convolution of the joint graph. Each document representation varies in dependence on adjacent nodes to accommodate context. The document representations are feature transformed using a residual layer. A per-label document representation is generated from the transformed document representations based on adjacent label attention. The classifier is trained for each of the more than one million labels based on joint learning using training data and the per-label document representations. The trained classifier performs highly efficiently compared to other classifiers trained using disjoint graphs of documents and labels.

The invention belongs to the technical field of document retrieval, and particularly relates to a multi-modal long document retrieval method based on hierarchical representation and double-branch retrieval. According to the method, three-level hierarchical document representation composed of an element level, a page level and a chapter and section level is constructed by designing hierarchical features oriented to a document structure; a double-branch retrieval mechanism is used for conducting semantic-level matching and feature-level matching on queries, and a final evidence set is generated through a fusion strategy. According to the method, the cross-page semantic association and the fine-grained visual clues can be utilized at the same time, effective retrieval and information positioning of the multi-modal long document are achieved, the retrieval requirements of documents with different layout forms and different lengths in a real scene are met, and the method has important practical application value.

The invention discloses an intellectual property information analysis and management method based on multi-dimensional data, and the method comprises the following steps: obtaining patent original data, constructing a patent record, and carrying out the preprocessing of an intellectual property data set; dividing the patent text data into a plurality of coding units according to a preset field range, and constructing vectorization representation for each patent; generating an adjusted sub-query set for the retrieval input based on a query decomposition algorithm; obtaining a sub-query mark sequence and a comprehensive candidate result set; and calculating a comprehensive sorting score, and generating a retrieval result list. According to the method, by introducing a patent retrieval framework combining multi-dimensional query decomposition and ConstBERT fixed multi-vector document representation, executable sub-query configuration can be stably generated and fine-grained semantic matching can be realized in a scene in which a long retrieval type, multiple limits and exclusion conditions coexist; and the accuracy, controllability, traceability and large-scale application performance of patent retrieval are improved.

The present invention provides a method, system, storage medium and electronic device for classifying hierarchical multi-label professional and technical documents using label information, and relates to the technical field of document classification. The present invention fully utilizes label information for hierarchical multi-label professional and technical documents to accurately classify documents. This method can not only capture the semantic representation of the text, but also learn label hierarchy information. Among them, the supervised contrastive learning module based on label perception introduces the definition of label similarity in supervised contrastive learning; a similarity relationship is established between the anchor sample and the positive sample, making the document representation more accurate. The label attention module based on hierarchical perception captures the semantic relationship between the document and the corresponding hierarchical perception label description, with the purpose of dynamically integrating the label hierarchy into the classification model.

The application provides a patent automatic classification method and device, a terminal and a storage medium, and comprises the following steps: performing dependency syntax analysis on a patent document to be classified to obtain pretreatment information; performing word embedding on the pretreatment information to obtain document representation; and obtaining a flow category prediction result, a function category prediction result and a meta-function category prediction result based on the document representation and trained flow classifiers, function classifiers and meta-function classifiers. Through dependency syntax analysis and word embedding on the patent document to be classified, the flow category prediction result, the function category prediction result and the meta-function category prediction result are obtained by using machine learning technology, the comprehensiveness of the classification of the patent document to be classified is realized, and the problem that the patent automatic classification method in the prior art is very limited and cannot comprehensively classify patents is solved.

This application relates to the field of document retrieval technology, and particularly to a multimodal document retrieval method and apparatus based on a cross-modal mutual attention mechanism. The method includes: modeling a multimodal representation of a document; obtaining a target document-perceived multimodal document representation based on a multimodal mutual attention mechanism; fusing the document's self-attention vectorized representation and multimodal enhanced vectorized representation to obtain a unified multimodal enhanced representation of the document; calculating and ranking the relevance scores between the target document and at least one candidate document; and retrieving relevant documents. This application's embodiments, based on a cross-modal mutual attention mechanism, can obtain matching documents by acquiring a unified multimodal enhanced representation of the document and calculating relevance scores, thereby fully utilizing the multimodal information of the document, enhancing the relevance between different modalities of the document, and thus improving the matching degree of the document retrieval results, making the retrieval results more accurate and reliable.

The application provides an event-based document retrieval method and device, electronic equipment and storage medium, wherein the method comprises: obtaining a user query statement of a user for a document set to be retrieved; inputting the user query statement into a pre-trained large language model to obtain a document retrieval result; wherein the large language model is obtained by training and optimizing a training sample data set composed of a document representation and a document identifier, the document representation is obtained by events and event relationships in the document set to be retrieved, and the document identifier is obtained by mapping the events in the document set to be retrieved to an event hierarchy. The method considers the relevance between document contents, effectively represents the document to be retrieved by using events and event relationships, and significantly improves the document retrieval performance of the large language model; the event hierarchy is used to construct a document identifier with a clear semantic structure, effectively strengthening the connection between the document identifier and the document content.

The present application relates to a kind of medical data index query sentence generation method and system based on statistical index;The present application is defined by attribute to statistical index, query syntax is defined, using ANTLR4 is expressed using.g4 file to query syntax, and.g4 File is generated Java syntax analysis code, the syntax in it is converted into logic execution operator, defines executor interface specification, encapsulates into the platform executor plug-in of each platform, defines task manager, identifies and registers platform executor, calls platform executor and obtains intermediate data set IDS from platform, processes into final index data set KDS with intermediate data set IDS, corresponding statistical index attribute and logic execution operator;Through the present application, the standard generation of the query language of different platform data is realized, and the programming workload of query language is reduced.

The present application relates to the field of text classification, and in particular to a method, device, computer equipment and storage medium for classifying meeting minutes. The method comprises: extracting sentence-level features of meeting minutes samples to obtain a sentence-level feature set; obtaining sentence-level feature subsets corresponding to each section of the meeting minutes sample in the sentence-level feature set, and generating document representations of corresponding sections based on each sentence-level feature subset; based on each document representation, using the cross entropy of each category weight of the meeting minutes sample as the objective function for training optimization to perform model training to obtain a meeting minutes classification model; using the meeting minutes classification model to classify the meeting minutes to be classified to obtain classification results. The present invention realizes the automation of meeting minutes classification by training the meeting minutes classification model.

The application discloses an RAG intelligent retrieval question and answer system and method based on enhanced metadata, relates to the technical field of information processing and intelligent retrieval, and obtains unified knowledge data after preprocessing of multi-source heterogeneous knowledge data, extracts structured metadata from the unified knowledge data based on the difference in text form; the literature text in the structured metadata is vectorized in combination with embedding of a knowledge graph to obtain document representation, and then the document representation, the structured metadata and an enhanced keyword set are output as an enhanced metadata object; a display relationship between different enhanced metadata objects is marked, and a knowledge database is constructed; restrictive conditions and a question intention are extracted from a user question, mixed retrieval is performed from the knowledge database based on the restrictive conditions and the question intention, a candidate literature semantic set is output, and then a structured statistical visual report and a structured answer are output, so that precise, interpretable and multifunctional intelligent knowledge service is realized.