1638 results about "Document processing" patented technology

The invention provides an enhanced document generation and retrieval method based on a knowledge graph, and relates to the technical field of knowledge graphs, and the method comprises the following steps: receiving heterogeneous document input, and carrying out dynamic segmentation on the heterogeneous document; constructing a Graph-RAG model, wherein the Graph-RAG model comprises a knowledge graph-document index extraction module and a design document generation module; constructing and updating a knowledge graph based on document segmentation through a knowledge graph-document index extraction module; extracting feature vectors of the document segments by using a feature extraction model, establishing a mapping relationship between the document segments and entities in the knowledge graph through a matching strategy, and constructing a retrieval index; and receiving a query sequence of a user, retrieving the related entities and document segments through the retrieval index, and generating a target design document in combination with a preset template. According to the method, accurate retrieval and high-quality document generation based on semantic understanding are realized, and the technical problems of insufficient semantic understanding, low knowledge association degree, poor generation quality and the like in a traditional document processing method can be solved.

According to the research and development document processing method and device provided by the embodiment of the invention, unified processing of text, voice and image information is realized by constructing the multi-mode document analysis engine. Different types of data are converted into standardized feature representations through cross-modal preprocessing and a semantic alignment network. The system adopts a deep learning model to identify research and development elements, establishes a multi-modal relation graph, and realizes intelligent extraction and correlation analysis of various types of information in research and development documents. According to the method, the defects of the traditional technology in the aspects of multi-modal information fusion and knowledge system construction are effectively overcome, powerful support is provided for research and development process management and knowledge asset accumulation, and the standardized management level of research and development documents is remarkably improved.

The invention provides a semi-structured file processing method based on an LLMs (Language Language Model), which is used for efficiently analyzing a semi-structured file and converting the semi-structured file, and belongs to the technical field of intelligent document processing and multi-modal learning. The method is characterized by comprising the following steps: multi-modal fusion analysis: adopting a hierarchical cross-modal attention mechanism HCMA, and combining a multi-head attention mechanism with a graph neural network GNN to realize multi-level feature fusion of a text and an image; adaptive structured conversion: adopting a dynamic structure analysis network DPN, and combining reinforcement learning and a generation model to realize adaptive analysis of a document structure; and model generation and multi-modal reasoning: adopting a multi-modal generation reasoning network MGRN, and combining a diffusion model and neural symbol reasoning to realize joint generation and reasoning of the text and the image. According to the method, a remarkable technical breakthrough is brought to the aspects of document analysis, information extraction and intelligent reasoning, and powerful support is provided for data-driven innovation of various industries.

The invention relates to a government affair file information extraction and question answering method and device and a medium, and the method comprises the steps: carrying out the entity extraction of a government affair file through employing a BERT-CRF joint model, and obtaining a structured entity set; performing relation extraction on the structured entity set to generate a semantic relation set between the entities; constructing a knowledge graph according to the structured entity set and the semantic relationship set, storing entity nodes into a graph database, and storing an embedded vector of an entity text into a vector database; when a query request of a user is received, relation query of the graph database and semantic retrieval of the vector database are carried out, sub-graph structures and semantic matching vectors related to query are extracted, and a mixed retrieval result is obtained; and inputting the mixed retrieval result into a large language model, and generating a question and answer response text conforming to a preset format by applying a dynamic prompt template. According to the method, the document processing efficiency and accuracy are effectively improved, and a solid technical support is provided for intelligent management of government affair documents.

The invention relates to an engineering document index consistency proofreading method and system based on a multi-modal large model, and the method comprises the steps: Q1. OCR detection and recognition: carrying out the optical character recognition and format analysis of a source document, converting an uploaded PDF document into a processable text message in a Markdown format, and carrying out the format discrimination of a table, a formula and a plain text; and Q2, table and formula processing: adopting a hierarchical processing strategy, intelligently selecting an optimal processing mode according to the complexity of the table, and converting table information into a descriptive long text through a language large model and cue words. According to the method, accurate, reliable and efficient document index checking service can be provided for a user, the quality and efficiency of professional document processing are remarkably improved, the efficiency and quality of knowledge graph construction are remarkably improved, a knowledge verification system capable of being evolved continuously is established, and the method is suitable for popularization and application. And a reliable technical support is provided for knowledge management and professional decision-making in a complex field.

The invention provides a long document semantic coherence processing method and device, a storage medium and computer device.The method comprises the steps that block coding is conducted on a long document through a sliding window converter, and the sliding window converter comprises a window dividing unit, a position coding unit and a converter coding unit; the window division unit adjusts block positions according to sentences and paragraph boundaries and sets overlapping areas between adjacent blocks; the encoded document content is stored and managed through a memory management module, the memory management module comprises a chapter-level memory pool and a gating memory unit, the chapter-level memory pool stores the document encoding content, and the gating memory unit maintains entities and event timelines; performing deep semantic understanding on the document content through a semantic processing module, and calculating a multi-dimensional attention weight capture dependency relationship between paragraphs; providing a retrieval result through a retrieval module; and generating semantically coherent output content through a content generation module. According to the scheme, the semantic coherence of long document processing is improved.

The invention discloses a file retrieval and management method fusing an AI large model and graph data, and belongs to the technical field of retrieval management, the retrieval and management method comprises the following specific steps: I, a user imports a multi-format file into a file retrieval and management system, and the system extracts characters and structured content through a file analysis module; iI, the file retrieval and management system gradually constructs a multi-level database based on the analyzed file content and metadata; iII, performing full-process management on the file from creation to archiving, and providing an intelligent tool to optimize a document processing process; according to the method, the automation and efficiency of file management can be greatly improved, a high-precision semantic search and sorting result is provided, complex association analysis and multi-dimensional query are supported, professional document translation requirements in an internationalized scene are met, document content management is optimized, and the knowledge precipitation capacity is improved.

The invention relates to the technical field of distributed file processing, in particular to a distributed file processing method and system, and the method comprises the following steps: based on a task distribution node and a data exchange interface, extracting path characteristics of a task input / output file, analyzing a file exchange sequence of a task path, and calculating a topological structure and length of the path. According to the method, the flexibility and the adaptability of task allocation are realized by combining task state monitoring and real-time adjustment of dependent path weights and task priority marks, resource allocation and a short-time task sequence are optimized by utilizing request frequency and time period records, high-frequency request resource conflicts are effectively relieved, the resource allocation efficiency is improved, and the resource allocation efficiency is improved. Through node historical resource distribution data and time distribution trend analysis, task distribution is adjusted and resource loads are balanced in combination with differences, the stability and balance of the system are enhanced, a file transmission path is optimized based on a load state and a task execution path, and a concurrent task distribution strategy is improved.

The invention provides an electronic data evidence storage verification method and system based on hierarchical hash and an intelligent contract, and relates to the technical field of block chains and data security, and the method comprises the steps: obtaining to-be-stored electronic data; to-be-stored electronic data is divided into data blocks according to a preset rule, a unique identifier and a timestamp are added to each data block, and a standardized data unit is generated; performing hierarchical hash calculation on the standardized data unit, generating a leaf node hash value by each data block, aggregating the leaf node hash values layer by layer according to a Merkle tree structure, and generating root hash; calling a block chain smart contract, submitting the tree structure hash, the timestamp and the public key encrypted signature to a block chain network, after verification of a consensus node, writing the evidence information into the block chain, analyzing a hash path submitted by a user by the smart contract to perform data verification, if the hash path is consistent with the data verification, returning verification success, otherwise, triggering an exception handling contract; through the dynamic partitioning algorithm and the layered hash structure, the calculation overhead of large file processing is reduced.

The invention relates to the technical field of intelligent document processing, and particularly discloses a file arrangement processing method and system. The method comprises the following steps: acquiring an input document, analyzing the structure and the style of the input document, and generating standardized format data; extracting a semantic relationship of the document through a pre-trained text understanding model, constructing a semantic relationship graph and optimizing a chapter sequence; loading a document processing plug-in to execute cross-format arrangement, and generating intermediate format data; executing processing nodes based on a task scheduling mechanism to generate optimized content; calling a multi-format output module to generate a target document, and adjusting metadata in combination with the global variable; and finally evaluating the document quality and updating the model. According to the method, automatic analysis, intelligent optimization and format unification of the multi-source heterogeneous document are realized, and the intelligent degree and the output efficiency of document processing are improved.

The present invention is related to data processing methods and systems thereof. According to an embodiment, the present invention provides a method of processing documents using a machine learning model. The process begins by accessing data files and extracting information from them, which is subsequently stored. This document information, along with the machine learning model trained on various document formats, is used to classify the data files and generate tabular data. From this tabular data, data objects are created and included in an output data file. The information from the output file is then used to update the data of the machine learning model, optimizing it for improved future document processing. There are other embodiments as well.

The invention relates to a document processing method and system based on text content extraction. The method comprises the steps that an original document containing text, image and format information is received, the encoding format of the document is automatically detected, character set conversion is executed, and hierarchical indexes including page numbers, paragraphs and tables are established for an unstructured document; the method comprises the following steps: synchronously processing text content and visual layout through a pre-trained visual-language model, extracting word-level and sentence-level semantic features by a text stream embedding layer, analyzing spatial distribution features of document elements by a visual encoder, and fusing text and visual features through a cross-modal attention mechanism; and loading the domain knowledge graph matched with the document type, and executing entity linking to associate the text mentions to the knowledge nodes. According to the document processing method and system based on text content extraction, through the synergistic effect of vision-text joint coding and knowledge enhancement, the accuracy of financial contract key clause recognition tasks is improved, the error rate is lower than that of industry benchmark products, and the semantic understanding precision is remarkably improved.

The invention discloses a semantic recognition system and method based on a heterogeneous graph attention network and dynamic normalization, and belongs to the technical field of natural language processing and artificial intelligence. The system adopts a dual-channel architecture and comprises a general semantic channel and a domain semantic channel, semantic feature extraction is performed through a DIFF attention mechanism and a ToST statistical attention mechanism, and training stability is improved by adopting a DyT dynamic normalization module. Adaptive fusion of cross-channel semantic features is realized through a GeGLU gating mechanism, and high-precision semantic recognition is realized by combining an improved SimCSE + + comparison learning loss and a local minimization editing strategy of semantic perception. According to the method, the problems of inaccurate semantic expression, poor context adaptability and the like in the prior art are solved, the accuracy and applicability of cross-domain semantic recognition are remarkably improved, and the method can be widely applied to scenes of legal document processing, financial document analysis and the like.

The present invention is related to data processing methods and systems thereof. According to an embodiment, the present invention provides a method of processing claim deduction documents using a machine learning model. The process begins by accessing data files and extracting information from them, which is subsequently stored. This document information, along with the machine learning model trained on various document formats, is used to classify the data files and generate tabular data. From this tabular data, data objects are created and included in an output data file. The information from the output file is then used to update the data of the machine learning model, optimizing it for improved future document processing. There are other embodiments as well.

In the field of document processing, format conversion is a common demand, for example, a PDF (Portable Document Format) or a scanning copy is converted into an editable format such as Word, Excel and the like, a traditional method generally adopts an OCR (Optical Character Recognition) technology to directly recognize document content and output a target format, and the method has the defects that the recognition accuracy is insufficient, errors can only be checked and corrected item by item after the target format is converted, and the efficiency is high. In order to solve the problems of lack of visual comparison with an original manuscript, easiness in omission, incapability of adjusting an identification result in real time in a format conversion process and high subsequent editing workload, the invention provides a brand-new document format conversion method, and provides a visual interactive interface by introducing a three-column visual interface and a real-time team correction mechanism. According to the method, the user can check and adjust the recognition result in real time in the conversion process, the accuracy of document conversion is remarkably improved, the flexibility of document conversion is achieved, the user is supported to carry out secondary editing on the content before formal output, visual comparison between the recognized content and an original manuscript is achieved, and the check difficulty is reduced.

The invention discloses an OCR (Optical Character Recognition)-based document automatic recognition intelligent management system, and relates to the technical field of intelligent document OCR processing. A preprocessing module adopts adaptive filtering and a GAN (Generic Area Network) to repair low-quality documents and separate seals from characters; the recognition engine realizes end-to-end recognition of inclined characters and mixed characters through a multi-scale feature pyramid network, and the semantic module constructs a dynamic knowledge graph and supports event evolution reasoning and cross-year correlation analysis; the classification module realizes small sample classification based on a prototype network, the security module realizes fine-grained authority control and anomaly detection through a block chain and federated learning, the text edge definition is improved after system processing, and real-time reasoning is supported. The intelligent level of document processing is improved through cooperation of multiple modules, the preprocessing and recognition module solves the complex scene problem, and deep analysis and correlation analysis are achieved through semantic understanding and a knowledge graph; the security module guarantees data security; and the efficiency and decision scientificity are comprehensively improved.

The invention provides an online document processing method and system based on a document processing model, and the method comprises the steps: obtaining an editing request of a user for a target data unit, generating a temporary locking identifier according to a user authority identifier and a request timestamp, limiting the modification operation of other users for the target data unit, and obtaining a conflict isolation result; constructing a data consistency module according to a conflict isolation result, extracting editing state information of the current data unit from the temporary locking identifier, and performing sequential recording on concurrent operation by adopting a distributed transaction processing technology; if it is detected that version conflicts exist in the sequenced records, a rollback mechanism is triggered, operation priorities are redistributed, and data versions after consistency verification are determined; and designing a hierarchical cache structure according to the data version after consistency verification, storing the high-frequency access data into a memory cache region, and storing the low-frequency access data into a disk cache region to obtain a hierarchical storage structure. The data consistency and security are good, and the storage and access efficiency is improved.

The invention relates to the technical field of document processing, in particular to a knowledge graph-based document intelligent writing and analysis system, which comprises a graph dynamic updating module, an entity recognition and mapping module, a context connection analysis module, a semantic structure rearrangement module and a semantic coherence verification module. According to the method, the real-time data source is adopted, the knowledge graph is dynamically updated and expanded, synchronization of document content and the current information trend is ensured, noun phrases and entity distribution in a text are accurately analyzed through intelligent entity recognition, the accuracy of information extraction is improved, the coincidence degree of keywords between paragraphs is calculated, and synonymous entities are intelligently inserted, so that the information extraction efficiency is improved. According to the method, the context connection quality of the document is improved, the document structure is automatically rearranged according to the correlation of the content, the logic presentation of the information is optimized, the reading experience is enhanced, and the overall semantic consistency of the document is ensured and the interpretation ambiguity is reduced through complex semantic coherence verification.

The invention relates to the field of document processing and data extraction, and particularly discloses a PDF text extraction method and system based on a large language model.The method includes the steps that content of all pages of a target PDF document is positioned and marked to obtain a first to-be-recognized area and a second to-be-recognized area, and noise interference features of the to-be-recognized areas are removed; formulating a multi-level text logic reconstruction strategy to complete reconstruction of a logic sequence of the target PDF document, preliminarily outputting a first-level PDF document, and performing primary image-text association degree analysis to output first association strength; performing intelligent anomaly recognition and correction on the content of the first-level PDF document on a semantic structure through a large language model to obtain a second-level PDF document, and outputting second association strength; judging whether the secondary PDF document is qualified or not based on the first association strength and the second association strength; according to the method, the logic sequence and the semantic integrity of the document can be recovered, and the text purity and the structural integrity are improved.

The embodiment of the invention discloses a chip register description document generation method and device, a storage medium and terminal equipment, and relates to the field of document processing. The method comprises the following steps: analyzing a register attribute table file of a chip, and determining each functional module included in the chip and a register included in each functional module according to an analysis result; querying an associated register description template document according to the model of the chip; extracting field values corresponding to fields in the register list display area and the register description display area from the register attribute table file, and filling the read field values into a register description template document to generate a register description document of the chip, the problems that in the prior art, compiling of the chip register description document is low in efficiency, prone to errors and poor in timeliness are effectively solved, and a more efficient, accurate and reliable method is provided for compiling and managing the chip document.

The invention discloses a document element extraction method based on an AI large model technology. The method comprises the following steps that various receipts input by a user are received; carrying out analysis and layout analysis on the document through a visual language model or a text analysis technology to generate a unified intermediate representation; a dynamic grading module is adopted to evaluate document complexity from three dimensions of format, structure and variation, and the document complexity is divided into a simple regular type, a structure complex type or a height variation type; adaptively selecting a processing flow according to a rating result, wherein the processing flow comprises high-speed template matching, multi-modal cognitive fusion or intelligent agent driving processing; the processing result is converted into an EasyEX format which is easy to process; the method comprises the following steps of: converting a natural language demand into an execution rule by extracting an Agent and utilizing a Prompt dynamic compiling technology, and positioning and extracting a target field by LLM (Logical Language Model); and finally, outputting structured data after type verification, knowledge graph verification and compliance review. According to the invention, the universality, the accuracy and the automation degree of receipt processing are improved, and the labor cost is greatly reduced.

Disclosed are methods, systems, devices, apparatus, media, and other implementations for improved search-time content retrieval performed by an information retrieval platform. The implementations include a method including determining by a searching system, at a first time instance, one or more first search results for a first query comprising one or more query terms associated with a first concept, modifying the query, based on the determined one or more first search results, to include one or more modified query terms associated with one or more concepts hierarchically related to the first concept, and determining at a subsequent time instance one or more subsequent search results for the modified query comprising the one or more modified query terms.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an intelligent document processing method, device, equipment and medium, comprising: receiving a document processing request and generating a task identifier, creating and sending a document processing task, constructing an intermediate document structure and generating a plurality of subtasks, and processing the sub-tasks, writing states and page contents into a cache, regularly querying task states, updating accessible identifiers, responding to an access request, loading the page contents, and integrating pages to generate a complete document after all the sub-tasks are completed. According to the method, the document generation task is divided into a plurality of sub-tasks which can be independently processed, and page-level asynchronous loading is realized in combination with a state cache and a regular query mechanism, so that the response speed and the system processing efficiency are remarkably improved while the generation accuracy is ensured; the problems that in the prior art, document generation delay is high, loading is slow, and user waiting time is long are effectively solved.

The invention discloses a retrieval enhancement generation method and device based on reciprocal ranking fusion and a medium, and relates to the technical field of intelligent question answering and document processing. The method comprises the following steps: receiving an original query input by a user, and processing the original query by utilizing a preset first large language model to generate a plurality of extended queries; using a semantic vectorization method to retrieve corresponding related documents in a document database for each extended query; according to a reciprocal ranking fusion algorithm, calculating reciprocal ranking scores of the related documents corresponding to the extended queries, and comprehensively ranking the related documents according to the reciprocal ranking scores; and inputting the related documents, the extended queries and the original queries after comprehensive sorting into a preset second large language model, and generating question and answer output.

In various examples, systems and techniques are provided that encapsulate indexing and query operations into an application programming interface (API) that automates and coordinates calls to various local and cloud-based services. When a user has a document(s) to add to a retrieval augmented generation (RAG) database, the API may offer to the user multiple document processing pipelines (DPPs) having pre-set indexing configurations. Similarly, when a user query is received, the API may generate calls to implement query processing that does not require the user to manually configure retrieval and processing of the embeddings. The API may further implement calls that locate a relevant embedding store and provide the stored embeddings, together with the query embeddings, to a search engine that identifies the most relevant matches. The API may then access the embedding-to-text indexing and identify relevant text segments and documents to a prompt generator.

A large language model generation method based on retrieval enhancement belongs to the field of computers and comprises the following steps: retrieving similar document abstracts according to input questions, converting the input questions and the document abstracts into points in a high-dimensional vector space, retrieving related documents and converting the related documents into a structured knowledge graph, generating sub-questions and extracting key information from the sub-questions, then, calling a large language model to carry out few-sample learning so as to generate associative cue words; generating a query command in combination with the associative cue word and the sub-question; obtaining sub-knowledge graph information by executing a query command, converting the sub-knowledge graph information into a text, and compressing and converting the text; and inputting the converted text and the question into a GPT-4 large language model to generate a natural language answer. According to the method, multi-level information and complex data in complex questions can be processed more accurately, the accuracy, efficiency and quality in large-scale data set and complex document processing are improved, accurate and coherent answers are provided, and the operation cost and resource consumption are reduced.

A document processing platform transforms unorganized documents into interactive systems where users can ask questions and get answers. The document processing platform implements a User-Driven Contextualization Process, which allows users to add meaning to data. The process also improves user productivity by automatically tagging information and allowing for the prioritization of relevant details. The user may then ask questions for which narrative answers are provided including the relevant details extracted from the document. The process of transforming an unorganized document into an interactive system where users can ask questions and receive answers is broken down into three phases including document upload and data extraction, user-driven contextualization and definition, and configuring the new documents for questions using a large language model such as OpenAI.

The embodiment of the invention provides a document processing method and device and an information retrieval method and device. According to the document processing method, the text content of a target document can be subjected to fragmentation processing to obtain a plurality of text fragments, then each text fragment is input into a first large language model for model processing to obtain a processing result, the processing result comprises a plurality of knowledge fragments, and then the target document is processed according to the knowledge fragments. And generating first tag data corresponding to a plurality of preset tag categories, and correspondingly storing each knowledge fragment and the first tag data in a first database, so that the first tag data is used for knowledge question and answer retrieval. In the information retrieval method, after a user question in a text form is determined according to an information retrieval request of a user, second label data corresponding to the plurality of label categories are generated according to the user question, and then the user question is retrieved based on first correlation between at least part of first label data in a first database and the second label data. Knowledge fragments related to the user question are retrieved.

The invention provides a long document processing method and system based on multi-agent collaborative reasoning. The method specifically comprises the steps that semantic coherence is reserved by adopting a sliding window overlapping partitioning strategy; a structured reasoning chain is generated by analyzing the agents, the agents are integrated to eliminate cross-block contradictions based on vector similarity and triple conflict detection, and a paragraph-level unified conclusion is output; and the summarizing agent constructs a global logic relationship by utilizing thinking chain prompt, reconstructs an answer framework according to user questions and binds a source identifier, and generates a traceable complete abstract or answer. According to the method, the technical problems of global reasoning failure caused by context window length limitation, semantic splitting and conclusion conflict caused by block processing, low single-model serial efficiency and the like in the prior art can be solved.

The invention relates to the technical field of document processing, and discloses a document auditing method, device and equipment and a medium, the method comprises the following steps: obtaining a to-be-audited document containing at least one of a text, an image and a chart, and analyzing the to-be-audited document to obtain corresponding to-be-audited content; obtaining an auditing rule document, extracting an auditing rule described in a natural language from the auditing rule document, and converting the auditing rule into a structured query statement; and extracting and auditing multi-dimensional elements of the to-be-audited content based on the structured query statement to obtain a corresponding auditing result, and outputting the auditing result. According to the technical scheme, the multi-modal document is automatically analyzed, the natural language rule is converted into the structured query statement, full-automatic analysis and auditing of the document are achieved on the basis of a multi-dimensional element extraction and auditing mechanism, manual work is not needed, and the document auditing efficiency and accuracy can be effectively improved.