1331 results about "Document processing" patented technology

According to the research and development document processing method and device provided by the embodiment of the invention, unified processing of text, voice and image information is realized by constructing the multi-mode document analysis engine. Different types of data are converted into standardized feature representations through cross-modal preprocessing and a semantic alignment network. The system adopts a deep learning model to identify research and development elements, establishes a multi-modal relation graph, and realizes intelligent extraction and correlation analysis of various types of information in research and development documents. According to the method, the defects of the traditional technology in the aspects of multi-modal information fusion and knowledge system construction are effectively overcome, powerful support is provided for research and development process management and knowledge asset accumulation, and the standardized management level of research and development documents is remarkably improved.

The invention provides a semi-structured file processing method based on an LLMs (Language Language Model), which is used for efficiently analyzing a semi-structured file and converting the semi-structured file, and belongs to the technical field of intelligent document processing and multi-modal learning. The method is characterized by comprising the following steps: multi-modal fusion analysis: adopting a hierarchical cross-modal attention mechanism HCMA, and combining a multi-head attention mechanism with a graph neural network GNN to realize multi-level feature fusion of a text and an image; adaptive structured conversion: adopting a dynamic structure analysis network DPN, and combining reinforcement learning and a generation model to realize adaptive analysis of a document structure; and model generation and multi-modal reasoning: adopting a multi-modal generation reasoning network MGRN, and combining a diffusion model and neural symbol reasoning to realize joint generation and reasoning of the text and the image. According to the method, a remarkable technical breakthrough is brought to the aspects of document analysis, information extraction and intelligent reasoning, and powerful support is provided for data-driven innovation of various industries.

The invention relates to a government affair file information extraction and question answering method and device and a medium, and the method comprises the steps: carrying out the entity extraction of a government affair file through employing a BERT-CRF joint model, and obtaining a structured entity set; performing relation extraction on the structured entity set to generate a semantic relation set between the entities; constructing a knowledge graph according to the structured entity set and the semantic relationship set, storing entity nodes into a graph database, and storing an embedded vector of an entity text into a vector database; when a query request of a user is received, relation query of the graph database and semantic retrieval of the vector database are carried out, sub-graph structures and semantic matching vectors related to query are extracted, and a mixed retrieval result is obtained; and inputting the mixed retrieval result into a large language model, and generating a question and answer response text conforming to a preset format by applying a dynamic prompt template. According to the method, the document processing efficiency and accuracy are effectively improved, and a solid technical support is provided for intelligent management of government affair documents.

The invention relates to an engineering document index consistency proofreading method and system based on a multi-modal large model, and the method comprises the steps: Q1. OCR detection and recognition: carrying out the optical character recognition and format analysis of a source document, converting an uploaded PDF document into a processable text message in a Markdown format, and carrying out the format discrimination of a table, a formula and a plain text; and Q2, table and formula processing: adopting a hierarchical processing strategy, intelligently selecting an optimal processing mode according to the complexity of the table, and converting table information into a descriptive long text through a language large model and cue words. According to the method, accurate, reliable and efficient document index checking service can be provided for a user, the quality and efficiency of professional document processing are remarkably improved, the efficiency and quality of knowledge graph construction are remarkably improved, a knowledge verification system capable of being evolved continuously is established, and the method is suitable for popularization and application. And a reliable technical support is provided for knowledge management and professional decision-making in a complex field.

The invention provides a long document semantic coherence processing method and device, a storage medium and computer device.The method comprises the steps that block coding is conducted on a long document through a sliding window converter, and the sliding window converter comprises a window dividing unit, a position coding unit and a converter coding unit; the window division unit adjusts block positions according to sentences and paragraph boundaries and sets overlapping areas between adjacent blocks; the encoded document content is stored and managed through a memory management module, the memory management module comprises a chapter-level memory pool and a gating memory unit, the chapter-level memory pool stores the document encoding content, and the gating memory unit maintains entities and event timelines; performing deep semantic understanding on the document content through a semantic processing module, and calculating a multi-dimensional attention weight capture dependency relationship between paragraphs; providing a retrieval result through a retrieval module; and generating semantically coherent output content through a content generation module. According to the scheme, the semantic coherence of long document processing is improved.

The invention discloses a file retrieval and management method fusing an AI large model and graph data, and belongs to the technical field of retrieval management, the retrieval and management method comprises the following specific steps: I, a user imports a multi-format file into a file retrieval and management system, and the system extracts characters and structured content through a file analysis module; iI, the file retrieval and management system gradually constructs a multi-level database based on the analyzed file content and metadata; iII, performing full-process management on the file from creation to archiving, and providing an intelligent tool to optimize a document processing process; according to the method, the automation and efficiency of file management can be greatly improved, a high-precision semantic search and sorting result is provided, complex association analysis and multi-dimensional query are supported, professional document translation requirements in an internationalized scene are met, document content management is optimized, and the knowledge precipitation capacity is improved.

The invention provides an electronic data evidence storage verification method and system based on hierarchical hash and an intelligent contract, and relates to the technical field of block chains and data security, and the method comprises the steps: obtaining to-be-stored electronic data; to-be-stored electronic data is divided into data blocks according to a preset rule, a unique identifier and a timestamp are added to each data block, and a standardized data unit is generated; performing hierarchical hash calculation on the standardized data unit, generating a leaf node hash value by each data block, aggregating the leaf node hash values layer by layer according to a Merkle tree structure, and generating root hash; calling a block chain smart contract, submitting the tree structure hash, the timestamp and the public key encrypted signature to a block chain network, after verification of a consensus node, writing the evidence information into the block chain, analyzing a hash path submitted by a user by the smart contract to perform data verification, if the hash path is consistent with the data verification, returning verification success, otherwise, triggering an exception handling contract; through the dynamic partitioning algorithm and the layered hash structure, the calculation overhead of large file processing is reduced.

The invention relates to the technical field of intelligent document processing, and particularly discloses a file arrangement processing method and system. The method comprises the following steps: acquiring an input document, analyzing the structure and the style of the input document, and generating standardized format data; extracting a semantic relationship of the document through a pre-trained text understanding model, constructing a semantic relationship graph and optimizing a chapter sequence; loading a document processing plug-in to execute cross-format arrangement, and generating intermediate format data; executing processing nodes based on a task scheduling mechanism to generate optimized content; calling a multi-format output module to generate a target document, and adjusting metadata in combination with the global variable; and finally evaluating the document quality and updating the model. According to the method, automatic analysis, intelligent optimization and format unification of the multi-source heterogeneous document are realized, and the intelligent degree and the output efficiency of document processing are improved.

The invention relates to a document processing method and system based on text content extraction. The method comprises the steps that an original document containing text, image and format information is received, the encoding format of the document is automatically detected, character set conversion is executed, and hierarchical indexes including page numbers, paragraphs and tables are established for an unstructured document; the method comprises the following steps: synchronously processing text content and visual layout through a pre-trained visual-language model, extracting word-level and sentence-level semantic features by a text stream embedding layer, analyzing spatial distribution features of document elements by a visual encoder, and fusing text and visual features through a cross-modal attention mechanism; and loading the domain knowledge graph matched with the document type, and executing entity linking to associate the text mentions to the knowledge nodes. According to the document processing method and system based on text content extraction, through the synergistic effect of vision-text joint coding and knowledge enhancement, the accuracy of financial contract key clause recognition tasks is improved, the error rate is lower than that of industry benchmark products, and the semantic understanding precision is remarkably improved.

The invention discloses a semantic recognition system and method based on a heterogeneous graph attention network and dynamic normalization, and belongs to the technical field of natural language processing and artificial intelligence. The system adopts a dual-channel architecture and comprises a general semantic channel and a domain semantic channel, semantic feature extraction is performed through a DIFF attention mechanism and a ToST statistical attention mechanism, and training stability is improved by adopting a DyT dynamic normalization module. Adaptive fusion of cross-channel semantic features is realized through a GeGLU gating mechanism, and high-precision semantic recognition is realized by combining an improved SimCSE + + comparison learning loss and a local minimization editing strategy of semantic perception. According to the method, the problems of inaccurate semantic expression, poor context adaptability and the like in the prior art are solved, the accuracy and applicability of cross-domain semantic recognition are remarkably improved, and the method can be widely applied to scenes of legal document processing, financial document analysis and the like.

In the field of document processing, format conversion is a common demand, for example, a PDF (Portable Document Format) or a scanning copy is converted into an editable format such as Word, Excel and the like, a traditional method generally adopts an OCR (Optical Character Recognition) technology to directly recognize document content and output a target format, and the method has the defects that the recognition accuracy is insufficient, errors can only be checked and corrected item by item after the target format is converted, and the efficiency is high. In order to solve the problems of lack of visual comparison with an original manuscript, easiness in omission, incapability of adjusting an identification result in real time in a format conversion process and high subsequent editing workload, the invention provides a brand-new document format conversion method, and provides a visual interactive interface by introducing a three-column visual interface and a real-time team correction mechanism. According to the method, the user can check and adjust the recognition result in real time in the conversion process, the accuracy of document conversion is remarkably improved, the flexibility of document conversion is achieved, the user is supported to carry out secondary editing on the content before formal output, visual comparison between the recognized content and an original manuscript is achieved, and the check difficulty is reduced.

The invention discloses an OCR (Optical Character Recognition)-based document automatic recognition intelligent management system, and relates to the technical field of intelligent document OCR processing. A preprocessing module adopts adaptive filtering and a GAN (Generic Area Network) to repair low-quality documents and separate seals from characters; the recognition engine realizes end-to-end recognition of inclined characters and mixed characters through a multi-scale feature pyramid network, and the semantic module constructs a dynamic knowledge graph and supports event evolution reasoning and cross-year correlation analysis; the classification module realizes small sample classification based on a prototype network, the security module realizes fine-grained authority control and anomaly detection through a block chain and federated learning, the text edge definition is improved after system processing, and real-time reasoning is supported. The intelligent level of document processing is improved through cooperation of multiple modules, the preprocessing and recognition module solves the complex scene problem, and deep analysis and correlation analysis are achieved through semantic understanding and a knowledge graph; the security module guarantees data security; and the efficiency and decision scientificity are comprehensively improved.

The invention provides an online document processing method and system based on a document processing model, and the method comprises the steps: obtaining an editing request of a user for a target data unit, generating a temporary locking identifier according to a user authority identifier and a request timestamp, limiting the modification operation of other users for the target data unit, and obtaining a conflict isolation result; constructing a data consistency module according to a conflict isolation result, extracting editing state information of the current data unit from the temporary locking identifier, and performing sequential recording on concurrent operation by adopting a distributed transaction processing technology; if it is detected that version conflicts exist in the sequenced records, a rollback mechanism is triggered, operation priorities are redistributed, and data versions after consistency verification are determined; and designing a hierarchical cache structure according to the data version after consistency verification, storing the high-frequency access data into a memory cache region, and storing the low-frequency access data into a disk cache region to obtain a hierarchical storage structure. The data consistency and security are good, and the storage and access efficiency is improved.

The invention relates to the technical field of document processing, in particular to a knowledge graph-based document intelligent writing and analysis system, which comprises a graph dynamic updating module, an entity recognition and mapping module, a context connection analysis module, a semantic structure rearrangement module and a semantic coherence verification module. According to the method, the real-time data source is adopted, the knowledge graph is dynamically updated and expanded, synchronization of document content and the current information trend is ensured, noun phrases and entity distribution in a text are accurately analyzed through intelligent entity recognition, the accuracy of information extraction is improved, the coincidence degree of keywords between paragraphs is calculated, and synonymous entities are intelligently inserted, so that the information extraction efficiency is improved. According to the method, the context connection quality of the document is improved, the document structure is automatically rearranged according to the correlation of the content, the logic presentation of the information is optimized, the reading experience is enhanced, and the overall semantic consistency of the document is ensured and the interpretation ambiguity is reduced through complex semantic coherence verification.

The invention relates to the field of document processing and data extraction, and particularly discloses a PDF text extraction method and system based on a large language model.The method includes the steps that content of all pages of a target PDF document is positioned and marked to obtain a first to-be-recognized area and a second to-be-recognized area, and noise interference features of the to-be-recognized areas are removed; formulating a multi-level text logic reconstruction strategy to complete reconstruction of a logic sequence of the target PDF document, preliminarily outputting a first-level PDF document, and performing primary image-text association degree analysis to output first association strength; performing intelligent anomaly recognition and correction on the content of the first-level PDF document on a semantic structure through a large language model to obtain a second-level PDF document, and outputting second association strength; judging whether the secondary PDF document is qualified or not based on the first association strength and the second association strength; according to the method, the logic sequence and the semantic integrity of the document can be recovered, and the text purity and the structural integrity are improved.

The invention discloses a document element extraction method based on an AI large model technology. The method comprises the following steps that various receipts input by a user are received; carrying out analysis and layout analysis on the document through a visual language model or a text analysis technology to generate a unified intermediate representation; a dynamic grading module is adopted to evaluate document complexity from three dimensions of format, structure and variation, and the document complexity is divided into a simple regular type, a structure complex type or a height variation type; adaptively selecting a processing flow according to a rating result, wherein the processing flow comprises high-speed template matching, multi-modal cognitive fusion or intelligent agent driving processing; the processing result is converted into an EasyEX format which is easy to process; the method comprises the following steps of: converting a natural language demand into an execution rule by extracting an Agent and utilizing a Prompt dynamic compiling technology, and positioning and extracting a target field by LLM (Logical Language Model); and finally, outputting structured data after type verification, knowledge graph verification and compliance review. According to the invention, the universality, the accuracy and the automation degree of receipt processing are improved, and the labor cost is greatly reduced.

Disclosed are methods, systems, devices, apparatus, media, and other implementations for improved search-time content retrieval performed by an information retrieval platform. The implementations include a method including determining by a searching system, at a first time instance, one or more first search results for a first query comprising one or more query terms associated with a first concept, modifying the query, based on the determined one or more first search results, to include one or more modified query terms associated with one or more concepts hierarchically related to the first concept, and determining at a subsequent time instance one or more subsequent search results for the modified query comprising the one or more modified query terms.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an intelligent document processing method, device, equipment and medium, comprising: receiving a document processing request and generating a task identifier, creating and sending a document processing task, constructing an intermediate document structure and generating a plurality of subtasks, and processing the sub-tasks, writing states and page contents into a cache, regularly querying task states, updating accessible identifiers, responding to an access request, loading the page contents, and integrating pages to generate a complete document after all the sub-tasks are completed. According to the method, the document generation task is divided into a plurality of sub-tasks which can be independently processed, and page-level asynchronous loading is realized in combination with a state cache and a regular query mechanism, so that the response speed and the system processing efficiency are remarkably improved while the generation accuracy is ensured; the problems that in the prior art, document generation delay is high, loading is slow, and user waiting time is long are effectively solved.

In various examples, systems and techniques are provided that encapsulate indexing and query operations into an application programming interface (API) that automates and coordinates calls to various local and cloud-based services. When a user has a document(s) to add to a retrieval augmented generation (RAG) database, the API may offer to the user multiple document processing pipelines (DPPs) having pre-set indexing configurations. Similarly, when a user query is received, the API may generate calls to implement query processing that does not require the user to manually configure retrieval and processing of the embeddings. The API may further implement calls that locate a relevant embedding store and provide the stored embeddings, together with the query embeddings, to a search engine that identifies the most relevant matches. The API may then access the embedding-to-text indexing and identify relevant text segments and documents to a prompt generator.

The invention provides a long document processing method and system based on multi-agent collaborative reasoning. The method specifically comprises the steps that semantic coherence is reserved by adopting a sliding window overlapping partitioning strategy; a structured reasoning chain is generated by analyzing the agents, the agents are integrated to eliminate cross-block contradictions based on vector similarity and triple conflict detection, and a paragraph-level unified conclusion is output; and the summarizing agent constructs a global logic relationship by utilizing thinking chain prompt, reconstructs an answer framework according to user questions and binds a source identifier, and generates a traceable complete abstract or answer. According to the method, the technical problems of global reasoning failure caused by context window length limitation, semantic splitting and conclusion conflict caused by block processing, low single-model serial efficiency and the like in the prior art can be solved.

The invention relates to the technical field of document processing, and discloses a document auditing method, device and equipment and a medium, the method comprises the following steps: obtaining a to-be-audited document containing at least one of a text, an image and a chart, and analyzing the to-be-audited document to obtain corresponding to-be-audited content; obtaining an auditing rule document, extracting an auditing rule described in a natural language from the auditing rule document, and converting the auditing rule into a structured query statement; and extracting and auditing multi-dimensional elements of the to-be-audited content based on the structured query statement to obtain a corresponding auditing result, and outputting the auditing result. According to the technical scheme, the multi-modal document is automatically analyzed, the natural language rule is converted into the structured query statement, full-automatic analysis and auditing of the document are achieved on the basis of a multi-dimensional element extraction and auditing mechanism, manual work is not needed, and the document auditing efficiency and accuracy can be effectively improved.

The invention relates to the technical field of cross-border document data verification, and discloses a cross-border document data verification method and device, electronic equipment and a storage medium, and the method comprises the steps: extracting a key paragraph of a specified cross-border document; mapping the key paragraph into a preset cross-border knowledge graph to obtain a corresponding three-level mapping relationship; wherein the three-level mapping relation is commodity description-coordination system code-local extension code; and verifying the cross-border document based on the three-level mapping relationship. The cross-border document processing method has the advantages that the document processing accuracy is improved, compliance verification becomes more efficient, missing detection and misjudgment caused by manual auditing are reduced, intellectualization, automation and standardization of cross-border document processing are achieved, and higher efficiency and safety are given to global trade.

The invention discloses a case factor intelligent analysis and processing method based on intelligent semantic understanding, and belongs to the field of artificial intelligence, natural language processing and public security judicial informationization, and the method comprises the following steps: 1, preprocessing public security judicial document information, and supporting text analysis, format standardization and structured data conversion; 2, carrying out refined extraction on case elements based on a large language model, and identifying case constituent elements, hazard degrees and processing results; 3, fusing logical reasoning of a public security judicial knowledge graph, and enhancing cross-cause semantic understanding and reasoning accuracy; and 4, performing intelligent auxiliary processing, generating class case recommendation and penalty interval prediction, and performing interactive regulation question and answer. According to the method, efficient, accurate and automatic case factor analysis is successfully realized, and the public security judicial document processing efficiency and decision accuracy are remarkably improved.

Disclosed is a new document processing solution that combines the powers of machine learning and deep learning and leverages the knowledge of a knowledge base. Textual information in an input image of a document can be converted to semantic information utilizing the knowledge base. A semantic image can then be generated utilizing the semantic information and geometries of the textual information. The semantic information can be coded by semantic type determined utilizing the knowledge base and positioned in the semantic image utilizing the geometries of the textual information. A region-based convolutional neural network (R-CNN) can be trained to extract regions from the semantic image utilizing the coded semantic information and the geometries. The regions can be mapped to the textual information for classification / data extraction. With semantic images, the number of samples and time needed to train the R-CNN for document processing can be significantly reduced.

Embodiments are directed towards a computer-implemented method for identifying one or more matching elements from a taxonomy present in a document. The method may include identifying the document, the taxonomy, and a question that may be processed by a large language model (LLM). The method may further include applying at least one taxonomy augmented generation (TAG) tactic from a set of TAG tactics to the identified document and to the identified taxonomy. The method may also include generating an input prompt that may be configured to be used as an input for the LLM, where the input prompt may include a document context derived from the document, a taxonomy context derived from the taxonomy, and the question to be processed by the LLM. The method may further include providing the input prompt to the LLM, and receiving a response generated by the LLM.

System and methods are disclosed for matching extracted text data based on one or more similarity scores. The method may include receiving one or more documents from a plurality of data sources, utilizing an optical character recognition algorithm for extracting text data from the one or more documents, comparing, utilizing a fuzzy matching algorithm, the extracted text data to reference dataset(s) to determine one or more matches between the extracted text data and at least one of the reference dataset(s), wherein the one or more matches are based on at least one similarity score, inputting the determined one or more matches and the at least one similarity score into a trained machine-learning model to refine the one or more matches, and outputting a representation of the refined one or more matches and the at least one similarity score to a graphical user interface of a device.

The invention discloses a clinical test document quality detection and processing method and system and computer equipment. The method comprises the following steps: acquiring a to-be-processed clinical test document; performing format conversion and optimization processing on the to-be-processed clinical test document to obtain a preprocessing result; automatically classifying the preprocessing result to obtain a classification result; extracting document key information according to the classification result, and generating a file name to obtain an extraction result; checking the integrity, compliance and archivability of the corresponding document according to the extraction result, and performing automatic processing according to the detection result to obtain an automatic processing result; and storing and archiving the automatic processing result. By implementing the method provided by the invention, efficient and accurate document quality detection and automatic processing can be realized, so that the document processing quality and efficiency are improved, and the problems of low efficiency, poor consistency and high error rate in the prior art are solved.

The invention relates to the field of document processing, and particularly provides a document format processing method, system, terminal and medium based on a large language model.The method comprises the steps that a generation instruction containing a target document type and a source material are received, and original text content is generated through the large language model integrating domain knowledge; obtaining a matched structured format template, and analyzing the style rule into a format instruction set; identifying logic elements and hierarchical relationships thereof in the original text based on a natural language processing technology; performing association mapping on the format instruction and the logic element, and performing automatic style rendering by calling a document object model interface to generate an intermediate document with a standard format; and finally, outputting after quality verification. According to the method, an automatic process of content generation and intelligent formatting is constructed, and the document writing efficiency and normalization are improved.

The invention relates to the technical field of artificial intelligence, financial science and technology and medical science and technology, and provides a document processing method, device and equipment based on artificial intelligence and a medium. The method comprises the steps that document pictures are input into a multi-modal large model, element-level segmentation and classification are conducted, and bounding boxes and category labels of all kinds of elements are obtained; according to the bounding box of each type of element, intercepting an independent subgraph of each type of element from the document picture; inputting the independent sub-graphs of the various elements into processing models corresponding to the category labels of the elements so as to extract information in the independent sub-graphs; and carrying out structured integration on the extracted information to obtain the information of the document picture. According to the method, a large model is used for carrying out element-level segmentation and classification on a document picture, then a processing model related to each type of elements is used for carrying out targeted information extraction on independent sub-graphs of each type of elements, so that the information extraction precision of a complex document is improved, and after information of a plurality of independent sub-graphs is integrated, complete and accurate document information is obtained.

Unified solutions for agentic automation and robotic process automation (RPA) with self-healing and capabilities to increase autonomy are disclosed. AI agents “coexist” in tandem with RPA robots that execute RPA automations. The AI agents can dynamically leverage the tools available via these RPA robots to perform document processing, user interface (UI) automation, semantic copy-and-paste between a source and a target, etc. AI agents can dynamically select these tools and execute them in the form of a pipeline.