1012 results about "Document processing" patented technology

The invention relates to a government affair file information extraction and question answering method and device and a medium, and the method comprises the steps: carrying out the entity extraction of a government affair file through employing a BERT-CRF joint model, and obtaining a structured entity set; performing relation extraction on the structured entity set to generate a semantic relation set between the entities; constructing a knowledge graph according to the structured entity set and the semantic relationship set, storing entity nodes into a graph database, and storing an embedded vector of an entity text into a vector database; when a query request of a user is received, relation query of the graph database and semantic retrieval of the vector database are carried out, sub-graph structures and semantic matching vectors related to query are extracted, and a mixed retrieval result is obtained; and inputting the mixed retrieval result into a large language model, and generating a question and answer response text conforming to a preset format by applying a dynamic prompt template. According to the method, the document processing efficiency and accuracy are effectively improved, and a solid technical support is provided for intelligent management of government affair documents.

The invention relates to an engineering document index consistency proofreading method and system based on a multi-modal large model, and the method comprises the steps: Q1. OCR detection and recognition: carrying out the optical character recognition and format analysis of a source document, converting an uploaded PDF document into a processable text message in a Markdown format, and carrying out the format discrimination of a table, a formula and a plain text; and Q2, table and formula processing: adopting a hierarchical processing strategy, intelligently selecting an optimal processing mode according to the complexity of the table, and converting table information into a descriptive long text through a language large model and cue words. According to the method, accurate, reliable and efficient document index checking service can be provided for a user, the quality and efficiency of professional document processing are remarkably improved, the efficiency and quality of knowledge graph construction are remarkably improved, a knowledge verification system capable of being evolved continuously is established, and the method is suitable for popularization and application. And a reliable technical support is provided for knowledge management and professional decision-making in a complex field.

The invention relates to a document processing method and system based on text content extraction. The method comprises the steps that an original document containing text, image and format information is received, the encoding format of the document is automatically detected, character set conversion is executed, and hierarchical indexes including page numbers, paragraphs and tables are established for an unstructured document; the method comprises the following steps: synchronously processing text content and visual layout through a pre-trained visual-language model, extracting word-level and sentence-level semantic features by a text stream embedding layer, analyzing spatial distribution features of document elements by a visual encoder, and fusing text and visual features through a cross-modal attention mechanism; and loading the domain knowledge graph matched with the document type, and executing entity linking to associate the text mentions to the knowledge nodes. According to the document processing method and system based on text content extraction, through the synergistic effect of vision-text joint coding and knowledge enhancement, the accuracy of financial contract key clause recognition tasks is improved, the error rate is lower than that of industry benchmark products, and the semantic understanding precision is remarkably improved.

The invention discloses a semantic recognition system and method based on a heterogeneous graph attention network and dynamic normalization, and belongs to the technical field of natural language processing and artificial intelligence. The system adopts a dual-channel architecture and comprises a general semantic channel and a domain semantic channel, semantic feature extraction is performed through a DIFF attention mechanism and a ToST statistical attention mechanism, and training stability is improved by adopting a DyT dynamic normalization module. Adaptive fusion of cross-channel semantic features is realized through a GeGLU gating mechanism, and high-precision semantic recognition is realized by combining an improved SimCSE + + comparison learning loss and a local minimization editing strategy of semantic perception. According to the method, the problems of inaccurate semantic expression, poor context adaptability and the like in the prior art are solved, the accuracy and applicability of cross-domain semantic recognition are remarkably improved, and the method can be widely applied to scenes of legal document processing, financial document analysis and the like.

The invention relates to the field of document processing and data extraction, and particularly discloses a PDF text extraction method and system based on a large language model.The method includes the steps that content of all pages of a target PDF document is positioned and marked to obtain a first to-be-recognized area and a second to-be-recognized area, and noise interference features of the to-be-recognized areas are removed; formulating a multi-level text logic reconstruction strategy to complete reconstruction of a logic sequence of the target PDF document, preliminarily outputting a first-level PDF document, and performing primary image-text association degree analysis to output first association strength; performing intelligent anomaly recognition and correction on the content of the first-level PDF document on a semantic structure through a large language model to obtain a second-level PDF document, and outputting second association strength; judging whether the secondary PDF document is qualified or not based on the first association strength and the second association strength; according to the method, the logic sequence and the semantic integrity of the document can be recovered, and the text purity and the structural integrity are improved.

The invention discloses a document element extraction method based on an AI large model technology. The method comprises the following steps that various receipts input by a user are received; carrying out analysis and layout analysis on the document through a visual language model or a text analysis technology to generate a unified intermediate representation; a dynamic grading module is adopted to evaluate document complexity from three dimensions of format, structure and variation, and the document complexity is divided into a simple regular type, a structure complex type or a height variation type; adaptively selecting a processing flow according to a rating result, wherein the processing flow comprises high-speed template matching, multi-modal cognitive fusion or intelligent agent driving processing; the processing result is converted into an EasyEX format which is easy to process; the method comprises the following steps of: converting a natural language demand into an execution rule by extracting an Agent and utilizing a Prompt dynamic compiling technology, and positioning and extracting a target field by LLM (Logical Language Model); and finally, outputting structured data after type verification, knowledge graph verification and compliance review. According to the invention, the universality, the accuracy and the automation degree of receipt processing are improved, and the labor cost is greatly reduced.

Disclosed are methods, systems, devices, apparatus, media, and other implementations for improved search-time content retrieval performed by an information retrieval platform. The implementations include a method including determining by a searching system, at a first time instance, one or more first search results for a first query comprising one or more query terms associated with a first concept, modifying the query, based on the determined one or more first search results, to include one or more modified query terms associated with one or more concepts hierarchically related to the first concept, and determining at a subsequent time instance one or more subsequent search results for the modified query comprising the one or more modified query terms.

In various examples, systems and techniques are provided that encapsulate indexing and query operations into an application programming interface (API) that automates and coordinates calls to various local and cloud-based services. When a user has a document(s) to add to a retrieval augmented generation (RAG) database, the API may offer to the user multiple document processing pipelines (DPPs) having pre-set indexing configurations. Similarly, when a user query is received, the API may generate calls to implement query processing that does not require the user to manually configure retrieval and processing of the embeddings. The API may further implement calls that locate a relevant embedding store and provide the stored embeddings, together with the query embeddings, to a search engine that identifies the most relevant matches. The API may then access the embedding-to-text indexing and identify relevant text segments and documents to a prompt generator.

The invention provides a long document processing method and system based on multi-agent collaborative reasoning. The method specifically comprises the steps that semantic coherence is reserved by adopting a sliding window overlapping partitioning strategy; a structured reasoning chain is generated by analyzing the agents, the agents are integrated to eliminate cross-block contradictions based on vector similarity and triple conflict detection, and a paragraph-level unified conclusion is output; and the summarizing agent constructs a global logic relationship by utilizing thinking chain prompt, reconstructs an answer framework according to user questions and binds a source identifier, and generates a traceable complete abstract or answer. According to the method, the technical problems of global reasoning failure caused by context window length limitation, semantic splitting and conclusion conflict caused by block processing, low single-model serial efficiency and the like in the prior art can be solved.

The invention relates to the technical field of document processing, and discloses a document auditing method, device and equipment and a medium, the method comprises the following steps: obtaining a to-be-audited document containing at least one of a text, an image and a chart, and analyzing the to-be-audited document to obtain corresponding to-be-audited content; obtaining an auditing rule document, extracting an auditing rule described in a natural language from the auditing rule document, and converting the auditing rule into a structured query statement; and extracting and auditing multi-dimensional elements of the to-be-audited content based on the structured query statement to obtain a corresponding auditing result, and outputting the auditing result. According to the technical scheme, the multi-modal document is automatically analyzed, the natural language rule is converted into the structured query statement, full-automatic analysis and auditing of the document are achieved on the basis of a multi-dimensional element extraction and auditing mechanism, manual work is not needed, and the document auditing efficiency and accuracy can be effectively improved.

The invention relates to the technical field of cross-border document data verification, and discloses a cross-border document data verification method and device, electronic equipment and a storage medium, and the method comprises the steps: extracting a key paragraph of a specified cross-border document; mapping the key paragraph into a preset cross-border knowledge graph to obtain a corresponding three-level mapping relationship; wherein the three-level mapping relation is commodity description-coordination system code-local extension code; and verifying the cross-border document based on the three-level mapping relationship. The cross-border document processing method has the advantages that the document processing accuracy is improved, compliance verification becomes more efficient, missing detection and misjudgment caused by manual auditing are reduced, intellectualization, automation and standardization of cross-border document processing are achieved, and higher efficiency and safety are given to global trade.

The invention discloses a case factor intelligent analysis and processing method based on intelligent semantic understanding, and belongs to the field of artificial intelligence, natural language processing and public security judicial informationization, and the method comprises the following steps: 1, preprocessing public security judicial document information, and supporting text analysis, format standardization and structured data conversion; 2, carrying out refined extraction on case elements based on a large language model, and identifying case constituent elements, hazard degrees and processing results; 3, fusing logical reasoning of a public security judicial knowledge graph, and enhancing cross-cause semantic understanding and reasoning accuracy; and 4, performing intelligent auxiliary processing, generating class case recommendation and penalty interval prediction, and performing interactive regulation question and answer. According to the method, efficient, accurate and automatic case factor analysis is successfully realized, and the public security judicial document processing efficiency and decision accuracy are remarkably improved.

System and methods are disclosed for matching extracted text data based on one or more similarity scores. The method may include receiving one or more documents from a plurality of data sources, utilizing an optical character recognition algorithm for extracting text data from the one or more documents, comparing, utilizing a fuzzy matching algorithm, the extracted text data to reference dataset(s) to determine one or more matches between the extracted text data and at least one of the reference dataset(s), wherein the one or more matches are based on at least one similarity score, inputting the determined one or more matches and the at least one similarity score into a trained machine-learning model to refine the one or more matches, and outputting a representation of the refined one or more matches and the at least one similarity score to a graphical user interface of a device.

The invention relates to the field of document processing, and particularly provides a document format processing method, system, terminal and medium based on a large language model.The method comprises the steps that a generation instruction containing a target document type and a source material are received, and original text content is generated through the large language model integrating domain knowledge; obtaining a matched structured format template, and analyzing the style rule into a format instruction set; identifying logic elements and hierarchical relationships thereof in the original text based on a natural language processing technology; performing association mapping on the format instruction and the logic element, and performing automatic style rendering by calling a document object model interface to generate an intermediate document with a standard format; and finally, outputting after quality verification. According to the method, an automatic process of content generation and intelligent formatting is constructed, and the document writing efficiency and normalization are improved.

The invention relates to the technical field of artificial intelligence, financial science and technology and medical science and technology, and provides a document processing method, device and equipment based on artificial intelligence and a medium. The method comprises the steps that document pictures are input into a multi-modal large model, element-level segmentation and classification are conducted, and bounding boxes and category labels of all kinds of elements are obtained; according to the bounding box of each type of element, intercepting an independent subgraph of each type of element from the document picture; inputting the independent sub-graphs of the various elements into processing models corresponding to the category labels of the elements so as to extract information in the independent sub-graphs; and carrying out structured integration on the extracted information to obtain the information of the document picture. According to the method, a large model is used for carrying out element-level segmentation and classification on a document picture, then a processing model related to each type of elements is used for carrying out targeted information extraction on independent sub-graphs of each type of elements, so that the information extraction precision of a complex document is improved, and after information of a plurality of independent sub-graphs is integrated, complete and accurate document information is obtained.

The invention relates to the field of text processing, in particular to a retrieval system for a bidding law document large language model. Comprising a document preprocessing module, a semantic dicing module, an entity and relation recognition module, a knowledge graph construction module, a multi-strategy mixed retrieval module and a retrieval result preferential module. During working, the bidding law document is preprocessed, based on document word number judgment, a chapter-level slicing strategy or a clause-level slicing strategy is adopted for cutting, a LateChunking algorithm is used for determining cutting points, semantic units are extracted, entity elements are recognized, a knowledge graph is constructed, and an optimal retrieval result is obtained through multi-strategy mixed retrieval and preferential processing. According to the method, the limitation of a traditional single retrieval mode in bidding legal chief document processing is overcome, and the provision retrieval accuracy and context coherence are improved, so that the illusion risk caused by information missing or misunderstanding of a large language model is greatly reduced, and the credibility and practicability of a legal intelligent question and answer result are enhanced.

The invention provides a multi-mode interaction mobile terminal intelligent office system and method, and the method comprises the steps: collecting and converting a voice signal through a voice input module, so as to obtain standardized audio data; the speech recognition and transcription module converts and preliminarily processes the standardized audio data to obtain text data; the intention recognition module analyzes a user intention and a key entity in the text data based on a natural language processing technology to obtain an intention recognition result; the cue word template module matches the intention recognition result to a cue word template to generate a structured instruction; the dialogue module sends the structured instruction to the large language model and analyzes structured response data returned by the large language model; the system docking and function execution module calls a target office system interface according to the structured response data so as to execute mail sending, schedule management, document processing or leave application operation; and the output and function implementation module converts the text of the operation result into a voice signal or directly outputs the voice signal, so that the problem of low office efficiency of the mobile terminal is solved.

The invention relates to an intelligent document information real-time retrieval method and system based on the RAG technology, and the method comprises the steps: analyzing documents of various formats, extracting a text, maintaining the content continuity through adaptive semantic partitioning processing, and building a character-level position index at the same time; after vectorizing the text blocks, generating a plurality of rewriting queries for the original query; respectively carrying out mixed retrieval (combining keywords and semantic retrieval) for each rewriting query, and fusing and reordering results to obtain candidate text blocks; after correlation filtering, inputting a large language model according to correlation to generate an answer, and if the result is negative, triggering secondary retrieval and reordering; and finally, outputting a structured answer containing position information and supporting front-end visualization. According to the method, the semantic integrity maintenance, the multi-format document processing efficiency and the key information retrieval accuracy are effectively improved.

The invention relates to the technical field of document processing, and discloses a document knowledge retrieval method and system, electronic equipment and a storage medium. Based on a language model, synchronously generating abstract contents and a semantic association query set for each text fragment, and aggregating the abstract contents of all text fragments corresponding to the same document to form a fragment abstract set; constructing a multi-path retrieval pool based on the text fragment, the abstract content and the semantic association query set, and respectively constructing a plurality of independent retrieval data sources; the method comprises the following steps: constructing a dual-granularity abstract index system, receiving a query request of a user, executing query routing processing based on dual-granularity abstract index and a hierarchical retrieval process based on a metadata structure, returning retrieval result data, performing fusion calculation and duplicate removal processing on the retrieval result data recalled by multiple paths, and obtaining a retrieval result. And meanwhile, the document abstract short sentence group is injected into a search suggestion function of a search engine. According to the method, the retrieval accuracy can be improved, and the user experience is improved.

The embodiment of the invention provides a large language model retrieval enhancement generation-oriented file processing method and device, and the method comprises the steps: carrying out the information extraction and semantic information enhancement of a file according to different file types, and constructing a meta-information structure of the file in combination with an enterprise business scene; dividing the document content into a plurality of structured blocks based on the meta-information structure, and labeling the title and context information of each block; when the file is uploaded, according to the parent directory material quantity and content change of the directory where the file is located, performing dirty marking on the directory; when a data request is received, whether a dirty mark exists in a related directory or not is judged, if yes, the directory is requested to be locked, a summary is extracted from files extracted from bottom to top through a large language model, and the dirty mark is cleared after the summary is cached.

Systems and methods described herein provide a document processing service using customizable schemas. First user input includes a document and second user input identifies a classification schema. The classification schema is retrieved to obtain first prompt content. Prompt data is generated. The prompt data includes the first prompt content and second prompt content that includes a document classification instruction. The prompt data and document content of the document are processed by a large language model to obtain a classification result for the document. The classification result is presented via a user interface at a user device.

The invention belongs to the technical field of data processing, and particularly discloses a GIS data intelligent conversion processing method and device, electronic equipment, a medium and a program product, and the method comprises the steps: receiving an SHP format data file, processing a file name code, and screening effective files; traversing the SHP file, converting the SHP file into a DWG format, and classifying and outputting the SHP file according to rules; processing the DWG file in batches based on a CAD filling algorithm of a transaction mechanism, generating a filling layer and executing entity filling; the DWG files are merged in batches through a file merging algorithm, and views are automatically adjusted; and compressing, packaging and returning the combined file. According to the method, the full-process automatic conversion from the SHP to the DWG is realized, the problems of coding disorder, incomplete data, complicated operation and the like in the traditional processing are solved, and the conversion efficiency and the result accuracy are improved.

The invention discloses a document retrieval method and device, equipment, a medium and a program product, and relates to the technical field of document processing. The method comprises the steps of obtaining a query statement of a document retrieval party, at least two candidate documents and candidate abstract vectors and candidate full-text vectors of the candidate documents; performing keyword extraction on the query statement to obtain a query keyword, and performing vectorization on the query statement to obtain a query statement vector; according to the query keyword, the query statement vector, each candidate document and a candidate abstract vector of each candidate document, performing coarse screening on each candidate document to obtain at least two coarse screening documents; and according to the query statement vector and the candidate full-text vector of each coarse screening document, performing fine arrangement on each coarse screening document to obtain a target retrieval document. According to the technical scheme provided by the embodiment of the invention, the accuracy of document retrieval is improved.

The invention provides an electric power document keyword extraction method based on Prompt and a knowledge graph, relates to the technical field of electric power document processing, and constructs a lightweight multi-level index knowledge graph in the electric power field by combining entity type and relation type division based on an electric power industry standard document and an electric power field corpus. The method comprises the following steps: performing vector modeling on a power document, constructing a multi-level index from an entity to a vector, realizing standardized semantic modeling and efficient hybrid retrieval of a power document field background, and obtaining a topic vector and a core paragraph of the power document in combination with power key information; according to the method, entity types are indexed in a knowledge graph by using subject vectors, similar entities are obtained to form knowledge sub-graphs, so that multilayer Prompt is obtained to guide a large language model to extract keywords, then knowledge graph similarity constraints are introduced to decode the output of the large language model, the keyword recognition capability in the power field is improved, and the keyword recognition efficiency is improved. And the accuracy of keyword type identification and the normalization of term naming are both considered.

The invention provides a file uploading method and device, a file processing method and device, a file verification method and device, equipment, a medium and a program product. A specific embodiment of the file verification method in the application comprises the following steps: sending a file acquisition request to a server; receiving a file fragment set and a first verification value of the file sent by the server; calculating a third verification value of the file fragment in the file fragment set; combining the third verification values of the file fragments in the file fragment set to generate a third verification value of the file; and comparing the first verification value and the third verification value of the file to generate a verification result of the file. According to the embodiment, the file verification efficiency is improved.

The invention discloses a PDF (Portable Document Format) document structured extraction system based on a multi-modal language model, belongs to the technical field of document processing and optical character recognition, and aims at solving the technical problem of how to improve the existing OCR (Optical Character Recognition) technology to improve the analysis capability of a complex document structure and improve the recognition precision of handwritten forms and other non-standard fonts. According to the technical scheme, the system adopts a layered decoupling architecture and comprises an input layer, a preprocessing layer, a reasoning layer, an output layer and a monitoring and fault-tolerant module; wherein the output layer is used for multi-source data access and path management to realize a local file system or S3 cloud storage; the preprocessing layer is used for invalid document filtering and visual feature extraction; the reasoning layer is used for multi-modal model interaction and content processing; the output layer is used for outputting a content aggregation result; and the monitoring and fault-tolerant module is used for realizing real-time state monitoring, resource consumption analysis and exception handling.

The invention relates to the technical field of information security, and discloses a handwriting dynamic encryption and electronic signature method based on a national secret algorithm, and the method comprises the steps: obtaining the handwriting data of a user, and carrying out the preprocessing of the data to remove noise and errors; carrying out feature extraction on the preprocessed handwriting data, extracting corresponding track features, speed features and pressure features, and generating a feature hash value of a unique identifier through a cryptographic SM3 hash algorithm; splicing and combining the feature hash value and a user private key, deriving a dynamic key through a national secret SM2 algorithm, and generating an electronic signature by using the dynamic key; an electronic signature is combined with a timestamp to form a structured signature packet, and the signature packet is hierarchically encrypted and stored in a database through a national cryptographic SM4 algorithm. According to the method and the system, the handwritten signature picture, the digital signature technology, the electronic signature technology and the biological recognition and layout file processing technology are fused, so that the safety and the reliability of electronic document signing are improved.

The invention discloses a document content generation method based on a title structuring demand and related equipment, and relates to the technical field of artificial intelligence, the method comprises the following steps: performing structured analysis on a target electronic document to extract at least one title element in the target electronic document; receiving personalized requirements input by a user for the title elements, and performing data association on the personalized requirements and the corresponding title elements; the personalized requirements are used for guiding content generation; the title elements and the personalized requirements corresponding to the data association are combined into a generation request, and the generation request is sent to an artificial intelligence model; using an artificial intelligence model to obtain generation content according to the generation request; and inserting the generated content into a position related to the corresponding title element in the target electronic document. According to the method, the document structure can be deeply understood, a user is allowed to set independent generation requirements for different title elements, a document processing scheme for batch generation and selective optimization can be realized, and the flexibility of document processing is greatly improved.

The embodiment of the invention discloses a document processing method and device, equipment, a medium and a program product. The method comprises the following steps: displaying a content interface of a document; in response to a content triggering operation in the content interface, displaying specific resource content in the resource control interface; and in response to a content control operation on the specific resource content in the resource control interface, displaying a target content material corresponding to the specific resource content after content control in the content interface. By adopting the embodiment of the invention, a document engine can be assisted to realize display and content control of specific resource content in a complex format, and the continuity and integrity of resource content display in a document are improved.

The invention discloses a data processing method and device, a medium and a program product, and relates to the technical field of storage. Encoding the data to be stored according to the size of the data file; determining a target data hierarchy according to the data attribute of the to-be-stored data; determining a target data protection strategy corresponding to the target data hierarchy according to the data attribute of the target data hierarchy; according to the target data protection strategy, determining the number of data blocks and verification blocks needing to be written into the to-be-stored data; determining target storage nodes corresponding to the data blocks and the verification blocks according to the number of the data blocks and the verification blocks needing to be written in the to-be-stored data; and storing the coded data to be stored to the target storage node according to the target data hierarchy and the target data protection strategy. The utilization rate of the disk and the data read-write performance can be considered, the resource calculation overhead is reduced, and the file processing efficiency is improved.