84 results about "Document layout" patented technology

The invention relates to the technical field of intelligent document processing, and particularly discloses a file arrangement processing method and system. The method comprises the following steps: acquiring an input document, analyzing the structure and the style of the input document, and generating standardized format data; extracting a semantic relationship of the document through a pre-trained text understanding model, constructing a semantic relationship graph and optimizing a chapter sequence; loading a document processing plug-in to execute cross-format arrangement, and generating intermediate format data; executing processing nodes based on a task scheduling mechanism to generate optimized content; calling a multi-format output module to generate a target document, and adjusting metadata in combination with the global variable; and finally evaluating the document quality and updating the model. According to the method, automatic analysis, intelligent optimization and format unification of the multi-source heterogeneous document are realized, and the intelligent degree and the output efficiency of document processing are improved.

The invention discloses a receipt information input method and device and a storage medium, and relates to the technical field of electric digital data processing, the receipt information input method comprises the steps that structured receipt data of a receipt image is extracted through a prior model, and the prior model is pre-trained through receipt layout data; windowing the structured document data according to fields to generate a detection task; verifying the target document data in the detection task through a rule engine to obtain a grammar result, and verifying the target document data in the detection task through a knowledge graph to obtain a semantic result; and if the grammar result and the semantic result are correct, storing the target document data to a document database. The technical problem of low error detection rate of content contradiction before and after receipt input due to the fact that the related technology focuses on text extraction and cannot understand context logic is solved, and the technical effect of improving the error detection rate is achieved.

The invention provides a document data processing system and method based on a lightweight model, and the system comprises a document conversion module which is used for converting a to-be-processed document into a picture file; the layout analysis module is used for processing the picture file according to a pre-constructed layout analysis lightweight model, and extracting the category and area coordinates of each label in the picture file; the layout restoration module is used for respectively analyzing and processing different types of label areas according to the type and the area coordinate of each label to obtain the content corresponding to each label area; obtaining all contents of the to-be-processed document by combining the contents corresponding to each label area; and the text segmentation module is used for segmenting all contents of the to-be-processed document into text blocks with preset sizes through a divider, and completing format conversion and document data processing of the to-be-processed document. And rapid identification and separation of graphs, tables and characters in the PDF format document are realized.

The invention discloses a nuclear power system file layout identification and structured information extraction method and system, and the method comprises the steps: collecting first object data, and classifying the first object data; and carrying out first preprocessing on the classification result, and carrying out layout analysis and data reduction on the preprocessing result. And performing text vectorization and semantic analysis according to the restored data to obtain structured output. According to the nuclear power system file layout identification and structured information extraction method and system provided by the invention, the file classification accuracy and efficiency are improved, and meanwhile, the manual correction requirement is remarkably reduced. And the processing capability of the scanned file is enhanced, and the stability in complex layout processing is also obviously enhanced. The automatic restoration of the hierarchical structure of the file is realized, and the manual intervention time is greatly reduced. And efficient identification and restoration of table contents, efficient text semantic extraction and clustering and generation of high-quality structured output are realized.

Techniques for identifying a document layout are disclosed. In one embodiment, attribute data associated with an electronic document is accessed. A machine learning model is then applied to the attribute data. The machine learning model is configured to classify the electronic document based on the attribute data and feature sets of a plurality of document classes. Based on the document class predicted by the machine learning model, the system identifies a layout associated with the document class. The layout specifies layout elements and content types associated with the layout elements. The system extracts and stores information from the electronic document according to its content type.

The invention provides a teaching document anti-copy protection method and system based on OCR interference resistance, and belongs to the technical field of information security and digital copyright protection. According to the method, anti-OCR font processing is applied to document characters, invisible disturbance symbols are inserted between characters or paragraphs, watermark information is embedded in document typesetting or font strokes, and finally a standard PDF or DOCX file is compiled. Watermark information is embedded through stroke thickness change, paragraph row spacing indentation perturbation and other modes. The system comprises a font disturbance module, a character disturbance module, a watermark embedding module, a compiling output module and a verification module. According to the method, the human eyes can normally read the document, but messy codes or disorder can occur when the OCR tool extracts the document, and the document cannot be directly reused; meanwhile, watermark information cannot be stripped, so that leakage tracking is facilitated; and the output file keeps a standard format and is compatible with the existing office teaching process. The method is suitable for anti-copying protection of teaching documents, scientific research data, test papers, contract files and the like.

The invention provides a rapid office document arrangement method, medium and system, and belongs to the technical field of document arrangement, and the method, medium and system comprises the following steps: analyzing a mark of a document, and constructing original feature data; constructing a feature processing model; constructing a contribution degree evaluation model to analyze the contribution degree value of the layout element in the document to the document typesetting score; obtaining a contribution degree evaluation model through training; determining a layout priority level and a layout interval value according to the contribution degree value; generating a mark tree of the document; performing dimension reduction mapping on the document feature vector and mapping the document feature vector to a three-dimensional display space to generate a three-dimensional layout mapping model; according to the method, the multi-modal features of the document can be comprehensively analyzed, the contribution degree of each layout element can be predicted, the optimized document layout can be generated, the rendering efficiency can be improved, and the problem that the layout quality is difficult to guarantee at present, and the layout efficiency of the document can be improved is solved. And the rendering performance is improved.

The invention relates to the technical field of text processing, and discloses an artificial intelligence text analysis and extraction and key point source positioning method, which comprises the following steps: collecting PDF document data, and carrying out manual labeling and preprocessing to obtain a training set, a verification set and a test set; initializing the deep learning model, and setting parameters of deep learning model training; training, verifying and testing the deep learning model based on the training set, the verification set and the test set to obtain a PDF document layout recognition model; identifying a to-be-identified PDF document by using the PDF document layout identification model, and converting an identification result into a text format or a chart / table format; performing depth vectorization processing on the text converted into the text format or the chart / table format; and semantic retrieval is realized based on an advanced vector space model and a similarity measurement algorithm. According to the method, the accuracy and efficiency of text analysis and extraction can be remarkably improved, and key point sources can be quickly positioned.

The invention discloses a document information extraction processing method and device based on an electric power lexical element structure, and relates to the technical field of document information process.The method comprises the steps that for a target electric power document, an extraction task is recognized, a task normal form is redefined, lexical element nodes are determined, and a lexical element directed graph is constructed; constructing a large language question and answer model based on a disambiguation principle, traversing the lexical directed graph, and determining a lexical relationship; a document layout encoder is matched, and an information extraction engine is constructed; identifying a lexical directed graph and lexical relationship, intervening an information extraction engine to perform engine parallel retrieval and information extraction on the target power document, and determining a multivariate power information system; and complementarily fusing the multi-element power information system as an information extraction result of the target power document. The technical problems that existing power document information retrieval is insufficient in precision and low in completeness are solved, and the effect of improving the precision and completeness of power document information extraction through task normal form-based multivariate parallel retrieval and information fusion is achieved.

The invention provides a document auditing method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a first sample data set and a second sample data set; performing model training on the first original model according to the first sample data set to obtain a first target model for identifying the document layout; performing model training on the second original model according to the second sample data set to obtain a second target model for identifying the document content; obtaining a to-be-audited document, and inputting the to-be-audited document into the first target model to obtain a first document with target layout labeling information; inputting the first document into a second target model to obtain target text content information corresponding to the to-be-audited document; and auditing the to-be-audited document according to the target layout labeling information and the target text content information. According to the method, the accuracy of document auditing can be improved.

The invention relates to the technical field of artificial intelligence, in particular to a method and a framework for optimizing scanning copy content recognition quality by using a large model. The method comprises the steps of document image analysis and processing, character extraction and formatting and context-based OCR correction by using a large model. The invention aims to provide the method and the framework for optimizing the identification quality of the scanned copy content by using the large model, the powerful functions of large language models such as a visual model and a text model are combined, the deep understanding of the document content and layout is realized, the document layout is accurately analyzed, different elements such as text blocks, tables and images are identified, and the identification quality of the scanned copy content is improved. And in combination with an analysis result of the visual model, converting the document content into a graceful and smooth Markdown format, and retaining an original layout of the document.

The invention discloses a question bank construction-oriented efficient document layout analysis method, system, equipment and medium, which are suitable for question bank construction, and the analysis method comprises the following steps: scanning document images of test papers, teaching material matched exercises and books of different subjects, and preprocessing to obtain non-tilt scanned document images; labeling relative positions and category labels of elements in the scanned document image to obtain a document data set; training the document layout target detection model by adopting the document data set; and inputting a to-be-detected image into the trained document layout target detection model, detecting foreground contents including topics, graphs and tables, and outputting an identification result of layout elements. According to the method, while the foreground content detection precision is improved, the reasoning speed of the document layout target detection model is increased, accurate identification of various elements in test papers and textbooks and exercises of different subjects is realized, and an efficient solution is provided for application such as question bank construction.

Embodiments of computer-implemented systems and methods for extracting tables from documents are described. Document layout data is generated based on a plurality of glyphs associated with document lines, comprising data identifying: a plurality of text segments within each line; a plurality of text segment links; a plurality of text blocks of one or more of the text segments; and a plurality of text block links. A document is generated including at least one editable document table corresponding to at least one document table identified based on the plurality of glyphs associated with document lines.

The invention belongs to the technical field of artificial intelligence, and particularly relates to an AI-based file data content accurate and deep analysis and interpretation method, which comprises the following steps: acquiring multi-format file data and file meta-information, constructing an AI analysis network, extracting text semantic vectors, image visual features, table structure information and document layout features, and constructing a multi-dimensional semantic map. According to a user query intention, semantic extension is performed in combination with a domain knowledge base, an enhanced semantic description vector is generated through a graph attention mechanism, semantic reasoning and relation mining are performed by adopting an improved knowledge distillation Transform model, and a deep analysis conclusion is generated through a multi-hop reasoning model in combination with file data complexity, information density and user requirements. And generating a personalized interpretation report in combination with a user role and a task scene, and outputting an analysis result through a visual interface. Therefore, the problems of poor understanding ability, poor file adaptability and the like in the prior art are solved.

A document layout system for determining a layout of a document. The document layout system is configured to apply an OCR technique to identify the text in the document. The document layout system is further configured to generate a graph representation of the document, wherein the graph representation comprises a plurality of nodes and a plurality of edges that connect different ones of the plurality of nodes, wherein individual ones of the nodes correspond to different portions of the text. The document layout system is also configured to apply a graph cluster network machine learning model to the graph representation to identify a layout of different sections of the document according to respective merge inferences determined for individual ones of the plurality of edges. The document layout system is also configured to provide the layout of different sections of the document.

A system and method for extracting structured key information from diverse document types using large multimodal models (LMMs) is disclosed. The invention employs a zero-shot analysis to identify candidate keys within an input document, then selects a document schema from a document schema database based on the identified keys. The LMM is prompted with the selected document schema to generate structured key-value pairs, with field constraints enforced by the document schema. Relationships among extracted keys are mapped to a graph representation, enabling robust handling of complex document layouts. The system supports nested structures, tabular data, and alias definitions for fields, and can update document schemas based on ground truth feedback. The resulting structured output is provided in a machine-readable format, enabling reliable and scalable document understanding across varied domains such as invoices, health cards, and driving licenses.

The invention discloses a PDF (Portable Document Format) file layout identification method based on mask processing, and aims to realize accurate identification of various layout elements such as titles, texts, page headers, page footers, tables and pictures in PDF files. According to the method, characters and coordinates in a PDF file are analyzed through MuPDF, different color masks are adopted to replace texts and punctuation marks respectively, original content of a non-text area is reserved, a page picture subjected to mask processing is generated, a training data set is constructed based on the page picture, training is conducted through a target detection model (such as YOLO), and a high-precision layout recognition model is obtained. According to the method, the accuracy and the automation level of PDF layout recognition are effectively improved, and the method has a wide application prospect.

The invention relates to an artificial intelligence technology, and provides an information extraction method and device, equipment and a medium, on one hand, extracted text information is fused with document layout information obtained after layout analysis, and image restoration can be performed on a result after text recognition so as to improve the accuracy of model recognition; on one hand, the target large language model is called from the pre-constructed model pool according to the information extraction demand data, and the large language model matched with the actual demand is called, so that the model deployment cost can be reduced while the task requirement is met; on the other hand, the target prompt is generated according to the fusion information and the key information description, the target large language model is called to process the target document based on the target prompt and the key information extraction strategy, the model does not need to be retrained for different tasks, and therefore generalization and universality can be improved while information extraction can be efficiently executed.

The disclosure generally describes methods, software, and systems for assigning incoming documents to a pre-defined layout class. A digitalized document corresponding to an original document is obtained. The digitalized document can be compressed, using a compression algorithm and a plurality of compression dictionaries, to generate a plurality of compressed documents. A respective compression ratio for each compressed document can be generated. A matching compression ratio associated with a first compressed document can be identified. The matching compression ratio can be identified as matching a selection criterion to identify a document layout matching the digitalized document. A first document layout associated with the compression dictionary used to generate the first compressed document can be assigned to the digitalized document. The assigned layout can be used to extract one or more data entries from the digitalized document to generate a record.

The invention relates to the technical field of document typesetting, in particular to a document streaming layout rendering method and device based on configuration driving. The method comprises the following steps: defining a four-dimensional generation key value pair configuration file according to document attributes, page layout, component geometry and styles, and verifying the key value pair configuration file; converting the configuration node into a document object model through an analysis engine; receiving external business data, positioning a dynamic slot position in the model, filling data, and generating a to-be-rendered instance tree; constructing a component rendering factory based on the strategy mode, and dynamically instantiating a corresponding rendering strategy class; and calculating the geometric position of the component by adopting a streaming typesetting algorithm, paging according to requirements, generating and executing a drawing instruction, and outputting a PDF (Portable Document Format) document. Aiming at the problems of code and style coupling, out-of-control typesetting and high operation threshold in the existing scheme, layout and code decoupling, high-precision typesetting and low-threshold configuration are realized, the method is adaptive to the requirements of multiple scenes such as finance and medical treatment, and the expansibility is high.

The invention relates to the technical field of document and image processing, and provides a format conversion method and system based on multi-modal fusion and generative adversarial networks, and the method comprises the steps: obtaining document layout information of a document format original file through a deep learning model according to the extracted document multi-modal information of the original file, obtaining document conversion style information by utilizing a document generative adversarial network model according to the document layout information and the first target style requirement, and converting the original file into a PDF format file according to the document conversion style information; for the image format original file, obtaining image understanding information by using an image analysis model according to the extracted image multi-modal information of the original file, and obtaining image conversion style information by using an image generative adversarial network model according to the image understanding information, a target image type requirement and a second target format requirement, and converting the original file into a PDF format file according to the image conversion style information. And PDF files meeting specific requirements are efficiently and accurately formed.

The present disclosure provides a method for detecting document layout, a method and device for training a text processing model, which relate to the field of artificial intelligence technology, and particularly relate to technologies such as natural language processing, computer vision, and deep learning. Document layout detection includes: determining multiple texts in the document and the position information of the multiple texts; constructing a target input based on the multiple texts and the position information of the multiple texts; and using the text processing model to process the target input to obtain a document layout detection result, where the document layout detection result indicates at least one text corresponding to a preset document component among the multiple texts and the order of the at least one text in the document.

A system for semantic parsing of an input digital document using visual and textual features is provided. The system includes a user interface, a document layout classification module, a semantic recovery module, and a text structuring module. The user interface enables users to upload the input digital document. The document layout classification module processes the document to categorize its elements based on page images and textual data, outputting layout information with tags and locations. The semantic recovery module uses this layout information to derive content, including tables, lists, and charts, and generates a hierarchical structure. The text structuring module organizes tokens based on the layout tags, groups text into sections by topic relevance, and handles page boundaries, producing another hierarchical structure.

The present application discloses a document information entry method, device and storage medium, and the present application relates to the field of electronic digital data processing technology. The document information entry method includes: extracting structured document data of a document image through a priori model, and the priori model is pre-trained through document layout data; dividing the structured document data into windows according to fields to generate a detection task; verifying the target document data in the detection task through a rule engine to obtain a grammatical result, and verifying the target document data in the detection task through a knowledge graph to obtain a semantic result; if the grammatical result and the semantic result are correct, storing the target document data in a document database. It solves the technical problem that the related technology focuses on text extraction and cannot understand the context logic, which leads to a low error detection rate when entering documents, such as inconsistencies between the previous and next content, and achieves the technical effect of improving the error detection rate.

The embodiment of the invention relates to a difference detection method and device for document typesetting, electronic equipment and a storage medium. The method comprises the following steps: opening a first document and a second document of which the typesetting difference is to be detected; performing screenshot on the first document and the second document to obtain a first screenshot and a second screenshot respectively; and generating typesetting difference information between the first document and the second document based on the first screenshot and the second screenshot. Therefore, the accuracy of generating the typesetting difference information between the first document and the second document can be improved.

The invention discloses an operator report PDF exporting method and system, and belongs to the technical field of report generation and document typeset.The method comprises the following steps that a data set and a field name list of a report to be exported are received; dynamically generating a header according to the field name list, and calling a PdfPTable to create a table; for each row of data in the table, estimating the height of the row and comparing the height with the remaining available height of the current page, if the height is not enough, calling document.newPage () for paging, and reconstructing a header on a new page; and for the cells, the Phrase is used for measuring and calculating the text size, and setNoWrap (false) and the minimum height are set so as to realize column width self-adaption and automatic line feed. According to the method, the report export flexibility, attractiveness and readability are remarkably improved, and the multi-scene and multi-format customization requirements of operators are met.

The application relates to the technical field of knowledge question answering, in particular to a knowledge question answering method based on a multi-modal document understanding large model of a graph structure, which comprises the following steps: obtaining a target task and a target document graph corresponding to the target task; generating a target heterogeneous document graph corresponding to the target document graph according to the target document graph; inputting the target task and the target heterogeneous document graph into a preset large model to obtain a target question and answer text corresponding to the target task; the method can achieve higher accuracy and robustness on multiple public benchmark tasks (such as document question answering, graph table question answering and table understanding); the method has excellent generalization ability for novel and complex document layouts; and the method realizes more simple and efficient system deployment and application through an end-to-end unified architecture.

The application relates to a low-cost entity labeling method and system based on user behavior analysis, which comprises the following steps: S1, data collection: using a state machine to provide a document layout service, collecting user historical documents, entity recognition results and user revision records; S2, data labeling: generating a labeling data set according to the entity recognition results, finding out suspicious incorrect labeling by using the user revision records and reconfirming to optimize the labeling data set; S3, model updating: training an NER model by using the labeling data set, and replacing the state machine in the step S1 with the NER model when the accuracy of the NER model exceeds that of the state machine. The method and system can obtain a higher labeling accuracy under the premise of less labeling workload.

Embodiments of the present application provide a document layout recognition method and device, electronic equipment and storage medium, the method comprises: obtaining a to-be-recognized document, extracting visual features and semantic features of the to-be-recognized document, wherein the visual features identify the visual characteristics on the overall layout of the image corresponding to the to-be-recognized document, and the semantic features at least include character-level features and text line-level features; fusing the image features and the semantic features to obtain multi-modal document features; and based on the multi-modal document features, recognizing the element positions and categories of each element in the to-be-recognized document. The character-level semantic features can extract text-level elements such as formulas embedded in the text, and the visual features can recognize visual elements such as images, and then the multi-modal document features can obtain elements including visual features such as images and character-level elements within text lines such as formulas, so that the recognition result of the document layout is more comprehensive, and the accuracy of the document layout recognition result is greatly improved.

The invention relates to a document typesetting method and device, and the method comprises the steps: obtaining a to-be-typeset document, and recognizing an element in a document page of the to-be-typeset document, a first position of the element, and a category label of the element; grouping the elements according to the category labels to obtain element groups; according to the category labels corresponding to the element groups, performing target processing on the elements in the element groups to obtain target elements, and creating a target document page corresponding to the document page; and typesetting the target element on the target document page according to the first position, and forming a target document by the target document page subjected to the typesetting of the target element. Therefore, the suitability is improved, the labor cost is reduced, and the efficient and accurate document typesetting requirement is met.