Compression Dictionary Layout Detection for Document Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing document processing systems face challenges in accurately extracting data due to varying document layouts, leading to complexity and errors in data extraction, especially when documents have different formats or languages.
Innovation Solution
A method involving document layout detection using compression dictionaries to assign a predefined layout class to incoming documents, employing a compression algorithm and multiple dictionaries to generate compressed documents, identify a matching compression ratio, and extract data based on the assigned layout.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple compression dictionaries are used to handle different document layouts, then data extraction accuracy is improved, but device complexity increases
Solution Approach 1:
The system pre-generates multiple compression dictionaries corresponding to different document layouts before processing. When a document arrives, the system quickly compares it against these pre-existing dictionaries to identify the matching layout, avoiding the need for complex real-time analysis during document processing
Solution Approach 2:
The system changes the parameter of compression ratio to identify document layouts. By compressing the document using different dictionaries and comparing the resulting compression ratios, the system can determine which dictionary (and thus which layout) best matches the input document, simplifying the matching process
2Productivity
If compression algorithms are applied to identify document layouts, then processing efficiency is improved, but use of energy increases
Solution Approach 1:
The system extracts only the essential characteristic (compression ratio) from the document compression process to identify the layout. Instead of fully processing and analyzing the entire document structure, it takes out the compression ratio metric as a simplified indicator for layout identification, reducing overall computational energy requirements
Data Source
AI summary
The disclosure generally describes methods, software, and systems for assigning incoming documents to a pre-defined layout class. A digitalized document corresponding to an original document is obtained. The digitalized document can be compressed, using a compression algorithm and a plurality of compression dictionaries, to generate a plurality of compressed documents. A respective compression ratio for each compressed document can be generated. A matching compression ratio associated with a first compressed document can be identified. The matching compression ratio can be identified as matching a selection criterion to identify a document layout matching the digitalized document. A first document layout associated with the compression dictionary used to generate the first compressed document can be assigned to the digitalized document. The assigned layout can be used to extract one or more data entries from the digitalized document to generate a record.