Document Splitting Neural Network for Auto-Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual document processing is time-consuming, labor-intensive, and prone to errors, especially when handling large volumes of documents with varying formats and types, which can impact accuracy and reliability.
Innovation Solution
A machine learning system comprising a visual splitting neural network, optical character recognition subsystem, title classifier, document classifier, and grouper subsystem that automatically splits and classifies documents into sub-documents by analyzing visual and textual features, using confidence scores and document types to group pages accurately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual document processing is used, then flexibility and adaptability to document formats are maintained, but processing speed and productivity are reduced
Solution Approach 1:
The document processing system is divided into multiple independent modules: visual splitting neural network for page segmentation, optical character recognition subsystem for text extraction, title classifier for document type identification, and grouper subsystem for organizing sub-documents. Each module handles a specific processing task independently, enabling parallel execution and improving overall processing speed while maintaining manageable complexity through modular architecture.
Solution Approach 2:
The patent replaces manual mechanical document processing with automated machine learning-based systems. The visual splitting neural network automatically detects and segments document pages, the optical character recognition subsystem extracts text content, the title classifier identifies document types, and the grouper subsystem organizes information - all replacing manual operations with intelligent automated processes that significantly increase productivity.
2Measurement precision
If manual document classification is performed, then accuracy can be maintained for complex documents, but time consumption and labor intensity increase
Solution Approach 1:
The system performs self-service document processing by automatically classifying documents without human intervention. The title classifier and document classifier work together to automatically identify document types and extract relevant information, with the system making decisions based on learned patterns from training data. This automated self-service approach maintains high classification accuracy while dramatically reducing processing time and eliminating labor intensity.
Solution Approach 2:
The system incorporates feedback mechanisms where the title classifier generates confidence scores for identified titles, and the document classifier uses these scores to determine document types. The grouper subsystem receives feedback about document characteristics and adjusts grouping decisions accordingly. This iterative feedback process ensures accurate classification while operating at machine speed, resolving the contradiction between accuracy and time consumption.
3Productivity
If automated document processing systems are implemented, then processing speed increases, but reliability and accuracy may be compromised due to errors in automation
Solution Approach 1:
The system performs partial processing actions with high confidence and reserves the ability to handle edge cases. The optical character recognition subsystem extracts text with confidence scores, and the title classifier only finalizes document type identification when confidence exceeds thresholds. This partial action approach maintains reliability by not making premature decisions, while still achieving high processing speed through automated batch processing of clear-cut documents.
Solution Approach 2:
The system prepares for potential errors by incorporating multiple validation layers before final processing decisions. The visual splitting neural network pre-segments pages, the optical character recognition subsystem pre-extracts text with confidence metrics, and the title classifier pre-identifies potential document types before the grouper subsystem finalizes organization. This beforehand cushioning of validation ensures reliability by catching errors early in the process while maintaining high throughput.
4Adaptability or versatility
If multiple document types and formats are handled, then versatility and adaptability improve, but system complexity and difficulty of detection increase
Solution Approach 1:
The system achieves universality by implementing a multi-functional architecture where the visual splitting neural network handles page segmentation for all document types, the optical character recognition subsystem extracts text from various formats, the title classifier identifies different document types, and the grouper subsystem organizes them accordingly. This universal approach enables the system to handle diverse document formats without increasing individual component complexity, as each component is designed to be broadly applicable.
Solution Approach 2:
The system manages format variability by dynamically adjusting processing parameters based on detected document characteristics. The optical character recognition subsystem adapts its extraction parameters based on document layout, the title classifier adjusts its classification thresholds based on document type, and the grouper subsystem modifies grouping criteria based on identified patterns. This parameter adaptation enables high versatility while keeping detection complexity manageable by using learned patterns rather than complex hard-coded rules.
Data Source
AI summary
A computer-implemented method for auto-splitting and classifying an input document into one or more sub-documents using a machine learning system is described. The machine learning system includes a visual splitting neural network, an optical character recognition sub-system, a title classifier, a document classifier, and a grouper sub-system. The method includes: receiving a visual input representing a plurality of pages of the input document; classifying, using the visual splitting neural network, each page of the input document into a respective template of a plurality of templates; for each page of the input document, determining a final document type that the page belongs to; and grouping, using a grouper sub-system, the plurality of pages of the input document into one or more sub-documents based on (i) the respective template of each page and (ii) the respective final document type that each page belongs to.


