Document Splitting Neural Network for Auto-Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual document processing is time-consuming, labor-intensive, and prone to errors, especially when handling large volumes of documents with varying formats and types, which can impact accuracy and reliability.

Innovation Solution

A machine learning system comprising a visual splitting neural network, optical character recognition subsystem, title classifier, document classifier, and grouper subsystem that automatically splits and classifies documents into sub-documents by analyzing visual and textual features, using confidence scores and document types to group pages accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual document processing is used, then flexibility and adaptability to document formats are maintained, but processing speed and productivity are reduced

Engineering Contradiction:
Improvedocument processing speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The document processing system is divided into multiple independent modules: visual splitting neural network for page segmentation, optical character recognition subsystem for text extraction, title classifier for document type identification, and grouper subsystem for organizing sub-documents. Each module handles a specific processing task independently, enabling parallel execution and improving overall processing speed while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces manual mechanical document processing with automated machine learning-based systems. The visual splitting neural network automatically detects and segments document pages, the optical character recognition subsystem extracts text content, the title classifier identifies document types, and the grouper subsystem organizes information - all replacing manual operations with intelligent automated processes that significantly increase productivity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual document classification is performed, then accuracy can be maintained for complex documents, but time consumption and labor intensity increase

Engineering Contradiction:
Improvedocument classification accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs self-service document processing by automatically classifying documents without human intervention. The title classifier and document classifier work together to automatically identify document types and extract relevant information, with the system making decisions based on learned patterns from training data. This automated self-service approach maintains high classification accuracy while dramatically reducing processing time and eliminating labor intensity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system incorporates feedback mechanisms where the title classifier generates confidence scores for identified titles, and the document classifier uses these scores to determine document types. The grouper subsystem receives feedback about document characteristics and adjusts grouping decisions accordingly. This iterative feedback process ensures accurate classification while operating at machine speed, resolving the contradiction between accuracy and time consumption.

Inventive Principle:
Principle #23Feedback

3Productivity

If automated document processing systems are implemented, then processing speed increases, but reliability and accuracy may be compromised due to errors in automation

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs partial processing actions with high confidence and reserves the ability to handle edge cases. The optical character recognition subsystem extracts text with confidence scores, and the title classifier only finalizes document type identification when confidence exceeds thresholds. This partial action approach maintains reliability by not making premature decisions, while still achieving high processing speed through automated batch processing of clear-cut documents.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system prepares for potential errors by incorporating multiple validation layers before final processing decisions. The visual splitting neural network pre-segments pages, the optical character recognition subsystem pre-extracts text with confidence metrics, and the title classifier pre-identifies potential document types before the grouper subsystem finalizes organization. This beforehand cushioning of validation ensures reliability by catching errors early in the process while maintaining high throughput.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Adaptability or versatility

If multiple document types and formats are handled, then versatility and adaptability improve, but system complexity and difficulty of detection increase

Engineering Contradiction:
Improvedocument format adaptabilityVSAvoiddocument feature detection complexity
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system achieves universality by implementing a multi-functional architecture where the visual splitting neural network handles page segmentation for all document types, the optical character recognition subsystem extracts text from various formats, the title classifier identifies different document types, and the grouper subsystem organizes them accordingly. This universal approach enables the system to handle diverse document formats without increasing individual component complexity, as each component is designed to be broadly applicable.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system manages format variability by dynamically adjusting processing parameters based on detected document characteristics. The optical character recognition subsystem adapts its extraction parameters based on document layout, the title classifier adjusts its classification thresholds based on document type, and the grouper subsystem modifies grouping criteria based on identified patterns. This parameter adaptation enables high versatility while keeping detection complexity manageable by using learned patterns rather than complex hard-coded rules.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11830270B1Machine learning systems for auto-splitting and classifying documents
Publication Date: 2023.11.28 FPT USA CORP
  • US11830270B1 patent drawing
  • US11830270B1 patent drawing
  • US11830270B1 patent drawing

AI summary

A computer-implemented method for auto-splitting and classifying an input document into one or more sub-documents using a machine learning system is described. The machine learning system includes a visual splitting neural network, an optical character recognition sub-system, a title classifier, a document classifier, and a grouper sub-system. The method includes: receiving a visual input representing a plurality of pages of the input document; classifying, using the visual splitting neural network, each page of the input document into a respective template of a plurality of templates; for each page of the input document, determining a final document type that the page belongs to; and grouping, using a grouper sub-system, the plurality of pages of the input document into one or more sub-documents based on (i) the respective template of each page and (ii) the respective final document type that each page belongs to.