End-to-End Document Extraction via Fully Convolutional Neural Network
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing OCR systems often require a two-stage process for text extraction from documents, which can be slow and inconsistent due to reliance on third-party services, and fail to optimize for specific types of text extraction, leading to inefficiencies and potential errors.
Innovation Solution
A single-stage solution that combines OCR and information extraction using a fully convolutional neural network model, allowing for end-to-end processing of documents to identify characters, words, and field groupings directly from images, thereby eliminating the need for third-party OCR services and enhancing processing speed and performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a two-stage process using third-party OCR services is used, then text extraction can be performed, but processing speed is slow and consistency is poor
Solution Approach 1:
The patent combines OCR and information extraction into a single integrated model that processes documents in one pass. The fully convolutional neural network simultaneously performs character recognition and field extraction, eliminating the sequential two-stage process and achieving both improved speed and consistency.
Solution Approach 2:
The patent introduces a custom fully convolutional neural network as an intermediary component between the document image and the final extracted information. This custom model replaces third-party OCR services and provides consistent, optimized processing specifically tailored for tax form documents.
2Measurement precision
If third-party OCR services are used, then text extraction is possible, but the process is slow due to Internet data exchange and runtime delays
Solution Approach 1:
The patent extracts the OCR functionality from external third-party services and implements it locally within a custom fully convolutional neural network. This eliminates the need for Internet data exchange and external service calls, removing runtime delays while maintaining extraction accuracy.
Solution Approach 2:
The patent performs all OCR and extraction operations in a single preliminary pass through the fully convolutional neural network, rather than requiring multiple sequential steps. This preliminary action captures both character recognition and field extraction simultaneously, eliminating subsequent processing delays.
3Adaptability or versatility
If generic third-party OCR solutions are used, then any type of document can be processed, but optimization for specific text extraction types is not achieved
Solution Approach 1:
The patent applies local quality by designing a specialized fully convolutional neural network tailored specifically for tax form documents. The model's architecture and training data are optimized for the particular structure and fields of tax forms, achieving high precision for this specific document type rather than using a generic solution.
Solution Approach 2:
Instead of using a generic OCR system and attempting to adapt it to specific document types, the patent inverts the approach by designing a custom model from the ground up that is inherently optimized for tax forms. This specialized model achieves superior performance for specific extraction tasks.
Data Source
AI summary
A processor may receive an image and identify a plurality of characters in the image using a machine learning (ML) model. The processor may generate at least one word-level bounding box indicating one or more words including at least a subset of the plurality of characters and/or may generate at least one field-level bounding box indicating at least one field including at least a subset of the one or more words. The processor may overlay the at least one word-level bounding box and the at least one field-level bounding box on the image to form a masked image including a plurality of optically-recognized characters and one or more predicted fields for at least a subset of the plurality of optically-recognized characters.


