End-to-End Document Extraction via Fully Convolutional Neural Network

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing OCR systems often require a two-stage process for text extraction from documents, which can be slow and inconsistent due to reliance on third-party services, and fail to optimize for specific types of text extraction, leading to inefficiencies and potential errors.

Innovation Solution

A single-stage solution that combines OCR and information extraction using a fully convolutional neural network model, allowing for end-to-end processing of documents to identify characters, words, and field groupings directly from images, thereby eliminating the need for third-party OCR services and enhancing processing speed and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a two-stage process using third-party OCR services is used, then text extraction can be performed, but processing speed is slow and consistency is poor

Engineering Contradiction:
Improveconsistency of outputVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent combines OCR and information extraction into a single integrated model that processes documents in one pass. The fully convolutional neural network simultaneously performs character recognition and field extraction, eliminating the sequential two-stage process and achieving both improved speed and consistency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a custom fully convolutional neural network as an intermediary component between the document image and the final extracted information. This custom model replaces third-party OCR services and provides consistent, optimized processing specifically tailored for tax form documents.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If third-party OCR services are used, then text extraction is possible, but the process is slow due to Internet data exchange and runtime delays

Engineering Contradiction:
Improvetext extraction accuracyVSAvoidruntime delays
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts the OCR functionality from external third-party services and implements it locally within a custom fully convolutional neural network. This eliminates the need for Internet data exchange and external service calls, removing runtime delays while maintaining extraction accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs all OCR and extraction operations in a single preliminary pass through the fully convolutional neural network, rather than requiring multiple sequential steps. This preliminary action captures both character recognition and field extraction simultaneously, eliminating subsequent processing delays.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If generic third-party OCR solutions are used, then any type of document can be processed, but optimization for specific text extraction types is not achieved

Engineering Contradiction:
Improveapplicability to any document typeVSAvoidoptimization for specific extraction
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by designing a specialized fully convolutional neural network tailored specifically for tax form documents. The model's architecture and training data are optimized for the particular structure and fields of tax forms, achieving high precision for this specific document type rather than using a generic solution.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of using a generic OCR system and attempting to adapt it to specific document types, the patent inverts the approach by designing a custom model from the ground up that is inherently optimized for tax forms. This specialized model achieves superior performance for specific extraction tasks.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS12087068B2End to end trainable document extraction
Publication Date: 2024.09.10 INTUIT INC
  • US12087068B2 patent drawing
  • US12087068B2 patent drawing
  • US12087068B2 patent drawing

AI summary

A processor may receive an image and identify a plurality of characters in the image using a machine learning (ML) model. The processor may generate at least one word-level bounding box indicating one or more words including at least a subset of the plurality of characters and/or may generate at least one field-level bounding box indicating at least one field including at least a subset of the one or more words. The processor may overlay the at least one word-level bounding box and the at least one field-level bounding box on the image to form a masked image including a plurality of optically-recognized characters and one or more predicted fields for at least a subset of the plurality of optically-recognized characters.