Interactive Form Field Prediction and Digitization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for electronically capturing data from paper forms are inefficient, requiring manual entry and lacking automation for accurately identifying and extracting information from images of forms.

Innovation Solution

A system that allows users to digitize paper forms by identifying and labeling fields within an image of the form using a computer, enabling automatic extraction of data through optical character recognition (OCR) and interactive prediction of field locations and labels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual entry is used to capture form data, then accuracy can be maintained, but productivity is low and time-consuming

Engineering Contradiction:
Improvedigitization speedVSAvoidtime for manual entry
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system enables self-service by having the form processing system automatically identify fields, detect data, and extract information without requiring manual intervention. The system processes forms autonomously by analyzing image data, recognizing patterns, and extracting information directly into the desired format, eliminating the need for manual data entry while maintaining accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual entry process with an automated electronic system. Instead of manually typing or transcribing data, the system uses image processing, pattern recognition, and data extraction algorithms to automatically capture and transfer form data electronically, substituting human labor with automated computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated capture methods are implemented, then productivity improves, but measurement precision and accuracy of field identification become challenging

Engineering Contradiction:
Improveautomation levelVSAvoidfield location accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system segments the form processing task into distinct functional components: field detection, data detection, and information extraction. By dividing the complex task of accurate field identification into separate manageable steps, each handled by specialized algorithms, the system achieves both high automation and precise measurement of field locations and boundaries.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system incorporates feedback mechanisms where the form processing system analyzes detected fields and data, validates the extracted information against expected patterns, and adjusts its processing accordingly. This feedback loop ensures that automated capture maintains high precision by continuously refining field identification based on detected patterns and structural analysis.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If interactive prediction of field locations is provided, then ease of operation improves, but device complexity increases

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidsystem structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary action by pre-processing the form image to identify potential fields, detect data patterns, and predict field locations before the user needs to input information. The system proactively analyzes the form structure, identifies relevant fields based on patterns and context, and presents predicted locations to the user, reducing the cognitive load and interaction time required during data entry.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates efficient and accurate digitization of form data, improving productivity by automating the capture and storage of information from completed forms, reducing manual entry errors and enhancing user interaction with the digitization process.

Implementation Method 1

enabling automatic extraction of data through optical character recognition (OCR)

Methodology Applied
Scientific EffectOptical character recognition: Image Processing

Data Source

PatentUS10824801B2Interactively predicting fields in a form
Publication Date: 2020.11.03 DST TECHNOLOGIES INC
  • US10824801B2 patent drawing
  • US10824801B2 patent drawing
  • US10824801B2 patent drawing

AI summary

Methods, apparatuses, and embodiments related to interactively predicting fields in a form. A computer system received an image of a form. A user moves a cursor to a first field of the form, and the computer system automatically displays a predicted location of the field, including a bounding box that represents a boundary of the field. The computer system further predicts the field name/label based on text in the document. The user clicks on the field to indicate that he wants to digitize the field. When needed, the user interactively modifies the size of the bounding box that represents the extent of the field, changes the name/label of the field. Once finalized, the user can cause the field information (e.g., the bounding box coordinate, the bounding box location, the name/label of the field, etc.) to be written to a database.