Automated Document Regression Testing via Attribute Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated regression testing of machine-generated documents is time-consuming and labor-intensive, requiring human analysis to ensure accuracy, especially after template changes, due to potential user or machine errors during data population and parsing.

Innovation Solution

A system comprising databases, processors, and memory that extracts attribute labels and values from multiple automatically generated documents, generates tabular reports, and alerts users to discrepancies, enabling bulk automated analysis and reducing human intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated regression testing is performed on machine-generated documents, then productivity is improved, but measurement precision deteriorates due to potential user or machine errors during data population and parsing

Engineering Contradiction:
Improveregression testing speedVSAvoiddata accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system automatically compares extracted data from generated documents against expected values and provides immediate feedback on discrepancies. This feedback mechanism enables continuous monitoring of data accuracy without requiring manual verification, thus maintaining both high productivity and measurement precision.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual mechanical review processes with automated computer-based extraction and comparison systems. By using optical character recognition and automated data parsing, the system eliminates human error in verification while maintaining the ability to detect accuracy issues through systematic comparison against expected values.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual human analysis is used for regression testing, then measurement precision is improved, but loss of time increases due to time-consuming review processes

Engineering Contradiction:
Improvedata accuracyVSAvoidregression testing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs self-verification by automatically extracting data, comparing it against expected values, and generating reports without requiring continuous human intervention. This self-service capability maintains measurement precision through automated comparison while dramatically reducing the time investment required for regression testing.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent substitutes manual mechanical review with automated computer-based extraction and comparison systems. By using optical character recognition and programmed comparison logic, the system achieves both high measurement precision and reduced time consumption compared to manual analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If bulk automated analysis is implemented, then productivity is improved, but device complexity increases due to multiple processing steps

Engineering Contradiction:
Improvedocument processing throughputVSAvoidsystem structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides the complex document analysis process into distinct segmented steps: data extraction, value comparison, and report generation. Each segment is handled by dedicated processing modules that work independently, enabling bulk automated analysis of thousands of documents while keeping the overall system structure manageable through modular design.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11720541B2Document content extraction and regression testing
Publication Date: 2023.08.08 MORGAN STANLEY SERVICES GROUP INC
  • US11720541B2 patent drawing
  • US11720541B2 patent drawing
  • US11720541B2 patent drawing

AI summary

A system for confirming file integrity of automatically generated documents is disclosed. The system comprises one or more processors that execute instructions to receive a document template specifying one or more sections, each section comprising a set of labels for attributes and receive two or more automatically generated documents, each comprising the set of labels for attributes and values of each of those attributes. The system extracts the set of labels for attributes and values of each of those attributes from each of the two or more automatically generated documents. Finally, the system generates a tabular report comparing the values of each of the attributes and generates an alert for a human user if the value for any attribute in a first document is different from the value for that attribute in a second document.