Automatic Script Repair for Unrecognized UI Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automation test scripts often fail due to unrecognized objects, leading to laborious and time-consuming manual revisions, as objects in the script change during the development phase, causing missed object recognition and blocking subsequent test steps.

Innovation Solution

A method and system that automatically detect missed objects in running scripts, determine the type of change (recognition property, class, hierarchy, or no change), and repair the script accordingly to maintain object recognition and continue the test process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual comparison and debugging methods are used to fix script failures, then script accuracy can be improved, but labor consumption and time consumption increase significantly

Engineering Contradiction:
Improvescript accuracyVSAvoiddebugging time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system enables self-service by automatically detecting missed objects, determining change types, and repairing scripts without human intervention. The processor independently performs object detection, change analysis, and script modification, eliminating the need for manual debugging while maintaining high accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual mechanical debugging processes are replaced by an automated computational system. The processor uses algorithmic methods to detect object changes and repair scripts, substituting human manual operations with automated electronic processing that is both faster and equally accurate.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual object comparison using tools like QTP is performed to identify failure reasons, then script reliability can be improved, but productivity decreases due to laborious operations

Engineering Contradiction:
Improvescript reliabilityVSAvoidtest efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs self-service by automatically comparing objects and identifying changes without requiring tester intervention. The processor independently executes object comparison, change type determination, and script repair, maintaining reliability while eliminating manual labor that reduces productivity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system extracts the time-consuming manual comparison operation from the test process by implementing automated object detection and change analysis. This extraction removes the productivity bottleneck while preserving the reliability benefits of thorough object comparison.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If researchers frequently revise scripts during development, then object recognition accuracy improves, but script stability deteriorates causing more test failures

Engineering Contradiction:
Improveobject recognition accuracyVSAvoidscript stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The system implements feedback by automatically detecting when objects are missed during test execution and providing information about the change type. This feedback loop enables the system to adapt to script revisions dynamically, maintaining object recognition accuracy even as the script evolves during development.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system embraces dynamics by automatically adapting to script changes during the development phase. Rather than requiring script stability, the system dynamically detects changes and repairs itself, allowing frequent revisions without compromising test execution.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10621066B2Automatic repair of scripts
Publication Date: 2020.04.14 KYNDRYL INC
  • US10621066B2 patent drawing
  • US10621066B2 patent drawing
  • US10621066B2 patent drawing

AI summary

A method and associated system for repairing a script. A change type of a missed object among one or more objects of a running script that is running in a computer system is determined. The missed object is unrecognized from an original object of a previous running of the script. The script is repaired based on the change type. Determining the change type of the missed object includes determining whether a height of a new hierarchical structure including the missed object has changed as compared with a height of an original hierarchical structure including the original object. The original hierarchical structure and the new hierarchical structure are hierarchical structures formed by the one or more objects of the running script together with the missed object.