AI Page Object Model for UI Test Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

UI testing for web applications is time-consuming due to the need for frequent updates of test scripts when UI elements change, as each test script associated with a UI element must be rewritten, leading to increased effort and time for test developers.

Innovation Solution

A UI test automation model utilizing a neural network to generate a generic page object representation based on UI codes, which can be compiled into page objects in various programming languages, reducing the effort required to update test scripts with changes to the web application's DOM.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If test scripts are manually updated whenever UI elements change, then testing accuracy is maintained, but time consumption and effort increase significantly

Engineering Contradiction:
Improvetesting accuracyVSAvoidtime consumption
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system enables self-service automation where the AI model automatically generates and updates test scripts in response to UI changes. The model monitors UI element changes and autonomously creates corresponding test script updates without requiring manual developer intervention, thus maintaining testing accuracy while eliminating time consumption associated with manual updates

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual process of test script updating with an AI-based automated system. The neural network model processes UI change detections and generates test script updates programmatically, substituting the manual mechanical updating process with an intelligent automated system that maintains reliability while dramatically reducing time investment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If multiple test scripts are maintained for each UI element, then comprehensive testing coverage is achieved, but complexity of maintenance increases

Engineering Contradiction:
Improvetesting coverageVSAvoidmaintenance complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The AI model serves multiple functions within a single system: it detects UI changes, generates test scripts, updates existing scripts, and manages the test suite. This universal approach consolidates what would otherwise require multiple separate tools and processes, achieving comprehensive testing coverage while reducing maintenance complexity through a unified automated system

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an AI model as an intermediary between UI elements and test scripts. This intermediary automatically manages the relationships between multiple test scripts and UI elements, handling the complexity of maintaining comprehensive testing coverage by autonomously generating and coordinating multiple test scripts rather than requiring manual management of their complex interrelationships

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If test scripts are updated frequently to match UI changes, then test reliability is maintained, but developer productivity decreases

Engineering Contradiction:
Improvetest reliabilityVSAvoiddeveloper productivity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs self-service by automatically detecting UI changes and generating corresponding test script updates without developer intervention. This maintains test reliability through frequent updates while preserving developer productivity, as developers are freed from the repetitive task of manually updating test scripts and can focus on higher-value activities

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The AI model creates copies of test script patterns and templates automatically based on detected UI changes. Rather than requiring developers to manually rewrite or modify test scripts, the system generates appropriate test script copies and variations automatically, maintaining test reliability through consistent updates while dramatically improving developer productivity by eliminating manual copying and modification work

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11748243B2Intelligent generation of page objects for user interface testing
Publication Date: 2023.09.05 SALESFORCE INC
  • US11748243B2 patent drawing
  • US11748243B2 patent drawing
  • US11748243B2 patent drawing

AI summary

Systems and methods for performing user interface (UI) test automation may include receiving a document object model (DOM) associated with a web application, the web application having one or more web pages; generating a generic object representation of the web application based on the DOM using a page object model; generating a page object based on the generic page object representation in a first programing language; and storing the page object in the first programming language in a database to be accessed by test scripts associated with a UI test automation of the web application.