Ambiguity Resolution in Keyword-Driven UI Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for testing user interfaces, such as macro recording and Selenium-based tools, face challenges with ambiguity in instruction statement interpretation due to varying screen sizes and the need for professional programming, limiting automation and ease of maintenance.
Innovation Solution
A method and system for resolving ambiguity in instruction statement interpretation using criteria such as proximity to previous interpretations, validity of keywords, context, and related elements, with optional user selection or machine learning algorithms to determine the correct interpretation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If keyword driven user interface testing is used to allow non-programmers to write test scripts, then ease of operation is improved, but ambiguity in instruction statement interpretation increases
Solution Approach 1:
The system performs preliminary actions by analyzing the user interface structure before executing test instructions. It pre-identifies and caches element hierarchies, properties, and relationships, allowing the system to resolve ambiguous keywords by matching them against pre-analyzed UI structures rather than attempting to resolve ambiguity during instruction execution
Solution Approach 2:
The system introduces an intermediary layer between the natural language instruction and the UI element execution. This intermediary component analyzes the instruction statement, identifies potential ambiguities, and resolves them by matching keywords against the pre-analyzed UI structure, translating vague terms into precise element identifiers
2Ease of operation
If macro recording is used to record screen coordinates for user interface testing, then ease of operation is improved, but adaptability to different screen sizes deteriorates
Solution Approach 1:
The system changes the parameters used to identify UI elements from fixed screen coordinates to dynamic properties such as element hierarchies, text content, and structural relationships. This allows the same test script to adapt to different screen sizes by matching elements based on their logical properties rather than their physical positions
Solution Approach 2:
The system transitions from a two-dimensional coordinate-based approach to a hierarchical structure-based approach. Instead of specifying elements by x,y coordinates on the screen, the system navigates through the UI element hierarchy (e.g., window > dialog > button), adding a dimensional layer of abstraction that enables screen-size independence
3Measurement precision
If Selenium-based testing tools with programming identifiers are used, then measurement precision of element identification is improved, but device complexity and difficulty of operation increase
Solution Approach 1:
The system creates a simplified copy or representation of the UI structure that mirrors the hierarchical organization of elements. This virtual model allows users to reference elements by their logical position and properties in the hierarchy rather than by complex programming identifiers, maintaining precision while reducing complexity
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An instruction set may comprise one or more instruction statements, which may include keywords that are not definitive and each of which may corresponds to multiple elements on a user interface which is subject to testing. The closer the format of the instruction statements is to a natural spoken language, the more likely ambiguity may occur in instruction statement interpretation. The present application provides systems, methods and computer readable media for ambiguity resolution in instruction statement interpretation. The methods include resolving ambiguity in interpreting an instruction statement of an instruction set based on one or more criteria.