Automated Menu Testing With Content-Aware Key Node Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional user interface (UI) testing of menus is inefficient and lacks flexibility due to the reliance on pre-defined menu maps, which break when menu elements are added or removed, and regression testing often positions the cursor incorrectly, requiring manual updates.

Innovation Solution

A key node-based menu navigation system that decomposes the frame buffer into text, foreground, and background spaces, using color and attribute matching to navigate menus without a pre-defined map, allowing dynamic menu changes without test case updates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If pre-defined menu maps are used for automated UI testing, then testing automation is achieved, but the test cases break when menu elements are added or removed

Engineering Contradiction:
Improveautomated UI testingVSAvoidflexibility with menu changes
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The testing system automatically detects and adapts to menu structure changes by monitoring actual menu content rather than relying on pre-defined maps. The system self-updates its understanding of menu structures through dynamic content analysis, eliminating the need for manual test case updates when menus change.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback mechanisms where the actual menu content is continuously monitored and compared against expected structures. This feedback loop enables automatic detection of menu changes and triggers adaptive adjustments to test navigation paths, ensuring tests remain valid despite menu modifications.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If pre-defined menu maps are used, then test navigation is simplified, but manual updates are required when menus change

Engineering Contradiction:
Improvetest navigationVSAvoidtime for manual updates
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically maintains test navigation validity by monitoring menu changes and self-adjusting navigation paths without human intervention. This eliminates the time-consuming manual update process while preserving the simplicity of test navigation through automated adaptation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary detection of menu changes before they affect test execution. By proactively monitoring and anticipating menu structure modifications, the system pre-adjusts navigation paths to prevent failures, eliminating the need for reactive manual updates.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If conventional menu testing is used, then testing coverage is maintained, but regression testing positions cursor incorrectly

Engineering Contradiction:
Improvetesting coverageVSAvoidcursor positioning accuracy
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The system replaces mechanical cursor-based navigation with a content-aware navigation approach. Instead of relying on fixed cursor positions defined in pre-defined maps, the system dynamically identifies menu elements through their content and attributes, ensuring accurate positioning regardless of menu changes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the parameters for identifying menu elements from fixed positional indices to dynamic content-based identification. By using content matching and attribute comparison, the system maintains reliable testing coverage while achieving precise cursor positioning that adapts to menu changes.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250225061A1Automated menu testing
Publication Date: 2025.07.10 DELL PROD LP
  • US20250225061A1 patent drawing
  • US20250225061A1 patent drawing
  • US20250225061A1 patent drawing

AI summary

Subsequent to initializing a frame buffer associated with a menu, an information handling system decomposes content of the frame buffer into a text space, a foreground space, and a background space. The system navigates the menu to a key node using a control key, wherein the key node includes an expected text and an expected attribute. The system also matches a text and an attribute of a current element to the expected text and the expected attribute, wherein the text is from the text space, and wherein the attribute is a foreground color from the foreground space or a background color from the background space.