UI Screen Component Comparison for Bug Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing software bug detection methods, such as those using machine learning, are inefficient in detecting bugs on user interface screens, despite the majority of software testing issues being related to these screens.
Innovation Solution
A method involving a server terminal that receives image data from a user terminal, extracts and compares components of a reference user interface screen with those displayed on the user terminal, and detects differences to identify bugs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If machine learning-based functional bug detection methods are used, then functional bugs can be detected, but user interface screen bugs cannot be effectively detected
Solution Approach 1:
The user interface screen is divided into multiple components (e.g., header, body, footer, buttons, text fields). The patent extracts and compares each component individually against its corresponding design data component, enabling precise detection of UI screen bugs while maintaining functional bug detection capabilities through the overall testing framework.
Solution Approach 2:
The patent introduces design data as an intermediary reference standard. Design data components serve as the mediator between the actual UI screen components and the expected correct state. By comparing actual components against this intermediary design data, the system can accurately detect UI screen bugs without compromising functional bug detection.
2Reliability
If comprehensive bug detection is implemented, then both functional and UI screen bugs can be detected, but testing efficiency decreases
Solution Approach 1:
By segmenting the UI screen into discrete components and comparing them individually against design data, the system achieves comprehensive UI bug detection without requiring exhaustive manual testing. This component-based approach enables efficient automated testing while maintaining high detection coverage.
Solution Approach 2:
The patent uses design data as a reference copy of the correct UI screen components. By extracting components from the actual screen and comparing them against the reference design data components, the system achieves efficient automated detection of UI bugs without requiring complex testing scenarios or manual verification processes.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
[Problem] To provide an efficient method of detecting bugs in software user interface screens. [Solution] In a method for testing software in one embodiment of the present invention, a control unit of a server terminal receives from a user terminal image data relating to a user interface screen of software to be displayed on the user terminal; extracts, based on design data stored in a memory unit of the server terminal for a reference user interface screen of software, components that divide the reference user interface screen of software; extracts components that divide the reference user interface screen of software to be displayed on the user terminal; compares the extracted components of the reference user interface screen of the software with the components of the user interface screen of the software displayed on the user terminal; and detects differences in the components.