Detecting Scroll Bars via Mouse Pointer Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Codeless testing platforms face challenges in reliably detecting modern scroll bars due to varied designs, leading to missed testing of scrollable elements, which can result in undetected faults propagating to users and causing resource-intensive issues.
Innovation Solution
An automatic testing system uses a mouse middle button click event to capture and compare images of a GUI before and after the click, determining the presence of a scroll bar by checking for changes in the mouse pointer, and accordingly selects or omits scroll bar specific tests.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional scroll bar detection methods are used, then simple high-contrast scroll bars can be detected, but modern varied scroll bar designs cannot be reliably detected
Solution Approach 1:
The patent introduces a mouse pointer as an intermediary element to detect scroll bars. Instead of directly analyzing scroll bar visual characteristics which vary widely, the system uses the mouse pointer's behavior (whether it changes shape when hovering over an element) as a mediator to indirectly detect the presence of scrollable regions, thereby resolving the contradiction between reliable detection and adaptability to modern designs
Solution Approach 2:
The patent replaces visual analysis mechanisms with interaction-based detection. Instead of using image processing to analyze scroll bar appearance (mechanical visual system), the system substitutes this with a behavioral test using mouse pointer interaction, where the pointer's shape change indicates the presence of a scroll bar, achieving reliable detection across diverse modern scroll bar designs
2Productivity
If scroll bar detection is omitted to simplify testing, then testing speed increases, but faults in scrollable elements remain undetected
Solution Approach 1:
The patent applies preliminary action by performing a quick mouse pointer interaction test before committing to comprehensive scroll bar testing. This preliminary detection step quickly identifies elements with scroll bars, allowing the testing system to then apply appropriate scroll-specific tests only where needed, thus maintaining testing speed while ensuring fault detection completeness
Solution Approach 2:
The patent introduces dynamics by making the testing process adaptive based on detection results. The system dynamically adjusts its behavior: if a scroll bar is detected through pointer interaction, then scroll-specific tests are applied; if not detected, standard tests proceed. This dynamic approach ensures both efficiency and thoroughness in fault detection
Data Source
AI summary
The design for modern graphical interfaces generated by an application under test (AUT) can take many forms. A codeless testing system reads the output generated by the AUT to identify components, however, scroll bars may be present but in a form that is not reliably identified. As a result, an AUT may comprise scrollable graphical elements that are not identified as such resulting in the performance of tests that are incomplete. By applying a middle button click event, an associated pointer changes form and reveals an associated graphical element to comprise a scrollable element. When the pointer change occurs, testing directed to the scrollable element is then included to perform a more complete testing of the features of the AUT.