Webpage Defect Detection Using Intersection Over Union Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing software testing tools fail to automatically detect truncation and overlap defects on webpages, which occur during internalization and localization, making it difficult for users to understand the content displayed.
Innovation Solution
A computer-implemented method that uses intersection over union (IoU) calculations and location relationship analysis between webpage elements to identify and mark truncation and overlap defects on a webpage, employing a table to define defect scenarios and determine the presence of text within elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual inspection methods are used to detect truncation and overlap defects, then detection accuracy can be maintained, but testing efficiency and productivity are significantly reduced
Solution Approach 1:
The patent replaces manual visual inspection (mechanical human operation) with an automated computer-based detection system that uses image processing and IoU calculations to identify truncation and overlap defects, thereby improving productivity while maintaining detection accuracy
Solution Approach 2:
The patent introduces an intermediary detection system that automatically analyzes webpage screenshots by calculating IoU values between UI elements and comparing them against predefined thresholds, serving as a bridge between automated testing and defect identification without requiring manual intervention
2Productivity
If automated detection methods are implemented, then testing productivity is improved, but the complexity of the detection system increases
Solution Approach 1:
The patent segments the detection process into distinct modules: screenshot capture, element location extraction, IoU calculation, defect classification, and result reporting. This modular approach automates defect detection while managing system complexity through organized, reusable components
Solution Approach 2:
The patent uses parameter-based detection by calculating IoU values and comparing them against predefined thresholds to automatically identify defects, transforming a complex visual inspection task into a series of simple parameter comparisons that are easy to implement and maintain
3Measurement precision
If comprehensive defect detection is performed across all webpage elements, then detection precision is improved, but the time required for testing increases
Solution Approach 1:
The patent applies partial action by focusing detection efforts specifically on UI elements that are likely to exhibit truncation or overlap defects (such as text fields, buttons, and lists), rather than uniformly analyzing all webpage elements, thereby maintaining high detection precision while reducing overall testing time
Data Source
AI summary
A computer-implemented method, system and computer program product for detecting truncation and overlap defects. Location and size information for the elements of the webpage are obtained. An intersection over union (IoU) calculation is performed for two webpage elements using the obtained location and size information for at least one of these webpage elements. Furthermore, the location relationship between these two webpage elements is determined. A table, which defines truncation defect and overlap defect scenarios, is then reviewed to determine if there are any truncation or overlap defects in these two webpage elements using the IoU calculation, the location relationship and the text condition, which indicates whether text is included in one of the two webpage elements. If any truncation or overlap defects are found in the webpage, then such truncation and/or overlap defects are marked on a screen capture of the webpage.