Web Page Separator Line Detection via Edge Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods fail to effectively detect separator lines in web pages due to varying content types and layouts, as well as the presence of diverse content such as text, images, and multimedia, which complicates the detection process.

Innovation Solution

A method and system that determine the coordinates of visible web elements, generate an edge image, filter non-separator line edges, detect horizontal and vertical lines, and filter short lines to accurately identify separator lines, utilizing a processor and memory device connected via a network to process web pages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing methods are used to detect separator lines, then the detection process is simple, but the detection accuracy deteriorates due to varying content types and layouts

Engineering Contradiction:
Improveseparator line detection accuracyVSAvoiddetection process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The detection process is segmented into distinct stages: edge detection, horizontal line detection, vertical line detection, and separator line identification. Each stage focuses on specific aspects of the image processing, making the overall complex task manageable and improving accuracy through systematic analysis of different line orientations and characteristics

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method transitions from simple 2D image analysis to multi-dimensional analysis by detecting both horizontal and vertical edges, then combining them to identify separator lines. This dimensional approach allows the system to distinguish separator lines from other image elements by analyzing lines in multiple orientations simultaneously

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If comprehensive edge detection is performed to handle diverse content, then the detection coverage is improved, but the false positive rate increases due to text and image edges

Engineering Contradiction:
Improvehandling of diverse content typesVSAvoidfalse positive rate
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

Different regions of the image are analyzed with different criteria. Text regions are identified and excluded from separator line candidates, while image regions are processed separately. This local differentiation allows the system to maintain high adaptability to diverse content types while reducing false positives by applying appropriate filtering to each region

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The method extracts and removes edges that belong to text and images from the set of detected edges. By explicitly identifying and excluding these problematic edges, the system maintains comprehensive detection coverage while significantly reducing the false positive rate in the final separator line identification

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8867837B2Detecting separator lines in a web page
Publication Date: 2014.10.21 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US8867837B2 patent drawing
  • US8867837B2 patent drawing
  • US8867837B2 patent drawing

AI summary

A system and method of detecting separator lines in a web page may include determining coordinates of visible web elements on a web page, generating an edge image of the web page based on the coordinates of the web elements, filtering edges belonging to non-separator line elements within the edge image, detecting horizontal lines within the edge image, detecting vertical lines within the edge image, and filtering short lines within the edge image. A system for detecting separator lines in a web page may include a memory device, and a processor communicatively coupled to the memory, in which the processor determines coordinates of visible web elements on a web page, generates an edge image of the web page based on the coordinates of the web elements, filters edges belonging to non-separator line elements within the edge image, detects horizontal lines within the edge image, detects vertical lines within the edge image, and filters short lines within the edge image.