Web Page Hidden Content Detection via Layout Engine Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for detecting hidden content in web pages, such as hidden chains, have low accuracy due to the encryption of malicious code by JavaScript, which bypasses static detection, and fail to recognize content added using deformation HTML+CSS modes.

Innovation Solution

A method and apparatus that utilize a layout engine to configure a user-agent character string as a search engine, generating description and layout information of a web page, and comparing these to determine hidden content, improving detection accuracy by distinguishing between visible and hidden tag nodes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If static detection mode using HTML, CSS and JavaScript text string characteristics is used, then the detection process is simple, but the detection accuracy is low due to JavaScript encryption bypassing static detection

Engineering Contradiction:
Improvedetection process simplicityVSAvoiddetection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a layout engine as an intermediary component between the web page and the detection system. The layout engine renders the web page and generates a render tree that reflects the actual visual layout, including hidden elements. This intermediary allows the system to detect hidden content that static text analysis cannot find, while maintaining a relatively simple detection process by comparing the DOM tree with the render tree.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If dynamic detection mode executing JavaScript codes is used, then the detection accuracy improves, but the device complexity increases due to requiring open source JavaScript engine

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the JavaScript execution function from the detection system itself and delegates it to the layout engine, which already has built-in JavaScript execution capabilities for rendering purposes. By separating the detection logic from the rendering logic, the system achieves high detection accuracy without significantly increasing the complexity of the detection apparatus, as the layout engine handles both rendering and detection tasks.

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If traditional detection modes comparing HTML structure are used, then the detection process is fast, but the detection accuracy is low for deformation HTML+CSS modes

Engineering Contradiction:
Improvedetection speedVSAvoiddetection accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent transitions from a one-dimensional text-based comparison approach to a two-dimensional structural comparison approach by introducing the render tree. The render tree captures not only the HTML structure but also the CSS-styled visual layout information. By comparing the DOM tree with the render tree, the system can detect hidden content created through deformation HTML+CSS modes while maintaining relatively fast detection speed through efficient tree structure comparison algorithms.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10333972B2Method and apparatus for detecting hidden content of web page
Publication Date: 2019.06.25 DISPERSIVE HLDG INC
  • US10333972B2 patent drawing
  • US10333972B2 patent drawing
  • US10333972B2 patent drawing

AI summary

According to an example, a web page is loaded and description information of the web page and layout information of the web page are generated, the description information of the web page is compared with the layout information of the web page, whether all tag nodes comprised in the description information of the web page are comprised in the layout information of the web page is determined, and it is determined at least one tag node, which being comprised in the description information of the web page and not contained in the layout information of the web page, as hidden content.