H5 Web Page Detection and Dynamic Rendering for Accurate Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for extracting information from Hypertext Markup Language 5 (H5) game web pages are inefficient and inaccurate due to the need for extensive manual screening and extraction, as web crawlers can only simply grab all web pages without effectively distinguishing between H5 and non-H5 content.

Innovation Solution

A web page grabbing method and server that detects H5 content based on web page source code, performs dynamic rendering on the H5 content, and extracts content details from the rendered page, improving recognition and extraction accuracy and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a web crawler is used to grab all web pages, then complete web page data is collected, but manual work is required to distinguish H5 pages leading to low efficiency

Engineering Contradiction:
Improveaccuracy of identifying H5 web pagesVSAvoidefficiency of information extraction
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces the mechanical manual screening process with an automated detection system that analyzes web page source code to identify H5 pages. The server automatically detects H5 web pages by examining source code characteristics, substituting human labor with computational analysis to improve both accuracy and efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The web page grabbing system performs self-service by automatically detecting and processing H5 web pages without requiring manual intervention. The server autonomously identifies H5 pages through source code analysis and proceeds with information extraction, making the system self-sufficient and eliminating the need for human operators to manually distinguish H5 content.

Inventive Principle:
Principle #25Self-service

2Reliability

If manual extraction is performed on all web pages, then information can be obtained, but the process is time-consuming and labor-intensive

Engineering Contradiction:
Improveaccuracy of information extractionVSAvoidtime required for information extraction
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts only the necessary H5 web pages from the complete set of grabbed web pages by detecting H5 characteristics in the source code. This selective extraction approach retrieves only relevant information from H5 pages, eliminating the time waste of processing non-H5 pages while maintaining extraction accuracy through automated detection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary detection of H5 web pages by analyzing source code before the actual information extraction process. This preliminary action identifies which pages require detailed extraction, allowing the system to prepare and process only relevant pages, thereby reducing overall processing time while ensuring accurate extraction from identified H5 pages.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If simple web page grabbing is used, then all pages are collected, but recognition of H5 content requires extensive manual work

Engineering Contradiction:
Improvecompleteness of web page collectionVSAvoidcomplexity of H5 page identification process
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent replaces complex manual identification processes with automated source code analysis. The server detects H5 web pages by examining source code characteristics, substituting the complex mechanical process of manual recognition with a systematic computational approach that maintains completeness of collection while simplifying the identification process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10922364B2Web crawling method and server
Publication Date: 2021.02.16 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US10922364B2 patent drawing
  • US10922364B2 patent drawing
  • US10922364B2 patent drawing

AI summary

A web page grabbing method is provided. A target web page on a website is grabbed, the target web page including a web page corresponding to a Hypertext Markup Language 5 (H5) content and a web page corresponding to a non-H5 content. The web page corresponding to the H5 content is detected according to web page source code of the target web page. Dynamic rendering is performed on the web page corresponding to the H5 content, to obtain a rendered web page. Content details information corresponding to the H5 content is extracted from the rendered web page.