Browser DOM Parsing for Webpage Content Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for playing video website resources rely on complex server technologies, increasing development costs and traffic consumption, and affecting webpage display speed due to the need for background server queries and third-party database support.
Innovation Solution
A method and terminal for extracting webpage content that parses the DOM node of a webpage script to identify and extract plug-in resources without relying on a background server, allowing for faster content extraction and display by processing plug-in resources on the browser terminal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a background server and third-party database are used to search and return video resource data, then the browser terminal can display webpage content, but the development cost increases and traffic consumption increases
Solution Approach 1:
The patent extracts the video resource extraction logic from the server-side database system and relocates it to the browser terminal. The browser directly parses the webpage DOM to extract plug-in tag nodes and obtain video resource information, eliminating the need for complex background server and third-party database infrastructure while maintaining webpage content display capability
Solution Approach 2:
The browser terminal performs self-service by directly parsing and extracting video resource information from the webpage DOM structure. The extraction module identifies plug-in tags, obtains associated resources, and processes video information locally without requiring external server support, thereby reducing system complexity and traffic consumption
2Quantity of substance
If a query instruction is sent to the background server for each webpage, then video resource data can be obtained, but the webpage display speed is affected and traffic consumption increases
Solution Approach 1:
The patent implements preliminary action by extracting video resource information during the webpage parsing process before the page is fully rendered and displayed. The extraction module identifies plug-in tags and obtains video resource data in advance, eliminating the need for subsequent server queries and improving webpage display speed while reducing traffic consumption
3Adaptability or versatility
If video player plug-ins with different protocol specifications are used, then various video and audio data can be played, but the extraction logic becomes complex and development cost increases
Solution Approach 1:
The patent applies universality by creating a unified extraction module that handles multiple plug-in types through a common DOM parsing approach. The module identifies different plug-in tag nodes (such as flash, quicktime, realplayer) and extracts their resources using the same basic mechanism, supporting multiple video players without requiring separate extraction logic for each protocol specification
Data Source
AI summary
A method, a terminal and a non-transitory storage medium for extracting webpage content includes: responding to a webpage browsing instruction triggered on a browser by a mobile client to obtain a corresponding webpage; parsing the webpage to obtain a DOM node of a tag in a webpage script; obtaining a plug-in tag node from the DOM node; and when a plug-in tag corresponding to the plug-in tag node is a predetermined type tag, extracting a plug-in resource that corresponds to the plug-in tag. The present method can complete extracting of content that complies with a specific protocol specification when a webpage has not been truly rendered, thereby improving a speed of extracting predetermined webpage content and also improving a webpage display speed.