Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Webpage content obtaining method and device

A web page content and acquisition method technology, which is applied in the field of network communication, can solve the problem of low efficiency of web page content acquisition, achieve the effect of facilitating unified management and improving acquisition efficiency

Active Publication Date: 2015-03-25
XIAOMI INC
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a method and device for acquiring webpage content to solve the problem of low efficiency of webpage content acquisition in related technologies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Webpage content obtaining method and device
  • Webpage content obtaining method and device
  • Webpage content obtaining method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0084] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

[0085] The terminology used in the present disclosure is for the purpose of describing particular embodiments only, and is not intended to limit the present disclosure. As used in this disclosure and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a webpage content obtaining method and device. The method comprises the steps that a network request is obtained and includes a download address; the network request is forwarded to an open proxy server; the webpage content obtained from a content server through the open proxy server according to the download address is received. A positive proxy server can obtain webpage content required to be downloaded through a download terminal according to open proxy resources in the open proxy server in the network, the requirement for capturing the webpage content of a search engine can be met by fully utilizing IP address resources in the network, and the network content obtaining efficiency is improved.

Description

technical field [0001] The present disclosure relates to the technical field of network communication, and in particular to a method and device for acquiring webpage content. Background technique [0002] A search engine is a system that collects information from the Internet in order to provide users with retrieval services. The above information mainly refers to the webpage content provided by various websites. Usually, the search engine server can search certain public network IP (Internet Protocol) through a crawler (spider) program. , Internet Protocol) address range of the web server to retrieve the content of the web page. However, in order to alleviate the access pressure, most web servers usually limit the access frequency of the crawler program provided by the search engine server from the same IP address. Therefore, in related technologies, the search engine server distributes web page content grabbing tasks to download terminals assigned different public network...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/951
Inventor 于胜军马哲谭国斌
Owner XIAOMI INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com