A method of obtaining network data

A network data and webpage technology, applied in the field of network data acquisition, can solve the problem that the browser cannot completely save the webpage, and achieve the effect of convenient technical analysis and content display

Inactive Publication Date: 2019-02-01
GLOBAL TONE COMM TECH
View PDF11 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that existing browsers cannot completely save webpages, the present invention provides a method for obtaining network data. The method reduces the problem of saving webpages to processing at the http protocol layer, and treats all urls without distinction. Save the content and address of the resource file without modifying it, ensuring the integrity of the offline page

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of obtaining network data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0027] See attached figure 1 .

[0028] A method for obtaining network data, comprising the following steps:

[0029] 1) Write an http proxy service program, proxy the http protocol, read the request address, create disk directories and files based on the address, read the response content corresponding to the request address and store it in the associated disk directory and file;

[0030] 2) Start the written http proxy service program;

[0031] 3) Set the proxy service of 360 Secure Browser as the http proxy service started in step 2);

[0032] 4) When visiting the home page of Sina.com, the http proxy service program automatically saves the web page and all resource files contained therein;

[0033] 5) You can view all saved resource files in the disk directory;

[0034] 6) Through the local http service, you can view the complete offline webpage of the homepage of Sina.com.

[0035] The step 4) includes the following execution process:

[0036] (1) The http proxy ser...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for acquiring network data. Between that brow and the server, Set up the http proxy service, Through the filtering feature of http proxy service, all url requests in the current web page are blocked, and the response contents of the server corresponding to each url request are saved as offline files, so that the orderly storage of all url request contents is realized, and the function of completely saving the web page and all resource files contained in the web page is achieved The method of the invention reduces the problem of web page storage to be handled atthe http protocol layer, All URLs are treated without discrimination, and can be saved in a transparent manner to the user, so as to realize the complete storage of the web page content and all the resource files contained therein, so as to facilitate the technical analysis and content presentation in a local and offline manner.

Description

technical field [0001] The invention belongs to the field of computer application technology, and in particular relates to a method for acquiring network data. Background technique [0002] With the popularity of network applications, there are more and more application systems with B / S architecture, and users have become accustomed to obtaining information through web browsers. In practice, users often need to save the content of some web pages. Currently, users use the "save as" function provided by the browser to save the content of the webpage they are browsing. However, the existing browser "save as" operation cannot completely save the content of the webpage. When the js or css contains url, it is difficult to grab the corresponding file; even if the crawler tool is used to crawl the page, there will be some files cannot be saved correctly. [0003] Existing web page storage solutions are generally processed at the content level. Too complex content is too difficult...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/958
Inventor 程国艮郝雁华
Owner GLOBAL TONE COMM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap