Web page grabbing method and web page grabbing system based on big data

A technology of webpage crawling and big data, which is applied in the field of webpage crawling method and system based on big data, can solve problems such as inconvenient webpage data crawling, and achieve the effect of convenient webpage data crawling
CN105683967AInactive Publication Date: 2016-06-15SHENZHEN BOXINNUODA ECONOMIC RELATIONS & TRADE CONSULTANTS CO LTD

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
SHENZHEN BOXINNUODA ECONOMIC RELATIONS & TRADE CONSULTANTS CO LTD
Publication Date
2016-06-15
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
Patent Text Reader

Abstract

The invention provides a web page grabbing method and a web page grabbing system based on big data. The web page grabbing method comprises the following steps of receiving a web page request of a user; classifying the big data according to key word classification of the web page; and transmitting the classified web page which corresponds with the web page request to the user. The web page grabbingmethod and the web page grabbing system provided by the invention have an advantage of high convenience in grabbing the web page.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the fields of communication and the Internet of Things, in particular to a method and system for capturing webpages based on big data. Background technique

[0002] The future development trend and prospect of big data and cloud computing are extremely broad. The future Internet will be dominated by big data and cloud computing. Big data and cloud computing will become the technologies that every IT personnel must know. In big data, webpage data is the main source of big data, and how to capture webpage data has become an important technology in big data processing. Contents of the invention

[0003] A web page grabbing method based on big data is provided, which solves the disadvantage of inconvenient web page data grabbing in the prior art.

[0004] On the one hand, there is provided a method for grabbing webpages based on big data, said method comprising the steps of:

[0005] Receive web page requests from users; [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More