Web page grabbing method and web page grabbing system based on big data

A technology of webpage crawling and big data, which is applied in the field of webpage crawling method and system based on big data, can solve problems such as inconvenient webpage data crawling, and achieve the effect of convenient webpage data crawling

Inactive Publication Date: 2016-06-15
SHENZHEN BOXINNUODA ECONOMIC RELATIONS & TRADE CONSULTANTS CO LTD
View PDF2 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Provides a method of webpage crawling based on big data, which solves the disadvantage of inconvenient webpage data crawling in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Web page grabbing method and web page grabbing system based on big data
  • Web page grabbing method and web page grabbing system based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0025] refer to figure 1 , figure 1 It is a flow chart of a big data-based web crawling method provided by the first preferred embodiment of the present invention, the method is completed by an intelligent terminal, and the method is as follows figure 1 shown, including the following steps:

[0026] Step S101, receiving a web page request from a user;

[0027] Step S102, classifying the big data according to the classification of web page keywords;

[0028...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a web page grabbing method and a web page grabbing system based on big data. The web page grabbing method comprises the following steps of receiving a web page request of a user; classifying the big data according to key word classification of the web page; and transmitting the classified web page which corresponds with the web page request to the user. The web page grabbingmethod and the web page grabbing system provided by the invention have an advantage of high convenience in grabbing the web page.

Description

technical field [0001] The invention relates to the fields of communication and the Internet of Things, in particular to a method and system for capturing webpages based on big data. Background technique [0002] The future development trend and prospect of big data and cloud computing are extremely broad. The future Internet will be dominated by big data and cloud computing. Big data and cloud computing will become the technologies that every IT personnel must know. In big data, webpage data is the main source of big data, and how to capture webpage data has become an important technology in big data processing. Contents of the invention [0003] A web page grabbing method based on big data is provided, which solves the disadvantage of inconvenient web page data grabbing in the prior art. [0004] On the one hand, there is provided a method for grabbing webpages based on big data, said method comprising the steps of: [0005] Receive web page requests from users; [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/00G06F16/35G06F16/951
Inventor 马岩
Owner SHENZHEN BOXINNUODA ECONOMIC RELATIONS & TRADE CONSULTANTS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap