Data capture method and device

A technology for data capture and data acquisition, applied in the field of network applications, can solve the problems of low data capture effectiveness and accuracy, and achieve the effects of avoiding capture of invalid information, improving capture efficiency, and reducing development costs.

Inactive Publication Date: 2017-10-24
BEIJING XIAODU INFORMATION TECH CO LTD
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a data capture method and device to sol

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data capture method and device
  • Data capture method and device
  • Data capture method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

[0044] In some processes described in the specification and claims of the present invention and the above-mentioned drawings, a plurality of operations appearing in a specific order are contained, but it should be clearly understood that these operations may not be performed in the order in which they appear herein Execution or parallel execution, the serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. Additionally, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel. It should be n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data capture method and device and relates to the field of network application technology. According to the embodiment, update content is determined based on parameter generation rules corresponding to a uniform resource locator (URL) template; the update content is utilized to update the URL template, and a to-be-captured URL is generated; the to-be-captured URL is pushed to a capture server; and the capture server is triggered to capture network data corresponding to the to-be-captured URL. Through the technical scheme in the embodiment, data capture effectiveness and accuracy are improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of network application technologies, and in particular, to a data capture method and device. Background technique [0002] Data scraping is currently a basic way to obtain information from the Internet. [0003] The data grabbing method in the prior art usually utilizes a web crawler to crawl, and the web crawler can perform in-depth traversal and grabbing based on a seed URL (Uniform Resource Locator, Uniform Resource Locator), but the URL and content to be grabbed None of them can be controlled, so it will lead to a lot of invalid information. Contents of the invention [0004] Embodiments of the present invention provide a data capture method and device to solve the technical problem of low effectiveness and accuracy of data capture in the prior art. [0005] In the first aspect, an embodiment of the present invention provides a data capture method, including: [0006] Based on the parame...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/955
Inventor 龚廖安
Owner BEIJING XIAODU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products