Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and system for automatically acquiring target data source

A target data source, automatic acquisition technology, applied in the direction of network data retrieval, network data indexing, other database retrieval, etc., can solve the problem of large amount of data and take up space, and achieve the effect of increasing the workload

Active Publication Date: 2022-07-15
GLOBAL TONE COMM TECH
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is the easiest, but the problem is that the huge amount of data takes up space, and because different types of data are stored together, it also brings a lot of inconvenience to subsequent processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for automatically acquiring target data source
  • A method and system for automatically acquiring target data source
  • A method and system for automatically acquiring target data source

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention. Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for automatically acquiring a target data source, comprising the following steps: parsing web page data; structuring or semi-structuring the parsed data to form analyzable data; Perform data analysis to determine whether the webpage data needs to be obtained; use a data collector to obtain the data source webpage data and save the obtained webpage data in a relational database or file. Using this method, before crawling the web page data, the web page data is first analyzed and analyzed to obtain the web page data that the user is interested in, which is different from the traditional crawling data saving first, and then performing method of analysis. The advantages of doing this are also very obvious. It can greatly reduce the huge data analysis and mining work of subsequent developers and improve efficiency. The invention further relates to a system for automatically acquiring target data sources.

Description

technical field [0001] The invention relates to the technical field of data acquisition, and in particular to a method and system for automatically acquiring a target data source. Background technique [0002] With the development of Internet technology, we have now entered the era of big data. With the exponential growth of the amount of data, the research and application of big data has become more and more extensive in various companies. Since most data is obtained through the Internet, there are many kinds of data on the Internet, and there are structured and Unstructured data brings a lot of inconvenience to users' collection and analysis. [0003] The current data collection method is to crawl and save all the data of the target website through the network data crawler, and then perform corresponding data cleaning and other processing work to obtain the data of interest and save it for future use. This method is the easiest, but the problem is that a huge amount of d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/951G06F16/957
Inventor 鄢亚东程国艮
Owner GLOBAL TONE COMM TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com