Intelligent collecting method and system of big data

A technology of intelligent collection and big data, applied in the field of data processing, can solve the problems of low data collection efficiency and achieve the effect of intelligent collection

Pending Publication Date: 2018-11-16
SHENZHEN YUNZHIJIA NETWORK CO LTD
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the case of many source data, this method has very high requirements for manual configuration staff. Since it is necessary to know the data structure of each data table, such as the type and length of each field, this data collection way less efficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent collecting method and system of big data
  • Intelligent collecting method and system of big data
  • Intelligent collecting method and system of big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] Embodiments of the present invention provide a method and system for intelligent collection of big data, which are used to realize intelligent collection of big data.

[0060] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0061] The terms "first", "second", "third", "fourth" and the like in the description and claims of the present invention and the above drawings are used to d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses an intelligent collecting method and system of big data. The method and system are used for achieving intelligent collection of the big data. The method includes the steps of maintaining the corresponding relation between a source database and a target database into configuration management; obtaining first data of the source database, wherein the first data includes list information and field information; maintaining the first data into the configuration management; according to the configuration management, importing second data in the source database into the target database, wherein the second data is list data and field data which correspond to the first data. Therefore, by automatically identifying and sensing the first data in the source database, namely the corresponding list information and the corresponding field information, maintaining the information above into the configuration management, assembling the collected data in a fieldorder and importing the collected data into the target database, intelligent collection of the big data is achieved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to an intelligent collection method and system for big data. Background technique [0002] With the advent of the era of big data, various industries, especially government agencies, are integrating more and more types of data. Some data do not even have standards. Under the big data platform, due to the more complex and diverse data sources, the form of data collection is also different. Become more complex and diverse, of course, business scenarios may also become very different. [0003] At present, the popular big data collection methods in the industry are all manually configured information, such as the table name, field name, field type and length of the source table, and the table name, field name, and field mapped to the corresponding target data system. Type and length and other information, and then the program captures the source data according to the configuration inform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 唐国伟
Owner SHENZHEN YUNZHIJIA NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap