Heterogeneous data exchange and cleaning system and method

A technology for heterogeneous data and cleaning systems, applied in the field of data processing, can solve the problems of single data access method and does not support data analysis applications, etc., to achieve the effect of benefiting data application, reliable and reliable data quality, and large data storage space

Active Publication Date: 2018-06-05
浙江航天恒嘉数据科技有限公司
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Not only the data access method is single, but also does not support data analysis applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous data exchange and cleaning system and method
  • Heterogeneous data exchange and cleaning system and method
  • Heterogeneous data exchange and cleaning system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0036] Such as figure 1 As shown, a heterogeneous data exchange and cleaning system includes: ETL system, the ETL system includes from bottom to top: data source layer 1, data acquisition layer 2, data processing layer 3, data storage layer 4, data analysis application layer 5 and presentation layer 6;

[0037] Data source layer 1 is used to provide address information for connecting relational databases, file databases and local databases;

[0038] The data acquisition layer 2 includes a data collection terminal and a data pull terminal. The data collection terminal is used to obtain structured data files from the relational database in a full or incremental manner according to the address information provided by ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous data exchange and cleaning system and method. The system comprises an ETL system, and the ETL system sequentially includes a data source layer, a data acquisition layer, a data processing layer, a data storage layer, a data analysis application layer and a display layer. The heterogeneous data exchange and cleaning system and method have the advantages thata clustering method is adopted to effectively improve the efficiency, the unified access of a traditional relational database and unstructured data is achieved, and the visual configuration of the data exchange operation is performed without the developer developing a code; through the combination with a big data technology; through combination with a big data technology, data warehouse building is performed, and a data analysis function is provided.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a heterogeneous data exchange and cleaning system and method. Background technique [0002] Most of the traditional methods use existing ETL tools for development or directly write codes according to requirements to realize the data exchange process. The former requires client deployment and the configuration is also bound to the client, while the latter requires time-consuming development and has extremely poor reusability. Existing technologies only perform data cleaning and exchange for traditional relational databases and a small number of fixed types of files. Not only is the data access method single, but it also does not support data analysis applications. Contents of the invention [0003] The invention provides a heterogeneous data exchange and cleaning system and method, which solves the technical problems of the prior art. [0004] The technical scheme that the pres...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/176G06F16/215G06F16/254
Inventor 刘益铭刘浩陈园园沈巧敏
Owner 浙江航天恒嘉数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap