Data importing processing method and data processing device

A processing method and data import technology, applied in the field of data processing, can solve problems affecting the performance of the target database, null values, duplicate data, etc.

Active Publication Date: 2013-09-04
NO 15 INST OF CHINA ELECTRONICS TECH GRP
View PDF2 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, in practical applications, since data can be imported from multiple source databases, the data in the imported target database will have duplicate data, garbage data, null values, wrong data, etc. Data table attributes are incompatible, resulting in various technical problems such as source data import failures
[0006] It can be seen from the above that in the existing data processing method based on data import, when the properties of the source data table are compatible with the properties of the data table in the target database, the source data table containing the source data is copied to the data table of the target database ; and when the attributes of the source data table are incompatible with the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data importing processing method and data processing device
  • Data importing processing method and data processing device
  • Data importing processing method and data processing device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] The technical solutions of the various embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0069] Data import technology is a widely used technology to realize data sharing or data reuse. The existing data processing method based on data import can simply copy the source data to the data table of the target database. For data import in the target database, it is difficult to maintain consistency for complex and changeable data and diverse data models, which makes the data imported into the target database redundant, the consistency of the data stored in the target database...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data importing processing method and a data processing device. The data importing processing method includes acquiring source data to be imported, a source data model and a target data model; establishing a mapping relation between the source data model and the target data model and converting the acquired source data according to the established mapping relation; acquiring preset business rules of the target data model and filtering the converted source data; and computing global similarity of the filtered source data and target data, deleting the source data with global similarity values higher than a preset similarity threshold value and importing the source data which meet similarity conditions into a data table of a target database after similarity processing is performed on the source data. The data importing processing method and the data processing device have the advantages that by the data importing processing method and the data processing device, the consistency of stored data can be improved, the storage efficiency is improved, and data redundancy is reduced.

Description

technical field [0001] The invention relates to data processing technology, in particular to a data import processing method and a data processing device. Background technique [0002] With the rapid development of the Internet / Intranet (Internet / Intranet) and the wide application of database technology, the amount of data generated by applications in various industries is also increasing. Among them, through the database technology, the massive data generated can be stored, the data can be backed up, and the data analysis and maintenance of the stored data can be facilitated later; and through the Internet / Intranet, the resource sharing of application data in various industries can be realized. In the prior art, databases can use different data structures to store data. Therefore, the data structures of the stored data are different among the databases, which is called heterogeneous data. How to make the heterogeneous data between the databases undergo data processing , ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 孙秋峰傅永财李淑惠宁江郑扬飞徐超郭红钰何岩王非刘玉龙
Owner NO 15 INST OF CHINA ELECTRONICS TECH GRP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap