Database data migration-oriented data verification method

A data verification and database technology, applied in the direction of database distribution/replication, electronic digital data processing, structured data retrieval, etc. The effect of speed, security and completeness, and stability

Active Publication Date: 2018-07-03
GEOVIS CO LTD
View PDF9 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

To solve the bottleneck of data storage, the existing storage structure must be switched. However, due to the huge amount of underlying data at present, how to migrate the original massive data to a new storage structure that supports horizontal expansion while switching the storage structure It is also a big bottleneck point, especially this kind of expansion cannot guarantee that the correct and complete data results will be obtained in the end
Moreover, the common expansion method is not only costly and inefficient, but also the security and reliability cannot be guaranteed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database data migration-oriented data verification method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, wherein the schematic embodiments and descriptions are only used to explain the present invention, but are not intended to limit the present invention.

[0013] See attached figure 1 , a data verification method for database data migration

[0014] Step S10, configuring a plurality of task information pairs of database data movement tasks; wherein, each task information pair includes source task information giving source data tables that need to be migrated from the first database, and the second database that needs to be migrated to The target task information of the target data table;

[0015] Step S20, read the data of the source data table to be migrated in the task information pair from the first database according to the scheduled task information pair, and divide the data of the source data table into multiple databases to obtain a plur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a database data migration-oriented data verification method. Compared with the prior art, the database data migration method and system have the advantages that each data table is taken as a migration task, a database import/export tool or a customized program is taken as a main measure for reading heterogeneous database data, the tasks are operated in a distributed cluster, a self-defined sub-library algorithm is added in the data processing, read data is divided into a plurality file, and in the tasks, the database import/export tool or the customized program is called to import the data into a plurality of new databases. Various paths of data migrations are carried out at the same time without influencing one another, so that the data migration speed is greatlyimproved. A data verification function is provided, so that the stability and data correctness in the migration process are ensured. In the data migration process, distributed verification is carriedout on the data, so that the safety and completeness of the data verification are ensured. Users are allowed to self-define data verification manners, and finally verified result data is returned to corresponding users.

Description

【Technical field】 [0001] The invention is dedicated to data security access, and ensures that the data is free from missing and complete during the migration process by performing distributed verification on the migration data during the data migration process of the database. 【Background technique】 [0002] In early Internet applications, the underlying data generally adopts a storage solution for storing all data in a single database. With the development of Internet applications, the number of users has increased sharply, and the amount of data storage has increased exponentially. The underlying data single-database storage scheme restricts or even limits the further expansion of Internet applications. Therefore, in order to solve the bottleneck problem of single database storage, it is necessary to gradually adopt another solution that supports horizontal storage. To solve the bottleneck of data storage, the existing storage structure must be switched. However, due to t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/214G06F16/27
Inventor 曾刚王焰辉李振钊
Owner GEOVIS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap