An easily expandable and configurable data backup system and method

A data backup and easy-to-extend technology, which is applied in database management systems, structured data retrieval, and redundant data error detection in computing. Flexible control of time, avoiding manual errors, and realizing the effect of automation

Active Publication Date: 2021-09-07
北京江融信科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In view of the above problems, an object of the present invention is to provide an easily expandable and configurable data backup system, which uses a backup database to replace the original backup files, and periodically (high frequency and small amount) expired files through migration (cleaning) of the system The data is migrated to the backup database, which solves the problem that the original migration takes a long time and the backup data cannot be directly queried; the backup database can be expanded horizontally, and the data migration (data cleaning) action can be performed between multiple physical machines and multiple data sources The system only backs up business data (non-business data does not need to be backed up), reducing the physical space occupied by the backup; data backup is flexibly configured, and the entire process of data migration (data cleaning) is executed by the program without manual intervention, realizing the automation of the data backup process and avoiding possibility of human error

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An easily expandable and configurable data backup system and method
  • An easily expandable and configurable data backup system and method
  • An easily expandable and configurable data backup system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] Such as figure 1 As shown, this embodiment discloses an easily expandable and configurable data backup system, including a management platform service module, a process processing engine module and a multi-data source service module.

[0065] The management platform service module is used to configure the relevant parameters and system parameters of data backup; provide the migration process monitoring function and monitor various indicators in the migration process; assume the role of the registration center in the service, provide service registration, service discovery and service monitoring; management The platform service module includes registration center sub-module, scheduling management sub-module, configuration center sub-module and monitoring center sub-module;

[0066] The registration center sub-module is used for unified service registration, service discovery and service monitoring functions, and the caller can discover and use the service through the reg...

Embodiment 2

[0082] Such as figure 2 As shown, this embodiment discloses an easily expandable and configurable data backup method, including the following steps:

[0083] S100: Configure system parameters, SQL parameter variables, and migrate SQL templates; when configuring migration SQL templates, when the same batch of related data is migrated, they are defined in groups to form migration groups, and each piece of data in the migration group will be Migrate the associated tables one by one in order;

[0084] Among them, the configuration of system parameters is shown in Table 1; the configuration of SQL parameter variables is shown in Table 2. When configuring SQL parameter variables, the parameters will replace the variables in the SQL template through parameter name matching to obtain actual operating parameters; the configuration of migrating SQL templates is shown in Table 3 , when configuring the migration SQL template, the SQL statement template is migrated based on the actual bu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an easily expandable and configurable data backup system and method, comprising a management platform service module, a flow processing engine module and a multi-data source service module; the management platform service module is used to configure system parameters and parameters related to data backup , providing migration process monitoring functions, providing service registration, service discovery, and service monitoring; the process processing engine module is used to execute migration tasks based on the parameters configured by the management platform service module, migration tasks are executed in the order of hierarchical codes between migration groups, and migration groups The migration tasks are executed in batches according to the order set in the system parameters; the multi-data source service module is used to configure, initialize and manage transactions for multiple data sources; the system uses batch processing to perform small batches and multiple batches Migrate data every time, and use error handling to ensure the integrity of data migration for abnormal situations that occur during the migration process.

Description

technical field [0001] The invention relates to the technical fields of data storage and data processing, in particular to an easily expandable and configurable data backup system and method. Background technique [0002] With the continuous deepening of the digitalization of the bank's online loan business system, the continuous and stable operation of the transaction system, and the increase of time, a large amount of transaction data is generated in the transaction system and stored in the database table. The gradual increase of data will lead to the current transaction system. The response speed of inter-time business slows down, exceeding the maximum response time required by the business. The end-of-day business processing takes a long time, which will delay the normal business development on the second day. , within the bank) required to submit data caused inconvenience, and even the data was too large, resulting in insufficient temporary space, resulting in query fai...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/215G06F16/25G06F16/28G06F11/14
CPCG06F11/1448G06F11/1461G06F16/215G06F16/252G06F16/284
Inventor 衣得平
Owner 北京江融信科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap