Database backup method, system, computer equipment and storage medium

Abstract

The present invention relates to the field of database storage technology, and specifically discloses a database backup method, system, computer equipment and storage medium, wherein the method comprises receiving a backup instruction containing a database address, locating a target database according to the database address, splitting the target database into data, and obtaining a sub-database; obtaining configuration information of a hardware architecture, and determining the number of primary backup processes and the number of secondary backup processes according to the configuration information; backing up the sub-database according to the number of primary backup processes to obtain a first backup database; backing up the first backup database according to the number of secondary backup processes to obtain a second backup database. The present invention improves the emergency handling capability through the secondary backup database by performing secondary backup on the backup database, and the secondary backup database only requires a basic memory to complete, and has strong universality and is easy to promote and use.

Description

Technical Field

[0001] The present invention relates to the technical field of database storage, and in particular to a database backup method, system, computer equipment and storage medium. Background Art

[0002] A database refers to an organized, sharable collection of data stored in a computer for a long period of time. The data in a database is organized, described, and stored according to a certain data model. Databases are widely used, and almost every service provider needs to build their own databases, which often store very important information, such as account information, etc. Therefore, the database needs to be backed up.

[0003] The existing database backup process is often instantaneous. When an interruption occurs, the cache data is cleared. The purpose of this is to make the cache receive other database backup operations in a brand new state. If there is still data in the cache, it will inevitably affect other backup processes. It can be imagined that the emergency processing capability of the existing database backup method is insufficient. Summary of the invention

[0004] The object of the present invention is to provide a database backup method, system, computer device and storage medium to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A database backup method, system, computer device and storage medium, the method comprising:

[0007] Receive a backup instruction containing a database address, locate a target database according to the database address, and split the target database into sub-databases;

[0008] Obtaining configuration information of the hardware architecture, and determining the number of primary backup processes and the number of secondary backup processes according to the configuration information;

[0009] Backing up the sub-database according to the number of first-level backup processes to obtain a first backup database;

[0010] Backing up the first backup database according to the number of secondary backup processes to obtain a second backup database;

[0011] The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; and the cache time of the second backup database is greater than that of the first backup database.

[0012] As a further solution of the present invention: the steps of receiving a backup instruction containing a database address, locating a target database according to the database address, and performing data splitting on the target database to obtain a sub-database include:

[0013] Receive the backup request containing the database address sent by the user, authenticate the user, and obtain the user level when the user passes the authentication;

[0014] Reading the demand level of the target database according to the database address, and locating the target database when the user level reaches the demand level;

[0015] Reading a sorting standard of data in a target database, and determining a file handle according to the sorting standard;

[0016] The target database is split into sub-databases according to the file handles.

[0017] As a further solution of the present invention: the step of splitting the target database into sub-databases according to the file handle comprises:

[0018] Determine an offset according to a preset sub-database capacity, and read data in the target database in sequence according to the offset; wherein a difference between the offset and the sub-database capacity is less than a preset difference threshold;

[0019] Determine whether the data is a file terminator, and when the data is a file terminator, mark the file terminator as a split point;

[0020] When the data is not a file terminator, the data is read sequentially from the current offset until the file terminator or the database end identifier is read, and the file terminator or the database end identifier is marked as a split point;

[0021] The target database is split into sub-databases according to the marked split points.

[0022] As a further solution of the present invention: the number of first-level backup processes is the minimum value of the first process number, the second process number and the third process number, wherein the first process number is determined by the configuration information of the central processing unit of the hardware architecture; the second process number is determined by the input and output configuration information of the hardware architecture; the third process number is determined according to the capacity of the sub-database and the number of the sub-databases.

[0023] As a further solution of the present invention: the step of backing up the sub-database according to the number of the first-level backup processes to obtain the first backup database includes:

[0024] Get the number of sub-databases, and create a new empty primary database set containing the number of sub-databases;

[0025] Extracting data from the sub-database according to the number of the primary backup processes, and inputting the data into the sub-database in the primary database set;

[0026] When the extraction process is completed, all data in the sub-database in the primary database set and the sub-database containing the original data are input into the XOR buffer area for XOR operation;

[0027] When the XOR operation result is zero, the backup is completed. When the XOR operation result is not zero, the backup is restarted.

[0028] As a further solution of the present invention: the step of backing up the first backup database according to the number of secondary backup processes to obtain the second backup database includes:

[0029] Create a secondary database set that is the same as the primary database set, and when the backup of the sub-database in the primary database set is completed, back up the data in the sub-database that has completed the backup to the sub-database in the secondary database set;

[0030] Calculate the sum and square sum of the data in the sub-database generated based on the target database, the sub-database in the primary database set, and the sub-database in the secondary database set respectively;

[0031] Compare the three sets of calculation data. When the three sets of calculation data are the same, the backup is completed. When the calculation data of the sub-database in the primary database set are different, back up the sub-database in the primary database set again. When the calculation data of the sub-database in the secondary database set are different, back up the sub-database in the secondary database set again.

[0032] As a further solution of the present invention: when the first backup database is interrupted, the unfinished backup data is deleted; when the second backup database is interrupted, the unfinished backup data is stored within a preset time range.

[0033] The technical solution of the present invention also provides a database backup system, the system comprising:

[0034] A data splitting module is used to receive a backup instruction containing a database address, locate a target database according to the database address, and split the data of the target database to obtain sub-databases;

[0035] A process number determination module is used to obtain configuration information of the hardware architecture and determine the number of primary backup processes and the number of secondary backup processes according to the configuration information;

[0036] A first backup module, used for backing up the sub-database according to the number of the first-level backup processes to obtain a first backup database;

[0037] A second backup module, configured to back up the first backup database according to the number of secondary backup processes to obtain a second backup database;

[0038] The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; and the cache time of the second backup database is greater than that of the first backup database.

[0039] The technical solution of the present invention also provides a computer device, which includes one or more processors and one or more memories, wherein at least one program code is stored in the one or more memories, and when the program code is loaded and executed by the one or more processors, the database backup method is implemented.

[0040] The technical solution of the present invention further provides a storage medium, in which at least one program code is stored. When the program code is loaded and executed by a processor, the database backup method is implemented.

[0041] Compared with the prior art, the beneficial effects of the present invention are: the present invention improves the emergency processing capability by performing secondary backup of the backup database, and the secondary backup database only requires basic storage, which is highly universal and easy to promote and use. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0043] Figure 1 A flowchart of a database backup method is shown.

[0044] Figure 2 A first sub-flow chart of the database backup method is shown.

[0045] Figure 3 A second sub-flow chart of the database backup method is shown.

[0046] Figure 4 A third sub-flow chart of the database backup method is shown.

[0047] Figure 5 A fourth sub-flow chart of the database backup method is shown.

[0048] Figure 6 The component structure block diagram of the database backup method system is shown. DETAILED DESCRIPTION

[0049] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. Example

[0050] Figure 1 A flowchart showing a database backup method is provided in an embodiment of the present invention, a database backup method, system, computer device and storage medium, the method comprising steps S100 to S400:

[0051] Step S100: receiving a backup instruction containing a database address, locating a target database according to the database address, and performing data splitting on the target database to obtain sub-databases;

[0052] The purpose of step S100 is to split the target database into sub-databases with smaller data volumes, where the sub-databases can be understood as some data tables with smaller data volumes;

[0053] Step S200: Acquire configuration information of the hardware architecture, and determine the number of primary backup processes and the number of secondary backup processes according to the configuration information;

[0054] The hardware architecture of each computer device is different. Different hardware architectures have different capabilities for reading and processing data. Devices with higher performance have more processes, while devices with lower performance have fewer processes.

[0055] Step S300: backing up the sub-database according to the number of the first-level backup processes to obtain a first backup database;

[0056] Step S400: backing up the first backup database according to the number of secondary backup processes to obtain a second backup database;

[0057] Step S300 and step S400 are the core steps in the technical solution of the present invention. In layman's terms, a backup of backup data is generated. The advantages of doing so are that the backup data can be tested and the ability to cope with special situations can be improved. For example, if the backup process is suddenly interrupted, if the data is saved in the backup database, then during that period of time, the backup database will not be used for the backup process of other databases. Therefore, the existing backup process often performs a reset action immediately once it is interrupted, or uploads the backup data to a storage area at a fixed time. When an interruption occurs, some data will always be lost. If there are two databases, the backup process can be recorded in real time without affecting other backup processes.

[0058] The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; and the cache time of the second backup database is greater than that of the first backup database.

[0059] The cache time of the second backup database is greater than that of the first backup database. In actual situations, the backup time of the first backup database is zero, that is, once an interruption occurs, it is immediately reset. The backup time of the second backup database is often in days. When the time exceeds the backup time, the second backup database is also cleared. It is worth mentioning that there can be more than one second backup database.

[0060] Figure 2 The first sub-flow chart of the database backup method is shown, wherein the steps of receiving a backup instruction containing a database address, locating a target database according to the database address, splitting the target database into sub-databases, and obtaining sub-databases include steps S101 to S104:

[0061] Step S101: receiving a backup request containing a database address sent by a user, performing identity authentication on the user, and obtaining a user level when the user passes the identity authentication;

[0062] Step S102: reading the demand level of the target database according to the database address, and locating the target database when the user level reaches the demand level;

[0063] Step S103: reading the sorting standard of the data in the target database, and determining the file handle according to the sorting standard;

[0064] Step S104: split the target database into sub-databases according to the file handle.

[0065] Steps S101 to S104 provide a data splitting method. First, step S101 authenticates the user. Then, step S202 verifies the user's authority. Not every user can back up any database. Finally, the sorting standard in the target database is read to determine the splitting method. The sorting standard can be time or the first letter of the name. The most common is time.

[0066] Figure 3 The second sub-flow chart of the database backup method is shown, wherein the step of splitting the target database into sub-databases according to the file handle includes steps S1041 to S1044:

[0067] Step S1041: determining an offset according to a preset sub-database capacity, and reading data in the target database in sequence according to the offset; wherein the difference between the offset and the sub-database capacity is less than a preset difference threshold;

[0068] Step S1042: determining whether the data is a file terminator, and if the data is a file terminator, marking the file terminator as a split point;

[0069] Step S1043: when the data is not a file terminator, reading data sequentially from the current offset until a file terminator or a database end identifier is read, and marking the file terminator or the database end identifier as a split point;

[0070] Step S1044: split the target database into sub-databases according to the marked split points.

[0071] Step S1041 to step S1044 further limit the step S104, the core content of which is to detect the file terminator. It should be noted that the offset is generally data close to the capacity of the sub-database, so that the amount of data in each sub-database is roughly the same.

[0072] Furthermore, the first-level backup process number is the minimum value of the first process number, the second process number and the third process number, wherein the first process number is determined by the configuration information of the central processing unit of the hardware architecture; the second process number is determined by the input and output configuration information of the hardware architecture; and the third process number is determined according to the capacity of the sub-database and the number of the sub-databases.

[0073] Figure 4 The third sub-flow chart of the database backup method is shown, wherein the step of backing up the sub-database according to the first-level backup process number to obtain the first backup database includes steps S301 to S304:

[0074] Step S301: Obtain the number of sub-databases, and create a first-level database set with empty content and the number of sub-databases;

[0075] Step S302: extracting data from the sub-database according to the number of the first-level backup processes, and inputting the data into the sub-database in the first-level database set;

[0076] Step S303: when the extraction process is completed, all data in the sub-database in the primary database set and the sub-database containing the original data are input into the XOR buffer area for XOR operation;

[0077] Step S304: When the XOR operation result is zero, the backup is completed; when the XOR operation result is not zero, the backup is performed again.

[0078] The above content is the verification process of the first backup database. The core of the verification is the XOR operation. If the backed-up data is the same as the original data, the final XOR operation result should be zero. The process of doing this only requires one variable to store the XOR result.

[0079] Figure 5 The fourth sub-flow chart of the database backup method is shown, wherein the step of backing up the first backup database according to the secondary backup process number to obtain the second backup database includes steps S401 to S403:

[0080] Step S401: creating a secondary database set identical to the primary database set, and when the backup of a sub-database in the primary database set is completed, backing up the data in the sub-database that has completed the backup to the sub-database in the secondary database set;

[0081] Step S402: respectively calculating the sum and the sum of squares of the data in the sub-database generated based on the target database, the sub-database in the primary database set, and the sub-database in the secondary database set;

[0082] Step S403: compare the three sets of calculation data. When the three sets of calculation data are the same, the backup is completed. When the calculation data of the sub-database in the primary database set are different, the sub-database in the primary database set is backed up again. When the calculation data of the sub-database in the secondary database set are different, the sub-database in the secondary database set is backed up again.

[0083] The core steps of step S401 to step S403 are to verify the data of the second backup database. The verification process verifies the three sub-databases at the same time by calculating the calculation data in different sub-databases according to a preset calculation formula and then comparing the calculated data.

[0084] It should be noted that, whether it is the XOR operation in step S301 to step S304 or the calculated data in step S401 to step S403, their purpose is not simply to determine whether there is a backup error, it also includes a certain positioning function. We know that the probability of an error in the backup process is very small, and the error that occurs is mostly a missing data. For the XOR operation, the final XOR operation result is the missing data; if two data are missing, then two independent equations can be constructed through the sum and the sum of squares, and the missing data can be calculated according to the equations. For example, the difference between the sum of the two sub-databases is the sum of the two missing data, and the difference between the sum of the squares of the two sub-databases is the sum of the squares of the two missing data.

[0085] It is worth mentioning that if three data are missing, then you can calculate another value and construct a new equation to calculate the missing data; however, under normal circumstances, multiple data are not missing. When the missing data reaches a certain threshold, it is often backed up again.

[0086] In a preferred embodiment of the technical solution of the present invention, when the first backup database is interrupted, the unfinished backup data is deleted; when the second backup database is interrupted, the unfinished backup data is stored within a preset time range. Example

[0087] Figure 6 The structure diagram of the database backup method system is shown. In the embodiment of the present invention, a database backup method, system, computer device and storage medium are provided. The system 10 includes:

[0088] The data splitting module 11 is used to receive a backup instruction containing a database address, locate a target database according to the database address, and split the data of the target database to obtain sub-databases;

[0089] The process number determination module 12 is used to obtain the configuration information of the hardware architecture and determine the number of primary backup processes and the number of secondary backup processes according to the configuration information;

[0090] A first backup module 13, configured to back up the sub-database according to the number of first-level backup processes to obtain a first backup database;

[0091] The second backup module 14 is used to back up the first backup database according to the number of secondary backup processes to obtain a second backup database;

[0092] The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; and the cache time of the second backup database is greater than that of the first backup database.

[0093] The functions that can be realized by the database backup method are all completed by a computer device, and the computer device includes one or more processors and one or more memories, and at least one program code is stored in the one or more memories. The program code is loaded and executed by the one or more processors to implement the data filtering method.

[0094] The processor takes out instructions from the memory one by one, analyzes the instructions, and then completes the corresponding operations according to the instruction requirements, generating a series of control commands, so that the various parts of the computer can automatically, continuously and coordinately move to become an organic whole, realize the input of programs, the input of data, and the calculation and output of results. The arithmetic operations or logical operations generated in this process are all completed by the operator; the memory includes a read-only memory (ROM), which is used to store computer programs, and a protection device is provided outside the memory.

[0095] Exemplarily, the computer program may be divided into one or more modules, one or more modules are stored in a memory and executed by a processor to implement the present invention. One or more modules may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program in a terminal device.

[0096] Those skilled in the art will understand that the description of the above service equipment is merely an example and does not constitute a limitation on the terminal equipment. It may include more or fewer components than described above, or a combination of certain components, or different components, for example, it may include input and output devices, network access devices, buses, etc.

[0097] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the terminal device, and uses various interfaces and lines to connect various parts of the entire user terminal.

[0098] The above-mentioned memory can be used to store computer programs and / or modules. The above-mentioned processor realizes various functions of the above-mentioned terminal device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as an information collection template display function, a product information release function, etc.), etc.; the data storage area can store data created according to the use of the berth status display system (such as product information collection templates corresponding to different product types, product information that different product providers need to release, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0099] If the module / unit integrated in the terminal device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable medium. Based on this understanding, the present invention implements all or part of the modules / units in the above-mentioned embodiment system, and can also be completed by instructing the relevant hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable medium, and the computer program can realize the functions of the above-mentioned various system embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0100] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0101] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A database backup method, characterized in that: The method comprises: Receive a backup instruction containing a database address, locate a target database according to the database address, and split data of the target database to obtain sub-databases; Obtaining configuration information of the hardware architecture, and determining the number of primary backup processes and the number of secondary backup processes according to the configuration information; Backing up the sub-database according to the number of first-level backup processes to obtain a first backup database; Backing up the first backup database according to the number of secondary backup processes to obtain a second backup database; The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; the cache time of the second backup database is greater than that of the first backup database; The step of backing up the sub-database according to the number of the first-level backup processes to obtain a first backup database comprises: Get the number of sub-databases, and create a new empty primary database set containing the number of sub-databases; Extracting data from the sub-database according to the number of the primary backup processes, and inputting the data into the sub-database in the primary database set; When the extraction process is completed, all data in the sub-database in the primary database set and the sub-database containing the original data are input into the XOR buffer area for XOR operation; When the XOR operation result is zero, the backup is completed. When the XOR operation result is not zero, the backup is restarted. The step of backing up the first backup database according to the number of secondary backup processes to obtain a second backup database comprises: Create a secondary database set that is the same as the primary database set, and when the backup of the sub-database in the primary database set is completed, back up the data in the sub-database that has completed the backup to the sub-database in the secondary database set; Calculate the sum and square sum of the data in the sub-database generated based on the target database, the sub-database in the primary database set, and the sub-database in the secondary database set respectively; Compare the three sets of calculation data. When the three sets of calculation data are the same, the backup is completed. When the calculation data of the sub-database in the primary database set is different, back up the sub-database in the primary database set again. When the calculation data of the sub-database in the secondary database set is different, back up the sub-database in the secondary database set again.

2. The database backup method according to claim 1, characterized in that: The step of receiving a backup instruction containing a database address, locating a target database according to the database address, and performing data splitting on the target database to obtain a sub-database includes: Receive the backup request containing the database address sent by the user, authenticate the user, and obtain the user level when the user passes the authentication; Reading the demand level of the target database according to the database address, and locating the target database when the user level reaches the demand level; Reading a sorting standard of data in a target database, and determining a file handle according to the sorting standard; The target database is split into sub-databases according to the file handles.

3. The database backup method according to claim 2, characterized in that: The step of splitting the target database into sub-databases according to the file handle comprises: Determine an offset according to a preset sub-database capacity, and read data in the target database in sequence according to the offset; wherein a difference between the offset and the sub-database capacity is less than a preset difference threshold; Determine whether the data is a file terminator, and when the data is a file terminator, mark the file terminator as a split point; When the data is not a file terminator, the data is read sequentially from the current offset until the file terminator or the database end identifier is read, and the file terminator or the database end identifier is marked as a split point; The target database is split into sub-databases according to the marked split points.

4. The database backup method according to claim 1, characterized in that: The first-level backup process number is the minimum value of the first process number, the second process number and the third process number, wherein the first process number is determined by the configuration information of the central processing unit of the hardware architecture; the second process number is determined by the input and output configuration information of the hardware architecture; and the third process number is determined according to the capacity of the sub-database and the number of the sub-databases.

5. The database backup method according to any one of claims 1 to 4, characterized in that: When the first backup database is interrupted, the unfinished backup data is deleted; when the second backup database is interrupted, the unfinished backup data is stored within a preset time range.

6. A database backup system, characterized in that: The system comprises: A data splitting module is used to receive a backup instruction containing a database address, locate a target database according to the database address, and split the data of the target database to obtain sub-databases; A process number determination module is used to obtain configuration information of the hardware architecture and determine the number of primary backup processes and the number of secondary backup processes according to the configuration information; A first backup module, used for backing up the sub-database according to the number of the first-level backup processes to obtain a first backup database; A second backup module, configured to back up the first backup database according to the number of secondary backup processes to obtain a second backup database; The number of the first-level backup processes is the same as the number of the second-level backup processes and is at least one; the cache time of the second backup database is greater than that of the first backup database; The step of backing up the sub-database according to the number of the first-level backup processes to obtain a first backup database comprises: Get the number of sub-databases, and create a new empty primary database set containing the number of sub-databases; Extracting data from the sub-database according to the number of the primary backup processes, and inputting the data into the sub-database in the primary database set; When the extraction process is completed, all data in the sub-database in the primary database set and the sub-database containing the original data are input into the XOR buffer area for XOR operation; When the XOR operation result is zero, the backup is completed. When the XOR operation result is not zero, the backup is restarted. The step of backing up the first backup database according to the number of secondary backup processes to obtain a second backup database comprises: Create a secondary database set that is the same as the primary database set, and when the backup of the sub-database in the primary database set is completed, back up the data in the sub-database that has completed the backup to the sub-database in the secondary database set; Calculate the sum and square sum of the data in the sub-database generated based on the target database, the sub-database in the primary database set, and the sub-database in the secondary database set respectively; Compare the three sets of calculation data. When the three sets of calculation data are the same, the backup is completed. When the calculation data of the sub-database in the primary database set is different, back up the sub-database in the primary database set again. When the calculation data of the sub-database in the secondary database set is different, back up the sub-database in the secondary database set again.

7. A computer device, characterized in that: The computer device includes one or more processors and one or more memories, wherein at least one program code is stored in the one or more memories, and when the program code is loaded and executed by the one or more processors, the database backup method according to any one of claims 1 to 5 is implemented.

8. A storage medium, characterized in that: The storage medium stores at least one program code, and when the program code is loaded and executed by the processor, the database backup method according to any one of claims 1 to 5 is implemented.

Images