Database disaster processing and drilling method and device, equipment and medium

Abstract

The invention discloses a disaster processing and drilling method and device for a database, equipment and a medium. The method comprises the following steps: when network connection with a local machine room is abnormal or a construction instruction is received, selecting a target standby data node from standby data nodes of a current machine room; carrying out snapshot storage on the target standby data node; and the target standby data node after snapshot storage is accessed to a management node of an island generation platform to obtain an island database system, and a service providing object of the island database system is a city where a corresponding machine room is located. According to the embodiment of the invention, services can be independently provided for each city when a disaster occurs, and the disaster recovery drill cost is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of database disaster recovery, and in particular to a method, device, equipment and medium for handling and rehearsing database disasters. Background Art

[0002] A high-availability database system is one that can provide continuous services and keep running even when part of the system fails. The design goal of this type of system is to minimize the risk of downtime and data loss, and ensure the continuity of critical business applications and the persistence of data.

[0003] There are many database high availability technologies on the market, most of which are switching between production environment and disaster recovery environment. This method not only affects the normal operation of the business, but also cannot provide services to the outside world in both production and disaster recovery environments at the same time. When a city-level disaster occurs, that is, when the network between the local and remote locations is interrupted, it is impossible to provide services to both local and remote locations at the same time, resulting in some users being unable to use the system normally. In addition, in the switching drill scenario, the existing switching method is costly, and the business will be interrupted during the switching, affecting normal use, and the drill cost is too high. Summary of the invention

[0004] The present invention provides a method, device, equipment and medium for handling and rehearsing disasters of a database, so as to independently provide services for each city when a disaster occurs and reduce the cost of disaster recovery rehearsals.

[0005] According to one aspect of the present invention, a database disaster handling and drill method is provided, comprising:

[0006] When the network connection with the local computer room is abnormal or a build instruction is received, a target standby data node is selected from the standby data nodes in the current computer room;

[0007] Saving a snapshot of the target standby data node;

[0008] The target backup data node after the snapshot is saved is connected to the management node of the isolated island generation platform to obtain an isolated island database system; wherein the service provider of the isolated island database system is the city where the corresponding computer room is located.

[0009] According to another aspect of the present invention, there is provided a database disaster handling and drill device, comprising:

[0010] A node selection module is used to select a target standby data node from the standby data nodes in the current computer room when the network connection with the local computer room is abnormal or a build instruction is received;

[0011] A snapshot saving module, used to save a snapshot of the target standby data node;

[0012] The node access module is used to connect the target backup data node after the snapshot is saved to the management node of the island generation platform to obtain the island database system; wherein the service provider of the island database system is the city where the corresponding computer room is located.

[0013] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the database disaster handling and drill method according to any embodiment of the present invention.

[0014] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the database disaster handling and drill method described in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the database disaster handling and drill method described in any embodiment of the present invention when executed.

[0019] The embodiment of the present invention selects backup data nodes from the high-availability database system to form an island database system, which provides external services to the city independently. Based on the snapshot, the backup data nodes can also automatically restore data and rejoin the production environment, without affecting the production business, facilitating maintenance and saving resources.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1Ais a flow chart of a database disaster handling and drill method provided according to an embodiment of the present invention;

[0023] Figure 1B is a schematic diagram of the structure of a high-availability database provided according to an embodiment of the present invention;

[0024] Figure 2 is a flow chart of a database disaster handling and drill method provided according to another embodiment of the present invention;

[0025] Figure 3 is a schematic structural diagram of a database disaster handling and drill method provided according to another embodiment of the present invention;

[0026] Figure 4 It is a schematic diagram of the structure of an electronic device implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] Figure 1A This is a flowchart of a database disaster handling and drill method provided by an embodiment of the present invention. This embodiment can be applied to high-availability databases in multiple locations and centers to ensure that they can still provide normal services to the outside world when a disaster occurs or during a drill. The method can be executed by a database disaster handling and drill device, which can be implemented in the form of hardware and / or software. The device can be configured in an electronic device with corresponding data processing capabilities, such as a computer room in the same city or a computer room in a different location. Figure 1AAs shown, the method includes:

[0030] S110, when the network connection with the local computer room is abnormal or a construction instruction is received, selecting a target standby data node from the standby data nodes in the current computer room;

[0031] S120, saving a snapshot of the target standby data node;

[0032] S130: Connect the target standby data node after the snapshot is saved to the management node of the isolated island generation platform to obtain an isolated island database system.

[0033] The service provider of the isolated database system is the city where the corresponding computer room is located. If the corresponding computer room is a local computer room, the service provider is the local city; if the corresponding computer room is a remote computer room, the service provider is the remote city. That is, the isolated database system only provides services to the city where it is located, not to other cities, and no longer synchronizes data with other computer rooms. Figure 1B As shown, the remote computer room and the local computer room are deployed in different cities, the computer room in the same city and the local computer room are deployed in the same city, and the backup data node corresponding to the master data node in the local computer room is deployed in the computer room in the same city or the remote computer room, and the computer room in the same city, the remote computer room and the local computer room are all components of the high-availability database system. When the high-availability database system operates normally, the local computer room provides services to all cities such as City 1, City 2, and City 3. The computer room in the same city is the local computer room's backup in the same city, and the remote computer room is the remote backup of the local computer room.

[0034] Specifically, an island generation platform is deployed in advance in each local computer room and each remote computer room of the high-availability database system. The island generation platform will continuously monitor the network connection between the computer room where it is located and the local computer room. When the network connection is abnormal or a construction instruction is received from the front end, the platform will build the island database system.

[0035] The first step of construction: According to the pre-set selection rules, select the target backup data node required for construction from all the backup data nodes in the current computer room. Some examples of selection rules are as follows: 1. The selected target backup data node should be the backup data node with the latest data synchronization to ensure data consistency and integrity; 2. The selected target backup data node needs to be able to maintain connectivity with the outside world through the network for data synchronization and business recovery; 3. The selected target backup data node should have sufficient computing and storage resources to bear business traffic and ensure service continuity; 4. There may be multiple backup data nodes, and the target backup data node needs to be selected from them according to the preset priority or load balancing strategy; 5. According to the established disaster recovery protocol and strategy, select the target backup data node that needs to be enabled first.

[0036] Step 2 of the construction: Since the island database system is only a temporary system, after the network connection with the local computer room is normal or the recovery command issued by the front end is received, the island database system needs to be restored to its initial state, and the selected target standby data nodes also need to resume work. Therefore, for the selected target standby data nodes, snapshots of these target standby data nodes need to be generated and saved so that the target standby data nodes can be restored to the state before the construction later.

[0037] The third step of construction: To facilitate maintenance and save resources, and to avoid actually shutting down the production database system during drills, normal production operations will not be affected by drills. The island generation platform does not have any data nodes at ordinary times, but only a small number of management nodes that occupy relatively few resources. Only when it is necessary to build an island database system, the platform will connect the processed (snapshot saved) target backup data nodes to the management nodes in the island generation platform to complete the construction of the island database system. Before communication is restored to normal or a revocation command is received, the island database system will replace the local computer room in the city where the current computer room is located to provide services in the city where it is located.

[0038] The embodiment of the present invention selects backup data nodes from the high-availability database system to form an island database system, which provides external services to the city independently. Based on the snapshot, the backup data nodes can also automatically restore data and rejoin the production environment, without affecting the production business, facilitating maintenance and saving resources.

[0039] Figure 2 This is a flowchart of a database disaster handling and drill method provided by another embodiment of the present invention. This embodiment is optimized and improved on the basis of the above embodiment. Figure 2 As shown, the method includes:

[0040] S210: When the network connection with the local computer room is abnormal or a building instruction is received, a target standby data node is selected from the standby data nodes in the current computer room.

[0041] S220: Generate a global transaction identifier snapshot of the target standby data node, and roll back the target standby data nodes of different shards to a consistency moment.

[0042] Among them, the Global Transaction Identifier (GTID) is a string of numbers or strings used to uniquely identify a single transaction in a database system. GTID is usually used in a distributed database environment and is often used in the data replication and recovery process in the database to ensure the global uniqueness of the transaction.

[0043] Specifically, the global transaction identifier mode of the standby data nodes in each computer room is set to the on state in advance, so that a globally unique GTID is generated for each transaction when the database is working. When a snapshot needs to be generated, an SQL query is used to obtain a set of all GTIDs that have been executed on the target standby data node, and the query results are exported as a file, which contains the GTID snapshot of the target standby data node.

[0044] Suspend new write operations on all target standby data nodes to avoid data inconsistency during the rollback process. Export the current database state, including the current transaction log, on each target standby data node. Find the transaction log corresponding to the most recent consistency moment and generate a rollback script based on the transaction log. Execute the rollback script on all target standby data nodes, and gradually undo all changes since the consistency moment according to the rollback script to complete the data rollback when building an isolated database system. In addition, if there are slave nodes or shards, restart the replication process to ensure that the data of all nodes remains synchronized.

[0045] S230, connecting the target backup data node after the snapshot is saved to the management node of the isolated island generation platform to obtain an isolated island database system, wherein the service provider of the isolated island database system is the city where the corresponding computer room is located.

[0046] S240. When a recovery instruction is received, clear the replication relationship between the target standby data node and the corresponding primary data node; and roll back the target standby data node to the state at the time of snapshot generation according to the global transaction identifier snapshot.

[0047] S250: Detach the target standby data node from the management node and reconnect it to the production environment.

[0048] Specifically, upon receiving the recovery command from the front-end, the platform recovers the isolated database system. The recovery process is also divided into three steps:

[0049] First, clear the replication relationship between the target backup data node and its corresponding primary data node to ensure that the recovery process does not affect the primary data node.

[0050] The second is to roll back the standby data node to the state before the island database system is built according to the global transaction identifier snapshot saved during the construction.

[0051] The third is to control the target backup data node to be separated from the management node of the island generation platform and reconnected to the production environment.

[0052] Optionally, the network connection anomaly includes a network interruption with a local computer room, and a network delay with a local computer room that continues to exceed a set threshold; the build instruction and the recovery instruction are issued by a user through a front-end interface.

[0053] Specifically, a front-end interface is deployed in advance for the island generation platform, and the front-end interface and the island generation platform communicate with each other. Users can manually trigger the build and restore process in the front-end page, and the front-end interface will send the corresponding build / instructions to the island generation platform.

[0054] The embodiment of the present invention allows the user to manually trigger the construction and recovery process in the front-end page, so as to facilitate the user to perform fast and efficient disaster recovery drills.

[0055] Figure 3 A schematic diagram of the structure of a database disaster handling and drill device provided by another embodiment of the present invention. Figure 3 As shown, the device comprises:

[0056] The node selection module 310 is used to select a target standby data node from the standby data nodes in the current computer room when the network connection with the local computer room is abnormal or a construction instruction is received;

[0057] A snapshot saving module 320, configured to save a snapshot of the target standby data node;

[0058] The node access module 330 is used to connect the target backup data node after the snapshot is saved to the management node of the island generation platform to obtain an island database system; wherein the service provider of the island database system is the city where the corresponding computer room is located.

[0059] The database disaster handling and drill device provided in the embodiment of the present invention can execute the database disaster handling and drill method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0060] Optionally, the snapshot saving module 310 is specifically used to: generate a global transaction identifier snapshot of the target standby data node, and roll back the target standby data nodes of different shards to a consistent moment.

[0061] Optionally, the device further comprises:

[0062] A relationship clearing module, used to clear the replication relationship between the target backup data node and the corresponding primary data node when receiving a recovery instruction;

[0063] A data rollback module, used to roll back the target standby data node to the state at the moment of snapshot generation according to the global transaction identifier snapshot;

[0064] The node separation module is used to separate the target standby data node from the management node and reconnect it to the production environment.

[0065] Optionally, the network connection anomaly includes a network interruption with a local computer room, and a network delay with a local computer room that continues to exceed a set threshold; the build instruction and the recovery instruction are issued by a user through a front-end interface.

[0066] Optionally, a backup data node corresponding to the primary data node in the local computer room is deployed in the same-city computer room or the remote computer room, the remote computer room and the local computer room are deployed in different cities, the same-city computer room and the local computer room are deployed in the same city, and the same-city computer room, the remote computer room and the local computer room are all components of a high-availability database system.

[0067] The database disaster handling and drill device further described can also execute the database disaster handling and drill method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0068] Figure 4 A schematic diagram of the structure of an electronic device 40 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0069] like Figure 4 As shown, the electronic device 40 includes at least one processor 41, and a memory connected to the at least one processor 41, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 to the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the electronic device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0070] A number of components in the electronic device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0071] The processor 41 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 executes the various methods and processes described above, such as disaster handling and drill methods for databases.

[0072] In some embodiments, the disaster handling and exercise method of the database may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded into the RAM 43 and executed by the processor 41, one or more steps of the disaster handling and exercise method of the database described above may be performed. Alternatively, in other embodiments, the processor 41 may be configured to execute the disaster handling and exercise method of the database by any other appropriate means (e.g., by means of firmware).

[0073] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0074] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0075] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0076] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0077] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0078] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0079] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0080] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A database disaster handling and drill method, characterized in that: Applied to a computer room in the same city or a computer room in a different city, the method includes: When the network connection with the local computer room is abnormal or a build instruction is received, a target standby data node is selected from the standby data nodes in the current computer room; Saving a snapshot of the target standby data node; The target backup data node after the snapshot is saved is connected to the management node of the isolated island generation platform to obtain an isolated island database system; wherein the service provider of the isolated island database system is the city where the corresponding computer room is located.

2. The method according to claim 1, characterized in that The storing of a snapshot of the target standby data node includes: A global transaction identifier snapshot of the target standby data node is generated, and the target standby data nodes of different shards are rolled back to a consistency moment.

3. The method according to claim 2, characterized in that After the target backup data node after the snapshot is saved is connected to the management node of the isolated island generation platform to obtain the isolated island database system, the method further includes: When receiving the recovery instruction, clearing the replication relationship between the target standby data node and the corresponding primary data node; Rolling back the target standby data node to the state at the time of snapshot generation according to the global transaction identifier snapshot; The target standby data node is separated from the management node and reconnected to the production environment.

4. The method according to claim 2, characterized in that: The network connection anomaly includes a network interruption with the local computer room, and a network delay with the local computer room that continues to exceed a set threshold; the construction instruction and the recovery instruction are issued by the user through the front-end interface.

5. The method according to claim 1, characterized in that: The backup data node corresponding to the main data node in the local computer room is deployed in the same-city computer room or the remote computer room. The remote computer room and the local computer room are deployed in different cities. The same-city computer room and the local computer room are deployed in the same city. The same-city computer room, the remote computer room and the local computer room are all components of the high-availability database system.

6. A database disaster handling and drill device, characterized in that: Deployed in a local computer room or a remote computer room, the device includes: A node selection module is used to select a target standby data node from the standby data nodes in the current computer room when the network connection with the local computer room is abnormal or a build instruction is received; A snapshot saving module, used to save a snapshot of the target standby data node; The node access module is used to connect the target backup data node after the snapshot is saved to the management node of the island generation platform to obtain the island database system; wherein the service provider of the island database system is the city where the corresponding computer room is located.

7. The device according to claim 6, characterized in that The snapshot saving module is specifically used to generate a global transaction identifier snapshot of the target standby data node, and roll back the target standby data nodes of different shards to a consistency moment.

8. The device according to claim 7, characterized in that The device also includes: A relationship clearing module, used to clear the replication relationship between the target backup data node and the corresponding primary data node when receiving a recovery instruction; A data rollback module, used to roll back the target standby data node to the state at the moment of snapshot generation according to the global transaction identifier snapshot; The node separation module is used to separate the target standby data node from the management node and reconnect it to the production environment.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the disaster handling and drill method for the database according to any one of claims 1-5.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the disaster handling and drill method for a database according to any one of claims 1 to 5 when executed.

Images