Data sharing service fault tolerance method and system based on cluster verification

Abstract

The invention relates to a data sharing service fault tolerance method and system based on cluster verification, and the method comprises the steps: configuring a data cluster, and extracting first target data according to a data sharing request, the first target data is used for executing a data sharing updating operation on each data node in the first data cluster, the second target data is used for executing a data sharing updating operation on other data clusters, and a distributed transaction and data replication technology is adopted to synchronize a data operation result to a plurality of nodes so as to ensure the consistency of the data; the method has incremental backup and differential backup capabilities, so that the efficiency can be improved and the backup time can be reduced when a large amount of data is backed up, and the reliability, availability, data security and privacy protection capabilities of the system are improved, thereby providing more stable, reliable and secure information sharing services for users.

Description

Technical Field

[0001] The present invention relates to the technical fields of data backup, data fault tolerance, and data security protection, and particularly relates to a data sharing service fault tolerance method and system based on cluster verification. Background Art

[0002] Fault tolerance and disaster recovery of an information sharing service system refer to establishing two or more sets of IT systems with the same functions in different locations far apart, which can monitor the health status and switch functions with each other. When one system stops working due to an accident (such as a fire, earthquake, etc.), the entire application system can switch to another location so that the system functions can continue to work normally. This technology can improve the reliability and stability of the system and avoid data loss and service interruption caused by single-point failures. The key technologies for current information sharing service system fault tolerance and disaster recovery include redundancy, fault tolerance, and backup. Increasing redundancy can be achieved by establishing multiple sets of IT systems with the same functions in different locations far apart, so that they can monitor and switch with each other to ensure the normal operation of the system. Fault tolerance means that the service can still be provided normally even if errors occur during operation (such as upstream and downstream failures or probabilistic failures), which can be achieved by switching to several more backups. Backup is an important means of disaster recovery, including full backup, incremental backup, and differential backup, etc., which can ensure the integrity and reliability of data.

[0003] Fault tolerance and disaster recovery of an information sharing service system can be divided into three levels: data disaster recovery, application disaster recovery, and business disaster recovery. Data disaster recovery refers to the remote backup of data. When a disaster occurs, only data loss is guaranteed to be avoided, but the business will be interrupted and slowly restored. Application disaster recovery builds a set of the same application systems on the basis of data backup or synchronization, which involves not only data but also hosts, networks, storage, OS, software, etc. When a disaster occurs, the business can be quickly restored or even not interrupted. Business disaster recovery includes not only IT application systems but also office sites, telephone communications, logistics support, etc., and everything related to the business should be considered.

[0004] There are still some deficiencies in the existing information sharing service systems when implementing the fault tolerance and disaster recovery functions: multiple users or nodes may operate on data simultaneously. If the system does not take corresponding measures, it may lead to data inconsistency. If the system fails or a disaster occurs and there are not enough backup and recovery measures, it may lead to data loss or damage, bringing serious impacts to enterprises and users; if the system does not have high availability and scalability, when a single node or server fails, the availability of the entire system may be affected, resulting in business interruption or efficiency decline; if the system does not have strong security measures and privacy protection capabilities, it may lead to security problems such as data leakage, tampering, or forgery, bringing serious losses to enterprises and users. Summary of the Invention

[0005] To address the deficiencies in the prior art, the present invention proposes a data sharing service fault-tolerant method and system based on cluster verification, which adopts distributed transaction and data replication technology to synchronize the results of data operations to multiple nodes to ensure data consistency, and has the capabilities of incremental backup and differential backup, so as to improve efficiency and reduce backup time when backing up large amounts of data, improve system reliability, availability, data security and privacy protection capabilities, thereby providing users with more stable, reliable and secure information sharing services.

[0006] To achieve the above objectives, the technical solutions adopted by the present invention include:

[0007] A data sharing service fault tolerance method based on cluster verification, characterized by comprising:

[0008] S1. Configure a data cluster, where the data cluster includes a number of data nodes, and the data nodes are added with cluster labels corresponding to the data clusters to which they belong;

[0009] S2. Obtain a data sharing request, extract first target data according to the data sharing request, and obtain a corresponding first cluster label according to the first data node that initiates the data sharing request;

[0010] S3, acquiring the corresponding first data cluster according to the first cluster label, and performing a data sharing update operation on each data node in the first data cluster using the first target data;

[0011] S4, randomly select a data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data;

[0012] S5. When it is determined that the selected data node matches the first target data, marking the first target data as the second target data;

[0013] S6. When it is determined that the selected data node does not match the first target data, use the first data node as the second target data to perform a data sharing update operation on each data node in the first data cluster;

[0014] S7. Use the second target data to perform a data sharing update operation on other data clusters.

[0015] Furthermore, the obtaining of the data sharing request includes:

[0016] Determine whether there is an updated data item;

[0017] When it is determined that there is an updated data item, a data sharing request is generated according to the updated data item.

[0018] Further, the performing of the data sharing update operation includes:

[0019] Match the target data with the data nodes, and update the data nodes accordingly.

[0020] Further, the performing of the data verification operation includes:

[0021] Determine whether the data node contains all data items of the first data node.

[0022] The present invention also relates to a data sharing service fault-tolerant system based on cluster verification, which is characterized by comprising:

[0023] The cluster management module is used to configure the data cluster and add cluster labels corresponding to the data cluster to which the data nodes belong;

[0024] A cluster matching module, configured to extract the first target data according to the data sharing request, and obtain the corresponding first cluster label according to the first data node that initiates the data sharing request;

[0025] A first data sharing execution module, configured to execute a data sharing update operation on each data node in the first data cluster using the first target data;

[0026] A data verification module, used to select a data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data;

[0027] The second data sharing execution module is used to execute a data sharing update operation on other data clusters using the second target data.

[0028] The present invention also relates to a computer-readable storage medium, characterized in that a computer program is stored on the storage medium, and the computer program implements the above method when executed by a processor.

[0029] The present invention also relates to an electronic device, characterized in that it comprises a processor and a memory;

[0030] The memory is used to store data clusters and data sharing requests;

[0031] The processor is used to execute the above method by calling the data cluster and the data sharing request.

[0032] The present invention also relates to a computer program product, comprising a computer program and / or instructions, characterized in that the computer program and / or instructions implement the steps of the above method when executed by a processor.

[0033] The beneficial effects of the present invention are:

[0034] The cluster-verification-based data sharing service fault-tolerant method and system described in the present invention adopts distributed transaction and data replication technology to synchronize the results of data operations to multiple nodes to ensure data consistency, and has the capabilities of incremental backup and differential backup, so as to improve efficiency and reduce backup time when backing up large amounts of data, improve system reliability, availability, data security and privacy protection capabilities, thereby providing users with more stable, reliable and secure information sharing services. DETAILED DESCRIPTION

[0035] In order to more clearly understand the content of the present invention, it will be described in detail with reference to the embodiments.

[0036] A first aspect of the present invention relates to a data sharing service fault tolerance method based on cluster verification, comprising:

[0037] S1. Configure a data cluster, where the data cluster includes a number of data nodes, and the data nodes are added with cluster labels corresponding to the data clusters to which they belong.

[0038] S2. Obtain a data sharing request, extract first target data according to the data sharing request, and obtain a corresponding first cluster label according to a first data node that initiates the data sharing request.

[0039] Preferably, obtaining the data sharing request includes: determining whether there is an updated data item; and generating a data sharing request based on the updated data item when it is determined that there is an updated data item.

[0040] S3. Acquire a corresponding first data cluster according to the first cluster label, and use the first target data to perform a data sharing update operation on each data node in the first data cluster.

[0041] Preferably, executing the data sharing update operation includes: matching the target data with the data node, and updating the data node according to the target data.

[0042] S4. Select any data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data.

[0043] Preferably, performing the data verification operation includes: determining whether the data node contains all data items of the first data node.

[0044] S5. When it is determined that the selected data node matches the first target data, the first target data is marked as the second target data.

[0045] S6. When it is determined that the selected data node does not match the first target data, use the first data node as the second target data to perform a data sharing update operation on each data node in the first data cluster.

[0046] S7. Use the second target data to perform a data sharing update operation on other data clusters.

[0047] Another aspect of the present invention also relates to a data sharing service fault-tolerant system based on cluster verification, comprising:

[0048] The cluster management module is used to configure the data cluster and add cluster labels corresponding to the data cluster to which the data nodes belong;

[0049] A cluster matching module, configured to extract the first target data according to the data sharing request, and obtain the corresponding first cluster label according to the first data node that initiates the data sharing request;

[0050] A first data sharing execution module, configured to execute a data sharing update operation on each data node in the first data cluster using the first target data;

[0051] A data verification module, used to select a data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data;

[0052] The second data sharing execution module is used to execute a data sharing update operation on other data clusters using the second target data.

[0053] By using this system, the above-mentioned operation processing method can be executed and the corresponding technical effects can be achieved.

[0054] An embodiment of the present invention also provides a computer-readable storage medium capable of implementing all the steps in the method in the above embodiment, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, all the steps in the method in the above embodiment are implemented.

[0055] An embodiment of the present invention also provides an electronic device for executing the above method. As an implementation device of the method, the electronic device has at least a processor and a memory, and in particular, the memory stores data and related computer programs required for executing the method, such as data clusters and data sharing requests, etc., and the processor calls the data and programs in the memory to execute all the steps of the implementation method and obtains the corresponding technical effects.

[0056] Preferably, the electronic device may include a bus architecture. The bus may include any number of interconnected buses and bridges, which link together various circuits including one or more processors and memories. The bus may also link together various other circuits such as peripheral devices, voltage regulators, and power management circuits, etc., which are well known in the art, and thus will not be further described herein. The bus interface provides an interface between the bus and the receiver and transmitter. The receiver and transmitter may be the same element, i.e., a transceiver, which provides a unit for communicating with various other systems over a transmission medium. The processor is responsible for managing the bus and general processing, while the memory may be used to store data used by the processor when performing operations.

[0057] Additionally, the electronic device may further include components such as a communication module, an input unit, an audio processor, a display, a power supply, etc. The processor (or referred to as a controller, operation control) employed may include a microprocessor or other processor devices and / or logic devices, which receive inputs and control the operations of the various components of the electronic device; the memory may be one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices, which can store the above-mentioned relevant data information, and can also store programs for executing relevant information, and the processor can execute the programs stored in the memory to implement information storage or processing, etc.; the input unit is used to provide inputs to the processor, for example, it can be a key or a touch input device; the power supply is used to provide power to the electronic device; the display is used to display display objects such as images and texts, for example, it can be an LCD display. The communication module is a transmitter / receiver that transmits and receives signals via an antenna. The communication module (transmitter / receiver) is coupled to the processor to provide input signals and receive output signals, which can be the same as in the case of a conventional mobile communication terminal. Based on different communication technologies, multiple communication modules can be provided in the same electronic device, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module, etc. The communication module (transmitter / receiver) is also coupled to the speaker and microphone via the audio processor to provide audio output via the speaker and receive audio input from the microphone, thereby implementing normal telecommunication functions. The audio processor may include any suitable buffer, decoder, amplifier, etc. Additionally, the audio processor is also coupled to the central processor, so that recording can be performed on the local machine through the microphone, and the sound stored on the local machine can be played through the speaker.

[0058] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) that contain computer-usable program code.

[0059] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate a system for implementing the functions specified in one or more flows in the flowchart and / or one or more blocks in the block diagram.

[0060] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including an instruction system that implements the functions specified in one or more flows in the flowchart and / or one or more blocks in the block diagram.

[0061] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more flows in the flowchart and / or one or more blocks in the block diagram. Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they know the basic creative concepts. Therefore, the appended claims are intended to be construed as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0062] The above description is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A data sharing service fault tolerance method based on cluster verification, It is characterized in that include: S1. Configure a data cluster, where the data cluster includes a number of data nodes, and the data nodes are added with cluster labels corresponding to the data clusters to which they belong; S2. Obtain a data sharing request, extract first target data according to the data sharing request, and obtain a corresponding first cluster label according to the first data node that initiates the data sharing request; S3, acquiring the corresponding first data cluster according to the first cluster label, and performing a data sharing update operation on each data node in the first data cluster using the first target data; S4, randomly select a data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data; S5. When it is determined that the selected data node matches the first target data, marking the first target data as the second target data; S6. When it is determined that the selected data node does not match the first target data, use the first data node as the second target data to perform a data sharing update operation on each data node in the first data cluster; S7. Use the second target data to perform a data sharing update operation on other data clusters.

2. The method according to claim 1, It is characterized in that The obtaining of data sharing request comprises: Determine whether there is an updated data item; When it is determined that there is an updated data item, a data sharing request is generated according to the updated data item.

3. The method according to claim 1, It is characterized in that The executing data sharing update operation comprises: Match the target data with the data nodes, and update the data nodes accordingly.

4. The method according to claim 1, It is characterized in that The performing of the data verification operation comprises: Determine whether the data node contains all data items of the first data node.

5. A data sharing service fault-tolerant system based on cluster verification, It is characterized in that include: The cluster management module is used to configure the data cluster and add cluster labels corresponding to the data cluster to which the data nodes belong; A cluster matching module, configured to extract the first target data according to the data sharing request, and obtain the corresponding first cluster label according to the first data node that initiates the data sharing request; A first data sharing execution module, configured to execute a data sharing update operation on each data node in the first data cluster using the first target data; A data verification module, used to select a data node in the first data cluster to perform a data verification operation to determine whether the selected data node matches the first target data; The second data sharing execution module is used to execute a data sharing update operation on other data clusters using the second target data.

6. A computer-readable storage medium, It is characterized in that The storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

7. An electronic device, It is characterized in that including a processor and a memory; The memory is used to store data clusters and data sharing requests; The processor is used to execute the method according to any one of claims 1 to 4 by calling a data cluster and a data sharing request.

8. A computer program product comprising a computer program and / or instructions, wherein, when the computer program and / or instructions are executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.