Multi-region data processing method and device of distributed storage system and electronic equipment
A distributed storage and data processing technology, which is applied in the fields of digital data processing, input/output process of data processing, error detection of redundant data in operation, etc. Large storage space, large network width consumption and other problems, to achieve the effect of shortening data synchronization time, ensuring data security, and reducing storage space occupation
Pending Publication Date: 2020-05-05
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF4 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In related technologies, although multi-regional data synchronization is realized, a large network bandwidth must be occupied in the process of realizing multi-regional data synchronization, which requires very high network construction and operation and maintenance costs
For other multi-region data synchronization schemes, for the same data, different regions store three copies of the data. For example, it is necessary to synchronize the data of three copies in region 1 to the three copies in region 2, so it needs to occupy Larger storage space, and data synchronization requires three copies of data interaction at the same time, and the consumption of network width is also large
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
example 1
[0117] Example 1: When it is determined that there is data loss in the primary copy, data recovery is performed on the primary copy based on the secondary copy (step 202); when it is determined that there is also data loss in the secondary copy, data recovery is performed on the primary copy based on the delayed copy (step 204).
example 2
[0118] Example 2: When it is determined that there is data loss in the slave copy, data recovery is performed on the slave copy based on the master copy (step 302); when it is determined that there is also data loss in the master copy, data recovery is performed on the slave copy based on the delayed copy (step 304).
example 3
[0119] Example 3: When it is determined that the temporary copy is missing, perform data recovery on the temporary copy based on the primary copy (step 402); when it is determined that the primary copy also has data loss, perform data recovery on the temporary copy based on the secondary copy (step 404).
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a multi-region data processing method and device of a distributed storage system, electronic equipment and a computer readable storage medium. The method comprises the steps: when a data writing request is received, writing data into a first storage server located in a first area to obtain a main copy of the data; respectively synchronizing the data of the master copy to asecond storage server and a third storage server in the first area to respectively obtain a slave copy and a temporary copy of the data; and synchronizing the data of the temporary copy to a fourth storage server located in a second area to obtain a delayed copy of the data. According to the invention, a multi-region function can be realized with relatively low economic cost and storage cost.
Description
technical field [0001] The invention relates to the field of distributed storage, in particular to a multi-region data processing method, device and electronic equipment of a distributed storage system. Background technique [0002] Most distributed file systems do not support multi-region (Region) data synchronization, and three copies of data are placed in one or more availability zones (AZ, availability zone). When a regional failure occurs, the data deployed in a single region may be damaged. For example, the data in the faulty region may be damaged or lost, seriously affecting the data security and stability of the distributed file system. [0003] Such as figure 1 As shown, it is a multi-regional architecture, which can include multiple regions, such as region 1, region 2 ... region n, and each region can include at least one availability zone, where a region is a physical geographical region (for example, North China region, South China region), and the availability...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/14
CPCG06F3/062G06F3/0643G06F3/065G06F3/0652G06F3/067G06F11/1469G06F21/6218
Inventor 甘红星
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD