Fault-tolerant coding method, device and system for improving expandability of data deduplication system
A fault-tolerant coding and scalability technology, applied in the field of computer storage
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0043] A fault-tolerant encoding method to improve the scalability of data deduplication systems, such as figure 1 shown, including:
[0044] When adding Δk=1 node in the data deduplication system, each k+Δk=3 containers with local associations are divided into an associative container group, and the encoding method is extended from RS(2,2) to RS (3,2); The newly added node is node 4, such as figure 1 As shown, three containers are used as an associated container group, denoted as G;
[0045] for figure 1 In the associated container group G, select one of the containers, that is, the third container, as the container to be migrated, and transfer the two data blocks D in the container to be migrated 5 and D 6 Evenly migrate to the newly added nodes; for each unmigrated container C in the associated container group G, that is, the first container or the second container, select a data block from each newly added node and the data block in the container C The combination of ...
Embodiment 2
[0069]A fault-tolerant coding device for improving the scalability of a data deduplication system, comprising: an associated container group division module, a data block migration module, an extended coding module, and a garbage collection module;
[0070] Associative container group division module, used to divide every 3 containers with locality association into an associative container group when adding 1 node in the data deduplication system, and extend the coding method from RS(2,2) is RS(3,2);
[0071] The data block migration module is used to, for each associated container group G, select one of the containers as the container to be migrated, and evenly migrate a total of two data blocks in the container to be migrated to one newly added node;
[0072] The extended encoding module is used to select a data block from each newly added node and combine it with the data block in container C for each unmigrated container C in the associated container group G to obtain 3 da...
Embodiment 3
[0076] A data deduplication system, the data deduplication system includes the error-tolerant encoding device provided in the second embodiment to improve the scalability of the data deduplication system.
[0077] Generally speaking, the fault-tolerant coding method, device and system provided by the present invention to improve the scalability of the data deduplication system, when the cluster expansion occurs, the expansion efficiency is greatly increased compared with the traditional coding expansion efficiency in the container, and the expansion efficiency of the cluster is improved. While scaling performance, it guarantees the degraded read and node recovery performance of the system, and at the same time has lower storage overhead compared with inter-container encoding.
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com