Erasable encoding and chained type backup-based distributed storage system

Abstract

The invention discloses an erasable encoding and chained type backup-based distributed storage system. The erasable encoding and chained backup-based distributed storage system includes a proxy server cluster composed of a plurality of proxy servers and an object storage cluster composed of a plurality of physical storage nodes. According to the devices, a traditional chained type backup method and encoding erasable storage method which are applied to the distributed storage system are combined together, so that excellent balance between reading and writing performance and storage space efficiency can be realized. Compared with a traditional multi-duplicate backup method, the devices of the invention can greatly reduce storage cost and maintain equally efficient reading and writing response performance; and compared with a pure encoding erasable storage scheme, the devices of the invention greatly improve the reading and writing efficiency of data objects and enhance the availability of the distributed storage system.

Description

technical field [0001] The invention belongs to the technical field of computer information management, and in particular relates to a distributed storage system based on erasable coding and chain backup. Background technique [0002] With the further popularization and in-depth application of cloud computing and mobile Internet, various online applications and services are playing a more important role in all walks of life. is growing at an explosive rate. Cloud storage technology is the cornerstone of cloud computing technology. The underlying data management, data storage, and the stability and efficiency of data processing systems all directly affect the operation of upper-level applications. The database and file system in the traditional sense can no longer meet the massive cross-border data storage needs, especially in some important application fields, such as medical, financial, government affairs and other systems, the availability of system data for system users,...

AI Technical Summary

Problems solved by technology

But as mentioned above, in the era of big data where the amount of data is increasing rapidly, the chain backup method shows its biggest disadvantage: extremely high storage space overhead

Erasable coding has attracted more and more attention because of its outstanding space efficiency, but it also has serious disadvantages: every time an object is read and written, the encoding and decoding procedures must be started, and the computing overhead of the CPU is related to the node. The transmission network overhead between them will greatly reduce the efficiency of the system in responding to customer requests and become the bottleneck of system throughput.

Therefore, although erasure coding can reduce the high space overhead caused by chain backup, it cannot meet the high and good system response efficiency

Images