Distributed storage method and distributed storage system
A distributed storage and metadata node technology, applied in transmission systems, electrical components, etc., can solve problems such as inconvenient maintenance, system failure, and reduced reliability of distributed systems, and achieve the effect of easy maintenance and high availability
Active Publication Date: 2018-05-01
SUZHOU KEDA TECH
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] 1) The separation of Paxos services and metadata nodes is cumbersome to deploy and inconvenient to maintain;
[0005] 2) The Paxos consensus algorithm is not only difficult to understand but also difficult to implement and apply
Since the details of the Paxos algorithm are difficult to fully understand, developers cannot fully realize and apply all the functions of the Paxos algorithm, which leads to a decrease in the reliability of the distributed system based on the Paxos algorithm;
[0006] 3) When the global Paxos service or the high availability cluster (High Availability Cluster, HA cluster) composed of metadata nodes fails, the entire system will be paralyzed, and the data will face the risk of complete loss
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0033] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar structures in the drawings, and thus their repeated descriptions will be omitted.
[0034] refer to Figure 1-3 As shown in the distributed storage system 100 , the distributed storage system 100 provided by the present invention includes a metadata server cluster 110 with multiple metadata nodes 111 and a data server cluster 120 with multiple data nodes 121 . In this embodiment, the metadata server cluster 110 is a high-availability cluster.
[0035] In some embodiments, the metadata server cluster 110 may...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a distributed storage method and a distributed storage system. The distributed storage system includes: a metadata server cluster including a plurality of metadata nodes, each of which stores metadata and controls writing of object data; And a data server cluster, including a plurality of data nodes, storing the object data and object metadata on each data node, the object metadata describing the object data, wherein, when the metadata server cluster is unavailable, at least one The data node controls the writing of the object data into the data node on behalf of the metadata node. The distributed storage method and distributed storage system provided by the present invention can avoid data loss when metadata nodes are unavailable.
Description
technical field [0001] The invention relates to the technical field of computer applications, in particular to a distributed storage method and a distributed storage system. Background technique [0002] In the field of security monitoring, due to monitoring needs, monitoring data such as video and pictures need to be stored continuously. Traditional array products built on Redundant Arrays of Independent Disks (RAID) often can only achieve fault tolerance at the disk level, but cannot achieve fault tolerance at the entire node level. If the entire array device fails, data will be lost. [0003] In the prior art, the distributed storage system is used instead of the centralized storage method to share the storage load, which not only improves the reliability, availability and access efficiency of the system, but is also easy to expand. But it still has many defects. For example, existing distributed storage systems based on Zookeeper (distributed, open source distributed ap...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/561
Inventor 孟宪晴沈伟平杨旭高杰顾旭
Owner SUZHOU KEDA TECH