Distributed storage network-oriented tree structure data insertion method
A distributed storage and tree-structured technology, applied in the input/output process of data processing, electrical digital data processing, input/output to record carrier, etc., can solve the problem of low data transmission efficiency, unbalanced load of storage nodes, etc. problem, achieve the effect of speeding up placement, solving unbalanced load, and shortening lifespan
Pending Publication Date: 2022-02-08
XIDIAN UNIV +1
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] In order to solve the problems described above, the present invention proposes a tree-structured data insertion method for distributed storage networks, which solves the problems of unbalanced storage node load and low data transmission efficiency in the traditional data insertion process
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0092] The technical solution of the present invention will be further clarified below in combination with specific implementation methods and accompanying drawings.
[0093] figure 1 It is a flowchart of a group-assisted tree-structured data insertion method oriented to a heterogeneous distributed storage network proposed by the present invention. The basic idea of the present invention is to divide the storage nodes in the distributed storage network into K groups according to the node positions; The utility function of the node, select the master node; then construct a tree network data transmission structure with the master node as the root node in each group, and establish the optimal data distribution tree optimization problem according to the link bandwidth between nodes in the tree ; Finally, based on the improved butterfly optimization algorithm, the optimal solution of the optimal data distribution tree problem is solved to obtain the minimum data placement time. ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a tree structure data insertion method for a distributed storage network. The tree structure data insertion method comprises the following steps: collecting position information of nodes in the storage network; dividing all storage nodes into K groups according to the positions of the nodes; then classifying the nodes in each group according to the failure rate of the nodes; constructing a game model by utilizing an evolutionary game theory, enabling the nodes in each group to participate in the game according to respective utility functions, and selecting a main node; constructing a data transmission network of a tree structure by taking the main node as a root node in each group; on the basis of a data transmission network of a tree structure, an optimal distribution tree problem is constructed by utilizing a node direct heterogeneous link bandwidth; and solving the optimal solution of the optimal distribution tree problem based on an improved butterfly optimization algorithm. The method has the advantages that a plurality of main nodes are selected by grouping and utilizing the evolutionary game theory, the problem of unbalanced node load is effectively relieved, the service life of the network is prolonged, in addition, the optimal distribution tree is constructed based on the improved butterfly algorithm, the data insertion speed is effectively increased, and the bandwidth resource utilization rate is increased.
Description
technical field [0001] The invention relates to the fields of distributed storage systems and data storage, in particular to a tree structure data insertion method oriented to a distributed storage network. Background technique [0002] In today's era of big data, the surge in data volume has brought severe challenges to data storage. According to the latest white paper "Data Age 2025" released by IDC, the global data volume will surge to 175ZB by 2025. In recent years, distributed storage systems have attracted widespread attention because of their highly reliable storage service capabilities that can provide solutions for the storage needs of large amounts of data. In a distributed storage system, in order to ensure the reliability and availability of stored data, multi-copy technology and erasure code technology are usually used as data redundancy technologies. Compared with multi-copy technology, erasure coding technology is widely favored in distributed storage system...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0655G06F3/067
Inventor 周子涵
Owner XIDIAN UNIV