Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed deployment method and device for file, electronic device and storage medium

A distributed and file technology, applied in electrical components, transmission systems, etc., can solve the problems of frequent IP address update, extra workload and load, etc., to reduce workload and load.

Active Publication Date: 2019-02-22
SHENZHEN ONETHING TECH CO LTD
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of this application is to provide a method for distributed deployment of files, a scheduling device, electronic equipment, and a computer-readable storage medium, aiming at solving the problem of the traditional method (that is, the active push type of the scheduling center) and the large number of shared files in the existing scheduling center. When the nodes perform distributed file deployment, it is necessary to frequently update the corresponding relationship between the IP address and the shared node, which brings about additional workload and load problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed deployment method and device for file, electronic device and storage medium
  • Distributed deployment method and device for file, electronic device and storage medium
  • Distributed deployment method and device for file, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] See figure 1 , figure 1 It is a flow chart of a file distributed deployment method provided by the embodiment of this application, which includes the following steps:

[0049] S101: Receive a file deployment task, and decompose the file deployment task into multiple sub-deployment tasks;

[0050] The dispatch center first receives the file deployment task from the upper layer, and the file deployment task received at this time is complete, corresponding to the complete file to be deployed. Since this application is applied to a distributed storage network scenario consisting of a large number of shared nodes, this step aims to decompose the complete file deployment task into multiple sub-deployments, and assign each sub-deployment task to different Shared nodes are used to implement distributed deployment of files. In this way, file fragments can not only be pulled from multiple shared nodes at the same time, but also better capacity balance can be achieved.

[0051]...

Embodiment 2

[0064] See figure 2 , figure 2 It is a flow chart of a method for assigning each sub-deployment task to each shared node in the file distributed deployment method provided by the embodiment of this application. The method for classifying the attributes of the nodes to increase the uniformity of the distribution of the same file fragments includes the following steps:

[0065] S201: Determine the target deployment quantity of each sub-deployment task according to preset redundancy rules;

[0066] This step is to determine the target number of deployments for each sub-deployment task according to the preset redundancy rules. Following the example given above, when the preset redundancy rules are set to 10, it means that there are 5 file fragments that constitute a complete file All need to be allocated to 10 shared nodes, that is to say, a total of 5×10=50 file fragments need to be deployed in each shared node.

[0067] S202: Allocate a first quantity of the same sub-deploy...

Embodiment 3

[0075] See image 3 , image 3 A sequence diagram of distributed deployment of files between the dispatch center and shared nodes provided for the embodiment of this application, which is different from the previous two descriptions of the solution provided by this application from the perspective of the dispatch center. This embodiment will include The sequence diagram of two execution subjects is used to better and clearly describe the interaction process between each shared node and the dispatch center:

[0076] 1. File deployment task:

[0077] The dispatch center receives the file deployment task from the upper layer, and expects to deploy the file corresponding to the file deployment task in the distributed storage network composed of shared nodes through the dispatch center.

[0078] 2. Task breakdown:

[0079] The scheduling center decomposes the file deployment task corresponding to the complete file into multiple sub-deployment tasks, and each sub-deployment task ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The application discloses a distributed deployment method for a file. A scheduling center only needs to distribute a sub-deployment task to a corresponding logged-in shared node according to identityinformation of the shared node; a to-be-deployed task corresponding to each shared node is obtained; afterwards, each shared node actively searches whether the to-be-deployed task corresponding to ownidentity information exists in the scheduling center through a fixed IP address of the scheduling center so as to obtain a corresponding file fragment according to the retrieved to-be-deployed task.Compared with the prior art that the scheduling center actively performs task push on the shared node, the technical scheme provided by the invention is that each shared node actively performs task query; therefore, the scheduling center does not need to maintain the corresponding relationship between the IP address and the node again, thereby reducing the workload of the scheduling center and reducing the load. The application also discloses a scheduling device, an electronic device, and a computer readable storage medium, which have the above beneficial effects.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to a file distributed deployment method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] A distributed storage system stores data dispersedly on multiple independent devices. Traditional network storage systems use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses the location server to locate and store information. It not only improves the reliability, availability and access efficiency of the system, but also is easy to expand. [0003] Existing distributed storage systems often distribute servers with st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/1097H04L67/145H04L67/54H04L67/60
Inventor 刘德峰
Owner SHENZHEN ONETHING TECH CO LTD