File slice uploading method and device and cloud storage system

Abstract

Embodiments of the invention provide a file slice uploading method and device and a cloud storage system. The method includes the steps of a metadata server receiving a distribution request, sent by aclient, of a target file to be uploaded; according to current load information of slice servers, determining an available slice server corresponding to the target file with a file identifier; according to the available slice server and current load information of object storage devices, determining an available object storage device corresponding to the target file with the file identifier; and sending a device identifier of the available slice server to the client so that the client sends a slice file of the target file to the available slice server based on the device identifier to make theavailable slice server store a first slice file of the target file to the available object storage device. Through the scheme, the file can still be uploaded normally when the server is overloaded orin a bad network environment.

Description

technical field [0001] The invention relates to the technical field of computer and Internet data processing, in particular to a file slice uploading method, device and cloud storage system. Background technique [0002] With the continuous improvement of Internet speed and the rapid popularization of mobile Internet and smart terminals, cloud storage system has become the current trend of Internet development. From the perspective of application architecture, the difference between cloud storage system and traditional distributed storage system is not obvious. The more essential difference is reflected in the internal software architecture. Cloud storage system builds a large-scale storage cluster based on a large number of servers and storage devices. , provides storage capacity, and can expand capacity online, so that the overall cost of building a large-capacity storage system is much lower than that of traditional storage architectures. With the increase in the number ...

AI Technical Summary

Problems solved by technology

In the existing file uploading technology, when the file is uploaded, a large amount of resources can be taken up, such as the CPU (Central Processing Unit, central processing unit), port, flow, memory and disk I / O (input / output, input / output) of the server. Port), etc., once the load on the server is too large, it is easy to cause excessive delay or packet loss when uploading the file, which will lead to the failure of file upload; at the same time, the bad network environment is also an important factor leading to the failure of file upload

Images