Supercharge Your Innovation With Domain-Expert AI Agents!

File processing method and system based on cloud storage, and server cluster system

A server cluster and file processing technology, which is applied in the field of data processing, can solve the problems of wasting system storage space and network bandwidth, file system access speed reduction, etc., and achieve the effect of cloud storage performance optimization, time reduction, and storage space saving

Active Publication Date: 2015-05-20
ALIBABA GRP HLDG LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to provide a file processing method, system and server cluster system based on cloud storage, so as to solve the problem that the existing cloud storage method wastes the storage space and network bandwidth of the system, and easily leads to a decrease in the access speed of the file system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and system based on cloud storage, and server cluster system
  • File processing method and system based on cloud storage, and server cluster system
  • File processing method and system based on cloud storage, and server cluster system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0039] see figure 2, which is the flow chart of the first embodiment of the file processing method based on cloud storage in this application:

[0040] Step 201: The WEB server receives the file upload request sent by the client, and the file upload request is used to request to upload a new file to the server cluster.

[0041] Step 202: The WEB server returns to the client the file ID generated by the server cluster for the new file.

[0042] Specifically, the WEB server sends a request to obtain the file ID of the new file to the server cluster, and the server cluster allocates a file ID for the new file according to the request, and the server cluster returns the file ID to the WEB server, and the WEB server sends the file ID to the client. Wherein, a large number of files are stored in the server cluster, and the server cluster assigns a unique file ID to each file, for example, a file ID sequentially numbered by numbers. When a unique file ID is assigned to the file in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A server receives a request to upload a file form a user device. The server may generate a unique file ID associated with the file based on the request, and transmit the file ID to the user device. The user device may divide the file to generate multiple slice files and their corresponding slice IDs. From the user device, the server receives the multiple slice files and the slice IDs. Based on the slice IDs, the server may determine storage addresses at which to store the multiple slice files in a distributed storage system using a consistent hash algorithm. The multiple slice files may be stored based on the corresponding storage addresses of the distrusted storage system.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a file processing method, system and server cluster system based on cloud storage. Background technique [0002] Cloud Computing is the development of Distributed Computing, Parallel Computing and Grid Computing. It splits the huge computing processing program into several smaller subroutines through the network. These small programs are respectively handed over to a system composed of multiple servers for calculation, and the calculation results are output. Cloud storage is an extension of the concept of cloud computing, which refers to the collection of a large number of different types of storage devices in the network through application software through functions such as cluster applications, grid technology, or distributed file systems, to achieve collaborative work and common external Provide data storage and business access functions. That is, when the c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/06H04L67/1097G06F16/183H04L61/457
Inventor 全小飞薛贵荣卓磊宋南宋万里程晗
Owner ALIBABA GRP HLDG LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More