File processing method and system based on cloud storage, and server cluster system

A server cluster and file processing technology, applied in the field of data processing, can solve the problems of slow file system access, waste of system storage space and network bandwidth, etc., and achieve the effect of cloud storage performance optimization, time reduction, and redundant data reduction.

Active Publication Date: 2012-12-19
ALIBABA GRP HLDG LTD
View PDF5 Cites 83 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to provide a file processing method, system and server cluster system based on cloud storage, so as to solve the problem that the existing cloud storage method wastes the storage space and network bandwidth of the system, and easily leads to a decrease in the access speed of the file system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and system based on cloud storage, and server cluster system
  • File processing method and system based on cloud storage, and server cluster system
  • File processing method and system based on cloud storage, and server cluster system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0039] see figure 2, which is the flow chart of the first embodiment of the file processing method based on cloud storage in this application:

[0040] Step 201: The WEB server receives the file upload request sent by the client, and the file upload request is used to request to upload a new file to the server cluster.

[0041] Step 202: The WEB server returns to the client the file ID generated by the server cluster for the new file.

[0042] Specifically, the WEB server sends a request to obtain the file ID of the new file to the server cluster, and the server cluster allocates a file ID for the new file according to the request, and the server cluster returns the file ID to the WEB server, and the WEB server sends the file ID to the client. Wherein, a large number of files are stored in the server cluster, and the server cluster assigns a unique file ID to each file, for example, a file ID sequentially numbered by numbers. When a unique file ID is assigned to the file in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application discloses a file processing method and system based on cloud storage, and a server cluster system. The method comprises the following steps that: a WEB server receives a file uploading request sent by a client; the WEB server returns a file ID (Identity) which is generated for a new file to be uploaded by a server cluster; the client splits the new file and generates a unique slice ID for each slice file; the client uploads a slice file data packet to the WEB server, the slice file data packet comprises the file ID, the slice ID of each slice file and slice data of each slice file; and the WEB server sends the slice data of each slice file in the slice file data packet to corresponding service terminals in the server cluster for storage. By virtue of the embodiment of the application, the file is subjected to splitting processing, and the slice files are stored in the server cluster in a distributed manner, so that the cloud storage performance based on the server cluster is relatively optimal.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a file processing method, system and server cluster system based on cloud storage. Background technique [0002] Cloud Computing is the development of Distributed Computing, Parallel Computing and Grid Computing. It splits the huge computing processing program into several smaller subroutines through the network. These small programs are respectively handed over to a system composed of multiple servers for calculation, and the calculation results are output. Cloud storage is an extension of the concept of cloud computing, which refers to the collection of a large number of different types of storage devices in the network through application software through functions such as cluster applications, grid technology, or distributed file systems, to achieve collaborative work and common external Provide data storage and business access functions. That is, when the c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097G06F9/06H04L29/08117H04L29/08H04L29/00H04L67/06H04L61/1582H04L29/08549G06F16/183H04L61/457
Inventor 全小飞薛贵荣卓磊宋南宋万里程晗
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products