Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed file storage system and method thereof

A distributed file and storage system technology, applied in the field of distributed file storage systems, can solve the problems of inflexible system expansion and idle computing resources, and achieve the effects of expanding processing capabilities, meeting performance requirements, and improving utilization

Active Publication Date: 2014-12-17
北京联创信安科技股份有限公司
View PDF7 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a distributed file storage system and method, which overcomes the shortcomings of a large number of idle CPU computing resources and inflexible system expansion in traditional distributed file storage systems, and improves the performance and flexibility of the entire distributed storage system sex

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file storage system and method thereof
  • Distributed file storage system and method thereof
  • Distributed file storage system and method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] figure 1 A schematic diagram of a distributed file storage system according to the first embodiment of the present invention is given. Such as figure 1 As shown, the system includes a client 1 for sending operation requests of data objects and receiving data content; a cluster storage pool 2 for operating data objects sent by the client 1; and a transmission network for connecting the Client 1 and the cluster storage pool 2; the cluster storage pool 2 includes multiple traditional X86 servers, and a virtualization platform system is deployed on each server to evolve a single cluster controller into multiple virtual cluster controllers . Among them, the virtualization platform system includes a virtual cluster controller 3 and a virtual resource scheduler 4; the virtual cluster controller 3 is used to undertake calculations in the cluster; the virtual resource scheduler 4 is used for virtualization management and Virtual resource scheduling.

[0044] This system uses the ...

Embodiment 2

[0046] figure 2 It is a schematic diagram of a distributed file storage system according to the second embodiment of the present invention. Such as figure 2 As shown, this system includes client 1, transmission network, and cluster storage pool 2. The cluster storage pool 2 includes multiple traditional X86 servers, and a virtualization platform system is deployed on each server to evolve a single cluster controller into Multiple virtual cluster controllers 3. Among them, the bottom layer of the virtual cluster controller 3 shares storage resources of all disks; the upper layer includes CPU, memory, and bus. The virtual resource scheduler 4 is a resource management and allocation module, which is used to dynamically allocate, use or recycle the virtual cluster controller 3. The virtual cluster controller 3 is provided with a role controller for assigning different logical labels to the virtual cluster controller 3, such as storing virtual machines, computing virtual machines...

Embodiment 3

[0054] image 3 It is a flowchart of a method for implementing a distributed file storage system according to the third embodiment of the present invention. Such as image 3 As shown, the method includes the following steps:

[0055] Step S301: initialize and pre-configure the virtual cluster controller;

[0056] Step S302: Determine whether the virtual cluster controller has data hot spots or access peaks;

[0057] Step S303: If a data hotspot or access peak occurs, the virtual resource scheduler performs an operation of increasing the number of virtual cluster controllers; at this time, the virtual resource scheduler calls the program to start more virtual cluster controllers to share the original virtual cluster control The workload of the processor can achieve the purpose of balance and optimization;

[0058] After the end of the data hotspot or the access peak in step S304 and step S303, the virtual resource scheduler performs an operation of reducing the number of virtual clust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed file storage system and a method thereof. The distributed file storage system comprises a client for sending an operation request of a data object and receiving data content, and a cluster storage pool for the operations of the data object; the cluster storage pool comprises a plurality of physical machines; a virtual platform system is deployed in each physical machine; the virtual platform system comprises a virtual cluster controller for undertaking the calculation work in a cluster, and a virtual resource scheduler for virtualization management and virtual resource scheduling in the cluster. The distributed file storage system is used for overcoming the defects of lots of idle calculation resources of a processor in a traditional distributed file storage system and inflexible system extension; the performance and the flexibility of the whole distributed storage system are improved.

Description

Technical field [0001] The invention relates to a data reading and writing storage system, in particular to a distributed file storage system and method. Background technique [0002] With the continuous innovation and deepening of digital applications, data has shown an explosive and massive growth trend. Among them, the growth of unstructured data is particularly rapid and significant. According to statistics, the global data volume doubles every 18 months, of which 80% is Unstructured data based on pictures, audio and video, and files. With the emergence of emerging business and service models such as web 3.0, cloud computing, and cloud storage, the era of "self-media" centered on individuals will come in full swing, which is bound to further promote the surge of unstructured data. The storage management of massive data requires a new storage architecture, among which elasticity and flexibility are an important feature for massive unstructured data storage. At present, distr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F9/50
Inventor 阮薛平
Owner 北京联创信安科技股份有限公司