Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Large-scale distributed storage system

A distributed storage, large-scale technology, applied in special data processing applications, instruments, electrical digital data processing, etc., to achieve high scalability

Inactive Publication Date: 2011-07-27
SHANGHAI JIAO TONG UNIV
View PDF4 Cites 78 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the above-mentioned deficiencies in the prior art, the present invention provides a large-scale distributed storage system, adopts configurable automatic load balancing and data migration, regularly checks the consistency of data, clears garbage data, etc., and eliminates the problems caused by manual operations. various problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale distributed storage system
  • Large-scale distributed storage system
  • Large-scale distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The embodiments of the present invention are described in detail below. This embodiment is implemented on the premise of the technical solution of the present invention, and provides a detailed implementation manner and a specific operation process, but the protection scope of the present invention is not limited to the following implementation. example.

[0037] like figure 1 As mentioned above, this embodiment includes: at least one management node that stores the namespace of the object, metadata information, object number and address information of the object, several storage nodes that store the corresponding object data, and several super clients or clients , in which: the client, the super client, the management node and the storage node communicate through the interactive network.

[0038] The management node is a personal computer, a workstation, a server, etc.; there may be shadow management nodes in the storage system; including: a file system that stores th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a large-scale distributed storage system in the technical field of computer network application, comprising at least one management node which is used for storing a name space, metadata information, an object number and address information of an object, a plurality of storage nodes which are used for storing corresponding object data and a plurality of super clients; the super clients access the management node by the storage node, search for the object number and the address information of the object of a file to be accessed in the management node and access the corresponding object data from the corresponding storage nodes; the management node comprises a file system which stores the name space and the metadata information of the object and a database which stores the object number and the address information of the object. Configurable automatic load balancing and data migration are adopted in the large-scale distributed storage system, the consistency of the data is periodically checked, and the junk data is periodically cleaned, therefore, various problems which are caused by manual operation are eliminated, and the large-scale distributed storage system has high expandability.

Description

technical field [0001] The invention relates to a device in the technical field of computer network application, in particular to a large-scale distributed storage system. Background technique [0002] In a traditional file storage system or file server, for example, based on Network Attached Storage (NAS), data is stored and managed by a huge, closed, and independent system. Enterprises often need to deploy multiple file servers to meet rapidly growing data processing demands. However, deploying multiple file servers will cause problems such as data migration, data sharing, load and capacity balancing, and high availability. These problems often require manual participation to solve, which will cause many hidden dangers. [0003] In the traditional file system, each file server limits the access bandwidth of the entire file system, and since metadata and data are stored in a separate system, when more and more users access, frequent random read and write operations make th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 李小勇刘海涛史高峰王皓
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products