Resource management method of distributed object storage system

An object storage and resource management technology, applied in the field of resource management of distributed object storage systems in cloud computing environment, can solve problems such as restricting system performance and occupying data access time, so as to solve difficult resource management, efficient metadata organization, Guaranteed safe effect

Active Publication Date: 2014-10-29
CHINA INFOMRAITON CONSULTING & DESIGNING INST CO LTD
View PDF5 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In a distributed object storage system, all operations on data objects require access to metadata. In some extreme cases, the number of system accesses to metadata occupies most of the data access time, which may become a bottleneck restricting system performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource management method of distributed object storage system
  • Resource management method of distributed object storage system
  • Resource management method of distributed object storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0095] (1) Metadata management

[0096] Metadata management mainly involves two aspects: metadata location and file access control attribute management.

[0097] The basic steps of the metadata location operation are that when the client needs to access the data file, it first needs to access the SPIS, and query the access control attribute and the SPID of the storage path of the file to be accessed. If you have access rights, you need to perform hash calculations based on the SPID to determine the master MDS that stores file metadata. Under normal access conditions, the required file metadata can be obtained by querying the master MDS. If the master MDS is overloaded, the slave MDS with a lighter load can be obtained from SPIS, and the required file metadata can be obtained by querying the slave MDS. Take accessing the metadata of the file / home / src / test / HelloWorld.Java as an example to illustrate the specific access process.

[0098] Step 1: Decompose the following file / hom...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a resource management method of a distributed object storage system. The resource management method comprises the following steps that the distributed object storage system enables the storage path attributes of files and the metadata of the files to be separated, the storage path attributes comprise the names of storage paths where the files are placed and corresponding route access control attributes, and the metadata of the files comprise access attributes including file names, establishing times, modifying times and file lengths; the distributed object storage system comprises a storage path index server, a metadata server and object storage devices, wherein the storage path index server is used for establishing index entries for all storage paths in the system; each index entry comprises an SPID and a storage path attribute, wherein the SPID is a globally-unique storage path ID distributed for the storage paths by the storage path index server; the metadata server positions the storage path ID to the object storage device corresponding to the storage path of the SPID.

Description

technical field [0001] The invention relates to the field of distributed object storage of cloud computing computer data, in particular to a resource management method of a distributed object storage system in a cloud computing environment. Background technique [0002] In the cloud computing environment, data storage is an extremely important issue. Traditional network storage is mainly divided into three types: direct attached storage (Direct Attached Storage, DAS), storage area network (Storage Area Network, SAN) and network attached storage (Network Attached Storage, NAS). However, DAS is not suitable for large-scale data storage; and for SAN and NAS, as the data scale increases, the metadata server can easily become the bottleneck of the entire system. [0003] Compared with the traditional storage system, the new distributed object storage system (Object-Based Storage, OBS) can well solve the above problems. OBS provides a single system image (single-system-image) fi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F3/067G06F16/13
Inventor 张文健房磊朱晨鸣张云帆乔爱锋乔长兵
Owner CHINA INFOMRAITON CONSULTING & DESIGNING INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap