Method, system and device for realizing dynamic balance of storage space

A storage space and storage system technology, applied in the field of dynamic balance of storage space, can solve the problems of occupying large bandwidth, high load of DataNode, not suitable for sensitive data services, etc., and achieve the effect of avoiding bandwidth occupation and avoiding local congestion

Active Publication Date: 2016-03-09
SHENZHEN TENCENT COMP SYST CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] However, the space balance strategy in HDFS does not consider the impact of read and write loads on storage system performance, which may easily cause a DataNode to be overloaded. Moreover, data relocation in HDFS will occupy a large amount of bandwidth, which is not suitable for sensitive data services.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and device for realizing dynamic balance of storage space
  • Method, system and device for realizing dynamic balance of storage space
  • Method, system and device for realizing dynamic balance of storage space

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0031] see figure 1 , figure 1 The flowchart provided for the embodiment of the present invention. Wherein, the process provided by the present invention is applied to a storage system divided into two levels of load balancing units, wherein one level of load balancing unit is a data block (Chunk) master server (master), and the other level of load balancing unit is a Chunk slave server (server), a Chunkmaster is used to manage at least one Chunkserver, specifically as figure 2 shown.

[0032] based on figure 2 The structure shown, then in the present invention, such as figure 1 As shown, each chunkmaster performs the following steps:

[0033] Step 101, receiving the load of the Chunkserver reported by each Chunkserver it manages, and reco...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method, system and device achieving storage space dynamic balancing. The method is applied to a storage system divided into two grade load balancing units, wherein one grade load balancing unit is a Chunk master, the other grade load balancing unit is a Chunk server, the Chunk master is used for managing at least one Chunk server, and the Chunk server is used for managing at least one Chunk. The Chunk master carries out the operation of receiving the load of the Chunk server reported by the Chunk server managed by the Chunk master and recording the reported load; after receiving of the storage space requirements sent by a client side, finding the load reported by the Chunk server corresponding to the Chunk master according to the reported and recorded load to meet load requirements, selecting all Chunks meeting the storage space requirements by means of residual space in all the Chunks, and returning the identification of the selected Chunks to the client side, and the client side updates data to the Chunk corresponding to the Chunk identification according to the received Chunk identification.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a method, system and device for realizing dynamic balance of storage space, and in particular, to a method, system and device for realizing dynamic balance of storage space in a distributed storage system. Background technique [0002] In Internet data storage, the ability to balance storage space allocation is an important indicator that reflects the business support capability of the storage system. It mainly refers to the balance of physical storage block space allocation and data heat balance of each node in the distributed storage system cluster, which affects the storage system. Overall throughput and efficiency of data location. At present, the existing storage space allocation balancing method is mainly a space balancing strategy in a distributed file system (HDFS: Hadoop Distributed File System). [0003] The so-called HDFS, which is used to provide high th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
Inventor 娄继冰李博黄楚加
Owner SHENZHEN TENCENT COMP SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap