Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for balancing load applied in distributed mass memory system

A load balancing and mass storage technology, applied in transmission systems, special data processing applications, instruments, etc., can solve the problem of inaccessibility of the entire file, and achieve the effect of ensuring reliability and load balancing

Inactive Publication Date: 2009-12-23
ZHEJIANG UNIV
View PDF0 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if some existing load balancing algorithms are applied, it is possible for a file block (Chunk) and its two copies to be balanced to the same file block storage server (Chunk Server). If it happens that the file block storage server ( Chunk Server) crashes or other unexpected conditions, then the entire file cannot be accessed because the file block (Chunk) and its copy are invalid

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for balancing load applied in distributed mass memory system
  • Method for balancing load applied in distributed mass memory system
  • Method for balancing load applied in distributed mass memory system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The specific embodiment of the present invention is illustrated below in conjunction with accompanying drawing, as figure 2 shown. In this embodiment, the following steps are adopted to achieve load balancing:

[0023] 1. Method for identifying file blocks (Chunk)

[0024] When identifying a file block, use a unique identification mark to represent the file block and need to indicate the file block storage server (Chunk Server) where all copies of the file block are located. For example, suppose a file File contains n different file blocks :File={F m _fb 1 , F m _fb 2 ,...,F m _fb n}, where F m stands for a file, F m _fb n Represents a block of this file, m and n can be used as the identification mark of the file block, assuming that each different file block has three copies in total, which are located on different file block storage servers (Chunk Server), then you can file block F m _fb n Make the following identification:

[0025] f m _fb n ={chunkS...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for balancing load applied in a distributed mass memory system. The method comprises the following steps: setting a heavy-load server and a light-load server; identifying a chunk (Chunk); identifying the heavy-load server and the light-load server; sequencing the heavy-load server and the light-load server in a decreasing order; determining whether a corresponding chunk of a first heavy-load server has a copy on a first light-load server; transferring the corresponding chunk of the first heavy-load server to the first light-load server; and the like. Through a load-balancing algorithm provided by the invention, the problem of reduced reliability of the system caused by transferring copy of the chunk (Chunk) to the same chunk server (Chunk Server) in the load balancing process of the distributed mass memory system can be solved.

Description

technical field [0001] The invention relates to a load balancing method applied to a distributed mass storage system. Background technique [0002] Distributed mass storage system, also known as large-scale distributed file system, is mainly developed for large-scale data storage and data access. Its main feature is that the content in the file system can be stored on multiple machines, and the data can be shared and transmitted through the network, which has strong robustness and scalability. Generally, it is stored once and accessed multiple times, so the requirements for access concurrency are very high. Such as figure 1 As shown, the distributed mass storage system is mainly divided into three parts: master server (Master Server), file block storage server (Chunk Server) and client (Client). [0003] Master server: manages the metadata of the file, mainly including the file name space, the mapping from the file to the file block (Chunk), and the mapping from the file ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30
Inventor 李莹曾文秋吴朝晖邓水光吴健尹建伟
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products