Transcript number dynamic adjustment method based on file heat and node load

A dynamic adjustment and file technology, applied in electrical components, transmission systems, etc., can solve problems such as it is difficult to take into account file heat and node load balancing, reduce overall system performance, and node performance differences, so as to reduce cluster communication traffic and improve overall performance. Performance, good load balancing effect

Inactive Publication Date: 2018-03-06
WUHAN UNIV OF TECH
View PDF2 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although relevant scholars have done a lot of research on replica creation and adjustment, these methods are not very applicable in the actual hybrid cloud environment
First of all, in terms of calculating file heat, it is only a simple count of the number of accesses within a period of time. Even considering the use of multiple frequencies to predict the access ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transcript number dynamic adjustment method based on file heat and node load
  • Transcript number dynamic adjustment method based on file heat and node load
  • Transcript number dynamic adjustment method based on file heat and node load

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0041] like figure 1 As shown, the method for dynamically adjusting the number of copies based on file heat and node load designed by the present invention includes the following steps:

[0042] 1) The files of the statistical cluster nodes are put into the collection F, for each file F in the collection Fi Set the reliability parameters according to the reliability of the file, and initialize the number of copies of the file;

[0043] 2) Count the number of accesses to each file and calculate the hotness of each file i ;

[0044] 3) Calculate the average access heat h of all files avg , divide the files in the set F into hot files, common files and unpopular files;

[0045] 4) Calculate the average load L of the node avg , divide the nodes into heavy load nodes, moderate load nodes and light load nodes;

[0046] 5) Traverse the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transcript number dynamic adjustment method based on file heat and node load. The method comprises the following steps: 1) setting reliability parameters according to file reliability, and initializing the transcript number of the file; 2) performing statistics on the access times, and calculating the file heat hoti; 3) calculating an average access heat havg of the file,and dividing files in a set F into hotspot files, ordinary files and cold files; 4) calculating the average node Lavg of nodes, and dividing the nodes into heavy load nodes, intermediate load nodes and light load nodes; and 5) traversing the files in the set F I, calculating a theoretical transcript number Mi of the file according to the file heat and the node load, and dynamically adjusting thetranscript number rm of the file. According to the method, the current access amount and the previous file heat are counted, the influence of the file change rate to the heat is considered, the transcript number is dynamically adjusted via the average access heat of the files and the average load of the nodes in the cluster, thereby reducing the average response time and improving the overall performance of the cluster.

Description

technical field [0001] The invention relates to the technical field of computer cloud storage, in particular to a method for dynamically adjusting the number of copies based on file heat and node load. Background technique [0002] Cloud storage systems generally use distributed file systems to store and manage data. Copy technology is a traditional data management technology. In order to avoid data loss and improve data security and availability, most cloud storage systems use the strategy of creating copies to improve system reliability and performance. [0003] Generally speaking, there are two main types of replica creation technologies for cloud storage systems: static replica creation and dynamic replica creation. The number and location of the copies in the static copy creation method are determined in advance, that is, before the file is created in the system, the number and location of the copies to be created are first determined, and the number of copies will not...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/06H04L67/1008H04L67/1095H04L67/1097
Inventor 李春林宫学谦赵亚辉杜书猛张鹏毛习均
Owner WUHAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products