Cluster node load state prediction-based cold and hot region division energy-saving storage method

A technology of area division and load status, applied in the field of information technology processing, can solve the problems of energy waste and occupation of computing node storage resources, etc., to achieve the effect of reducing energy consumption, reducing operating costs, and increasing the average load of nodes

Inactive Publication Date: 2019-08-06
SHANDONG UNIV OF SCI & TECH
View PDF1 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This causes some computing nodes to run at a lower load, resulting in wasted energy
At the same time, the data blocks stored by the data nodes will become cold data for a considerable proportion of the time, and these data will occupy the storage resources of the computing nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster node load state prediction-based cold and hot region division energy-saving storage method
  • Cluster node load state prediction-based cold and hot region division energy-saving storage method
  • Cluster node load state prediction-based cold and hot region division energy-saving storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Below in conjunction with accompanying drawing and specific embodiment the present invention is described in further detail:

[0033] There are general rules for data block access in Hadoop clusters. The application obtains the general explanation of the law by consulting the literature, and the application designs the storage strategy of the Hadoop cluster data block according to the data access law.

[0034] 1. Data block storage design idea

[0035] Access to a data block generally occurs within a short period of time after it is uploaded. As time goes by, the data block will become colder and the probability of being accessed will decrease. Verifying the rationality of this law is of great help to the design of storage strategies for data blocks.

[0036] 1.1, Hadoop cluster data block storage analysis

[0037] (1) Analysis of copy storage mechanism

[0038] For a data block Data, the default copy storage mechanism of the Hadoop cluster will store its copies in ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cluster node load state prediction-based cold and hot region division energy-saving storage method, and belongs to the field of information technology processing. The methodincludes firstly introducing the idea of the method, and then describing the execution steps of the method and pseudo code implementation of the method; theoretically analyzing the energy-saving effect of the energy-saving strategy; introducing the experiment process, including the experiment environment; selecting an experiment environment, selecting a data set and accessing a data block, finallyanalyzing an experiment result, and verifying that the energy-saving storage strategy disclosed by the invention has a certain actual energy-saving effect through quantitative analysis and comparisonwith the energy consumption of a Hadoop cluster which is not subjected to cold and hot region division.

Description

technical field [0001] The invention belongs to the field of information technology processing, and in particular relates to an energy-saving storage method for dividing hot and cold areas based on cluster node load state prediction. Background technique [0002] The development of cloud computing technology has continuously expanded the scale and number of data centers, and at the same time, it has also brought about the problem of higher and higher energy consumption costs of data center clusters. In order to achieve data reliability in the Hadoop cluster, each data block has multiple backups. As time goes by, the access frequency of data blocks gradually decreases, and the computing load of nodes also gradually decreases. This causes some computing nodes to run at a lower load, resulting in wasted energy. At the same time, the data blocks stored by the data nodes will become cold data for a considerable proportion of the time, and these data will occupy the storage reso...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4893G06F9/5088G06F2209/5019Y02D10/00
Inventor 倪丽娜韩庆亮禹继国张金泉
Owner SHANDONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap