Data-oriented processing energy consumption optimization dataset distribution method

A technology for optimizing data and allocation methods, applied in resource allocation, energy-saving computing, multi-programming devices, etc.

Active Publication Date: 2014-07-16
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the above defects or improvement needs of the prior art, the present invention provides a method for data processing-oriented energy-optimized data set allocation, the purpose of which is to solve the huge For the technical problems of energy waste and unbalanced load, on the premise of ensuring QoS, deploy the user's request data set to the server node according to the distribution scheme provided by the present invention, so as to achieve the purpose of optimizing the energy consumption of the data center processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data-oriented processing energy consumption optimization dataset distribution method
  • Data-oriented processing energy consumption optimization dataset distribution method
  • Data-oriented processing energy consumption optimization dataset distribution method

Examples

Experimental program
Comparison scheme
Effect test

example

[0088] The technical solutions of the present invention will be further described below in conjunction with specific examples. refer to figure 1 , the present invention implements a data processing-oriented method for allocating energy-optimized data sets.

[0089] Step 1. Obtain the attribute value of each physical machine in the scheduling domain;

[0090] Specifically include: there are two physical machines PM1 and PM2 set in the scheduling domain, the total load capacity of PM1 is (15TBytes, 1000 tasks / s, 8GBytes, 800), in the list of data sets allocated by the server, the attributes of each data set: 5 D1=(4GBytes, 100 tasks / s, 1GBytes, 100, 0.5), 4 D2=(2GBytes, 100 tasks / s, 80, 0.5GBytes, 0.25), 2 D3=(1GBytes, 50 tasks / s, 50, 0.25 GBytes, 1).

[0091] The total load capacity of PM2 is (5TBytes, 1000 tasks / s, 4GBytes, 500), in the list of data sets allocated by the server, the attributes of each data set: 3 D1=(4GBytes, 100 tasks / s, 100, 0.5GBytes, 1 ), 1 D2=(2GBytes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data-oriented processing energy consumption optimization dataset distribution method. The method includes: ranking datasets to be distributed, according to IOPS attributes sequentially from large to small so as to form a dataset queue to be distributed, and ranking data center servers according to IOPS capacities sequentially from large to small so as to form a server queue to be distributed; creating a distributed server queue and a distributed dataset queue of the data center servers, extracting a first dataset to be distributed, from the head of the dataset queue to be distributed, judging whether the distributed server queue is blank or not, and if yes, selecting the first server from the head of the server queue to be distributed, as the current data center server. The data-oriented processing energy consumption optimization dataset distribution method has the advantages that hotspot datasets with high IOPS demands are centrally distributed to the data center servers, placement and transfer problems of virtual machines in the process of processing large-scale data are avoided, data center energy consumption is comprehensively optimized, and server load is balanced.

Description

technical field [0001] The invention belongs to the technical field of data center energy consumption optimization, and more specifically relates to a data processing-oriented energy consumption optimization data set allocation method. Background technique [0002] A current typical data center contains tens of thousands of computer nodes, including computer nodes, network nodes, and storage nodes. Their application scenarios, configuration methods, usage patterns, and load behaviors are very different. However, all kinds of data centers are facing the same problem to be solved: amazing energy consumption. According to a report submitted to the U.S. Congress by the U.S. Environmental Protection Agency in 2007, servers and data centers in the U.S. consumed about 61 billion kilowatt-hours of electricity in 2006, and the electricity bill was $4.5 billion. McKensey predicts that by 2020, the data center will become the largest carbon dioxide emitting industry. [0003] As the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCY02D10/00
Inventor 曹强万胜刚钱璐谭诗诗谢长生
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap