Storm big data energy-saving scheduling method based on energy consumption perception

Abstract

The invention relates to the field of big data processing and energy consumption, in particular to a Storm big data energy-saving scheduling method based on energy consumption perception, which comprises the following steps: constructing an improved Storm computing framework-based big data computing energy consumption model, and establishing an energy consumption priority table of tasks and computing resources; after the task is submitted, whether task related information exists in a database of the energy consumption model or not is judged, and if yes, the task is distributed to the low-energy-consumption process according to the energy consumption priority in the database; otherwise, distributing the task to each node in the cluster; Monitoring the energy consumption information on eachprocess, writing the energy consumption information into a database of an energy consumption model, judging the priority of the task according to the energy consumption model, updating a priority list, and re-submitting the task; according to the scheduling strategy algorithm, the operation energy efficiency of the big data program can be improved, meanwhile, the service level protocol is met, andthe cost of the whole data center can be remarkably reduced by improving the energy efficiency of big data calculation of the data center.

Description

technical field [0001] The invention relates to the fields of big data processing and energy consumption, in particular to a Storm big data energy-saving scheduling method based on energy consumption awareness. Background technique [0002] Today's society is a society of rapid development, with advanced technology and convenient information, the communication between people is getting closer and closer, and life is becoming more and more convenient. Big data is the product of this high-tech era. The application of big data is also showing its advantages more and more, and it occupies more and more fields, such as e-commerce, O2O, logistics distribution, etc., and various fields that use big data for development are assisting enterprises to continuously develop new businesses , Innovate the operation mode. With the concept of big data, the judgment of consumer behavior, the forecast of product sales, the precise scope of marketing and the replenishment of inventory have bee...

AI Technical Summary

Problems solved by technology

We need to understand how to minimize energy consumption in data centers, as well as address high energy consumption and long response times in most existing studies

Images