Power communication network utility maximization resource allocation policy generation method based on Q-learning

Abstract

The invention provides a power communication network utility maximization resource allocation policy generation method based on Q-learning. The method comprises the following steps that a power communication network resource management model is established, wherein the power communication network resource management model comprises a resource management simulation platform, power communication network infrastructure and power communication business; the resource management simulation platform obtains information of the power communication network infrastructure; the resource management simulation platform obtains information of the power communication business; and the resource management simulation platform generates a resource allocation policy of power communication business based on the Q-learning. According to the method provided by the invention, a relatively fast convergence rate is achieved. Through comparison with a static resource allocation algorithm and a dynamic resource allocation algorithm, it proves that according to the method provided by the invention, under the condition of ensuring a relatively high resource utilization rate, power business obtains a relativelyhigh utility value, resource demands of relatively much business are satisfied, and the degree of satisfaction of a user is improved.

Description

technical field [0001] The invention relates to the technical field of power communication network resource allocation, in particular to a Q-learning-based method for generating resource allocation strategies for maximizing power communication network utility. Background technique [0002] With the rapid development of smart grid business, the resource demand for power communication network is gradually increasing. Network virtualization technology is the key technology of current network transformation, and it has great advantages in QoS guarantee. Under the network virtualization environment, the power communication network includes power communication network infrastructure (PTNI, Power Telecommunication Network Infrastructure) and power communication business (PCB, Power Communication Business), in which PTNI creates and manages the basic network, including computing nodes and link resources and other physical resources, while PCB provides users with differentiated serv...

AI Technical Summary

Problems solved by technology

However, the existing research has not solved the problem of how to meet more business needs and improve user satisfaction.

Images