Deployment method of virtualized network service function chain based on deep reinforcement learning

Abstract

The invention relates to a virtualized network service function chain deployment method based on deep reinforcement learning, which is used to solve the problem of virtualized network service function deployment under the background of edge computing, and belongs to the technical field of edge computing. This method, by solving the two problems of virtual function placement and traffic routing respectively, realizes the deployment of the service function chain at the minimum cost, and can take advantage of deep reinforcement learning to adapt to the time-varying traffic control requirements. This method uses the neural network as the basis for the accumulated reward Q value. In addition, deep reinforcement learning introduces the concept of an experience pool when inputting samples to a neural network. The present invention considers not only the total cost but also the end-to-end delay, especially the intermediate processing delay, and is suitable for applications in dynamic and complex scenarios requiring high communication cost and delay of the server.

Description

technical field [0001] The invention relates to a deep reinforcement learning and network function virtualization technology, in particular to a virtualized network service function chain deployment method based on a deep reinforcement learning algorithm, which is used to solve the problem of virtualized network service function deployment under the background of edge computing, It belongs to the field of edge computing technology. Background technique [0002] With the advent of the Internet era, various mobile smart terminals have exploded in popularity. All kinds of things in life are connected to the Internet, resulting in an explosive growth in the amount of network data. According to the prediction of the Internet Data Center (IDC), the total amount of global data will be greater than 40ZB in 2020. The traditional Internet-based cloud computing provides users with network services by using the huge resource system on the Internet, and uploads data to the cloud comput...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem of complex and changeable network environment under edge computing, and to provide a deployment method of virtualized network service function chain. The goal is to improve the deployment efficiency and reduce the deployment cost as much as possible.

Images