Super-dense edge computing network mobility management method based on deep reinforcement learning

A technology of reinforcement learning and edge computing, applied in neural learning methods, network traffic/resource management, based on specific mathematical models, etc.

Active Publication Date: 2020-09-15
NORTHWESTERN POLYTECHNICAL UNIV
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the envisioned ultra-dense edge computing technology can improve the communication and computing capacity of the edge networ

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-dense edge computing network mobility management method based on deep reinforcement learning
  • Super-dense edge computing network mobility management method based on deep reinforcement learning
  • Super-dense edge computing network mobility management method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0094] The present invention provides a mobility management method for ultra-dense edge computing networks based on deep reinforcement learning, which can be well implemented in the case of dense deployment of wireless access nodes and edge computing nodes. In the process, mobility management decisions are provided for multiple wireless access nodes and multiple edge computing nodes. In addition, simply considering the performance of nodes to select the optimal performance decision will lead to the problem of frequent migration. Therefore, the present invention studies the balance between user quality of service (QoS) and service mobility in the process of user mobility, that is, in the user During the mobile process, select the appropriate wireless access point and edge server to ensure the user's QoS while reducing the service migration rate at a certain rate. The present invention regards the processing delay of computing tasks as the index of user QoS, and proposes a metho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a super-dense edge computing network mobility management method based on deep reinforcement learning. The super-dense edge computing network mobility management method includesthe steps: establishing a communication time delay model, a computing model, a QoS model and a service cost migration model according to environment information and processing resource information; establishing a mobile management model according to the established model information, simplifying the problem by adopting a dynamic loss queue technology and a Lyapunov optimization method, and abstractly describing a dynamic change process of an ultra-dense edge computing environment of the mobile management model by adopting a discrete time Markov decision process; and establishing an algorithmbased on deep reinforcement learning according to the abstract model and obtaining an optimal mobility management decision. According to the super-dense edge computing network mobility management method, for a super-dense edge computing network, the mobility management decision is small in limitation and good in mobility, and on the premise of considering the integrity, dynamics and balance of thesystem, the optimal decision of the association network and task allocation in the user moving process is realized.

Description

technical field [0001] The invention belongs to the technical field, and in particular relates to a mobility management method for an ultra-dense edge computing network based on deep reinforcement learning. Background technique [0002] With the rapid development of smart mobile devices and the rise of technologies such as 5G and the Internet of Things, the demand for wireless connections and traffic is increasing. Today's network architecture is difficult to support the hundreds of times the demand for wireless connections and the wireless traffic that will increase by a hundred times in the future. . The increase of wireless traffic demand puts forward new requirements for wireless network capacity, and the ultra-dense network (UDN) technology emerges under such circumstances. UDN technology achieves a 100-fold increase in wireless network capacity by densely deploying small base stations in hotspots to cope with the increasing demand for mobile data traffic and wireless ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06N3/04G06N3/08G06N7/00H04W28/24
CPCG06F9/505G06N3/08H04W28/24G06F2209/509G06F2209/508G06F2209/502G06N7/01G06N3/045Y02D30/70
Inventor 张海宾孙文王榕黄相喆
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products