Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Heterogeneous wireless network vertical switching method based on depth deterministic strategy gradient

A heterogeneous wireless network, vertical switching technology, applied in the field of communication

Active Publication Date: 2019-09-10
JILIN UNIV
View PDF11 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in a complex heterogeneous wireless network environment, how to provide users with diversified services anytime and anywhere and ensure the quality of service for users is a hot issue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous wireless network vertical switching method based on depth deterministic strategy gradient
  • Heterogeneous wireless network vertical switching method based on depth deterministic strategy gradient
  • Heterogeneous wireless network vertical switching method based on depth deterministic strategy gradient

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0061] Embodiment: A vertical handover method for heterogeneous wireless networks based on depth deterministic policy gradient, such as figure 1 shown, including the following steps:

[0062] S1: Calculate the weight of the network state parameters using the AHP, and construct a reward function based on the weight.

[0063] S2: Use the BP neural network of error backpropagation to construct the evaluation network for approximating the state action value function and the policy network for approximating the policy function, and initialize the network parameters and initialize a storage space R at the same time; the evaluation network includes the state estimation network and state-reality network, policy network includes action estimation network and action-reality network.

[0064] S3: The action estimation network makes a switching decision based on the current network state parameters, and then obtains a reward value through the reward function, and at the same time obtains...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a heterogeneous wireless network vertical switching method based on a depth deterministic strategy gradient. The invention relates to the technical field of communication, solves the problem that user terminals with different service types are frequently switched among different networks in a heterogeneous wireless network environment, and adopts the technical scheme that an analytic hierarchy process is adopted to calculate the weight of network state parameters for constructing a reward function; the strategy network makes a switching decision based on the current network state, then a reward is obtained, the evaluation network is updated according to the reward, and the strategy network is updated in the suggested direction of the evaluation network; the algorithm is not only based on the current network state, but also considers the potential future network state to ensure the QOS requirement of the user. The optimal access network can be selected for usersof different service types, the average switching frequency and the switching failure probability can be effectively reduced, meanwhile, the blocking rate of new calling users is reduced, and the resource utilization rate of the system is improved.

Description

technical field [0001] The present invention relates to the technical field of communication, and more specifically relates to a method for vertical handover of heterogeneous wireless networks based on deep deterministic policy gradients. Background technique [0002] In order to meet the ever-increasing number of mobile terminals and the explosive growth of network traffic, 5G networks emerged as the times require, and put forward requirements such as high bandwidth and low latency. However, it is difficult for a single network to meet the increasingly diverse service needs of users. Therefore, it is required A new generation of networks can integrate existing heterogeneous networks. The next generation wireless system will integrate multiple wireless access technologies, such as 4G, 5G, WLAN, WIMAX, Bluetooth, etc. [0003] Vertical handover means that in a heterogeneous wireless network area, in order to meet the different service requirements of the terminal, provide se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W24/02H04W36/00G06N3/04G06N3/08
CPCH04W24/02H04W36/0055G06N3/084G06N3/044
Inventor 钱志鸿孙佳妮王雪冯一诺李京杭毕晶
Owner JILIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com