Heterogeneous network access control method based on Q learning resource allocation strategy

A heterogeneous network and distribution strategy technology, applied in access restriction, electrical components, wireless communication, etc., can solve the problem of subversion of user access control decision conditions

Active Publication Date: 2013-07-24
哈尔滨工业大学高新技术开发总公司
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In fact, if the network is in a congested state, it will have a great impact on network status parameters, and the impact on user access control decision conditions may be subversive

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous network access control method based on Q learning resource allocation strategy
  • Heterogeneous network access control method based on Q learning resource allocation strategy
  • Heterogeneous network access control method based on Q learning resource allocation strategy

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0048] Specific implementation mode 1. A heterogeneous network access control method based on the Q-learning resource allocation strategy. The specific steps are as follows:

[0049] Step 1: In the offline phase,

[0050] Define the executable action set A in Q learning, which is used to set different resource allocation thresholds TH in the Q learning process 1 with TH 2 ;

[0051] Define the immediate reward function p of the system t (e, a), for each current state e t After the system executes the available actions, it is used as the reward of the network environment for the system to execute the actions to judge the correctness of the system's actions;

[0052] Initialize the Q value table, assign a corresponding Q value to each available action a, form a Q value table, and randomly assign a value to each Q value in the interval [0, 1];

[0053] Step two: the online phase,

[0054] Step 21, first record the current state of the system e t .

[0055] Step 22. Whenever...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous network access control method based on a Q learning resource allocation strategy and relates to a heterogeneous network access control method. The method aims to perform user call access control under the network congestion condition of the heterogeneous network in the process of considering the overall network performance and user quality of service (QoS) requirements. The threshold setting in the threshold control module is controlled by employing a Q learning method, and the dynamic priority allocation of the limited wireless allocation resources is realized by utilizing the self-learning property of Q learning. Due to the learning for a period of time, the optimal strategy of resource allocation can be found in different network states. Therefore, the user access control can adapt to the dynamic change network environment, particularly the method has effectiveness under the heterogeneous network congestion condition. The method is applied to the user access control in the heterogeneous network.

Description

technical field [0001] The invention relates to a heterogeneous network access control method. Background technique [0002] WCDMA / WLAN heterogeneous network is the mainstream trend of next-generation heterogeneous network integration. The two have perfect complementary characteristics in technology: WCDMA network has wide coverage and perfect QoS guarantee mechanism, but the data rate is low; WLAN has high data rate and cheap price, but the coverage is limited and the QoS guarantee mechanism is not perfect. If the two can be effectively combined to form a unified network, it will be possible to provide users with high-quality and seamless services in a wide coverage area. [0003] In the process of WCDMA / WLAN heterogeneous network convergence, user admission control mechanism is a very important research content. Its performance will directly affect the QoS quality of users such as the blocking rate of new users and the call drop rate of switching users. In addition, it w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W48/06
Inventor 徐玉滨陈佳美马琳赵洪林崔扬杨松
Owner 哈尔滨工业大学高新技术开发总公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap