Method for controlling, optimizing and selecting of heterogeneous network access based on Q-learning

A heterogeneous network, optimization selection technology, applied in the field of wireless networks, can solve the problems of complex calculation, network type cannot achieve global optimization, and it is difficult to apply to actual systems.

Active Publication Date: 2012-08-22
哈尔滨工业大学高新技术开发总公司
View PDF1 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the problem of WCDMA / WLAN converged heterogeneous network system. The network type selection based on the measurement-based access scheme cannot achieve global optimization, while the network type selection based on the model-based access scheme is too complicated to calculate and difficult to apply. Based on the problem of the actual system, a Q-learning-based optimal selection method for heterogeneous network access control is provided.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for controlling, optimizing and selecting of heterogeneous network access based on Q-learning
  • Method for controlling, optimizing and selecting of heterogeneous network access based on Q-learning
  • Method for controlling, optimizing and selecting of heterogeneous network access based on Q-learning

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0082] Specific implementation mode one: the following combination Figure 1 to Figure 3 Describe this embodiment, the Q-learning-based heterogeneous network access control optimization selection method described in this embodiment, the method includes the following steps:

[0083] Step 1. Judging the state of the heterogeneous network when a new user is connected;

[0084] Step 2: Query the Q value table, and select the subnetwork corresponding to the largest Q value in the Q value table corresponding to the heterogeneous network state in step 1 as the access network of the new user.

[0085] The heterogeneous network refers to a converged heterogeneous network composed of a WCDMA subnet and a WLAN subnet in a loosely coupled manner,

[0086] The heterogeneous network state is jointly determined according to four network states based on interference of the WCDMA subnetwork and four network states based on channel busy rate of the WLAN subnetwork,

[0087] Four kinds of netw...

specific Embodiment approach 2

[0174] Specific implementation mode two: this implementation mode will further illustrate implementation mode one, I 1 = 4, I 2 = 8, I 3 =12.

specific Embodiment approach 3

[0175] Embodiment 3: This embodiment further describes Embodiment 1, and the discount factor γ=0.9.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for controlling, optimizing and selecting of heterogeneous network access based on Q-learning belongs to the field of wireless networks. The method solves the problem that for a wideband code division multiple access / wireless local area network (WCDMA / WLAN) converged heterogeneous network system, network types selected by adoption of an access method based on measurement can not achieve the global optimum and network types selected by adoption of an access method based on models are too complicated in calculation and hard to be applied to actual systems. The method for controlling, optimizing and selecting of the heterogeneous network access based on the Q-learning comprises the steps of Step 1, judging a heterogeneous network state when a new user accesses a network; and Step 2, inquiring a Q-value form and selecting a sub-network which corresponds to the maximum Q value in the Q-value form which corresponds to the heterogeneous network state mentioned in Step 1 to be the access network of the new user. The method is used for quickly selecting the network type to be accessed according to current actual situations when the new user accesses the network.

Description

technical field [0001] The invention relates to a Q-learning-based heterogeneous network access control optimization selection method and belongs to the field of wireless networks. Background technique [0002] With the abundance of terminals such as mobile phones, notebooks, and netbooks, and the rise of various services such as multimedia, a single network has become increasingly unable to meet people's needs for bandwidth and service quality. Users have brought a lot of inconvenience, therefore, the integration of multiple wireless access networks has become a new trend of the next generation wireless network. In all access networks, due to the complementary advantages and disadvantages of 3G wireless network system WCDMA and wireless local area network WLAN, it has attracted the attention of experts from all walks of life. WLAN has the characteristics of high data rate, flexibility, rapid network construction, and personalization, but its coverage is small. WCDMA mobile...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04W48/16
Inventor马琳陈佳美徐玉滨邓志安刘宁庆
Owner哈尔滨工业大学高新技术开发总公司