Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for managing heterogeneous network resources based on reinforcement learning

A heterogeneous network and resource management technology, applied in the field of wireless resource management, can solve problems such as the inability to meet user business needs, and achieve the effect of improving resource utilization.

Inactive Publication Date: 2011-11-09
NANJING UNIV OF POSTS & TELECOMM
View PDF2 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the rapid development of wireless communication technology, multiple wireless access technologies coexist. Since these wireless access systems are designed for certain types of services and user groups, the network coverage , available bandwidth, tariff level, support for user mobility, and quality of service (QoS) guarantees, etc., all have certain differences. Complex and changeable business requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for managing heterogeneous network resources based on reinforcement learning
  • Method for managing heterogeneous network resources based on reinforcement learning
  • Method for managing heterogeneous network resources based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The present invention takes figure 1 The network environment shown is the background. This heterogeneous network is covered by a network N with the largest coverage area and the least available bandwidth resources. The network coverage area is a circle with a radius of R and the number of available bandwidth resources is B. At the same time, in order to meet the service requests of some hotspot areas, some networks with small coverage but rich bandwidth resources are repeatedly covered within the network range. i , the coverage area of ​​each network is a circle with radius Ri. The number of available bandwidth resources for each network is B i , where B i >B(i≥1). The bandwidth resources allocated by the network to each user are based on the basic bandwidth units (BWU), according to 2 b BWU to allocate (b=0,1,2,...).

[0014] According to the 3GPP (3rd Generation Partnership Project) definition of 3G system service types, we selected three different services, voic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for managing heterogeneous network resources based on reinforcement learning. In the method, reinforcement learning is adopted in the resource management of heterogeneous wireless network according to multiple business needs and various call types of the heterogeneous network, different call types is treated differently by assigning different processing priorities, different resource allocation policies for different business types, a bandwidth adaptive equalization factor based on load and a profit function based on bandwidth are given, the bandwidth adaptive equalization factor is combined with the profit function to form a reward function, load balance among different networks and adaptive bandwidth allocation in the same network is realized in the condition of meeting various requirements on business bandwidth as much as possible, and the resource utilization rate is improved.

Description

technical field [0001] The invention relates to a wireless resource management method especially used in a heterogeneous network environment, and adopts a control strategy of reinforcement learning, belonging to the technical field of communication. Background technique [0002] With the rapid development of wireless communication technology, multiple wireless access technologies coexist. Since these wireless access systems are designed for certain types of services and user groups, the network coverage , available bandwidth, tariff level, support for user mobility, and quality of service (QoS) guarantees, etc., all have certain differences. Complex and changeable business requirements. Since the current wireless access systems overlap in many areas, these overlapping wireless access systems can be intelligently integrated to jointly provide users with wireless access services anytime and anywhere , thereby forming a heterogeneous wireless network (Heterogeneous Wireless N...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04W28/08H04W72/04
Inventor 朱琦赵彦清赵夙
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products