Wireless Roaming Decisions Using Reinforcement Learning Agents
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Maintaining connectivity for moving wireless devices while minimizing unnecessary roaming and associated costs across varying wireless communications networks is challenging.
Innovation Solution
Utilizing reinforcement learning agents to dynamically determine optimal network transitions based on location, connectivity quality, and historical data to minimize roaming and maximize connectivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a user equipment establishes a PDN connection to a 2G/3G packet core network via a 2G/3G base station, then the user can access packet data services, but the data transmission rate is limited and the quality of service is poor
Solution Approach 1:
The patent introduces a gateway as an intermediary component that enables user equipment to establish a PDN connection to the packet core network through an evolved base station rather than directly through legacy 2G/3G base stations. This gateway acts as a mediator that maintains backward compatibility while enabling higher-speed data transmission through the E-UTRAN, thereby improving both data rate and service quality without requiring user equipment to directly connect to legacy networks
Solution Approach 2:
The patent segments the network connection path into separate functional components: the user equipment connects to the evolved base station for high-speed data transmission, while the gateway handles the connection to the packet core network. This segmentation allows the data path to use the high-capacity E-UTRAN while maintaining compatibility with existing packet core infrastructure, resolving the contradiction between speed and reliability
2Adaptability or versatility
If a user equipment establishes a PDN connection to a 2G/3G packet core network via a 2G/3G base station, then the connection can be established using existing network infrastructure, but the data transmission rate is limited
Solution Approach 1:
The gateway serves as an intermediary that provides network compatibility while enabling high-speed transmission. It allows user equipment to connect to the existing packet core network infrastructure through the new E-UTRAN, maintaining adaptability to legacy systems while achieving improved data rates through the evolved base station interface
3Adaptability or versatility
If the network supports both 2G/3G and 4G services, then users can access both legacy and advanced services, but the network structure becomes complex
Solution Approach 1:
The gateway is designed with multi-functionality to handle both legacy 2G/3G packet core connections and evolved packet core connections through the E-UTRAN. This universal component consolidates multiple network access paths into a single network element, maintaining service coverage for both legacy and advanced services while reducing overall network structural complexity
Solution Approach 2:
The gateway acts as a mediating component that simplifies the network structure by centralizing the connection management between user equipment and different packet core networks. Instead of requiring separate infrastructure for 2G/3G and 4G services, the gateway provides a unified access point that handles both service types, thereby maintaining service coverage while reducing complexity
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method performed by a first wireless device served by a first wireless access point in a first wireless communications network, the first wireless communications network being operated by a first network operator, comprises acquiring (202) a determination from a first reinforcement learning agent of whether to roam from the first wireless access point to a second wireless access point in a second wireless communications network, the second wireless communications network being operated by a second network operator. The method further includes roaming (204) from the first wireless access point to the second wireless access point, based on the determination.