O-RAN Traffic Steering xApp for Per-UE Handover Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 5G and 6G cellular networks face challenges in providing fine-grained control of Radio Access Network (RAN) functionalities for heterogeneous use cases due to limitations in traditional architectures, particularly in optimizing handover decisions for UEs with varying requirements, which are not adequately addressed by traditional RRM solutions based on heuristics.
Innovation Solution
A Deep Reinforcement Learning (DRL)-based method is employed within the O-RAN framework to optimize traffic steering (TS) for handover decisions, utilizing a Near-RT RIC platform with open interfaces and service models, leveraging Conservative Q-learning (CQL) and Random Ensemble Mixture (REM) variants of the Deep Q-Network (DQN) algorithm, and a Convolutional Neural Network (CNN) architecture to maximize UE throughput and QoS.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional RRM heuristics are used for handover decisions, then device complexity is reduced and ease of operation is improved, but manufacturing precision (optimization accuracy) and reliability are insufficient for heterogeneous use cases
Solution Approach 1:
The patent introduces an intermediary AI/ML-based handover optimization system that sits between traditional RRM heuristics and actual handover decisions. This intermediary layer processes network state information, predicts optimal handover targets, and generates recommendations that are then executed by the RAN controller, thereby improving optimization accuracy without requiring complete redesign of the existing RAN architecture.
Solution Approach 2:
The handover optimization function is segmented into distinct modular components: data collection module, AI/ML model module, decision generation module, and execution module. Each component performs a specific function and can be independently developed, trained, and deployed. This segmentation allows the complex optimization task to be broken down into manageable parts while maintaining high accuracy through the coordinated work of specialized modules.
2Productivity
If per-UE control and optimization is implemented, then productivity (network performance) is improved, but device complexity and difficulty of detecting and measuring increase
Solution Approach 1:
The patent implements a universal AI/ML-based optimization framework that can handle multiple UE types (eMBB, URLLC, mMTC) and various network conditions through a single multi-functional system. The same core architecture processes handover decisions for different UEs, adapting to specific requirements through configurable parameters and trained models rather than requiring separate specialized systems for each UE type or scenario.
Solution Approach 2:
The system uses simulation and digital twin techniques to create virtual copies of the network environment for training and testing AI/ML models before deployment. By copying network states and behaviors in a virtual environment, the system can extensively monitor, measure, and optimize handover decisions without impacting real network performance, thereby reducing the actual monitoring complexity deployed in production.
3Adaptability or versatility
If AI/ML algorithms are onboarded through custom xApps, then adaptability to evolving use cases is improved, but device complexity and ease of manufacture worsen
Solution Approach 1:
The patent implements a dynamic xApp ecosystem where handover optimization applications can be continuously developed, trained, updated, and deployed without requiring changes to the core RAN infrastructure. The system dynamically adapts to evolving use cases by onboarding new xApps that incorporate latest AI/ML techniques and network requirements, with the capability to hot-swapping and incremental updates that maintain service continuity while improving adaptability.
Data Source
Figure 1
Figure 2a
Figure 2b
AI summary
A method of optimizing traffic steering (TS) radio resource management (RRM) decisions for handover of individual user equipment (UE) in Open Radio Access Network (O-RAN) includes: providing an O-RAN-compliant near real time RAN intelligent controller (near-RT RIC) configured to interact with O-RAN nodes; and utilizing an artificial intelligence (Al)-based TS application xApp in the near-RT RIC to optimize TS handover control and maximize UE throughput utility. The TS xApp is configured utilizing a virtualized and simulated environment for O-RAN, which virtualized and simulated environment for O-RAN is provided by ns-O-RAN platform. The optimization problem to be solved is formulated as a Markov Decision Process (MDP), and a solution to the optimization problem is derived by using at least one reinforcement learning (RL) technique.