Relative user equipment performance feedback

Abstract

A method is provided that includes receiving a request for information regarding relative user equipment (UE) performance for one or more UEs. The method includes collecting one or more UE performance measurements for the one or more UEs based on the request. The method includes performing an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs. And the method includes reporting the relative UE performance for at least one of the one or more UEs based on the evaluation. A corresponding apparatus is also provided.

Description

RELATIVE USER EQUIPMENT PERFORMANCE FEEDBACKTECHNOLOGICAL FIELD

[0001] The present disclosure relates generally to telecommunications and, in particular, to user equipment performance feedback collection and reporting.BACKGROUND

[0002] A telecommunications system can be seen as a facility that enables communication sessions between two or more entities such as user terminals, base stations and / or other nodes by providing carriers between the various entities involved in the communications path. A telecommunications system can be provided for example by means of a communication network and one or more compatible communication devices. The communication sessions may comprise, for example, communication of data for carrying communications such as voice, video, electronic mail (email), text message, multimedia and / or content data and so on. Nonlimiting examples of services provided comprise two-way or multi-way calls, data communication or multimedia services and access to a data network system, such as the Internet.

[0003] In a wireless telecommunications system at least a part of a communication session between at least two stations occurs over a wireless link. Examples of wireless systems comprise public land mobile networks (PLMN), satellite based communication systems and different wireless local networks, for example wireless local area networks (WLAN). Some wireless systems can be divided into cells, and are therefore often referred to as cellular systems.

[0004] A user can access the telecommunications system by means of an appropriate communication device or terminal. A communication device of a user may be referred to as user equipment (UE) or user device. A communication device is provided with an appropriate signal receiving and transmitting apparatus for enabling communications, for example enabling access to a communication network or communications directly with other users. The communication device may access a carrier provided by a station, for example a base station of a cell, and transmit and / or receive communications on the carrier.

[0005] The telecommunications system and associated devices typically operate in accordance with a given standard or specification which sets out what the various entities associated with the system are permitted to do and how that should be achieved. Communication protocols and / or parameters which shall be used for the connection are also typically defined. One example of a telecommunications system is the Universal Mobile Telecommunications System (UMTS). Other examples of telecommunications systems are Long-Term Evolution (LTE), LTE Advanced and the so-called 5G or New Radio (NR) networks. NR is being standardized by the 3rd Generation Partnership Project (3GPP).BRIEF SUMMARY

[0006] Example implementations of the present disclosure are directed to telecommunications and, in particular, to user equipment performance feedback collection and reporting. The present disclosure includes, without limitation, the following example implementations.

[0007] Some example implementations provide an apparatus comprising: at least one memory configured to store instructions; and at least one processing circuitry configured to access the at least one memory, and execute the instructions to cause the apparatus to at least: send a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receive at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluate an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0008] Some example implementations provide an apparatus comprising: means for sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; means for receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected atthe radio access node and a UE performance reference value; and means for evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0009] Some example implementations provide a method comprising: sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0010] Some example implementations provide a computer-readable storage medium that is non-transitory and has instructions stored therein that, in response to execution by at least one processing circuitry, causes an apparatus to at least: send a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receive at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluate an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0011] Some example implementations provide an apparatus comprising: at least one memory configured to store instructions; and at least one processing circuitry configured to access the at least one memory, and execute the instructions to cause the apparatus to at least: receive a request for information regarding relative user equipment (UE) performance for one or more UEs; collect one or more UE performance measurements for the one or more UEs based on the request; perform an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and report the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0012] Some example implementations provide an apparatus comprising: means for receiving a request for information regarding relative user equipment (UE) performance for oneor more UEs; means for collecting one or more UE performance measurements for the one or more UEs based on the request; means for performing an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and means for reporting the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0013] Some example implementations provide a method comprising: receiving a request for information regarding relative user equipment (UE) performance for one or more UEs; collecting one or more UE performance measurements for the one or more UEs based on the request; performing an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and reporting the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0014] Some example implementations provide a computer-readable storage medium that is non-transitory and has instructions stored therein that, in response to execution by at least one processing circuitry, causes an apparatus to at least: receive a request for information regarding relative user equipment (UE) performance for one or more UEs; collect one or more UE performance measurements for the one or more UEs based on the request; perform an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and report the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0015] These and other features, aspects, and advantages of the present disclosure will be apparent from a reading of the following detailed description together with the accompanying figures, which are briefly described below. The present disclosure includes any combination of two, three, four or more features or elements set forth in this disclosure, regardless of whether such features or elements are expressly combined or otherwise recited in a specific example implementation described herein. This disclosure is intended to be read holistically such that any separable features or elements of the disclosure, in any of its aspects and example implementations, should be viewed as combinable unless the context of the disclosure clearly dictates otherwise.

[0016] It will therefore be appreciated that this Brief Summary is provided merely for purposes of summarizing some example implementations so as to provide a basic understandingof some aspects of the disclosure. Accordingly, it will be appreciated that the above described example implementations are merely examples and should not be construed to narrow the scope or spirit of the disclosure in any way. Other example implementations, aspects and advantages will become apparent from the following detailed description taken in conjunction with the accompanying figures which illustrate, by way of example, the principles of some described example implementations.BRIEF DESCRIPTION OF THE FIGURE(S)

[0017] Having thus described example implementations of the disclosure in general terms, reference will now be made to the accompanying figures, which are not necessarily drawn to scale, and wherein:

[0018] FIG. 1 illustrates a telecommunications system that includes one or more public land mobile networks (PLMNs) coupled to one or more external data networks, according to some example implementations of the present disclosure;

[0019] FIG. 2 illustrates a deployment of a PLMN, according to some example implementations;

[0020] FIG. 3 illustrates a deployment of a PLMN including multiple radio access nodes, according to some example implementations;

[0021] FIG. 4 illustrates a signaling chart of a data collection initiation procedure according to 3GPP Release 18;

[0022] FIG. 5 illustrates user equipment (UE) performance reporting of actual measurements according to 3 GPP Release 18;

[0023] FIG. 6 is a signaling chart of data collection initiation and data collection reporting procedures for UE performance feedback;

[0024] FIG. 7 illustrates relative UE performance reporting in which a UE performance reference value is determined by a first radio access node, according to some example implementations;

[0025] FIG. 8 illustrates relative UE performance reporting in which a UE performance reference value is determined by a second radio access node, according to some example implementations;

[0026] FIG. 9 illustrates a signaling chart of a data collection initiation procedure according to some example implementations;

[0027] FIG. 10 illustrates a signaling chart of a data collection reporting procedure according to some example implementations;

[0028] FIG. 11 illustrates a signaling chart of data collection reporting initiation and data collection reporting procedures, according to some example implementations;

[0029] FIG. 12 illustrates a signaling chart of data collection reporting initiation and data collection reporting procedures, according to some other example implementations;

[0030] FIGS. 13Aand 13B illustrate a signaling chart of data collection reporting initiation and data collection reporting procedures, according to yet other example implementations;

[0031] FIGS. 14 A, 14B and 14C are flowcharts illustrating various steps in a method according to various example implementations;

[0032] FIGS. 15Aand 15B are flowcharts illustrating various steps in a method according to various example implementations; and

[0033] FIG. 16 illustrates an apparatus according to some example implementations.DETAILED DESCRIPTION

[0034] Some implementations of the present disclosure will now be described more fully hereinafter with reference to the accompanying figures, in which some, but not all implementations of the disclosure are shown. Indeed, various implementations of the disclosure may be embodied in many different forms and should not be construed as limited to the implementations set forth herein; rather, these example implementations are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Like reference numerals refer to like elements throughout.

[0035] Unless specified otherwise or clear from context, references to first, second or the like should not be construed to imply a particular order. A feature described as being above another feature (unless specified otherwise or clear from context) may instead be below, and vice versa; and similarly, features described as being to the left of another feature else may instead be to the right, and vice versa. Also, while reference may be made herein to quantitative measures, values, geometric relationships or the like, unless otherwise stated, any one or more if not all of thesemay be absolute or approximate to account for acceptable variations that may occur, such as those due to engineering tolerances or the like.

[0036] As used herein, unless specified otherwise or clear from context, the “or” of a set of operands is the “inclusive or” and thereby true if and only if one or more of the operands is true, as opposed to the “exclusive or” which is false when all of the operands are true. Thus, for example, “[A] or [B]” is true if [A] is true, or if [B] is true, or if both [A] and [B] are true. Further, the articles “a” and “an” mean “one or more,” unless specified otherwise or clear from context to be directed to a singular form. Furthermore, it should be understood that unless otherwise specified, the terms “data,” “content,” “digital content,” “information,” and similar terms may be at times used interchangeably. The term “network” may refer to a group of interconnected computers including clients and servers; and within a network, these computers may be interconnected directly or indirectly by various means including via one or more switches, routers, gateways, access points or the like.

[0037] Reference may be made herein to terms specific to a particular system, architecture or the like, but it should be understood that example implementations of the present disclosure may be equally applicable to any of a number of systems, architectures and the like. For example, reference may be made to 3 GPP technologies such as Global System for Mobile Communications (GSM), UMTS, LTE, LTE Advanced, 5GNR, 5G Advanced and 6G; however, it should be understood that example implementations of the present disclosure may be equally applicable to non-3 GPP technologies such as IEEE 802, Bluetooth and Bluetooth Low Energy.

[0038] Further, as used in this application, the term “circuitry” may refer to one or more or all of the following: (a) hardware-only circuit implementations (such as implementations in only analog and / or digital circuitry); (b) combinations of hardware circuits and software, such as (as applicable): (i) a combination of analog and / or digital hardware circuit(s) with software / firmware and (ii) any portions of hardware processor(s) with software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions); or (c) hardware circuit(s) and / or processor(s), such as a microprocessor s) or a portion of a microprocessor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation.

[0039] The above definition of circuitry applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term circuitry also covers an implementation of merely a hardware circuit or processor (or multiple processors) or portion of a hardware circuit or processor and its (or their) accompanying software and / or firmware. The term circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit or processor integrated circuit for a mobile device or a similar integrated circuit in server, a cellular network device, or other computing or network device.

[0040] FIG. 1 illustrates a telecommunications system 100 according to various example implementations of the present disclosure. The telecommunications system generally includes one or more telecommunications networks. As shown, for example, the system includes one or more public land mobile networks (PLMNs) 102 coupled to one or more other external data networks 104 - notably including a wide area network (WAN) such as the Internet. Each of the PLMNs includes a core network (CN) 106 backbone such as the Evolved Packet Core (EPC) of LTE, the 5G core network (5GC) or the like; and each of the core networks and the Internet are coupled to one or more radio access networks (RANs) 108, air interfaces or the like that implement one or more radio access technologies (RATs). As used herein, a “network device” refers to any suitable device at a network side of a telecommunications network. Examples of suitable network devices are described in greater detail below.

[0041] In addition, the system includes one or more radio units that may be varyingly known as user equipment (UE) 110, terminal device, terminal equipment, mobile station or the like. The UE is generally a device configured to communicate with a network device or a further UE in a telecommunications network. The UE may be a portable computer (e.g., laptop, notebook, tablet computer), mobile phone (e.g., cell phone, smartphone), wearable computer (e.g., smartwatch), or the like. In other examples, the UE may be an Internet of things (loT) device, an industrial loT (IIoT device), a vehicle equipped with a vehicle-to-everything (V2X) communication technology, or the like. In some examples, as referenced by 3 GPP, the UE may be a narrowband loT (NB-IoT) device, an enhanced machine-type communication (eMTC) device, a reduced capability (RedCap) device, an ambient loT device, or the like.

[0042] In operation, these UEs 110 may be configured to connect to one or more of the RANs 108 according to their particular radio access technologies to thereby access a particularCN 106 of a PLMN 102, or to access one or more of the external data networks 104 (e.g., the Internet). The external data network may be configured to provide Internet access, operator services, 3rd party services, etc. For example, the International Telecommunication Union (ITU) has classified 5G mobile network services into three categories: enhanced mobile broadband (eMBB), ultra-reliable and low-latency communications (URLLC), and massive machine type communications (mMTC) or massive internet of things (MIoT).

[0043] Examples of radio access technologies include 3 GPP radio access technologies such as GSM, UMTS, LTE, LTE Advanced, 5GNR, 5G Advanced, and 6G. Other examples of radio access technologies include IEEE 802 technologies such as IEEE 802.11 (Wi-Fi), IEEE 802.15 (including 802.15.1 (WPAN / Bluetooth), 802.15.4 (Zigbee) and 802.15.6 (WBAN)), Bluetooth, Bluetooth Low Energy (BLE), ultra wideband (UWB), and the like. Generally, a radio access technology may refer to any 2G, 3G, 4G, 5G, 6G or higher generation mobile communication technology and their different versions, as well as to any other wireless radio access technology that may be arranged to interwork with such a mobile communication technology to provide access to the CN 106 of a mobile network operator (MNO).

[0044] In various examples, a RAN 108 may be configured as one or more macrocells, microcells, picocells, femtocells or the like. The RAN may generally include one or more radio access nodes that are configured to interact with UEs 110. In various examples, a radio access node may be referred to as a base station (BS), access point (AP), base transceiver station (BTS), Node B (NB), evolved NB (eNB), macro BS, NB (MNB) or eNB (MeNB), home BS, NB (HNB) or eNB (HeNB), next generation NB (gNB), enhanced gNB (en-gNB), next generation eNB (ng- eNB), or the like. The RAN may include some type of network controlling / governing entity responsible for control of the radio access nodes. The network controlling / governing entity and radio access node may be separate or integrated into a single apparatus. The network controlling / governing entity may include processing circuity configured to carry out various management functions, etc. The processing circuity may be associated with a memory, computer- readable storage medium or database for maintaining information required in the management functions.

[0045] A RAN 108 may be centralized or distributed. In various examples, components of a RAN may be interconnected by Ethernet, Gigabit Ethernet, Asynchronous Transfer Mode (ATM), optical fiber, dark fiber, passive wavelength division multiplexing (WDM), WDMpassive optical network (WDM-PON), optical transport network (OTN), time sensitive networking (TSN) and / or any other data link layer network, possibly including radio links. The RAN may be connected to a CN 106 through one or more gateways, network functions or the like.

[0046] As will be appreciated, a PLMN 102 may be deployed in a number of different manners. In a 4G LTE deployment, the EPC is the CN 106, and the evolved UMTS terrestrial radio access network (E-UTRAN) is the RAN 108; and the E-UTRAN includes one or more eNBs (radio access nodes) configured to connect UEs 110 to the E-UTRAN to thereby access the EPC. FIG. 2 illustrates a deployment 200, such as a 5G or 6G deployment. As shown, the 5GC 202 is the CN, and the next generation (NG) radio access network (NG-RAN) 204 is the RAN; and the NG-RAN includes one or more NG-RAN nodes 206 (radio access nodes) configured to connect UEs 208 to the NG-RAN to thereby access the 5GC (at times referred to as the NGC). In this context, a NG-RAN node may be a gNB or a ng-eNB. The term ‘gNB’ in 5G may correspond to the eNB in 4G LTE.

[0047] Some deployments of 4G LTE and 5G in particular are considered standalone (SA) deployments. Other deployments combine 4G LTE and 5 G technologies, and are referred to as non-standalone (NSA) deployments. In some deployments, the E-UTRAN includes one or more ng-eNBs that are configured to communicate with the 5GC, and that may also be configured to communicate with one or more gNBs. Similarly, in another deployment, the NG-RAN may include one or more en-gNBs that are configured to communicate with the EPC, and that may also be configured to communicate with one or more eNBs. In various instances, a single UE 208, a dual-mode or multimode UE, may support multiple (two or more) RANs — thereby being configured to connect to multiple RANs, such as 4G LTE and 5G.

[0048] In some deployments, operations of a radio access node (e.g., NG-RAN node 206) may be distributed or functionally split into components including one or more remote radio head (RRHs) or radio units (RUs), and a baseband unit (BBU); and in some architectures, the BBU may be split into a distributed unit (DU) and a central / centralized unit (CU), such as a server, host or node. In some architectures, the RRH / RU and DU may be collocated. It is also possible that node operations may be distributed among a plurality of servers, hosts or nodes.

[0049] It should also be understood that the distribution of work between core network operations and radio access node operations may vary depending on implementation. Thus, a 5Gnetwork architecture may be based on a so-called CU-DU split. One gNB-CU (central node) may control one or more gNB-DUs. The gNB-CU may control a plurality of spatially separated gNB- DUs, acting at least as transmit / receive (Tx / Rx) nodes. In some example implementations, however, the gNB-DUs (also called DU) may include, for example, a radio link control (RLC), medium access control (MAC) layer and a physical (PHY) layer, whereas the gNB-CU (also called a CU) may include the layers above the RLC layer, such as a packet data convergence protocol (PDCP) layer, a radio resource control (RRC), and an internet protocol (IP) layer. Other functional splits are also possible. It is considered that skilled person is familiar with the OSI model and the functionalities within each layer.

[0050] In some example implementations, the server or CU may generate a virtual network through which the server communicates with the radio node. In general, virtual networking may involve a process of combining hardware and software network resources and network functionality into a single, software-based administrative entity, a virtual network. Such virtual network may provide flexible distribution of operations between the server and the radio head / node. In practice, any digital signal processing task may be performed in either the CU or the DU, and the boundary where the responsibility is shifted between the CU and the DU may be selected according to implementation.

[0051] Although only one NG-RAN node 206 is shown in FIG. 2, the deployment may include multiple NG-RAN nodes. FIG. 3 illustrates an example including multiple NG-RAN nodes 206 connected to one another by a network interface, such as an Xn interface. The Xn interface may be used for various purposes such as in UE context retrieval, handover procedures, interference co-ordination, load balancing / management, and the like. Similarly, the NG-RAN nodes may be connected to the 5GC 202 by a network interface. As also shown, in 5GNR, the network interface between a NG-RAN node and the CN is referred to as the NG interface, which is a network interface between the NG-RAN node and network functions of the 5GC, including an access and mobility management function (AMF) / user plane function (UPF) 302.

[0052] The network interface between the NG-RAN node 206 and the 5GC 202 may support the exchange of signaling messages between the NG-RAN 204 and the 5GC. The signaling messages may be formatted according to an application layer protocol, such as the NG application protocol (NGAP) for the NG interface. The NGAP supports a number of procedures, comprising elementary procedures, such as to establish, maintain or release the RAN part of acommunication session between a UE 208 and external data network 104 (referred to in 5G NR as a packet data unit (PDU) session), perform handover of a UE, and the like.

[0053] As specified by 3 GPP, the RRC layer of the 5G radio protocol stack is responsible for various control functions such as synchronization, connection establishment and its management, facilitating security and reliable messaging, radio resource management, signaling handling, dedicated and broadcast network configuration management, mobility procedures paging notification.

[0054] The operation of the RRC is guided by a state machine which defines certain specific states that a UE 208 may be present in. The different states in the RRC state machine have different amounts of radio resources associated with them and these are the resources that the UE may use when the UE is present in each state. Since different amounts of resources are available at different states, the quality of the service that the user experiences and the energy consumption of the UE are influenced by this state machine. Relative to previous generations, 5G NR supplemented RRC IDLE and RRC CONNECTED states by an RRC INACTIVE state, which offers light connectivity with major power saving methods integrated into the state.

[0055] In Release 18, 3 GPP introduced artificial intelligence (Al) / machine learning (ML) functionality in the RAN by allowing NG-RAN nodes 206 to exchange several measurements related to AI / ML. Those measurements comprised predictions related to load such as predicted number of RRC connections, predicted number of active UEs and predicted radio resource status, an energy cost index that is a node level measured Energy Consumption index, measured and predicted UE trajectory information and UE Performance measurements. As introduced, the exchanged information may be used to enable a number of use cases, including AI / ML energy saving, AI / ML load balancing, and AI / ML mobility optimization. In some examples, a source node may configure a candidate target node with UE performance measurements to be reported after successful handover execution to the target node.

[0056] UE performance feedback includes a set of measurements corresponding to UE performance that may be exchanged between NG-RAN nodes 206. In Release 18, UE performance measurements include downlink (DL) throughput, uplink (UL) throughput, packet loss and packet delay, although other measurements may also be considered, such as those related to quality of experience (QoE) or to an energy consumption of a UE 208. The measurement collection for UE Performance measurements may start after successful executionof a handover procedure and continue until the collected UE performance measurements are reported according to one-shot or periodic reporting.

[0057] UE performance measurements may serve to enable a NG-RAN node 206 to evaluate the UE performance immediately after a handover decision to determine whether the handover decision was a good decision or not, based on the impact to a UE’s performance. In this regard, in some contexts, a first NG-RAN node that requests data collection may be a source node, and a second NG-RAN node that is requested to collect the data may be a target node.

[0058] FIG. 4 illustrates a signaling chart 400 of a data collection initiation procedure according to 3GPP Release 18. As shown, a first NG-RAN node 206A (NG-RAN node 1) initiates the procedure at step 401 by sending a data collection request message to request that a second NG-RAN node 206B (NG-RAN node 2) collect UE performance feedback. The data collection request message may include a UE Performance information element (IE) that indicates the UE performance metrics to be collected by the second NG-RAN node, and a UE Performance Collection Configuration IE with a Collection Time Duration IE that indicates a measurement collection duration during which the UE performance measurements are to be collected. The data collection request message may also include Reporting Periodicity for Data Collection IE that indicates the periodicity for the measurement reporting. If the second NG- RAN node is capable of providing the requested information, the second NG-RAN node at step 402 responds with a data collection response message.

[0059] A number of conditions are also specified for termination of the UE performance data collection. For example, the second NG-RAN node 206B may terminate the data collection when the time since UE 208 was successfully handed over to the second NG-RAN node is equal to the value of the Collection Time Duration. In another example, the second NG-RAN node may terminate the data collection if the UE moves to the RRC INACTIVE or RRC IDLE state, or if the UE is handed over to a cell belonging to another NG-RAN node different from the second NG-RAN node.

[0060] FIG. 5 illustrates UE performance reporting of actual measurements according to 3GPP Release 18. As shown, the second NG-RAN node 206B reports UE performance measurements based on a configuration that may include a measurement collection duration starting at successful handover execution within which the UE performance measurements are collected. The UE performance may be reported in one-shot or periodically, according to aperiodicity indicated in the data collection request message. A UE 208 may continue the collection of UE performance measurements (reported to the first NG-RAN node by the second NG-RAN node) until either the time since UE was successfully handed over to the second NG- RAN node is equal to the value of the Collection Time Duration IE, until UE moves to RRC INACTIVE or RRC IDLE state, or until the UE is handed over to another cell.

[0061] The above procedures support only detailed feedback using actual or absolute measurements of UE performance at the second NG-RAN node 206B at each reporting period. The frequency of the reported measurements may be reduced by adjusting the reporting periodicity provided in the Reporting Periodicity for Data Collection IE, that is, by using a higher value for the reporting periodicity (e.g., to 1 seconds instead of 500 milliseconds) or by increasing the reporting periodicity (e.g., 2 seconds instead of 500 milliseconds). But the reporting periodicity is static and therefore applies to all UEs 208 that are associated with a corresponding Data Collection ID that indicates NG-RAN node measurement IDs which identify a data collection reporting context.

[0062] Also, the configuration of the reporting periodicity is also only performed at the first NG-RAN node 206A. The second NG-RAN node 206B is primarily responsible just for collecting and reporting the performance measurements. In some scenarios, this may result the second NG-RAN node reporting a large number of UE performance measurements per UE 208 even though the exact value of those measurements are not relevant or important to the first NG- RAN node.

[0063] Detailed measurements as feedback and first NG-RAN node-based evaluation is not optimal in all scenarios. Detailed feedback (actual measurement in each reporting period) is the only supported option to exchange UE performance feedback between NG-RAN nodes in Release 18. FIG. 6 is a signaling chart 600 of data collection initiation and data collection reporting procedures for UE performance feedback. As shown, the data collection initiation procedure includes a first NG-RAN node 206A (NG-RAN node 1) at step 601 sending a data collection request message to request that a second NG-RAN node 206B (NG-RAN node 2) collect UE performance feedback, and the second NG-RAN node at step 602 responding with a data collection response message, such as in a manner similar to that described above with respect to FIG. 4.

[0064] Following the data collection initiation procedure, the data collection reporting procedure includes, at steps 603A, 603B, 603C and 603D, the second NG-RAN node 206B periodically reporting UE performance measurements in data collection update messages. The first NG-RAN node 206A receives and performs an evaluation of the UE performance measurements. As shown at steps 604A, 604B, 604C and 604D, in some examples, the first NG- RAN node may perform an evaluation after the receipt of each UE performance measurement. In other examples, the first NG-RAN node may perform a consolidated evaluation of the UE performances after the UE performance feedback reporting is terminated.

[0065] The second NG-RAN node 206B collects the UE performance measurements and transparently sends the UE performance measurements to the first NG-RAN node 206 A at each reporting period. When the first NG-RAN node performs the evaluation, the result of the evaluation at the first NG-RAN node may be similar for multiple measurements since the reported values may be almost identical (e.g., reported measurement may be around 1 Mbps in each reporting period). In some scenarios, then, the reported measurements may include redundant data, which may create unnecessary overhead in the Xn interface between the first NG-RAN node and the second NG-RAN node.

[0066] Detailed feedback therefore may not be necessary in all scenarios when the first NG- RAN node 206A is interested UE performance measurements only when those measurements change (e.g., performance degrades or improves beyond a threshold) during the data collection duration. When an AI / ML-based load balancing or network energy saving action is triggered, for example, the action typically involves a set of UE(s) 208 that should be handed over to another node. The first NG-RAN node may not be interested in detailed measurement for all UEs. For some UE(s), the first NG-RAN node may be interested only in coarse feedback, e.g., where there is a significant degradation in the UE performance feedback. This may be for UE(s) with guaranteed bit rate (GBR) bearers such as voice or video, or for non-GBR bearers such as browsing sessions or other data services. Currently, however, the first NG-RAN node may either not trigger any feedback from the second NG-RAN node 206B or trigger periodic or one-shot reporting of detailed measurements only. The NG-RAN nodes are currently unable to collect and exchange coarse feedback. Detailed feedback also increases the amount of data exchanged over the Xn interface when feedback is periodically collected for multiple UEs.

[0067] In view of the foregoing, some example implementations of the present disclosure provide a solution in which coarse, relative or flexible UE performance feedback for multiple UEs 208 may be configured and exchanged between NG-RAN nodes 206. According to some example implementations, data collection reporting may be triggered based on UE performance changes at the second NG-RAN node 206B, namely, depending on variation of UE performance measurements.

[0068] Example implementations of the present disclosure may be applicable to a number of different use cases, such as load balancing or network energy saving where the first NG-RAN node 206A is not interested in detailed measurements for all UEs 208. In load balancing or network energy saving use cases, a handover action may not be triggered for coverage reasons (e.g., mobility), but for overall energy saving. Even in this case, the best target cell may be chosen before a handover action is triggered. This concept may also be used to optimize UE performance feedback reporting involving a single UE, such as for mobility robustness optimization.

[0069] High variation between the reported measurements is typically caused by drastic changes in the radio condition or bearer characteristics after a handover to a target cell. This does not apply in most cases of UE performance feedback, however, since the best cell is selected based on the reported radio conditions and the bearer(s) are already prepared in the target cell before the handover procedure is executed. It may therefore be possible to optimize the reporting when this condition is detected. In cases in which there is still a significant variation, the solution provided by example implementations of the present disclosure may enable fallback to the Release 18 data collection reporting in which actual measurements are sent in each reporting period.

[0070] According to some example implementations, NG-RAN nodes 206 may exchange relative UE performance with respect to a UE performance reference value. A second NG-RAN node 206B may therefore notify a first NG-RAN node 206A only when the UE performance changes compared to this UE performance reference value. This may be achieved by performing a comparison of UE performance measurements at a cell of the second NG-RAN node (e.g., a target cell) and a UE performance reference value, and then deciding whether an event or triggering condition is met in order to send the feedback. In each reporting period, for example, the second NG-RAN mode may evaluate if a UE performance measurement differs from the UEperformance reference value (e.g., average UE performance measurement), and decide whether send the feedback based on the difference.

[0071] In some example implementations, the second NG-RAN node 206B may start the collection UE performance measurements for each UE 208; and in some examples, the second NG-RAN node may calculate an average UE performance measurement using the UE performance measurements. In each reporting period, the second NG-RAN node may evaluate if a UE performance measurement differs from the UE performance reference value (e.g., average UE performance measurement) by more than a threshold, which may be configured. If this condition is true, the UE performance measurement for the UE is sent to the first NG-RAN node 206A; otherwise, if it is not true, the UE performance measurement for the UE is not sent to the first NG-RAN node. The same evaluation may be repeated for each UE for each reporting period until the reporting period ends or a terminating condition for UE performance is met.

[0072] In the first NG-RAN node 206A, for each UE 208 for which a UE performance measurement is not included in a reporting period, the first NG-RAN node may infer that the UE performance at the second NG-RAN node 206B is within the threshold of the UE performance reference value. For each UE for which the UE performance measurement is included, the first NG-RAN node may infer or determine that the UE performance at the second NG-RAN node differs from the UE performance reference value by more than the threshold in that reporting period.

[0073] Relative Performance evaluation is based on UE performance reference value. The UE performance reference value can be derived or otherwise determined in a number of different manners. In some examples, the UE performance reference value may be determined by the first NG-RAN node 206A based on UE performance at the first NG-RAN node. The UE performance reference value may be an instantaneous value just before the UE handover, an average over a period before handover, an average over a time the UE is served by the first NG-RAN node, or the like. FIG. 7 illustrates relative UE performance reporting in which a UE performance reference value is determined by the first NG-RAN node, and measurement / comparison and reporting is performed at the second NG-RAN node 206B, according to some example implementations.

[0074] In other examples, the UE performance reference value may be determined by the second NG-RAN node 206B based on an initial UE performance at the second NG-RAN nodeitself. In some of these other examples, the first NG-RAN node 206A may send information to the second NG-RAN node on how to determine the UE performance reference value using initial measurements at the second NG-RAN node. In this regard, the first NG-RAN node may indicate that a first reported measurement from the second NG-RAN node is the UE performance reference value. In other examples, the second NG-RAN node may determine the UE performance reference value as the Nth measurement at the second NG-RAN node, an average of the first N measurements, the measurement reported after a specific time offset following the start of data collection at the second NG-RAN node, or the like. FIG. 8 illustrates relative UE performance reporting in which both UE performance reference value is determined by the second NG-RAN node, and the measurement / comparison and reporting is performed at the second NG-RAN node, according to some example implementations.

[0075] In case of relative UE performance feedback, a measurement may be included in the report only if the measurement is within the threshold relative to the UE performance reference value. Otherwise, the measurement may be left out of the report. The absence of the measurement, then, may indicate that the measurement is within the threshold of the UE performance reference value.

[0076] Consider an example of one UE performance metric for a single UE 208, which may be for a use case of mobility robustness optimization. In this example, further consider a reporting configuration in which the Collection Time Duration is 5 seconds, the Reporting Periodicity for Data Collection is 1 second, and average DL throughput is the UE performance metric requested to be exchanged. When actual UE performance measurements are reported, the second NG-RAN node 206B will report five measurements.

[0077] When the relative UE performance feedback is reported, the number of measurements that are reported by the second NG-RAN node 206B depends on the number of measurements that exceed a configured threshold. If all the measurements are within the threshold, e.g. within a region limited by the threshold, then none of the five measurements are reported; conversely, if all the measurements are outside the threshold (outside the region) from the UE performance reference value, all five of the measurements are reported. For example, if the configured threshold is -5% and if the measurement is not 5% below UE performance reference value, measurement is 'within' the threshold, if the configured threshold is +5% and if the measurement is not 5% above UE performance reference value, measurement is 'within' the threshold, if theconfigured threshold is + / -5% and if the measurement is not 5% below or above UE performance reference value, measurement is 'within' the threshold. Some example implementations therefore result in no more measurements being reported than the case when the actual UE performance measurements are reported. In the average case, if one or more measurements are above the threshold, then n < 5 measurements are reported.

[0078] Now consider an example for a single UE 208 in which all UE performance metrics are reported, again for mobility robustness optimization. In this example, consider a reporting configuration in which the Collection Time Duration is 5 seconds, the Reporting Periodicity for Data Collection is 0.5 seconds, and a maximum number of UE performance measurements is 4. For a given UE, for each reporting interval, the number of measurements reported by the second NG-RAN node 206B may be 0, 40, or some number between 0-40 depending on how many of the measurements are outside the threshold from the UE performance reference value.

[0079] In yet another example, consider multiple UEs 208 in which all UE performance metrics are reported, such as for load balancing or network energy saving. Also consider that 100 UEs are offloaded (handed over from the first NG-RAN node 206A to the second NG-RAN node 206B). In this example, the second NG-RAN node may collect 4000 measurements across all UEs. According to some example implementations of the present disclosure, the data collection update message from the second NG-RAN node may omit a UE if all the measurements are within the threshold, or include a UE with only the set of measurements that are outside the threshold. The relative performance feedback may therefore increase the efficiency in the transmission by significantly reducing the message size of data collection update message when UE performance at the second NG-RAN node is within the threshold for many UE(s) for multiple measurements.

[0080] FIG. 9 illustrates a signaling chart 900 of a data collection initiation procedure according to some example implementations. In a manner similar to the data collection initiation procedure specified by Release 18, a first NG-RAN node 206A may initiate the procedure at step 901 by sending a data collection request message to request that a second NG-RAN node 206B (NG-RAN node 2) collect relative UE performance feedback. And if the second NG-RAN node is capable of providing the requested information, the second NG-RAN node at step 902 responds with a data collection response message.

[0081] Relative to Release 18, the data collection initiation procedure of some example implementations may include a number of signaling enhancements. In some examples, the data collection request message sent at step 901 may be enhanced with an indication whether the configured UE performance feedback is relative (or actual), and an associated relative reporting configuration. In some examples, the indication may be provided by a flag (e.g., UE performance feedback flag) that indicates to the second NG-RAN node 206B whether to report UE performance feedback in a relative or legacy (Release 18) fashion.

[0082] In other examples, the indication whether the configured UE performance feedback is relative (or actual) may be provided in the data collection request message by an optional IE, such as a Relative Reporting Configuration Information IE, that includes relative reporting configuration information. When this IE is present in the data collection request message, the second NG-RAN node may provide relative UE performance feedback to the first NG-RAN node 206A using the Relative Reporting Configuration Information IE in the data collection request message. When the IE is absent from the data collection request message, the second NG-RAN node may instead provide actual UE performance feedback to the first NG-RAN node (Release 18 baseline).

[0083] In some examples, the Relative Reporting Configuration Information IE may also include relevant information such as the UE performance reference value, relative reporting trigger, reporting quantity, or the like. The UE performance reference value indicates the reference value to be used as a reference in the second NG-RAN node 206B. The UE performance reference value may be provided by an IE, such as a UE Performance Reference Value IE. In some examples, this IE may include two sub-IE, such as Source Node-Based UE Performance Reference Value and Target Node-Based UE Performance Reference Value. If the UE performance reference value is determined by the first NG-RAN node 206A, the Source Node-Based UE Performance Reference Value may be included with the value. And if the UE performance reference value is determined by the second NG-RAN node, the Target Node-Based UE Performance Reference Value may be included with the value.

[0084] In some examples, there may be different options to configure the Target Node-Based UE Performance Reference Value. In one option, the Target Node-Based UE Performance Reference Value may be an integer value denoting the Nth measurement to be used as UE performance reference value. The indicated value may be between 1 to a maximum number offeedback measurements (Data Collection Duration divided by Reporting Periodicity for Data Collection) configured in the data collection request message. If the value is set to 1, the first measurement at the second NG-RAN node may be used as the UE performance reference value. In another option, the Target Node-Based UE Performance Reference Value may be an average of the first N measurements at the second NG-RAN node 206B.

[0085] The relative reporting trigger may indicate the threshold or margin of variation between a UE performance measurement and the UE performance reference value. In some examples, the relative reporting trigger may be provided by an IE, such as Relative Reporting Trigger. The value may indicate a positive or negative threshold. If the first NG-RAN node 206A is interested only to know if UE performance has degraded after handover, the first NG-RAN node may set the value of the Relative Reporting Trigger to only a negative value. If the first NG-RAN node is interested to know an overall UE performance change (either improved or degraded), the Relative Reporting Trigger may be set to a + / - value. In a particular example, if the Relative Reporting Trigger includes + / - 5%, the second NG-RAN node 206B may report back to the first NG-RAN node when UE performance in the target node is more than 5% greater or less than the UE performance reference value.

[0086] The reporting quantity indicates how the relative UE performance feedback is reported when the reporting trigger is met. In some examples, the reporting quantity may be provided by an IE, such as Reporting Quantity. The value of this IE may indicate that the second NG-RAN node 206B is to report the measured value itself or an indication of a difference between the measured value and the UE performance reference value. Examples of suitable indications of difference include the actual difference (result of a subtraction), deviation, variance, standard deviation, percentage deviation, percentage variance, or the like.

[0087] There may be a number of options for the first NG-RAN node 206A to trigger the relative UE performance feedback. In one option (explicit), the relative UE performance configuration may only be present if the UE performance feedback flag in the data collection request message indicates the reporting of relative UE performance. When the UE performance feedback flag is set to “relative,” the data collection request message may also include the Relative Reporting Configuration Information IE. When the UE performance feedback flag is not included or otherwise set to “detailed,” the Release 18 behavior may be applicable such that the actual measurements at the second NG-RAN node 206B are reported.

[0088] In another option (implicit), the UE performance feedback flag may be omitted from the data collection request message. Instead, the presence of the Relative Reporting Configuration Information IE itself triggers the relative UE performance feedback. If the Relative Reporting Configuration Information IE is not present, then the Release 18 behavior is applied.

[0089] FIG. 10 illustrates a signaling chart 1000 of a data collection reporting procedure according to some example implementations. Similar to Release 18, following the data collection initiation procedure, the second NG-RAN node 206B at step 1001 periodically reports relative UE performance measurements in data collection update messages. And although not separately shown, the first NG-RAN node 206A receives and performs an evaluation of the relative UE performance measurements.

[0090] Relative to Release 18, some example implementations of the present disclosure provide an enhanced data collection update message. In particular, some example implementations provide a trigger by which the relative UE performance measurements are sent only when the actual measured UE performance at the second NG-RAN node 206B is outside the configured threshold (e.g., Relative Reporting Trigger) from the UE performance reference value (e.g., UE Performance Reference Value). The data collection update message may also include the relative UE performance feedback.

[0091] The data collection update message may include the relative UE performance feedback in a number of different manners. In some examples, the relative UE performance feedback may be provided by an IE, such as a Relative Performance Feedback IE. This IE may either include the measured value of the UE performance measurement or an indication of the difference between the measured value and the UE performance reference value (e.g., actual difference, deviation, variance, standard deviation, percentage deviation, percentage variance). In a first case, in some examples in which the threshold is set to -5% and the UE performance measurement is 5% below the UE performance reference value, the actual measured value may be reported to the first NG-RAN node 206A. In a second case, in some examples in which the threshold is set to +5% and the UE performance measurement is 6% above the UE performance reference value, the deviation of 1% may be indicated back to the first NG-RAN node.

[0092] In some examples, the first NG-RAN node 206A may selectively trigger relative UE performance feedback reporting based on static / semi-static target cell / nodeconfiguration / capability or dynamic UE-specific considerations, such as the service / bearer characteristics or radio conditions of the UE(s) 208 being handed over. The first NG-RAN node may use any specific criteria or a combination of the above.

[0093] In some more particular examples, the first NG-RAN node 206A may trigger granular feedback (Release 18 UE performance feedback) or coarse feedback (relative UE performance feedback) for specific UE(s) 208 based on service / bearer characteristics. In this regard, the first NG-RAN node may trigger course feedback for specific UE(s) or UE groups for which the first NG-RAN node is interested to know only if UE performance degraded below a specific threshold. In some of these examples, the first NG-RAN node may be uninterested in feedback if the UE performance improved in the second NG-RAN node 206B.

[0094] The first NG-RAN node 206A may can identify UE(s) 208 for course feedback (relative UE performance feedback) in a number of different manners. In some examples, the first NG-RAN node hands over some UE(s) to an only available target cell of the second NG- RAN node 206B for network energy saving action (to coverage layer when a capacity layer is de-activated). In some of these examples, the first NG-RAN node may be interested in relative UE performance feedback from the second NG-RAN node for only those UE(s) for which UE performance degraded below a certain threshold.

[0095] In some examples, the first NG-RAN node 206A hands over some UE(s) 208 to a second NG-RAN node 206B for load balancing. In some of these examples, the first NG-RAN node may be interested in detailed UE performance feedback only for UE(s) with specific QCI(s), such as UE(s) with ongoing voice calls (QCI-1) or video calls (QCI-2). For the other UE(s) with QCIs other than QCI-1 or QCI-2, a simple relative UE performance feedback is sufficient.

[0096] The first NG-RAN node 206A may configure different threshold ranges using separate data collection IDs depending on the granularity of the notification requested by the first NG-RAN node for different sets of UE(s). In some examples, the first NG-RAN node 206A may configure two threshold ranges, e.g., -5% and + / -20%, and associate the data collection ID in the corresponding handover requests of UE(s) 208. In some of these examples, for the UE(s) with QCI-l / QCI-2, the first NG-RAN node may associate the data collection ID with a -5% threshold. For those UE(s) with a voice or video call, if the UE performance drops below the 5% threshold, the first NG-RAN node may be notified by the second NG-RAN node 206B. For other UE(s)without QCI-l / QCI-2, the first NG-RAN node may associate the data collection ID with the + / - 20% threshold. In this case, as long as the UE performance does not drop or improve beyond 20%, the second NG-RAN node does not notify the first NG-RAN node.

[0097] In some examples, the first NG-RAN node 206A may trigger granular feedback (Release 18 UE performance feedback) or coarse feedback (relative UE performance feedback) for specific UE(s) 208 based on radio characteristics. In some of these examples, before triggering a handover procedure, the first NG-RAN node may configure the UE to report the target cell measurements. Based on these measurements, the first NG-RAN node may select a specific set of UE(s), such as those UE(s) which only have a single target cell and at least a threshold reported signal strength. In this case, it may be unnecessary for the first NG-RAN node to receive detailed measurements, as relative UE performance feedback is sufficient. The first NG-RAN node may also use the variance of radio characteristics between source cell and target cell to select the UE(s). For example, UE(s) that are in a reduced radio condition in the source cell (cell edge), and would be in a better radio condition (cell edge) in the target cell, may be good candidates for relative feedback. Other UE(s) may be configured with detailed measurements for UE performance feedback.

[0098] In yet other examples, the relative UE performance feedback may be setup considering a target cell configuration compared to the source cell configuration / capabilities. For example, if the target cell (provided by the second NG-RAN node 206B) has same or higher bandwidth compared to the source cell (provided by the first NG-RAN node 206A), the first NG- RAN node may setup relative UE performance feedback with a higher threshold since the second NG-RAN node may be more likely able to allocate sufficient resources to the handed over UE 208. If the target cell has lower bandwidth compared to the source cell, the first NG-RAN node may decide to enable relative performance reporting with a very low margin (e.g., -1%) or use the Release 18 data collection reporting itself.

[0099] Example implementations of the present disclosure therefore provide a first NG-RAN node 206A that may send a request to second NG-RAN node 206B for information regarding relative UE performance for one or more UEs 208 following a handover of the UE(s) to the second NG-RAN node.

[0100] The second NG-RAN node 206B may receive the request from the first NG-RAN node 206A, and collect one or more UE performance measurements for the UE(s) based on therequest. The second NG-RAN node may perform an evaluation in which the UE performance measurement(s) are compared to a UE performance reference value to determine the relative UE performance for the UE(s). The second NG-RAN node may then report the relative UE performance for at least one of the UE(s) based on the evaluation.

[0101] The first NG-RAN node 206A may receive at least one report from the second NG- RAN node 206B based on the request. The first NG-RAN node may then evaluate an impact of the handover on performance of the UE(s) based on the relative UE performance indicated in the at least one report.

[0102] In some examples, the relative UE performance includes an indication of a difference between the UE performance measurement(s) and the UE performance reference value.

[0103] In some examples, the request indicates a threshold, and the UE performance measurement(s) are a plurality of UE performance measurements. In some of these examples, the report(s) that is received by the first NG-RAN node 206A indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0104] In some further examples, the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold. In other examples, the the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0105] In some examples, the first NG-RAN node 206A may determine the UE performance reference value based on UE performance measurements collected at the first NG-RAN node. In some of these examples, the request that is sent to the second NG-RAN node may include the UE performance reference value.

[0106] In some examples in which the UE performance measurement(s) are a plurality of UE performance measurements collected at the second NG-RAN node 206B, the request that is sent to the second NG-RAN node may include an indication for the second NG-RAN node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements. In some of these and other similar examples, the second NG-RAN node 206B may determine the UE performance reference value based on at least some of theplurality of UE performance measurements collected at the second NG-RAN node, such as based on the indication from the first NG-RAN node 206A.

[0107] To further illustrate some example implementations, FIG. 11 illustrates a signaling chart 1100 of data collection reporting initiation and data collection reporting procedures. As shown, a first NG-RAN node 206A at step 1101 sends a data collection request to a second NG- RAN node 206B. The data collection request includes one or more UE performance feedback metrics to be collected. Also in the data collection request, the first NG-RAN node sets the UE Performance feedback type to “relative,” and includes a relative reporting configuration information with a UE performance reference value and relative reporting threshold configuration.

[0108] The second NG-RAN node 206B at step 1102 sends a data collection response to the first NG-RAN node 206 A.

[0109] The first NG-RAN node 206 A at step 1103 executes one or more handover procedure are associated with a data collection identifier (ID) created in step 1101 and step 1102.

[0110] The second NG-RAN node 206B at step 1104 starts collecting the UE performance feedback for the UE(s) 208 associated with the data collection ID. The second NG-RAN node at steps 1105 and 1106 checks if the collected UE performance feedback in the second NG-RAN node is within the margin indicated by the first NG-RAN node 206A with respect to the UE performance in the first NG-RAN node. That is, the second NG-RAN node checks if the collected UE performance feedback differs from the UE performance reference value by no more than the threshold provided by the relative reporting threshold configuration. If the UE performance feedback is within the margin, the second NG-RAN node no report is sent to the first NG-RAN node. If it is not within the margin (i.e., if the collected UE performance feedback differs from the UE performance reference value by more than the threshold), the second NG- RAN node at step 1107 sends a report to the first NG-RAN node with the measurement.

[0111] FIG. 12 illustrates a signaling chart 1200 of data collection reporting initiation and data collection reporting procedures, according to some other example implementations. As shown, a first NG-RAN node 206A at step 1201 sends a data collection request to a second NG- RAN node 206B. The data collection request includes one or more UE performance feedback metrics to be collected. Also in the data collection request, the first NG-RAN node sets the UEPerformance feedback type to “relative,” and includes a relative reporting configuration information with a relative reporting threshold configuration.

[0112] The second NG-RAN node 206B at step 1202 sends a data collection response to the first NG-RAN node 206 A.

[0113] The first NG-RAN node 206A at step 1203 executes one or more handover procedure are associated with a data collection identifier (ID) created in step 1201 and step 1202.

[0114] The second NG-RAN node 206B at step 1104 starts collecting the UE performance feedback for the UE(s) 208 associated with the data collection ID. Based on the relative reporting configuration information received in step 1201, at steps 1205 and 1206, the second NG-RAN node first establishes a UE performance reference value.

[0115] The second NG-RAN node 206B then at steps 1207 and 1208 checks if the collected UE performance feedback in the second NG-RAN node is within the margin indicated by the first NG-RAN 206A node with respect to the UE performance at the second NG-RAN node. That is, the second NG-RAN node checks if the collected UE performance feedback differs from the UE performance reference value by no more than the threshold provided by the relative reporting threshold configuration. If the UE performance feedback is within the margin, no report is sent to the first NG-RAN node. If it is not within the margin (i.e., if the collected UE performance feedback differs from the UE performance reference value by more than the threshold), the second NG-RAN node at step 1209 sends a report to the first NG-RAN node with the measurement.

[0116] FIGS. 13 A and 13B illustrate a signaling chart 1300 of data collection reporting initiation and data collection reporting procedures, according to yet other example implementations. The signaling chart in FIGS. 13A and 13B depict a scenario in which both actual and relative UE performance reporting is enabled for separate sets of UE(s) 208. In some examples, the first NG-RAN node 206A may create two separate data collection ID(s) between the first NG-RAN node and the second NG-RAN node 206B for actual and relative UE performance reporting. The first NG-RAN node may associate the corresponding data collection ID to specific UE(s) depending on whether the first NG-RAN node requests collection of actual or relative UE performance feedback.

[0117] As shown in FIG. 13A, the first NG-RAN node 206A at step 1301 sends a data collection request to the second NG-RAN node 206B with one or more UE performancefeedback metrics to be collected. The first NG-RAN node also sets the UE performance feedback type to “relative,” and includes relative reporting configuration information. The second NG- RAN node at step 1302 sends a data collection response to the first NG-RAN node. This creates a first NG-RAN node measurement ID pair 1, 2 with relative UE performance reporting.

[0118] The first NG-RAN node 206A at step 1303 sends a second data collection request to the second NG-RAN node 206B with one or more UE performance feedback metrics to be collected. The first NG-RAN node does not include UE Performance feedback type, which indicates the collection and reporting of actual measurements for UE performance feedback. The second NG-RAN node at step 1304 sends a second data collection response to the first NG-RAN node. This creates a second NG-RAN node measurement ID pair 3,4 with actual UE performance reporting.

[0119] The first NG-RAN node 206A at step 1305 executes one or more handover procedures and selects the specific set of UE(s) 208 for which actual feedback or relative feedback is requested. The first NG-RAN node then associates the NG-RAN node measurement ID pair 1,2 or 3,4 in the corresponding handover request. The selection of UE(s) by the first NG- RAN node may be based on different criteria, such as UE(s) with specific quality of service (QoS), UE(s) with a specific slice, or the like.

[0120] The second NG-RAN node 206B at step 1306 starts collecting the UE performance feedback for the UE(s) 208. As shown in FIG. 13B, the second NG-RAN node at step 1307 checks if the reporting type is actual; and if so, the second NG-RAN node at step 1308 reports the UE performance feedback as per the reporting attributes.

[0121] The second NG-RAN node 206B at step 1309 checks if reporting type is relative. If the reporting type is relative, the second NG-RAN node at steps 1310 and 1311 checks if the collected UE performance feedback at the second NG-RAN node is within the margin indicated by the first NG-RAN node with respect to the UE performance in the first NG-RAN node. If the UE performance feedback within the margin, no report is sent to the first NG-RAN node; otherwise, if the UE performance feedback is not within the margin, the second NG-RAN node at step 1312 sends a report to the first NG-RAN node 206A with the relative UE performance feedback (e.g., the amount of variation).

[0122] As described above, the solution of some example implementations may coexist with currently-supported reporting periodicity and reporting termination conditions. At each reportingperiod, the second NG-RAN node 206B may evaluate the condition (if configured); and if the condition is met, the second NG-RAN node considers the UE 208 as a candidate for which feedback is requested. Otherwise, the UE may be excluded. And when the terminating condition is met, the second NG-RAN node may send an appropriate notification to the first NG-RAN node 206A.

[0123] FIGS. 14A - 14C are flowcharts illustrating various steps in a method 1400 according to various example implementations. The method includes sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node, as shown at block 1402 of FIG. 14A. The method includes receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value, as shown at block 1404. And the method includes evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance, as shown at block 1406.

[0124] In some examples, the request indicates a threshold, and the one or more UE performance measurements are a plurality of UE performance measurements. In some of these examples, the at least one report that is received at block 1404 indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0125] In some examples, the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0126] In some examples, the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0127] In some examples, the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0128] In some examples, the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio accessnode. In some of these examples, the method 1400 further includes determining the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, as shown at block 1408 of FIG. 14B. Then, the request that is sent to the second radio access node at block 1402 includes the UE performance reference value.

[0129] In some examples, the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node. In some of these examples, the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radio access node. Also in some of these examples, the request that is sent to the second radio access node at block 1402 includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

[0130] In some examples, the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node. In some of these examples, the method 1400 further includes selecting the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer or radio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node, as shown at block 1410 of FIG. 14C.

[0131] FIGS. 15A and 15B are flowcharts illustrating various steps in a method 1500 according to various example implementations. The method includes receiving a request for information regarding relative user equipment (UE) performance for one or more UEs, as shown at block 1502 of FIG. 15A. The method includes collecting one or more UE performance measurements for the one or more UEs based on the request, as shown at block 1504. The method includes performing an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs, as shown at block 1506. And the method includes reporting the relative UE performance for at least one of the one or more UEs based on the evaluation, as shown at block 1508.

[0132] In some examples, the request indicates a threshold, and the one or more UE performance measurements are a plurality of UE performance measurements. In some of theseexamples, the relative UE performance is reported at block 1508 for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0133] In some examples, the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0134] In some examples, the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0135] In some examples, the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0136] In some examples, the request is received at block 1502 at a second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

[0137] In some examples, the request is received at block 1502 at a second radio access node from a first radio access node, the one or more UE performance measurements are a plurality of UE performance measurements. In some of these examples, the method 1500 further includes determining the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements, as shown at block 1510 of FIG. 15B.

[0138] According to example implementations of the present disclosure, a telecommunications system 100 or PLMN 102, and its components such as a CN 106, RAN 108, UE 110, 5GC 202, NG-RAN 204, NG-RAN node 206, UE 208, AMF / UPF 302, first NG-RAN node 206A, and / or second NG-RAN node 206B, may be implemented by various means. Means for implementing the system and its components may include hardware, firmware, software, or combinations thereof. In some examples, one or more apparatuses may be configured to function as or otherwise implement the system and its components shown and described herein. In examples involving more than one apparatus, the respective apparatuses may be connected to orotherwise in communication with one another in a number of different manners, such as directly or indirectly via a wired or wireless network or the like.

[0139] According to some example implementations, at least some of the method 1400 described with respect to FIGS. 14A - 14C may be carried out by an apparatus comprising means for performing functions corresponding steps of the method. Similarly, at least some of the method 1500 described with respect to FIGS. 15A and 15B may be carried out by an apparatus comprising means for performing functions corresponding steps of the method. Examples of a suitable apparatus may include a NG-RAN node, gNB (e.g., gNB-DU, gNB-CU), ng-eNB, MW AB node, MWAB-gNB, or any suitable apparatus, such as a server, host or node.

[0140] FIG. 16 illustrates an apparatus 1600 in which means for performing various functions includes hardware, alone or under direction of one or more computer programs from a computer-readable storage medium or other memory, such as computer memory, according to some example implementations of the present disclosure. The apparatus may include one or more of each of a number of components such as, for example, processing circuitry 1602 connected to computer-readable storage medium or other memory 1604.

[0141] The processing circuitry 1602 may be composed of one or more processors alone or in combination with one or more computer-readable storage media. The processing circuitry is generally any piece of computer hardware that is capable of processing information such as, for example, data, computer programs and / or other suitable electronic information. The processing circuitry is composed of a collection of electronic circuits some of which may be packaged as an integrated circuit or multiple interconnected integrated circuits (an integrated circuit at times more commonly referred to as a “chip”). The processing circuitry may be configured to execute computer programs, which may be stored onboard the processing circuitry or otherwise stored in the memory 1604 (of the same or another apparatus).

[0142] The processing circuitry 1602 may be a number of processors, a multi-core processor or some other type of processor, depending on the particular implementation. Further, the processing circuitry may be implemented using a number of heterogeneous processor systems in which a main processor is present with one or more secondary processors on a single chip. As another illustrative example, the processing circuitry may be a symmetric multi-processor system containing multiple processors of the same type. In yet another example, the processing circuitry may be embodied as or otherwise include one or more ASICs, FPGAs or the like. Thus, althoughthe processing circuitry may be capable of executing a computer program to perform one or more functions, the processing circuitry of various examples may be capable of performing one or more functions without the aid of a computer program. In either instance, the processing circuitry may be appropriately programmed to perform functions or operations according to example implementations of the present disclosure.

[0143] The memory 1604 is generally any piece of computer hardware that is capable of storing information such as, for example, data, computer programs, instructions 1606 (e.g., computer-readable program code) and / or other suitable information either on a temporary basis and / or a permanent basis. The memory may include volatile and / or non-volatile memory, and may be fixed or removable. Examples of suitable memory include recording media, random access memory (RAM), read-only memory (ROM), a hard drive, a flash memory, a thumb drive, a removable computer diskette, an optical disk or some combination thereof.

[0144] The memory 1604 is a non-transitory device capable of storing information. One example of a suitable memory is a computer-readable storage medium, which is distinguishable from a computer-readable transmission medium capable of carrying information from one location to another. Examples of suitable computer-readable transmission media comprise electronic carrier signals, telecommunications signals, software distribution packages, or some combination thereof. As used herein, the term “non-transitory” is a limitation of the medium itself (i.e., tangible, not a signal) as opposed to a limitation on data storage persistency (e.g., RAM versus ROM). A computer-readable medium as described herein generally refers to a computer-readable storage medium or computer-readable transmission medium. A computer- readable medium is any entity or device capable in which information, such as one or more computer programs or portions thereof, may be stored and carried.

[0145] In addition to the memory 1604 (e.g., computer-readable storage medium), the processing circuitry 1602 may also be connected to one or more interfaces for displaying, transmitting and / or receiving information. The interfaces may include a communications interface 1608 and / or one or more user interfaces (e.g., display, user input interface). The communications interface may be configured to transmit and / or receive information, such as to and / or from other apparatus(es), network(s) or the like. The communications interface may be configured to transmit and / or receive information by physical (wired) and / or wirelesscommunications links. Examples of suitable communication interfaces include a network interface controller (NIC), wireless NIC (WNIC) or the like.

[0146] Execution of the instructions 1606 by the processing circuitry 1602, or storage of the instructions in the memory 1604, supports combinations of operations for implementing example implementations of the present disclosure. In this manner, an apparatus 1600 may comprise at least one processing circuitry and at least one memory coupled to the at least one processing circuitry, where the at least one processing circuitry is configured to execute instructions stored in the at least one memory. It will also be understood that one or more functions, and combinations of functions, may be implemented by special purpose hardware-based computer systems and / or processing circuitry which perform the specified functions, or combinations of special purpose hardware and program code instructions.

[0147] Some example implementations of the present disclosure may also be carried out in the form of a computer process defined by one or more computer programs or portions thereof. Example implementations of the present disclosure may be carried out by executing at least one portion of a computer program comprising instructions. The computer program may be in source code form, object code form, or in some intermediate form. The computer program may be stored in a computer-readable medium that is readable by a computer, processing circuitry or other suitable apparatus. As indicated above, for example, the computer program may be stored in a memory, such as a computer-readable storage medium. Additionally or alternatively, for example, the computer program may be stored in a computer-readable transmission medium. The coding of software for carrying out example implementations of the present disclosure is well within the scope of a person of ordinary skill in the art.

[0148] As will be appreciated, any suitable instructions may be loaded onto a computer, a processing circuitry or other programmable apparatus from a memory or a computer-readable medium (e.g., computer-readable storage medium, computer-readable transmission medium) to produce a particular machine, such that the particular machine becomes a means for implementing the functions specified herein. The instructions may also be stored in a computer- readable medium that can direct a computer, a processing circuitry or other programmable apparatus to function in a particular manner to thereby generate a particular machine or particular article of manufacture. In some examples, the instructions stored in the computer-readable medium may produce an article of manufacture, where the article of manufacture becomes ameans for implementing functions described herein. The instructions may be retrieved from a computer-readable medium and loaded into a computer, processing circuitry or other programmable apparatus to configure the computer, processing circuitry or other programmable apparatus to execute operations to be performed on or by the computer, processing circuitry or other programmable apparatus.

[0149] Retrieval, loading and execution of instructions comprising program code instructions may be performed sequentially such that one instruction is retrieved, loaded and executed at a time. In some example implementations, retrieval, loading and / or execution may be performed in parallel such that multiple instructions are retrieved, loaded, and / or executed together. Execution of the program code instructions may produce a computer-implemented process such that the instructions executed by the computer, processing circuitry or other programmable apparatus provide operations for implementing functions described herein.

[0150] As explained above and reiterated below, the present disclosure includes, without limitation, the following example implementations.

[0151] Clause 1. An apparatus comprising: at least one memory configured to store instructions; and at least one processing circuitry configured to access the at least one memory, and execute the instructions to cause the apparatus to at least: send a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receive at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluate an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0152] Clause 2. The apparatus of clause 1, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one report that is received indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0153] Clause 3. The apparatus of clause 2, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0154] Clause 4. The apparatus of clause 2 or clause 3, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0155] Clause 5. The apparatus of any of clauses 1 to 4, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0156] Clause 6. The apparatus of any of clauses 1 to 5, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the at least one processing circuitry is configured to execute the instructions to cause the apparatus to further determine the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, and the request that is sent to the second radio access node includes the UE performance reference value.

[0157] Clause 7. The apparatus of any of clauses 1 to 6, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radio access node, and the request that is sent to the second radio access node includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

[0158] Clause 8. The apparatus of any of clauses 1 to 7, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the at least one processing circuitry is configured to execute the instructions to cause the apparatus to further select the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer orradio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node.

[0159] Clause 9. An apparatus comprising: means for sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; means for receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and means for evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0160] Clause 10. The apparatus of clause 9, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one report that is received indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0161] Clause 11. The apparatus of clause 10, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0162] Clause 12. The apparatus of clause 10 or clause 11, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0163] Clause 13. The apparatus of any of clauses 9 to 12, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0164] Clause 14. The apparatus of any of clauses 9 to 13, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the apparatus further comprises means for determining the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, and the request that is sent to the second radio access node includes the UE performance reference value.

[0165] Clause 15. The apparatus of any of clauses 9 to 14, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radio access node, and the request that is sent to the second radio access node includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

[0166] Clause 16. The apparatus of any of clauses 9 to 15, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the apparatus further comprises means for selecting the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer or radio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node.

[0167] Clause 17. A method comprising: sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0168] Clause 18. The method of clause 17, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one report that is received indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0169] Clause 19. The method of clause 18, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0170] Clause 20. The method of clause 18 or clause 19, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0171] Clause 21. The method of any of clauses 17 to 20, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0172] Clause 22. The method of any of clauses 17 to 21, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the method further comprises determining the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, and the request that is sent to the second radio access node includes the UE performance reference value.

[0173] Clause 23. The method of any of clauses 17 to 22, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radio access node, and the request that is sent to the second radio access node includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

[0174] Clause 24. The method of any of clauses 17 to 23, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the method further comprises selecting the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer or radio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node.

[0175] Clause 25. A computer-readable storage medium that is non-transitory and has instructions stored therein that, in response to execution by at least one processing circuitry, causes an apparatus to at least: send a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receive at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least oneof the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluate an impact of the handover on performance of the one or more UEs based on the relative UE performance.

[0176] Clause 26. The computer-readable storage medium of clause 25, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one report that is received indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0177] Clause 27. The computer-readable storage medium of clause 26, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0178] Clause 28. The computer-readable storage medium of clause 26 or clause 27, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0179] Clause 29. The computer-readable storage medium of any of clauses 25 to 28, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0180] Clause 30. The computer-readable storage medium of any of clauses 25 to 29, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the computer-readable storage medium has further instructions stored therein that, in response to execution by the at least one processing circuitry, causes the apparatus to further determine the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, and the request that is sent to the second radio access node includes the UE performance reference value.

[0181] Clause 31. The computer-readable storage medium of any of clauses 25 to 30, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radioaccess node, and the request that is sent to the second radio access node includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

[0182] Clause 32. The computer-readable storage medium of any of clauses 25 to 31, wherein the apparatus is implemented by a first radio access node, the radio access node is a second radio access node, and the handover of the one or more UEs is from the first radio access node to the second radio access node, and wherein the computer-readable storage medium has further instructions stored therein that, in response to execution by the at least one processing circuitry, causes the apparatus to further select the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer or radio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node.

[0183] Clause 33. An apparatus comprising means for performing the method of any of clauses 17 to 24.

[0184] Clause 34. A computer-readable medium comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 17 to 24.

[0185] Clause 35. A computer-readable storage medium comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 17 to 24.

[0186] Clause 36. A computer program comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 17 to 24.

[0187] Clause 37. An apparatus comprising: at least one memory configured to store instructions; and at least one processing circuitry configured to access the at least one memory, and execute the instructions to cause the apparatus to at least: receive a request for information regarding relative user equipment (UE) performance for one or more UEs; collect one or more UE performance measurements for the one or more UEs based on the request; perform an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs;and report the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0188] Clause 38. The apparatus of clause 37, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the relative UE performance is reported for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0189] Clause 39. The apparatus of clause 38, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0190] Clause 40. The apparatus of clause 38 or clause 39, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0191] Clause 41. The apparatus of any of clauses 37 to 40, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0192] Clause 42. The apparatus of any of clauses 37 to 41, wherein the apparatus is implemented by a second radio access node, the request is received at the second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

[0193] Clause 43. The apparatus of any of clauses 37 to 42, wherein the apparatus is implemented by a second radio access node, and the request is received at the second radio access node from a first radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one processing circuitry is configured to execute the instructions to cause the apparatus to further determine the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements.

[0194] Clause 44. An apparatus comprising: means for receiving a request for information regarding relative user equipment (UE) performance for one or more UEs; means for collecting one or more UE performance measurements for the one or more UEs based on the request; means for performing an evaluation in which the one or more UE performance measurements arecompared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and means for reporting the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0195] Clause 45. The apparatus of clause 44, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the relative UE performance is reported for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0196] Clause 46. The apparatus of clause 45, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0197] Clause 47. The apparatus of clause 45 or clause 46, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0198] Clause 48. The apparatus of any of clauses 44 to 47, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0199] Clause 49. The apparatus of any of clauses 44 to 48, wherein the apparatus is implemented by a second radio access node, the request is received at the second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

[0200] Clause 50. The apparatus of any of clauses 44 to 49, wherein the apparatus is implemented by a second radio access node, and the request is received at the second radio access node from a first radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements, and the apparatus further comprises means for determining the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements.

[0201] Clause 51. A method comprising: receiving a request for information regarding relative user equipment (UE) performance for one or more UEs; collecting one or more UE performance measurements for the one or more UEs based on the request; performing an evaluation in which the one or more UE performance measurements are compared to a UEperformance reference value to determine the relative UE performance for the one or more UEs; and reporting the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0202] Clause 52. The method of clause 51, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the relative UE performance is reported for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0203] Clause 53. The method of clause 52, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0204] Clause 54. The method of clause 52 or clause 53, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0205] Clause 55. The method of any of clauses 51 to 54, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0206] Clause 56. The method of any of clauses 51 to 55, wherein the request is received at a second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

[0207] Clause 57. The method of any of clauses 51 to 56, wherein the request is received at a second radio access node from a first radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements, and the method further comprises determining the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements.

[0208] Clause 58. A computer-readable storage medium that is non-transitory and has instructions stored therein that, in response to execution by at least one processing circuitry, causes an apparatus to at least: receive a request for information regarding relative user equipment (UE) performance for one or more UEs; collect one or more UE performance measurements for the one or more UEs based on the request; perform an evaluation in which the one or more UE performance measurements are compared to a UE performance reference valueto determine the relative UE performance for the one or more UEs; and report the relative UE performance for at least one of the one or more UEs based on the evaluation.

[0209] Clause 59. The computer-readable storage medium of clause 58, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the relative UE performance is reported for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0210] Clause 60. The computer-readable storage medium of clause 59, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

[0211] Clause 61. The computer-readable storage medium of clause 59 or clause 60, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

[0212] Clause 62. The computer-readable storage medium of any of clauses 58 to 61, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

[0213] Clause 63. The computer-readable storage medium of any of clauses 58 to 62, wherein the apparatus is implemented by a second radio access node, the request is received at the second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

[0214] Clause 64. The computer-readable storage medium of any of clauses 58 to 63, wherein the apparatus is implemented by a second radio access node, and the request is received at the second radio access node from a first radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements, and the computer- readable storage medium has further instructions stored therein that, in response to execution by the at least one processing circuitry, causes the apparatus to further determine the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements.

[0215] Clause 65. An apparatus comprising means for performing the method of any of clauses 51 to 57.

[0216] Clause 66. A computer-readable medium comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 51 to 57.

[0217] Clause 67. A computer-readable storage medium comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 51 to 57.

[0218] Clause 68. A computer program comprising instructions that, in response to execution by at least one processing circuitry, causes an apparatus to perform the method of any of clauses 51 to 57.

[0219] Many modifications and other implementations of the disclosure set forth herein will come to mind to one skilled in the art to which the disclosure pertains having the benefit of the teachings presented in the foregoing description and the associated figures. Therefore, it is to be understood that the disclosure is not to be limited to the specific implementations disclosed and that modifications and other implementations are intended to be included within the scope of the appended claims. Moreover, although the foregoing description and the associated figures describe example implementations in the context of certain example combinations of elements and / or functions, it should be appreciated that different combinations of elements and / or functions may be provided by alternative implementations without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and / or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims

WHAT IS CLAIMED IS:

1. A method comprising: sending a request to a radio access node for information regarding relative user equipment (UE) performance for one or more UEs following a handover of the one or more UEs to the radio access node; receiving at least one report from the radio access node based on the request, the at least one report indicating the relative UE performance of at least one of the one or more UEs based on a comparison of one or more UE performance measurements collected at the radio access node and a UE performance reference value; and evaluating an impact of the handover on performance of the one or more UEs based on the relative UE performance.

2. The method of claim 1, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the at least one report that is received indicates the relative UE performance for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

3. The method of claim 2, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

4. The method of claim 2 or claim 3, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

5. The method of any of claims 1 to 4, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

6. The method of any of claims 1 to 5, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the method further comprises determining the UE performance reference value at the first radio access node based on UE performance measurements collected at the first radio access node, and the request that is sent to the second radio access node includes the UE performance reference value.

7. The method of any of claims 1 to 6, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements collected at the second radio access node, and the request that is sent to the second radio access node includes an indication for the second radio access node to determine the UE performance reference value based on at least some of the plurality of UE performance measurements.

8. The method of any of claims 1 to 7, wherein the radio access node is a second radio access node, and the handover of the one or more UEs is from a first radio access node to the second radio access node, and wherein the method further comprises selecting the one or more UEs for which to receive the information regarding the relative UE performance based on at least one of service, bearer or radio characteristics of the one or more UEs, or one or more characteristics of the first radio access node or the second radio access node.

9. An apparatus comprising means for performing the method of any of claims 1 to 8.

10. A method comprising: receiving a request for information regarding relative user equipment (UE) performance for one or more UEs;collecting one or more UE performance measurements for the one or more UEs based on the request; performing an evaluation in which the one or more UE performance measurements are compared to a UE performance reference value to determine the relative UE performance for the one or more UEs; and reporting the relative UE performance for at least one of the one or more UEs based on the evaluation.

11. The method of claim 10, wherein the request indicates a threshold, the one or more UE performance measurements are a plurality of UE performance measurements, and the relative UE performance is reported for only a subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

12. The method of claim 11, wherein the relative UE performance includes the subset of the plurality of UE performance measurements that differ from the UE performance reference value by more than the threshold.

13. The method of claim 11 or claim 12, wherein the relative UE performance includes an indication of a difference between the subset of the plurality of UE performance measurements and the UE performance reference value.

14. The method of any of claims 10 to 13, wherein the relative UE performance includes an indication of a difference between the one or more UE performance measurements and the UE performance reference value.

15. The method of any of claims 10 to 14, wherein the request is received at a second radio access node from a first radio access node, and the request includes the UE performance reference value determined at the first radio access node based on UE performance measurements collected at the first radio access node.

16. The method of any of claims 10 to 15, wherein the request is received at a second radio access node from a first radio access node, and wherein the one or more UE performance measurements are a plurality of UE performance measurements, and the method further comprises determining the UE performance reference value at the second radio access node based on at least some of the plurality of UE performance measurements.

17. An apparatus comprising means for performing the method of any of claims 10 to 16.

Images