Conformance testing of ai / ML-based beam management
By separating signal measurement and predictive calculations between apparatuses, the method addresses high costs and complexity in AI/ML-based beam management testing, ensuring efficient and secure conformance evaluation.
Patent Information
- Application Number
- PCT/IB2026/054410
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-09
- Filing Date
- 2026-05-05
- Publication Date
- 2026-11-12
AI Technical Summary
Existing conformance testing systems for AI/ML-based beam management in wireless communication networks face challenges such as high hardware costs, complex system designs, and potential cheating by devices under test, due to the need for extensive beam measurements and rotations, which prolong testing time and compromise test integrity.
A method where a first apparatus performs basic signal quality measurements and sends results to a second apparatus, which determines a mapping to prediction beams and generates estimated signal qualities, reducing the need for actual beam transmissions and simplifying the testing process.
This approach decreases hardware costs, reduces system complexity, and ensures accurate testing without prolonged measurement times, while preventing device manipulation during conformance testing.
Smart Images

Figure IB2026054410_12112026_PF_FP_ABST
Abstract
Description
CONFORMANCE TESTING OF AI / ML-BASED BEAM MANAGEMENTFIELD
[0001] Various example embodiments of the present disclosure generally relate to the field of telecommunication and in particular, to methods, devices, apparatuses and computer readable storage medium for conformance testing of artificial intelligence / machine learning (AIZML)-based beam management.BACKGROUND
[0002] A communication network may serve as a facility that enables communications between two or more communication devices or provides communication devices access to a data network. A mobile or wireless communication network is one example of a communication network. The communication network may operate in accordance with standards such as those provided by Third Generation Partnership Project (3GPP) or European Telecommunications Standards Institute (ETSI). Examples of standards provided by 3GPP are the so-called 3GPP standards for cellular technology generations, such as 3GPP standards for 4G technology, 5G technology, 6G technology, etc.SUMMARY
[0003] In a first aspect of the present disclosure, there is provided a first apparatus. The first apparatus comprises at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the first apparatus at least to: perform a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; and send, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
[0004] In a second aspect of the present disclosure, there is provided a second apparatus. The second apparatus comprises at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the second apparatus at least to: receive, from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; determine a mapping from a set of prediction beams to the plurality of test antennas; and generate respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
[0005] In a third aspect of the present disclosure, there is provided a method. The methodcomprises: performing a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; and sending, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
[0006] In a fourth aspect of the present disclosure, there is provided a method. The method comprises: receiving, from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; determining a mapping from a set of prediction beams to the plurality of test antennas; and generating respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
[0007] In a fifth aspect of the present disclosure, there is provided a first apparatus. The first apparatus comprises means for performing a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; and means for sending, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
[0008] In a sixth aspect of the present disclosure, there is provided a second apparatus. The second apparatus comprises means for receiving, from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; means for determining a mapping from a set of prediction beams to the plurality of test antennas; and means for generating respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
[0009] In a seventh aspect of the present disclosure, there is provided a computer readable medium. The computer readable medium comprises instructions stored thereon for causing an apparatus to perform at least the method according to the third aspect.
[0010] In an eighth aspect of the present disclosure, there is provided a computer readable medium. The computer readable medium comprises instructions stored thereon for causing an apparatus to perform at least the method according to the fourth aspect.
[0011] It is to be understood that the Summary section is not intended to identify key or essentialfeatures of embodiments of the present disclosure, nor is it intended to be used to limit the scope of the present disclosure. Other features of the present disclosure will become easily comprehensible through the following description.BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Some example embodiments will now be described with reference to the accompanying drawings, where:
[0013] FIG. 1 illustrates an example communication environment in which example embodiments of the present disclosure can be implemented;
[0014] FIG. 2A illustrates a schematic diagram of an example sample test system with probes aligned in the xz plane;
[0015] FIG. 2B illustrates a schematic diagram of an example sample test system with probes aligned in the yz plane;
[0016] FIG. 3 illustrates a schematic diagram of an example setup for Multiple-Input Multiple-Output (Ml MO) over-the-air (OTA) testing;
[0017] FIG. 4 illustrates a schematic diagram of an example test system according to some example embodiments of the present disclosure ;
[0018] FIG. 5 illustrates a signaling flow for conformance testing of AI / ML-based beam management according to some example embodiments of the present disclosure;
[0019] FIG. 6 illustrates another signaling flow for conformance testing of AI / ML-based beam management according to some example embodiments of the present disclosure ;
[0020] FIG. 7 illustrates a signaling flow for example conformance testing of AI / ML enabled beam management in a scenario where one test probe is activated according to some example embodiments of the present disclosure;
[0021] FIG. 8 illustrates a signaling flow for example conformance testing of AI / ML enabled beam management in a scenario where more than one test probe is activated according to some example embodiments of the present disclosure;
[0022] FIG. 9A illustrates a flowchart of a method implemented at a first apparatus in accordance with some example embodiments of the present disclosure;
[0023] FIG. 9B illustrates a flowchart of a method implemented at a second apparatus in accordance with some example embodiments of the present disclosure;
[0024] FIG.10A illustrates a flowchart of a method implemented at a first apparatus in accordance with some example embodiments of the present disclosure;
[0025] FIG. 10B illustrates a flowchart of a method implemented at a second apparatus in accordance with some example embodiments of the present disclosure;
[0026] FIG. 11 illustrates a simplified block diagram of a device that is suitable for implementing example embodiments of the present disclosure; and
[0027] FIG. 12 illustrates a block diagram of an example computer readable medium in accordance with some example embodiments of the present disclosure.
[0028] Throughout the drawings, the same or similar reference numerals represent the same or similar element.DETAILED DESCRIPTION
[0029] Principle of the present disclosure will now be described with reference to some example embodiments. It is to be understood that these embodiments are described only for the purpose of illustration and help those skilled in the art to understand and implement the present disclosure, without suggesting any limitation as to the scope of the disclosure. Embodiments described herein can be implemented in various manners other than the ones described below.
[0030] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skills in the art to which this disclosure belongs.
[0031] References in the present disclosure to "one embodiment,” "an embodiment,” "an example embodiment,” and the like indicate that the embodiment described may include a particular feature, structure, or characteristic, but it is not necessary that every embodiment includes the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
[0032] It shall be understood that although the terms "first,” "second,”..., etc. in front of noun(s) and the like may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another and they do not limit the order of the noun(s). For example, a first element could be termed a second element, and similarly, a second element could be termed a first element, without departing from the scope of example embodiments. As used herein, the term "and / or” includes any and all combinations of one or more of the listed terms.
[0033] As used herein, "at least one of the following: ” and "at least one of ” and similar wording, where the list of two or more elements are joined by "and” or "or”, mean at least any one of the elements, or at least any two or more of the elements, or at least all the elements.
[0034] As used herein, unless stated explicitly, performing a step "in response to A” does not indicate that the step is performed immediately after "A” occurs and one or more intervening steps may be included.
[0035] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms "a”, "an” and "the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises”, "comprising”, "has”, "having”, "includes” and / or "including”, when used herein, specify the presence of stated features, elements, and / or components etc., but do not preclude the presence or addition of one or more other features, elements, components and / or combinations thereof.
[0036] As used in this application, the term "circuitry” may refer to one or more or all of the following:(a) hardware-only circuit implementations (such as implementations in analog, digital and / or quantum circuitry) and(b) combinations of hardware circuit(s) and software, such as (as applicable):(I) a combination of analog, digital and / or quantum hardware circuit(s) with software / fi rmware and(II) any or all portions of hardware processor(s) (including digital and / or quantum processor(s)) with software, and memory(ies) that work together to cause an apparatus, such as a mobile device, computing device, or server, to perform various functions) and(c) any or all portions of hardware circuit(s), such as a microprocessor(s), processor(s) and / or quantum processor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation.
[0037] This definition of circuitry applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term circuitry also covers an implementation of merely a hardware circuit or processor (or multiple processors) or portion of a hardware circuit or processor and its (or their) accompanying software and / or firmware. The term circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit or processor integrated circuit for a mobile device or a similar integrated circuit in server, a cellular network device, or other computing or network device.
[0038] As used herein, the term "communication network” refers to a network following any suitable communication standards, such as New Radio (NR), Long Term Evolution (LTE), LTE-Advanced (LTE-A), Wideband Code Division Multiple Access (WCDMA), High-Speed Packet Access (HSPA), Narrow Band Internet of Things (NB-loT) and so on. Furthermore, the communications between a terminaldevice and a network device in the communication network may be performed according to any suitable generation communication protocols, including, but not limited to, the first generation (1 G), the second generation (2G), 2.5G, 2.75G, the third generation (3G), the fourth generation (4G), 4.5G, the fifth generation (5G), 5.5G, the sixth generation (6G) communication protocols, and / or any other protocols either currently known or to be developed in the future. Embodiments of the present disclosure may be applied in various communication systems. Given the rapid development in communications, there will of course also be future type communication technologies and systems with which the present disclosure may be embodied. It should not be seen as limiting the scope of the present disclosure to only the aforementioned system.
[0039] As used herein, the term "network device” refers to a node in a communication network via which a terminal device accesses the network and receives services therefrom. The network device may refer to a base station (BS) or an access point (AP), for example, a node B (NodeB or NB), an evolved NodeB (eNodeB or eNB), an NR NB (also referred to as a gNB), a Remote Radio Unit (RRU), a radio header (RH), a remote radio head (RRH), a relay, an Integrated Access and Backhaul (IAB) node, a low power node such as a femto, a pico, a non-terrestrial network (NTN) or non-ground network device such as a satellite network device, a low earth orbit (LEO) satellite and a geosynchronous earth orbit (GEO) satellite, an aircraft network device, and so forth, depending on the applied terminology and technology. In some example embodiments, radio access network (RAN) split architecture comprises a Centralized Unit (OU) and a Distributed Unit (DU) at an IAB donor node. An IAB node comprises a Mobile Terminal (IAB-MT) part that behaves like a UE toward the parent node, and a DU part of an IAB node behaves like a base station toward the next-hop IAB node.
[0040] The term "terminal device” refers to any end device that may be capable of wireless communication. By way of example rather than limitation, a terminal device may also be referred to as a communication device, user equipment (UE), a Subscriber Station (SS), a Portable Subscriber Station, a Mobile Station (MS), or an Access Terminal (AT). The terminal device may include, but not limited to, a mobile phone, a cellular phone, a smart phone, voice over IP (VoIP) phones, wireless local loop phones, a tablet, a wearable terminal device, a personal digital assistant (PDA), portable computers, desktop computer, image capture terminal devices such as digital cameras, gaming terminal devices, music storage and playback appliances, vehicle-mounted wireless terminal devices, wireless endpoints, mobile stations, laptop-embedded equipment (LEE), laptop-mounted equipment (LME), USB dongles, smart devices, wireless customer-premises equipment (CPE), an Internet of Things (loT) device, a watch or other wearable, a head-mounted display (HMD), a vehicle, a drone, a medical device and applications (e.g., remote surgery), an industrial device and applications (e.g., a robot and / or other wireless devices operating in an industrial and / or an automated processing chaincontexts), a consumer electronics device, a device operating on commercial and / or industrial wireless networks, and the like. The terminal device may also correspond to a Mobile Termination (MT) part of an IAB node (e.g., a relay node). In the following description, the terms "terminal device”, "communication device”, "terminal”, "user equipment” and "UE” may be used interchangeably.
[0041] As used herein, the term "resource,” "transmission resource,” "resource block,” "physical resource block” (PRB), "uplink resource,” or "downlink resource” may refer to any resource for performing a communication, for example, a communication between a terminal device and a network device, such as a resource in time domain, a resource in frequency domain, a resource in space domain, a resource in code domain, or any other combination of the time, frequency, space and / or code domain resource enabling a communication, and the like. In the following, unless explicitly stated, a resource in both frequency domain and time domain will be used as an example of a transmission resource for describing some example embodiments of the present disclosure. It is noted that example embodiments of the present disclosure are equally applicable to other resources in other domains.
[0042] FIG. 1 illustrates an example communication environment 100 in which example embodiments of the present disclosure can be implemented. In the communication environment 100, a first apparatus 110 and a second apparatus 120 may communicate with each other. In some example embodiments, the first apparatus 110 may be a terminal device and the second apparatus 120 may be a network device. In some example embodiments, in a testing case, the first apparatus 110 may be a device under test (DUT), and the second apparatus 120 may be a test equipment (TE) or a system simulator (SS).
[0043] It is to be understood that the number of apparatuses and their connections shown in FIG. 1 are only for the purpose of illustration without suggesting any limitation. The communication environment 100 may include any suitable number of apparatuses configured to implement example embodiments of the present disclosure.
[0044] In the following, for purpose of illustration, some example embodiments are described with the first apparatus 110 operating as a DUT, and the second apparatus 120 operating as aTE. However, in some example embodiments, operations described in connection with the DUT may be implemented at other devices, and operations described in connection with the TE may be implemented at other devices.
[0045] In some example embodiments, a transmission direction from the second apparatus 120 to the first apparatus 110 is referred to as a downlink (DL), while a transmission direction from the first apparatus 110 to the second apparatus 120 is referred to as an uplink (UL). In DL, the second apparatus 120 is a transmitting (TX) device (or a transmitter) and the first apparatus 110 is a receiving (RX) device (or a receiver). In UL, the first apparatus 110 is a TX device (or a transmitter) and thesecond apparatus 120 is a RX device (or a receiver).
[0046] Communications in the communication environment 100 may be implemented according to any proper communication protocol (s), comprising, but not limited to, cellular communication protocols of the first generation (1G), the second generation (2G), the third generation (3G), the fourth generation (4G), the fifth generation (5G), the sixth generation (6G), and the like, wireless local network communication protocols such as Institute for Electrical and Electronics Engineers (IEEE) 802.11 and the like, and / or any other protocols currently known or to be developed in the future. Moreover, the communication may utilize any proper wireless communication technology, comprising but not limited to: Code Division Multiple Access (CDMA), Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Frequency Division Duplex (FDD), Time Division Duplex (TDD), Multiple-Input Multiple-Output (MIMO), Orthogonal Frequency Division Multiple (OFDM), Discrete Fourier Transform spread OFDM (DFT-s-OFDM) and / or any other technologies currently known or to be developed in the future.
[0047] AI / ML-based BM may target spatial and / or time beam prediction to reduce overhead and reporting latency. In AI / ML-based beam management, the measurements of multiple beams in Set B may be used as input to the UE side ML model. The output of the UE side ML model may be represented by one of the beams in Set A. The measured beams (such as beams in Set B) may be provided with the channel state information (CSI) reporting configurations.
[0048] Spatial beam prediction (referred to as BM-case1) may aim to predict the best-K (i.e., top K) Tx beams or Tx-Rx beam pairs in different spatial locations. Conversely, time-domain beam predictions (referred to as BM-case2) may aim to predict the most likely beam to be used for the next time instants, e.g., beam prediction in the spatial domain (BM-case1).
[0049] The general requirements and testing frameworks for AI / ML-based performance enhancements may mainly focus on how to define requirements and tests for inference, how to evaluate the feasibility and necessity of requirements or tests for lifecycle management (LCM), and how requirements for data collection (particularly for training) may need to be defined. The design of tests should ensure guaranteed performance and prevent a situation where a UE might pass the test but perform poorly in the field.
[0050] The OTA testing for frequency range 2 (FR2) multi-panel UEs with the capability to receive four DL layers from two angles of arrival (AoAs) may utilize test systems such as multi-Rx test systems. The test systems have all probes positioned within the same two-dimensional (2D) plane. This plane may maintain a constant azimuthal angle “cp” within the reference system. FIG. 2A illustrates a schematic diagram of an example sample test system 200A with AoA2 probes aligned in the xz plane. FIG. 2B illustrates a schematic diagram of an example sample test system 200B with AoA2 probesaligned in the yz plane. The sample test systems 200A and 200B include 4 total probes (i.e., 1 AoA1 probe and 3 AoA2 probes). The three AoA2 probes are offset by 60° (P60), 120° (P120), and 150° (P150) from the AoA1 probe, which is placed along the z-axis (P0). In the sample test system 200A, the AoA2 probes are aligned within the xz-plane. In the sample test system 200B, the AoA2 probes are aligned within the yz-plane.
[0051] For FR2 NR MIMO OTA testing, the 3D multi-probe anechoic chamber (3D-MPAC) test method may serve as the reference. This method involves the arrangement of an array of antennas around the DUT. The 3D-MPAC system may simulate a spatial distribution of AoAs, thereby exposing the DUT to a near field environment that appears to have originated from a complex multipath far field environment.
[0052] Signals may be transmitted from the BS or TE to the DUT through a simulated multipath environment, referred to as a spatial channel model. Channel impairments, such as Doppler and fading, may be applied to each path before all the directional signals are injected into the chamber simultaneously via the probe array. The resulting field distribution in the test zone is then integrated by the DUT's antenna(s) and processed by its receiver(s), just as it would do in any non-simulated multipath environment.
[0053] The 3D-MPAC system, equipped with six dual-polarized probes arranged on a sector with a minimum radius of 0.75 meters from the center of the test zone, may be permitted for NR FR2 MIMO OTA testing. FIG. 3 illustrates a schematic diagram of an example setup 300 for NR FR2 MIMO OTA testing using a 3D-MPAC system. The setup 300 includes a system simulator 301, a DUT 302, and sector 340. The system simulator 301 includes a base station simulator 310, a channel emulator 320, and multiple radio heads 330. The base station simulator 310 is connected to the channel emulator 320. The channel emulator 320 links to the multiple radio heads 330. The test zone has a 20 cm diameter circular area where the DUT 302 is placed for testing (e.g., FR2 MIMO OTA testing). The sector 340 includes six probes arranged at a fixed minimum radius of 0.75 meters from the center of the test zone. It should be understood that the setup 300 is not limited to the specific configuration shown, and alternative implementations may also be utilized.
[0054] The objective of AI / ML-based beam management conformance testing may be to verify whether the DUT may correctly predict the top 1 or top K (best) beams from the Set A. The prediction may be based on measurements of beams in the Set B, which may serve as an input to the UE side AI / ML model / functionality. The TE may require ground-truth measurements to compare with the prediction of the DUT. The ground truth, such as layer 1 reference signal receive power (L1-RSRP), may depend on the architecture and implementation of the DUT. During the conformance test, the TE may first generate each beam in Set A. The DUT may then measure and report the ground truth (e.g.,L1-RSRP) for each transmitted beam in Set A back to the TE.
[0055] The number of beams in Set A may be 32. The number of beams in Set B may be 8. The emulation of beams in Set A during the conformance test may present several issues. For example, the emulation of 32 beams in Set A may require many test probes. Existing test systems may not support such a large number. Enhancing current test systems may be expensive and complex. The size of the test system may also increase. Test equipment vendors may be unlikely to adopt this approach. As the DUT itself reports the ground truth back to the TE, it is possible that the DUT may either manipulate the reported ground truth values or the reported prediction values to pass the test. This will raise concern about UE cheating during the test. Moreover, during the conformance test, measuring the ground truth for the beams in Set A may require multiple DUT rotations. This may result in significantly longer testing time.
[0056] In accordance with some example embodiments of the present disclosure, there is provided some solutions for conformance testing of AI / ML-based beam management. In a solution, the first apparatus performs a signal quality measurement on a plurality of test signals transmitted from one or more test antennas of a plurality of test antennas. Then, the first apparatus sends, to the second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals. The second apparatus receives the respective measurement results and the information from the first apparatus, and determines a mapping from a set of prediction beams to the plurality of test antennas. Based on the mapping and the respective measurement results, the second apparatus generates respective estimated signal qualities (e.g., L1-RSRP values) for the set of prediction beams. In other words, the ground truths for the beams in the prediction set may be generated without actually transmitting the prediction beams.
[0057] In this way, by separating some of the test signal measurements from predictive calculations, the first apparatus (such as the DUT) may only need to perform basic signal quality measurements, and the second apparatus (such as the TE) is responsible for complex predictive mapping calculations, thus deployment of high-complexity AI / ML models on the DUT side. Furthermore, there is no need to actually transmit reference signals for all prediction beams, and only the signals for a few test antennas need to be measured. This may reduce the number of probes needed in the test system, thereby decreasing hardware costs and system complexity.
[0058] Example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.
[0059] To better understand the example embodiments of the present disclosure, an example test system is now described. In some example embodiments, the first apparatus 110 may include or maybe included in a DUT, and the second apparatus 120 may include or may be included in a TE. The first apparatus 110 and the second apparatus 120 may be applied in a test system as shown in FIG.4, which illustrates a schematic diagram of an example test system 400 according to some example embodiments of the present disclosure. As shown in FIG. 4, the test system 400 involves a TE 410, and a DUT 420. The TE 410 may include a channel emulator (CE) or may access or utilize the CE. The DUT 420 is located within an anechoic chamber 430, which is also referred to as a test chamber. The test system 400 further includes a plurality of test antennas P0, P1 , P2 and P3 controlled by the TE 410. In the example, FIG. 4 shows test antennas P0, P1, P2 and P3. The DUT 420 may receive signals from the TE 410 via Rx beams, for example, Rx-beam 1, Rx-beam 2, .... Rx-beam N. It is to be understood that FIG. 4 is merely an example without any limitation. The test system 400 may additionally include other components, and the number of antennas is also not limited thereto.
[0060] Some example principles are now described first.
[0061] Firstly, in a scenario that the test signal is transmitted via one test antenna, a test signal with an index T may be used as an example for elaborating the process of generating ground truth. Let the test signal#? contains the unit energy symbol xtwhose transmit power is ptWatts, and the channel implemented by the CE to transmit ^TpiX,- be a scalar htdue to single activated probe antenna. Hence, the baseband equivalent of the signal transmitted by the test probe antenna#? may be written as pthiXi which then propagates through the over the air (OTA) wireless channel of the testing chamber and is received by the DUT's antenna / antenna array. The baseband equivalent of the signal received at the DUT is given by:yt = wih0TA,i(yfpi'hixi') + ni (1) where captures the impact of the receiving antenna pattern and / or receiving beamforming gain in the direction of test probe#?, h0TAdenotes the wireless channel of the testing chamber, andrepresents the additive noise added by the hardware of the first apparatus 110. Hence, the RSRP of the received signal ytmay be approximated as:RSRPTS. = Fflyd2] = E ^Wihor^^ihiXi) + nj ] « |w;A0W| x A|AJ2|XJ2+ a2(2)where E[. ] denotes the expectation operation and is performed by taking the linear average over the power distribution (in [W]) over all resource elements that carry the RSs configured by the network for RSRP measurements, and a2denotes the average noise power or noise variance.
[0062] It is noted that in the above mathematical expression for RSRPTS., the only unknowns are Wj and h0TA ias the second apparatus 120 may know the test parameters it has selected, i.e., Pi, hi, Xi for transmitting the test signal#?, and noise power / variance may be estimated by the first apparatus 110 using the already known techniques in the state-of-the-art. Therefore, the ground truthof the first apparatus 110 may be generated by the second apparatus 120 if the information |wiRoTA,i | is available at the second apparatus 120 for all possible or relevant test directions '!'. One possible way of obtaining this information at the second apparatus 120 is to take the ratio of RSRPTS. and TPTS., where TPTS. is the transmit power of the test signal#'!' transmitted by the test probe antenna ‘i’ and may be written as TPTS. = p^h^2^^2. Therefore, the ratio is given by:YI= - 7A^\2- IWih°TA’iI+~ IWihoTA’iI(3)as the term — Pi—\h^i\72—\xi\72will be very small due to high p,- and small a2.
[0063] It is noted that if the test probe antennas have a directional gain, it may be assumed that the joint impact of the test probe antenna and characteristics of the OTA testing chamber for test probe antenna#'!' may be captured in h0TA iland the first apparatus 110 may be configured to also report the information of Rx beam (e.g., Rx beam ID) it has used to calculate the RSRPTS..
[0064] The second apparatus 120 may use the obtained |wj / iorAj| to generate the ground truth. For example, for a Set A beam corresponding to the RS id#‘m' having a transmit power of pm, the corresponding RS may be mapped (in one example) to test probe antenna#']', where j = (‘m’ modulo ‘t’), t is the maximum number of test probe antennas in the test chamber to be used for the conformance test. If the channel model to be used is hj, the second apparatus 120 may already know the test probe information, hj and pm. Therefore, the ground truth for this Set A beam may be generated by the second apparatus 120 without actually transmitting this Set A beam as:RSRRTSmj ~ \wjh0TAj\ X pm| / ly| \xm\2+ (72(4)
[0065] In this way, the ground truth for all Set A beams may be generated at the second apparatus 120 without actually transmitting them.
[0066] As the ground truth may be generated by the second apparatus 120, the first apparatus 110 may be configured for measuring the Set B beams for the consistent prediction of top K Set A beams based on the ground truth generated by the second apparatus 120. For this, the second apparatus 120 may need to indicate the first apparatus 110 that when a Set B beam is transmitted by the test probe antenna#'!', the first apparatus 110 may use the antenna pattern and / or receiving beamforming gain which results in | wih0TAi | being the overall impact of OTA testing chamber and hardware for the corresponding Set B beam.
[0067] In the following, in a scenario that the test signal is transmitted via more than one test antenna, a test signal #'!' may be used as an example for elaborating on the process of generating ground truth. Still let the test signal#'!' contains the unit energy symbol xtwhose transmit power ispij Watts when transmitted by the test probe ‘j’. The channel implemented by the CE to transmitbe a vector ht=...] . where represents the channel coefficient (e.g., clustered delay line (CDL) or simplified CDL channel coefficient corresponding to the jthcluster represented by the test probe antenna 'j') corresponding to the channel component for test probe antenna 'j' when the test signal 'I' will be transmitted. The number of test probe antennas transmitting the test signal#'!' is Mj. The test signal#'!' will be transmitted using several or all available test probe antennas after which it propagates through the wireless OTA channel of the test chamber, and then is received by the antenna array of the first apparatus 110. The first apparatus 110 may perform the RX beamforming (e.g., analog beamforming) and forms a combined scalar signal yfwhich is given by:y; = Wi HoTA^PihtXt) + nt(5) where is a N x 1 vector capturing the impact of Rx antenna pattern and / or Rx beamforming gain for test signal#'!' arriving from the directions of the test probe antenna combination used for transmitting test signal #'!', H0TA,i is aN x wireless OTA channel matrix where N is the number of antenna elements in the antenna array of the first apparatus 110, Ptis a Mtx Mi diagonal matrix withbeing its jthdiagonal element andrepresents the additive noise added by the UE hardware. Hence, the RSRP of the received signal yfcan be approximated as:RSRPTS. = E[|yd2] = (6)where E[. ] denotes the expectation operation and is performed by taking the linear average over the power contributions (in [W]) over all resource elements that carry the RSs configured by the network for RSRP measurements, and a2denotes the average noise power or noise variance.
[0068] It is set that Pt= IM. (identity matrix). Therefore, it may be obtained:2 2 2 2 ^i HoTA.itPihiXi)} = \w?H0TA,i(hixi)\ = \w?H0TA,ihi\ ■ kl2= \w^H0TA,ihi\ (7)2 2
[0069] Hence,RSRPTS. « + a2< ||wfH0W|| || / ij|2+ ct2, with equality holds if hi and Wi H0TA,i are linearly dependent. In some cases, the design of htis not limited in the present disclosure, and inequality may be approximated by the equality to obtain an estimate during the conformance test.
[0070] Hence, the following may be considered:RSRPTS. ^ ||wfH0W|| HM2+ o2(8)
[0071] It is noted that the above mathematical expression for RSRPTS. contains the unknownsand H0TA,i as well as the second apparatus 120 known test parameter hi. One possible way of obtaining the estimate of \w- HOTAii| at the second apparatus 120 is to take the ratio of RSRPTS.and TPTS. where TPTS. = ||hj||2. Therefore, the ratio is given by:defRSRPTSi_ ||wf1HOTAi||2||hiii2+<72_ II Hff ||2+ ~ ||wHw ||2Yi =~ - PdF - "H°TA^+~ IIWi H°TA'iW(9)
[0072] Therefore, the ground truth may be generated by the second apparatus 120 using the procedure described below.
[0073] Derivation of RSRPs as ground truths is described above. However, it is understood that the derivation is an example without any limitation. The parameters and formation of the equations are described as examples without limitation. The derivation may be adapted to any other parameters and / or formation of equations. For example, in the above example, the reference signal has a unit energy, but this is not limited. In another example, the reference signal may have a non-unit energy. Moreover, in the above derivation, RSRP is described as an example of the signal quality metric. The derivation principle may be applied to another signal quality metric, for example, Signal to Interference plus Noise Ratio (SI NR), Reference Signal Received Quality (RSRQ), etc.
[0074] FIG. 5 illustrates a signaling flow 500 for conformance testing of AI / ML-based beam management according to some example embodiments of the present disclosure. The signaling flow 500 involves the first apparatus 110 and the second apparatus 120 in FIG. 1. For purpose of illustration, the signalling flow 500 will be described with respect to FIG. 1. For purpose of discussion, some example embodiments are described where the first apparatus 110 is implemented as the DUT 420 in FIG. 4, and the second apparatus 120 is implemented as the TE 410 in FIG. 4.
[0075] In some example embodiments, in order to test beam prediction performance of the first apparatus 110, the second apparatus 120 may transmit a plurality of test signals to the first apparatus 110. A test signal of the plurality of test signals may be transmitted through one or more test antennas of a plurality of test antennas. As used herein, the test antenna may refer to any antenna (e.g., test probe antenna) used to transmit the test signal. For example, in an OTA testing case, the test antenna(s) may include one or more test probe antennas arranged in a multi-probe configuration. In some cases, the test signal may be transmitted from only one of the available test probe antennas at a given time. In some further cases, the test signal may be transmitted concurrently from multiple (more than one) available test antennas, for example, to simulate multi-path propagation conditions, or to form a desired Tx antenna (or antenna array) radiation pattern. The selection between singleantenna or multi-antenna transmission may depend on factors such as configured testing scenario, capability of the first apparatus 110, or predefined test requirements, etc.
[0076] The first apparatus 110 receives the plurality of test signals from the second apparatus 120. The first apparatus 110 performs (502) a signal quality measurement on the plurality of test signals, and obtains a plurality of measurement results based on the signal quality measurement. In someexample embodiments, the measurement result of the test signal may include the RSRP of the test signal, such as L1-RSRP, L3-RSRP, etc. The measurement result may further include other metrics such as signal-to-noise ratio (SNR) which may be correlated or uncorrelated with the RSRP measurement, and embodiments of the present disclosure do not limit it thereto. As an example, the first apparatus 110 receives N (an integer greater than 1) test signals, namely test signal 1, test signal 2, .... test signal N. For each of the N test signals, the first apparatus 110 may perform a signal quality measurement, and may obtain N respective measurement results based on these signal quality measurements. For example, for the test signal i, the first apparatus 110 may measure its RSRP, and derive its RSRP value (denoted by RSRPTS.).
[0077] For each of the N test signals, the first apparatus 110 may apply an antenna configuration for receiving the test signal. For example, for the test signal i, the first apparatus 110 may the antenna configuration / . The antenna configuration may include any suitable configuration or parameter of one or more receiving antennas of the first apparatus 110. In some example embodiments, the antenna configuration used at the first apparatus 110 for receiving the test signal may include at least one of a receiving antenna pattern for receiving the test signal, or a receiving beamforming parameter for receiving the test signal. As an example, the receiving beamforming parameter may include receiving beamforming gain.
[0078] The first apparatus 110 sends (504), to the second apparatus 120, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations (also referred to as antenna configuration information) used at the first apparatus 110 for receiving the plurality of test signals. The antenna configuration information may include any suitable information for identifying the antenna configuration used at the first apparatus 110.
[0079] In some example embodiments, for a test signal of the plurality of test signals, the antenna configuration information may include beam information associated with a receiving beam used at the first apparatus 110 for receiving the test signal. For example, the beam information may include the identifier (ID) of the receiving beam (also referred to as Rx beam ID) used for receiving the test signal. The first apparatus 110 may send the respective measurement results and the antenna configuration information to the second apparatus 120 either individually per test signal or collectively as an aggregated report, which is not limited in the present disclosure. The second apparatus 120 receives the respective measurement results and the antenna configuration information from the first apparatus 110.
[0080] The second apparatus 120 determines (506) a mapping from a set of prediction beams to the plurality of test antennas. In some cases, the prediction beam may refer to a beam for which thesignal quality (for example, RSRP) is to be predicted. The set of prediction beams may include a Set A, and the beam in the Set A may be referred to as the Set A beam. For example, the second apparatus 120 may map a prediction beam in the set of prediction beams to an activated test antenna. As used herein, if a prediction beam is mapped to one or more test antennas, it may mean that a reference signal (RS) corresponding to the prediction beam is assumed as being transmitted from the one or more mapped test antennas. It is noted that the RS corresponding to the prediction beam may not be actually transmitted from the one or more mapped antennas.
[0081] Then, the second apparatus 120 generates (508) respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results. For example, for a prediction beam A, the second apparatus 120 may generate its estimated signal quality based on the one or more test antennas to which the prediction beam A is mapped and the measurement result on the test signal which is transmitted from the one or more test antennas. The estimated signal qualities for the set of prediction beams may be at least a portion of the ground truths for beam prediction.
[0082] In some example embodiments, based on the respective estimated signal qualities generated for the set of prediction beams, the second apparatus 120 may identify, from the set of prediction beams, a predefined number of beams with the highest signal qualities, which may be also referred to as best beams. For example, the second apparatus 120 may identify the Top-K beams from set A. Depending on the metric used for the signal quality measurement, the highest signal qualities may have corresponding definition. For example, if RSRP is used as the metric, the highest signal qualities may refer to highest RSRP values. In such example embodiments, the estimated signal qualities for the set of prediction beams and the estimated best beam may constitute the ground truths for the beam prediction.
[0083] In some examples, due to hardware factors of the first apparatus 110, there may be some noise associated with the reception of the plurality of test signals by the first apparatus 110. In some example embodiments, the first apparatus 110 may send noise information to the second apparatus 120. For example, the noise information may include average noise power, or noise variance, etc. In some example embodiments, the second apparatus 120 may generate the respective estimated signal qualities further based on the noise information as will be described below.
[0084] Now some example embodiments are described with respect to the generation of the ground truths.
[0085] In some example embodiments, for a prediction beam, of the set of prediction beams, that is mapped to one or more test antennas of the plurality of test antennas, the second apparatus 120 may obtain a characteristic of signal transmission from the one or more mapped test antennas to the firstapparatus 110. In some cases, for a test signal / of the plurality of test signals that is transmitted from the one or more mapped test antennas, the second apparatus 120 may determine the characteristic of the signal transmission from the one or more mapped test antennas to the first apparatus 110 based on a measurement result on the test signal and a transmit power of the test signal. It is noted that the transmit power of the test signal is known to the second apparatus.
[0086] In an example, for the test signal i, the characteristic may be determined as a ratio of the RSRP measured on the test signal i to the transmit power of the test signal i. Such a characteristic may be also referred to as a ratio / . As an example, the ratio i may be calculated by using the equation (3) or (9).
[0087] In some example embodiments, the characteristic of the signal transmission may include a combination of a channel from the one or more mapped test antennas to the first apparatus 110, and an effect of an antenna configuration of the first apparatus 110 to the one or more mapped test antennas. For example, the characteristic of the signal transmission may be associated with the product of the channel h0TA iand the effect Wj. The second apparatus 120 may then generate an estimated signal quality for the prediction beam based on the characteristic of the signal transmission, and a transmission property of the prediction beam. For example, the estimated RSRP may be generated by using the equation (4) or (6). It is noted that the noise term in the equations may be neglected in some cases or may be provided by the first apparatus 110 to the second apparatus 120.
[0088] In some example embodiments, the transmission property of the prediction beam may include at least one of: a transmit power pmof a reference signal corresponding to the prediction beam, a channel hj modeled for the one or more mapped test antennas, or a symbol with unit energy xmfor carrying the reference signal. For example, the transmission property may be calculated as \xm\2as shown in equation (4). The transmission property may also be other manners, which is not limited in the present disclosure. An example for calculating the ratio is described below with respect to the equation (3).
[0089] Therefore, the ground truths may be generated by the second apparatus 120.
[0090] In some example embodiments, for each measurement beam in a set of measurement beams, the procedure 550 including steps 510-516 may be performed. As used herein, the measurement beam may refer to a beam actually measured by the first apparatus 110. The set of measurement beams may include a Set B, and the beam in the Set B may be referred to as the Set B beam. For example, the second apparatus 120 may map (510) a measurement beam to one or more test antennas of the plurality of test antennas. If a measurement beam is mapped to one or more test antennas, a RS corresponding to the measurement beam is to be transmitted from the one or more mapped test antennas.
[0091] The second apparatus 120 may send (512), to the first apparatus 110, identification information indicating an antenna configuration used at the first apparatus 110 for receiving a test signal of the plurality of test signals. That test signal is the one which is transmitted from the one or more mapped test antennas. For example, if a set B beam is mapped to one or more test antennas used for receiving the test signal i, the identification information may indicate the antenna configuration i used at the first apparatus 110 for receiving the test signal i.
[0092] As mentioned above, in some cases, the antenna configuration used at the first apparatus 110 for receiving the test signal may include at least one of a receiving antenna pattern for receiving the test signal, or a receiving beamforming parameter for receiving the test signal. As an example, the receiving beamforming parameter may include receiving beamforming gain.
[0093] The first apparatus 110 may receive the identification information from the second apparatus 120. The second apparatus 120 may cause the one or more mapped test antennas to transmit (514) a reference signal (RS) corresponding to the measurement beam to the first apparatus 110. In some cases, the RS may include synchronization signal blocks (SSBs) or CSI-RSs, etc. The first apparatus 110 may then perform (516) the signal quality measurement for the measurement beam by applying the indicated antenna configuration to receive a reference signal corresponding to the measurement beam.
[0094] The procedure 550 may be repeated for each beam in the set of measurement beams. As such, the first apparatus 110 may obtain respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams. For example, the first apparatus 110 may obtain respective RSRPs for set B beams.
[0095] In some example embodiments, the first apparatus 110 may generate (518) a prediction result for a set of prediction beams based on respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams. In some examples, the first apparatus 110 may generate the prediction result based on an AI / ML model.
[0096] In some example embodiments, the prediction result may include respective identifiers of a predefined number of beams, among the set of prediction beams, with highest signal qualities, which may be also referred to as best beams. As mentioned above, depending on the metric used for the signal quality measurement, the highest signal qualities may have corresponding definition. For example, if RSRP is used as the metric, the highest signal qualities may refer to highest RSRP values. The prediction result may include, e.g., top K beams in the set of prediction beams (e.g., Set A). For example, the first apparatus 110 may predict top K Set A beams.
[0097] In some example embodiments, the prediction result may include at least respective RSRPs of the predefined number of beams. In some example embodiments, the prediction result may includeRSRP of each beam in the set of prediction beams. It is noted that the RSRP for the prediction beam is predicted for example by the AI / ML model.
[0098] The first apparatus 110 may transmit (520) the prediction result to the second apparatus 120. The second apparatus 120 may receive prediction result for the set of prediction beams from the first apparatus 110. In some cases, the second apparatus 120 may compare the prediction result with the respective estimated signal qualities for the set of prediction beams, and determine (522) the beam prediction performance of the first apparatus 110 based on the comparison result. For example, the second apparatus 120 may determine a test verdict (e.g., pass or fail) of the first apparatus 110 based on the predefined performance criteria.
[0099] FIG. 6 illustrates another signaling flow 600 for conformance testing of AI / ML-based beam management based on measurement information according to some example embodiments of the present disclosure. The signaling flow 600 involves the first apparatus 110 and the second apparatus 120 in FIG. 1. For purpose of illustration, the signalling flow 600 will be described with respect to FIG.1. The acts 502-508 and 518-522 may be implemented similarly to the corresponding acts with the same reference numerals in FIG. 5, and details thereof are not repeated herein.
[0100] As shown, the second apparatus 120 may determine a mapping from measurement beams in the set of measurement beams to the plurality of test antennas. For example, each set B beam may be mapped to one or more test antennas, which means that the RS corresponding to the set B beam is to be transmitted from the one or more mapped test antennas.
[0101] Based on the mapping, the second apparatus 120 may send (612), to the first apparatus 110, measurement information associated with a signal quality measurement for the set of measurement beams. The measurement information indicates the first apparatus 110 to apply, for the signal quality measurement, respective antenna configurations used at the first apparatus 110 for receiving the plurality of test signals from the plurality of test antennas. The antenna configuration is similar as that described with reference to FIG. 5. The first apparatus 110 receives measurement information from a second apparatus 120.
[0102] In some example embodiments, for each measurement beam, the measurement information may include identification information indicating an antenna configuration used at the first apparatus 110 for receiving a test signal that is transmitted from the one or more test antennas to which the measurement beam is mapped.
[0103] Based on the mapping, the second apparatus 120 causes (614) the plurality of test antennas to transmit, to the first apparatus 110, RSs corresponding to the set of measurement beams. For example, for each measurement beam, the second apparatus 120 may control the one or more antennas, to which the measurement beam is mapped, to transmit the RS corresponding to themeasurement beam.
[0104] Correspondingly, the first apparatus 110 may obtain (616) respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams based on the measurement information. For example, for each measurement beam, the first apparatus 110 may apply the antenna configuration indicated for the measurement beam and measured the RSRP on the RS corresponding to the measurement beam.
[0105] In some example embodiments, the procedure 650 described above may be performed in an aggregated mode. For example, the respective antenna configurations for the measurement beams may be indicated to the first apparatus 110 in the same signaling. Then, the second apparatus 120 may transmit the RSs corresponding to the measurement beams in an order known by the first apparatus 110. Accordingly, the first apparatus 110 may apply the indicated antenna configurations in the same order.
[0106] In some example embodiments, the procedure 650 described above may be performed in a sequential mode. For example, the procedure 550 may be repeated for each measurement beam in the set of measurement beams.
[0107] To better understand the conformance testing proposed, some more examples are described with reference to FIG. 7 and FIG. 8.
[0108] FIG. 7 illustrates a signaling flow 700 for example conformance testing of AI / ML enabled beam management in a scenario where one test probe is activated according to some example embodiments of the present disclosure. As shown in FIG. 7, the signaling flow 700 involves A TE 752 and a DUT 751. The TE 752 may be an example of the second apparatus 120 in FIG. 1, and the DUT 751 may be an example of the first apparatus 110 in FIG. 1. The signaling flow 700 may be an example of the signaling flow 500 or 600.
[0109] At 701, the DUT 751 is placed inside a test chamber (e.g., a multi-Rx test system) and positioned in the declared orientation. In some cases, the test chamber may be connected to the TE 752 via a CE. That is, the test signals from the TE 752 may be applied to the CE, and its output is then fed to the test probe antennas. In an implementation, the CE may be a part of the TE 752, and hence the output of the TE, which includes the effects produced by the CE, may be directly applied to the test probe antennas.
[0110] At 702, CE settings may be applied at the TE 752 and / or CE such that such that only one test probe antenna is activated at a time. In other words, the test signal may be transmitted from only one of the available test probe antennas. For example, a test Signal#1 may be transmitted from test probe antenna P0 in FIG. 4. The test Signal#2 may be transmitted from the test probe antenna P1 in FIG. 4. The test Signal#3 may be transmitted from the test probe antenna P2 in FIG. 4. The testSignal#4 may be transmitted from the test probe antenna P3 in FIG. 4. It is noted that the order of activation of the test probe antennas is not fixed, i.e., any of the available test probe antennas may be activated first, in between, or last. The test Signals may include DL reference signals (RSs), e.g., SSB or CSI-RS.
[0111] At 703, the TE 752 transmits a test signal from each test probe antenna sequentially to the DUT 751. At 704, the DUT 751 measures the L1-RSRP corresponding to the transmitted test signals. For example, for each test signal I, the DUT 751 measures the L1-RSRP (e.g., RSRP_TS_i) of the test signal I. In this way, the L1-RSRP measurements for all test signals may be obtained.
[0112] At 705, the DUT 751 reports the measured L1-RSRP and the Rx beam information (e.g., Rx beam ID) used for measuring the L1-RSRP back to the TE 752. For example, for each test signal transmitted by the TE 752, e.g., test signal I, the DUT 751 transmits its L1-RSRP RSRP_TS_i to the TE 752. In some cases, the report may either be individually report for each RSRP measurement or a common report for all RSRP measurements. At 706, the TE 752 saves the L1-RSRP (e.g., RSRP_TS_i) and Rx beam information reported by the DUT 751 along with the corresponding activated test probe antenna information (e.g., index of the test probe antenna activated at that time instant).
[0113] At 707, the TE 752 derives the ratio (e.g., the characteristic y;) for each test probe antenna 'I'. At 708, the TE 752 maps each Set A beam to a test probe antenna, and generates the ground truth using the ratio y; for each Set A beam. Before transmitting the Set B beams, the TE 752 maps each Set B beam to a test probe antenna (709). For the test probebased transmission, the TE 752 indicates the DUT 751 to lock the same Rx antenna pattern and / or apply the same Rx beamforming which corresponds to the ratio y; (710). For example, if the given Set B beam is to be transmitted by the test probe antenna ‘j’, the TE 752 may first indicate the DUT 751 to lock the same Rx antenna pattern and / or apply the same Rx beamforming which corresponds to the ratio yj.
[0114] At 711, the DUT 751 locks the same Rx antenna pattern and / or apply the same Rx beamforming. At 712, the TE 752 transmits a Set B beam using the test probe antenna 'j' to the DUT 751. The DUT 751 measures the RSRP and save it for inputting to AI / ML model for top-K Set A beam prediction. At 713, the TE 752 maps a next Set B beam to the test probe antenna ‘j+1 ', and indicates the DUT 751 to lock the same Rx antenna pattern and / or apply the same Rx beamforming which corresponds to the ratio y<j+i).
[0115] At 714, the DUT 751 locks the corresponding Rx antenna pattern and / or apply the corresponding Rx beamforming. At 715, the TE 752 transmits a Set B beam using the test probe antenna ‘j+T to the DUT 751. The DUT 751 measures the RSRP and save it for inputting to AI / ML model for prediction of top-K Set A beams. At 716, the TE 752 transmits all Set B beams to the DUT 751. The DUT 751 measures the L1-RSRP for AI / ML based prediction of top-K Set A beams. At 717,the DUT 751 predicts the top-K Set A beams and reports the prediction results (e.g., Tx beam IDs and RSRPs of the predicted top-K beams) to the TE 752.
[0116] At 718, the TE 752 receives the prediction result from the DUT 751, and compares the prediction results with the ground truth it had generated. The TE 752 may then determine the beam prediction performance of the DUT 751 based on the comparison result. For example, the TE 752 may determine a test verdict (e.g., pass or fail) for the current test iteration based on predefined performance criteria.
[0117] FIG. 8 illustrates a signaling flow 800 for example conformance testing of AI / ML enabled beam management in a scenario where more than one test probe is activated according to some example embodiments of the present disclosure. As shown in FIG. 8, the signaling flow 800 involves the TE 752 and the DUT 751. The signaling flow 800 may be an example of the signaling flow 500 or 600.
[0118] The signaling flow 800 includes steps 801-803, 807-810, 812, 813 and 815, and steps 704-706, 711, 714, 716-718. The steps 704-706, 711, 714, 716-718 may be implemented similarly to the corresponding steps with the same reference numerals in FIG. 7, and details thereof are not repeated herein.
[0119] At 801, the DUT 751 is placed inside a test chamber. The test chamber may be FR2 MIMO OTA test chamber equipped with 6 dual-polarized probes placed on a sector to model the CDL channel. Alternatively, for multi-Rx test chamber, each test probe antenna may also be seen to be modelling a particular cluster for CDL or simplified CDL or any other suitable channel model. In another example, the required channel model to be used for the conformance testing of AI / ML based beam management may be implemented by the channel emulator and the test probe antennas are used to transmit signals to the DUT from the multiple directions. At 802, settings may be applied at the TE 752 and / or CE such that the test signal will be transmitted from multiple (more than one) available test probe antennas. At 803, the TE 752 transmits different test signals using different antenna patterns (e.g., antenna pattern#'!' where I = 1,2,3 ...) corresponding to different beams using the combination of the available test probe antennas to the DUT 751.
[0120] At 807, the TE 752 derives the ratio (e.g., the characteristic y;) for each test signal#'!’. At 808, the TE 752 maps each Set A beam to a combination of test probe antennas, and generates the ground truth using the ratio y; for each Set A beam. Before transmitting the Set B beams, the TE 752 maps each Set B beam to a combination of test probe antennas (809). For example, if a given Set B beam is to be transmitted by the test signal ‘j’, the TE 752 may first indicate the DUT 751 to lock the same Rx antenna pattern and / or apply the same Rx beamforming which corresponds to the ratio yj (810).
[0121] At 812, the TE 752 transmits a Set B beam using the test signal ‘j’ using a combination of test probe antennas. The DUT 751 measures the RSRP and saves it for inputting to AI / ML model for top-K Set A beam prediction. At 813, the TE 752 maps a next Set B beam to test signal ‘j+1 ' and indicates the DUT 751 to lock the same Rx antenna pattern and / or apply the same Rx beamforming which corresponds to the ratio yg+i). At 815, the TE 752 transmits a Set B beam using the test signal ‘j+r using a combination of test probe antennas to the DUT 751. The DUT 751 measures the RSRP and save it for inputting to AI / ML model for prediction of top-K Set A beams.
[0122] In the present disclosure, a key concept behind the proposed solution is based on the fact that a practical OTA testing chamber has only a limited number (e.g., 4, 6, or 8) of test probe antennas using which the test signals will be transmitted to the DUT. The common understanding for the AI / ML-enabled beam management conformance testing is that beams in both Set A beams and Set B need to be transmitted to the DUT during the conformance test for ground truth extraction and AI / ML prediction, respectively. As the number of available test probe antennas at the testing chamber is limited, all beams in both Set A beams and Set B need to be transmitted using those limited test probe antennas by reusing each test probe antenna for transmitting more than one beam.
[0123] Therefore, if the characteristics of the OTA test chamber (e.g., path loss from each test probe antenna to the DUT) and the UE Rx antenna pattern and / or Rx beamforming gain towards the direction of test probe antennas may be obtained either prior to the test or during the starting phase of the test, the ground truth for the beams in Set A may be generated by using the obtained UE Rx antenna pattern and / or Rx beamforming gain knowledge and OTA characteristics knowledge at the TE, without actually transmitting the beams in Set A during the conformance testing.
[0124] Based on the solutions in the present disclosure, the transmission of beams in Set A may be avoided during the conformance testing of AI / ML enabled beam management features, which may lead to cost-effective, efficient, and reliable conformance testing. It may also solve the concerns about UE cheating during the test as the ground truth is generated directly by the TE and is not available to the DUT. The TE may be allowed to estimate the joint effect of the OTA test chamber (e.g., path loss from each test probe antenna to the DUT) and the UE Rx antenna pattern and / or Rx beamforming gain towards the direction of test probe antennas either prior to the test or during the starting phase of the test. The TE may generate the ground truth for the beams in Set A without actually transmitting the beams in Set A during the conformance testing. The TE may be informed about the Rx beam information used by the DUT for calculating the L1-RSRP during the conformance test. Additionally, the DUT may be informed about the locking of the corresponding Rx antenna pattern and / or Rx beamforming during the conformance test.
[0125] FIG. 9A shows a flowchart of an example method 900A implemented at a first apparatus inaccordance with some example embodiments of the present disclosure. For the purpose of discussion, the method 900A will be described from the perspective of the first apparatus 110 in FIG. 1.
[0126] At block 910, the first apparatus 110 performs a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas.
[0127] At block 920, the first apparatus 110 sends, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
[0128] In some example embodiments, the method 900A further comprises: sending, to the second apparatus, noise information associated with reception of the plurality of test signals.
[0129] In some example embodiments, for the test signal of the plurality of test signals, the information indicating the respective antenna configurations comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
[0130] In some example embodiments, the measurement result of the test signal comprises a reference signal received power of the test signal.
[0131] In some example embodiments, the method 900A further comprises: for each measurement beam in a set of measurement beams, receiving, from the second apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving the test signal of the plurality of test signals; and performing the signal quality measurement for the measurement beam by applying the indicated antenna configuration to receive a reference signal corresponding to the measurement beam.
[0132] In some example embodiments, the method 900A further comprises: generating a prediction result for a set of prediction beams based on respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams; and transmitting the prediction result to the second apparatus.
[0133] In some example embodiments, the prediction result is generated by using an artificial intelligence / machine learning, AI / ML, model.
[0134] In some example embodiments, the first apparatus comprises or is comprised in a device under test, and the second apparatus comprises or is comprised in a test equipment.
[0135] FIG. 9B shows a flowchart of an example method 900B implemented at a second apparatus in accordance with some example embodiments of the present disclosure. For the purpose of discussion, the method 900B will be described from the perspective of the second apparatus 120 in FIG. 1.
[0136] At block 930, the second apparatus 120 receives, from a first apparatus, respectivemeasurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas.
[0137] At block 940, the second apparatus 120 determines a mapping from a set of prediction beams to the plurality of test antennas.
[0138] At block 950, the second apparatus 120 generates respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
[0139] In some example embodiments, the method 900B further comprises: for a prediction beam, of the set of prediction beams, that is mapped to one or more test antennas of the plurality of test antennas, obtaining a characteristic of signal transmission from the one or more mapped test antennas to the first apparatus; and generating an estimated signal quality for the prediction beam based on the characteristic of the signal transmission, and a transmission property of the prediction beam.
[0140] In some example embodiments, the second apparatus is cause to: for a test signal of the plurality of test signals that is transmitted from the one or more mapped test antennas, determine the characteristic of the signal transmission from the one or more mapped test antennas to the first apparatus based on a measurement result on the test signal and a transmit power of the test signal.
[0141] In some example embodiments, the characteristic of the signal transmission comprises a combination of: a channel from the one or more mapped test antennas to the first apparatus, and an effect of an antenna configuration of the first apparatus to the one or more mapped test antennas.
[0142] In some example embodiments, the transmission property of the prediction beam comprises at least one of: a transmit power of a reference signal corresponding to the prediction beam, a channel modeled for the one or more mapped test antennas, or a symbol with unit energy for carrying the reference signal.
[0143] In some example embodiments, the method 900B further comprises: receiving, from the first apparatus, noise information associated with reception of the plurality of test signals, wherein the respective estimated signal qualities are generated further based on the noise information.
[0144] In some example embodiments, for the test signal of the plurality of test signals, the information indicating the respective antenna configurations comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
[0145] In some example embodiments, the method 900B further comprises: for each measurement beam in the set of measurement beams, mapping the measurement beam to one or more test antennas of the plurality of test antennas; sending, to the first apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving a test signal of the pluralityof test signals, wherein the test signal is transmitted from the one or more mapped test antennas; and causing the one or more mapped test antennas to transmit, to the first apparatus, a reference signal corresponding to the measurement beam.
[0146] In some example embodiments, the method 900B further comprises: receiving, from the first apparatus, a prediction result for the set of prediction beams; and determining a beam prediction performance of the first apparatus by comparing the prediction result and the respective estimated signal qualities for the set of prediction beams.
[0147] In some example embodiments, the first apparatus comprises or is comprised in a device under test, and the second apparatus comprises or is comprised in a test equipment
[0148] In some example embodiments, a first apparatus capable of performing any of the method 900A (for example, the first apparatus 110 in FIG. 1) may comprise means for performing the respective operations of the method 900A and / or any of the described one or more example embodiments thereof. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. The first apparatus may be implemented as or included in the first apparatus 110 in FIG. 1.
[0149] In some example embodiments, a second apparatus capable of performing any of the method 900B (for example, the second apparatus 120 in FIG. 1) may comprise means for performing the respective operations of the method 900B and / or any of the described one or more example embodiments thereof. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. The second apparatus may be implemented as or included in the second apparatus 120 in FIG. 1
[0150] FIG. 10A shows a flowchart of an example method 1000A implemented at a first apparatus in accordance with some example embodiments of the present disclosure. For the purpose of discussion, the method 1000A will be described from the perspective of the first apparatus 110 in FIG.1.
[0151] At block 1010, the first apparatus 110 receives, from a second apparatus, measurement information associated with a signal quality measurement for a set of measurement beams, wherein the measurement information indicates the first apparatus to apply, for the signal quality measurement, respective antenna configurations used at the first apparatus for receiving a plurality of test signals from a plurality of test antennas.
[0152] At block 1020, the first apparatus 110 obtains respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams based on the measurement information.
[0153] In some example embodiments, the method 1000A further comprises: for each measurementbeam in a set of measurement beams, receiving, from the second apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving a test signal of the plurality of test signals; and performing the signal quality measurement for the measurement beam by applying the indicated antenna configuration to receive a reference signal corresponding to the measurement beam.
[0154] In some example embodiments, the method 1000A further comprises: generating a prediction result for a set of prediction beams based on the respective measurement results; and transmitting the prediction result to the second apparatus.
[0155] In some example embodiments, the prediction result is generated by using an artificial intelligence / machine learning, AI / ML, model.
[0156] In some example embodiments, the prediction result for the set of prediction beams comprises at least one of: respective identifiers of a predefined number of beams, among the set of prediction beams, with highest signal qualities, or respective reference signal received powers of the predefined number of beams.
[0157] In some example embodiments, an antenna configuration used at the first apparatus for receiving a test signal of the plurality of test signals comprises at least one of: a receiving antenna pattern for receiving the test signal, or a receiving beamforming parameter for receiving the test signal.
[0158] In some example embodiments, the method 1000A further comprises: performing a signal quality measurement on the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of the plurality of test antennas; and sending, to the second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating the respective antenna configurations.
[0159] In some example embodiments, the method 1000A further comprises: sending, to the second apparatus, noise information associated with reception of the plurality of test signals.
[0160] In some example embodiments, the identification information comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
[0161] In some example embodiments, the first apparatus comprises or is comprised in a device under test, and the second apparatus comprises or is comprised in a test equipment.
[0162] FIG. 10B shows a flowchart of an example method 1000B implemented at a second apparatus in accordance with some example embodiments of the present disclosure. For the purpose of discussion, the method 1000B will be described from the perspective of the second apparatus 120 in FIG. 1.
[0163] At block 1030, the second apparatus 120 determines a mapping from measurement beams in a set of measurement beams to a plurality of test antennas.
[0164] At block 1040, the second apparatus 120 sends, to a first apparatus based on the mapping, measurement information associated with a signal quality measurement for a set of measurement beams, wherein the measurement information indicates the first apparatus to apply, for the signal quality measurement, respective antenna configurations used at the first apparatus for receiving a plurality of test signals from the plurality of test antennas.
[0165] At block 1050, the second apparatus 120 causes, based on the mapping, the plurality of test antennas to transmit, to the first apparatus, reference signals corresponding to the set of measurement beams.
[0166] In some example embodiments, the method 1000B further comprises: for each measurement beam in the set of measurement beams, mapping the measurement beam to one or more test antennas of the plurality of test antennas; sending, to the first apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving a test signal of the plurality of test signals, wherein the test signal is transmitted from the one or more mapped test antennas; and causing the one or more mapped test antennas to transmit, to the first apparatus, a reference signal corresponding to the measurement beam.
[0167] In some example embodiments, the method 1000B further comprises: receiving, from the first apparatus, a prediction result for a set of prediction beams; and determining a beam prediction performance of the first apparatus by comparing the prediction result and respective estimated signal qualities for the set of prediction beams.
[0168] In some example embodiments, the prediction result for the set of prediction beams comprises at least one of: respective identifiers of a predefined number of beams, among the set of prediction beams, with highest signal qualities, or respective reference signal received powers of the predefined number of beams.
[0169] In some example embodiments, the method 1000B further comprises: receiving, from the first apparatus, respective measurement results of a signal quality measurement on the plurality of test signals and information indicating the respective antenna configurations; determining a mapping from a set of prediction beams to the plurality of test antennas; and generating the respective estimated signal qualities for the set of prediction beams based on the mapping, and the respective measurement results.
[0170] In some example embodiments, the method 1000B further comprises: receiving, from the first apparatus, noise information associated with reception of the plurality of test signals, wherein the respective estimated signal qualities are generated further based on the noise information.
[0171] In some example embodiments, the identification information comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
[0172] In some example embodiments, the first apparatus comprises or is comprised in a device under test, and the second apparatus comprises or is comprised in a test equipment.
[0173] In some example embodiments, a first apparatus capable of performing any of the method 1000A (for example, the first apparatus 110 in FIG. 1) may comprise means for performing the respective operations of the method 1000A and / or any of the described one or more example embodiments thereof. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. The first apparatus may be implemented as or included in the first apparatus 110 in FIG. 1.
[0174] In some example embodiments, a second apparatus capable of performing any of the method 1000B (for example, the second apparatus 120 in FIG. 1) may comprise means for performing the respective operations of the method 1000B and / or any of the described one or more example embodiments thereof. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. The second apparatus may be implemented as or included in the second apparatus 120 in FIG. 1.
[0175] FIG. 11 is a simplified block diagram of a device 1100 that is suitable for implementing example embodiments of the present disclosure. The device 1100 may be provided to implement a communication device, for example, the first apparatus 110 or the second apparatus 120 as shown in FIG. 1. As shown, the device 1100 includes one or more processors 1110, one or more memories 1120 coupled to the processor 1110, and one or more communication modules 1140 coupled to the processor 1110.
[0176] The communication module 1140 is for bidirectional communications. The communication module 1140 has one or more communication interfaces to facilitate communication with one or more other modules or devices. The communication interfaces may represent any interface that is necessary for communication with other network elements. In some example embodiments, the communication module 1140 may include at least one antenna.
[0177] The processor 1110 may be of any type suitable to the local technical network and may include one or more of the following: general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on multicore processor architecture, as non-limiting examples. The device 1100 may have multiple processors, such as an application specific integrated circuit chip that is slaved in time to a clock which synchronizes the main processor.
[0178] The memory 1120 may include one or more non-volatile memories and one or more volatile memories. Examples of the non-volatile memories include, but are not limited to, a Read Only Memory (ROM) 1124, an electrically programmable read only memory (EPROM), a flash memory, a hard disk,a compact disc (CD), a digital video disk (DVD), an optical disk, a laser disk, and other magnetic storage and / or optical storage. Examples of the volatile memories include, but are not limited to, a random-access memory (RAM) 1122 and other volatile memories that will not last in the power-down duration.
[0179] A computer program 1130 includes computer executable instructions that are executed by the associated processor 1110. The instructions of the program 1130 may include instructions for performing operations / acts of some example embodiments of the present disclosure. The program 1130 may be stored in the memory, e.g., the ROM 1124. The processor 1110 may perform any suitable actions and processing by loading the program 1130 into the RAM 1122.
[0180] The example embodiments of the present disclosure may be implemented by means of the program 1130 so that the device 1100 may perform any process of the disclosure as discussed with reference to FIG. 4 to FIG. 10B. The example embodiments of the present disclosure may also be implemented by hardware or by a combination of software and hardware.
[0181] In some example embodiments, the program 1130 may be tangibly contained in a computer readable medium which may be included in the device 1100 (such as in the memory 1120) or other storage devices that are accessible by the device 1100. The device 1100 may load the program 1130 from the computer readable medium to the RAM 1122 for execution. In some example embodiments, the computer readable medium may include any types of non-transitory storage medium, such as ROM, EPROM, a flash memory, a hard disk, CD, DVD, and the like. The term "non-transitory,” as used herein, is a limitation of the medium itself (i.e., tangible, not a signal) as opposed to a limitation on data storage persistency (e.g., RAM vs. ROM).
[0182] FIG. 12 shows an example of the computer readable medium 1200 which may be in form of CD, DVD or other optical storage disk. The computer readable medium 1200 has the program 1130 stored thereon.
[0183] Generally, various embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. Some aspects may be implemented in hardware, and other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device. Although various aspects of embodiments of the present disclosure are illustrated and described as block diagrams, flowcharts, or using some other pictorial representations, it is to be understood that the block, apparatus, system, technique or method described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
[0184] Some example embodiments of the present disclosure also provide at least one computerprogram product tangibly stored on a computer readable medium, such as a non-transitory computer readable medium. The computer program product includes computer-executable instructions, such as those included in program modules, being executed in a device on a target physical or virtual processor, to carry out any of the methods as described above. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, or the like that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or split between program modules as desired in various embodiments. Machineexecutable instructions for program modules may be executed within a local or distributed device. In a distributed device, program modules may be located in both local and remote storage media.
[0185] Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. The program code may be provided to a processor or controller of a general-purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
[0186] In the context of the present disclosure, the computer program code or related data may be carried by any suitable carrier to enable the device, apparatus or processor to perform various processes and operations as described above. Examples of the carrier include a signal, computer readable medium, and the like.
[0187] The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable medium may include but not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the computer readable storage medium would include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random-access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0188] Further, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specificimplementation details are contained in the above discussions, these should not be construed as limitations on the scope of the present disclosure, but rather as descriptions of features that may be specific to particular embodiments. Unless explicitly stated, certain features that are described in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, unless explicitly stated, various features that are described in the context of a single embodiment may also be implemented in a plurality of embodiments separately or in any suitable subcombination.
[0189] Although the present disclosure has been described in languages specific to structural features and / or methodological acts, it is to be understood that the present disclosure defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims
We Claim1. A first apparatus comprising:at least one processor; andat least one memory storing instructions that, when executed by the at least one processor, cause the first apparatus at least to:perform a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; and send, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
2. The first apparatus of claim 1, wherein the first apparatus is further caused to:send, to the second apparatus, noise information associated with reception of the plurality of test signals.
3. The first apparatus of claim 1, wherein for the test signal of the plurality of test signals, the information indicating the respective antenna configurations comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
4. The first apparatus of claim 1, wherein the measurement result of the test signal comprises a reference signal received power of the test signal.
5. The first apparatus of claim 1, wherein the first apparatus is further caused to:for each measurement beam in a set of measurement beams,receive, from the second apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving the test signal of the plurality of test signals; and perform the signal quality measurement for the measurement beam by applying the indicated antenna configuration to receive a reference signal corresponding to the measurement beam.
6. The first apparatus of claim 5, wherein the first apparatus is further caused to:generate a prediction result for a set of prediction beams based on respective measurement results of the signal quality measurement for measurement beams in the set of measurement beams; and transmit the prediction result to the second apparatus.
7. The first apparatus of claim 6, wherein the prediction result is generated by using an artificial intelligence / machine learning, AI / ML, model.
8. The first apparatus of any one of claims 1 to 7, wherein the first apparatus comprises or is comprised in a device under test, and the second apparatus comprises or is comprised in a test equipment.
9. A second apparatus comprising:at least one processor; andat least one memory storing instructions that, when executed by the at least one processor, cause the second apparatus at least to:receive, from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas;determine a mapping from a set of prediction beams to the plurality of test antennas; and generate respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
10. The second apparatus of claim 9, wherein the second apparatus is caused to:for a prediction beam, of the set of prediction beams, that is mapped to one or more test antennas of the plurality of test antennas,obtain a characteristic of signal transmission from the one or more mapped test antennas to the first apparatus; andgenerate an estimated signal quality for the prediction beam based on the characteristic of the signal transmission, and a transmission property of the prediction beam.
11. The second apparatus of claim 10, wherein the second apparatus is cause to:for a test signal of the plurality of test signals that is transmitted from the one or more mapped test antennas,determine the characteristic of the signal transmission from the one or more mapped test antennas to the first apparatus based on a measurement result on the test signal and a transmit power of the test signal.
12. The second apparatus of claim 10, wherein the characteristic of the signal transmission comprises a combination of:a channel from the one or more mapped test antennas to the first apparatus, andan effect of an antenna configuration of the first apparatus to the one or more mapped test antennas.
13. The second apparatus of claim 10, wherein the transmission property of the prediction beam comprises at least one of:a transmit power of a reference signal corresponding to the prediction beam,a channel modeled for the one or more mapped test antennas, ora symbol with unit energy for carrying the reference signal.
14. The second apparatus of claim 9, wherein the second apparatus is further caused to: receive, from the first apparatus, noise information associated with reception of the plurality of test signals, wherein the respective estimated signal qualities are generated further based on the noise information.
15. The second apparatus of claim 14, wherein for the test signal of the plurality of test signals, the information indicating the respective antenna configurations comprises beam information associated with a receiving beam used at the first apparatus for receiving the test signal.
16. The second apparatus of claim 9, wherein the second apparatus is further caused to:for each measurement beam in the set of measurement beams,map the measurement beam to one or more test antennas of the plurality of test antennas; send, to the first apparatus, identification information indicating an antenna configuration used at the first apparatus for receiving a test signal of the plurality of test signals, wherein the test signal is transmitted from the one or more mapped test antennas; andcause the one or more mapped test antennas to transmit, to the first apparatus, a reference signal corresponding to the measurement beam.
17. The second apparatus of claim 9, wherein the second apparatus is further caused to: receive, from the first apparatus, a prediction result for the set of prediction beams; and determine a beam prediction performance of the first apparatus by comparing the prediction result and the respective estimated signal qualities for the set of prediction beams.
18. A method comprising:performing, at a first apparatus, a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; andsending, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
19. A method comprising:receiving, at a second apparatus from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas;determining a mapping from a set of prediction beams to the plurality of test antennas; and generating respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
20. A first apparatus comprises means for:performing a signal quality measurement on a plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas; and sending, to a second apparatus, respective measurement results of the signal quality measurement on the plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals.
21. A second apparatus comprises means for:receiving, from a first apparatus, respective measurement results of a signal quality measurement on a plurality of test signals and information indicating respective antenna configurations used at the first apparatus for receiving the plurality of test signals, a test signal of the plurality of test signals being transmitted from one or more test antennas of a plurality of test antennas;determining a mapping from a set of prediction beams to the plurality of test antennas; and generating respective estimated signal qualities for the set of prediction beams based on the mapping and the respective measurement results.
