Device test in reporting a measurement report

Abstract

Various example embodiments of the present disclosure relate to device test in reporting a measurement report. A method comprises: at a first apparatus, transmitting a reference signal to a second apparatus under a plurality of reference measurement conditions; receiving, from the second apparatus, a first number of measurement reports related to the reference signal; performing classification of the first number of measurement reports into a second number of categories; for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and determining, based on the determination of the matching, a test result for the second apparatus.

Description

DEVICE TEST IN REPORTING A MEASUREMENT REPORTCROSS-REFERENCE TO RELATED APPLICATION

[0001] This application claims priority to, and the benefit of, US Provisional Application No. 63 / 556992, filed February 23, 2024, the contents of which are hereby incorporated by reference in their entirety.FIELD

[0002] Various example embodiments of the present disclosure generally relate to the field of telecommunication and in particular, to a method, device, apparatus and computer readable storage medium for device test for reporting a measurement report.BACKGROUND

[0003] Depending on the specific communication standard and network requirements, user equipment (UE) may transmit measurement reports, which may contain measurement information about signal quality, neighboring cell data, or other relevant measurement results. These measurement reports are crucial for network optimization, radio resource management, and mobility management.SUMMARY

[0004] In a first aspect of the present disclosure, there is provided a first apparatus. The first apparatus comprises at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the first apparatus at least to: transmit a reference signal to a second apparatus under a plurality of reference measurement conditions; receive, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; perform classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; for each of the first number of measurement reports, determine whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and determine, based on the determination of the matching, a test result for the second apparatus, the testresult indicating whether the second apparatus passes a test for reporting a measurement report.

[0005] In a second aspect of the present disclosure, there is provided a method. The method comprises: transmitting, at a first apparatus, a reference signal to a second apparatus under a plurality of reference measurement conditions; receiving, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; performing classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and determining, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

[0006] In a third aspect of the present disclosure, there is provided a first apparatus. The first apparatus comprises means for transmitting a reference signal to a second apparatus under a plurality of reference measurement conditions; means for receiving, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; means for performing classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; means for, for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and means for determining, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

[0007] In a fourth aspect of the present disclosure, there is provided a computer readable medium. The computer readable medium comprises instructions stored thereon for causing an apparatus to perform at least the method according to the second aspect.

[0008] It is to be understood that the Summary section is not intended to identify key or essential features of embodiments of the present disclosure, nor is it intended to be used to limit the scope of the present disclosure. Other features of the present disclosure will become easily comprehensible through the following description.BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Some example embodiments will now be described with reference to the accompanying drawings, where:

[0010] FIG. 1 illustrates an example communication environment in which example embodiments of the present disclosure can be implemented;

[0011] FIG. 2A illustrates an example of doppler spread for Line of Sight (LoS) channel conditions;

[0012] FIG. 2B illustrates an example of doppler spread for Non-Line of Sight (NLoS) channel conditions;

[0013] FIG. 3 illustrates an example of time correlation properties of the channel;

[0014] FIG. 4 illustrates an example of time correlation calculation for Time Domain Channel property;

[0015] FIG. 5 illustrates a signaling chart of ability tests related to measurement reports according to some example embodiments of the present disclosure;

[0016] FIG. 6 illustrates an example of mobility measurement for low speed and high speed according to some example embodiments of the present disclosure;

[0017] FIG. 7 illustrates an example of mapping method according to some example embodiments of the present disclosure;

[0018] FIG. 8 illustrates a flowchart of a method implemented at a test equipment according to some example embodiments of the present disclosure;

[0019] FIG. 9 illustrates a simplified block diagram of a device that is suitable for implementing example embodiments of the present disclosure; and

[0020] FIG. 10 illustrates a block diagram of an example computer readable medium in accordance with some example embodiments of the present disclosure.

[0021] Throughout the drawings, the same or similar reference numerals represent the same or similar element.DETAILED DESCRIPTION

[0022] Principle of the present disclosure will now be described with reference to some example embodiments. It is to be understood that these embodiments are described only forthe purpose of illustration and help those skilled in the art to understand and implement the present disclosure, without suggesting any limitation as to the scope of the disclosure. Embodiments described herein can be implemented in various manners other than the ones described below.

[0023] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skills in the art to which this disclosure belongs.

[0024] References in the present disclosure to “one embodiment,” “an embodiment,” “an example embodiment,” and the like indicate that the embodiment described may include a particular feature, structure, or characteristic, but it is not necessary that every embodiment includes the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.

[0025] It shall be understood that although the terms “first,” “second,”..., etc. in front of noun(s) and the like may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another and they do not limit the order of the noun(s). For example, a first element could be termed a second element, and similarly, a second element could be termed a first element, without departing from the scope of example embodiments. As used herein, the term “and / or” includes any and all combinations of one or more of the listed terms.

[0026] As used herein, “at least one of the following: ” and “at least one of ” and similar wording, where the list of two or more elements are joined by “and” or “or”, mean at least any one of the elements, or at least any two or more of the elements, or at least all the elements.

[0027] As used herein, unless stated explicitly, performing a step “in response to A” does not indicate that the step is performed immediately after “A” occurs and one or more intervening steps may be included.

[0028] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises”, “comprising”, “has”, “having”, “includes” and / or “including”, when usedherein, specify the presence of stated features, elements, and / or components etc., but do not preclude the presence or addition of one or more other features, elements, components and / or combinations thereof.

[0029] As used in this application, the term “circuitry” may refer to one or more or all of the following:(a) hardware-only circuit implementations (such as implementations in only analog and / or digital circuitry) and(b) combinations of hardware circuits and software, such as (as applicable):(i) a combination of analog and / or digital hardware circuit(s) with software / firmware and(ii) any portions of hardware processor(s) with software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions) and(c) hardware circuit(s) and or processor(s), such as a microprocessor(s) or a portion of a microprocessor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation.

[0030] This definition of circuitry applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term circuitry also covers an implementation of merely a hardware circuit or processor (or multiple processors) or portion of a hardware circuit or processor and its (or their) accompanying software and / or firmware. The term circuitry also covers, for example and if applicable to the particular claim element, a baseband integrated circuit or processor integrated circuit for a mobile device or a similar integrated circuit in server, a cellular network device, or other computing or network device.

[0031] As used herein, the term “communication network” refers to a network following any suitable communication standards, such as New Radio (NR), Long Term Evolution (LTE), LTE-Advanced (LTE-A), Wideband Code Division Multiple Access (WCDMA), High-Speed Packet Access (HSPA), Narrow Band Internet of Things (NB-IoT) and so on. Furthermore, the communications between a terminal device and a network device in the communication network may be performed according to any suitable generation communication protocols, including, but not limited to, the first generation (1G), the second generation (2G), 2.5G, 2.75G, the third generation (3G), the fourth generation (4G), 4.5G,the fifth generation (5G), the sixth generation (6G) communication protocols, and / or any other protocols either currently known or to be developed in the future. Embodiments of the present disclosure may be applied in various communication systems. Given the rapid development in communications, there will of course also be future type communication technologies and systems with which the present disclosure may be embodied. It should not be seen as limiting the scope of the present disclosure to only the aforementioned system.

[0032] As used herein, the term “network device” refers to a node in a communication network via which a terminal device accesses the network and receives services therefrom. The network device may refer to a base station (BS) or an access point (AP), for example, a node B (NodeB or NB), an evolved NodeB (eNodeB or eNB), an NR NB (also referred to as a gNB), a Remote Radio Unit (RRU), a radio header (RH), a remote radio head (RRH), a relay, an Integrated Access and Backhaul (IAB) node, a low power node such as a femto, a pico, a non-terrestrial network (NTN) or non-ground network device such as a satellite network device, a low earth orbit (LEO) satellite and a geosynchronous earth orbit (GEO) satellite, an aircraft network device, and so forth, depending on the applied terminology and technology. In some example embodiments, radio access network (RAN) split architecture comprises a Centralized Unit (CU) and a Distributed Unit (DU) at an IAB donor node. An IAB node comprises a Mobile Terminal (IAB-MT) part that behaves like a User Equipment (UE) toward the parent node, and a DU part of an IAB node behaves like a base station toward the next-hop IAB node.

[0033] The term “terminal device” refers to any end device that may be capable of wireless communication. By way of example rather than limitation, a terminal device may also be referred to as a communication device, user equipment (UE), a Subscriber Station (SS), a Portable Subscriber Station, a Mobile Station (MS), or an Access Terminal (AT). The terminal device may include, but not limited to, a mobile phone, a cellular phone, a smart phone, voice over IP (VoIP) phones, wireless local loop phones, a tablet, a wearable terminal device, a personal digital assistant (PDA), portable computers, desktop computer, image capture terminal devices such as digital cameras, gaming terminal devices, music storage and playback appliances, vehicle-mounted wireless terminal devices, wireless endpoints, mobile stations, laptop-embedded equipment (LEE), laptop-mounted equipment (LME), USB dongles, smart devices, wireless customer-premises equipment (CPE), an Internet of Things (loT) device, a watch or other wearable, a head-mounted display (HMD), a vehicle, a drone, a medical device and applications (e.g., remote surgery), an industrial device and applications (e.g., a robot and / or other wireless devices operating in an industrial and / or anautomated processing chain contexts), a consumer electronics device, a device operating on commercial and / or industrial wireless networks, and the like. The terminal device may also correspond to a Mobile Termination (MT) part of an IAB node (e.g., a relay node). In the following description, the terms “terminal device”, “communication device”, “terminal”, “user equipment” and “UE” may be used interchangeably.

[0034] As used herein, the term “resource,” “transmission resource,” “resource block,” “physical resource block” (PRB), “uplink resource,” or “downlink resource” may refer to any resource for performing a communication, for example, a communication between a terminal device and a network device, such as a resource in time domain, a resource in frequency domain, a resource in space domain, a resource in code domain, or any other combination of the time, frequency, space and / or code domain resource enabling a communication, and the like. In the following, unless explicitly stated, a resource in both frequency domain and time domain will be used as an example of a transmission resource for describing some example embodiments of the present disclosure. It is noted that example embodiments of the present disclosure are equally applicable to other resources in other domains.

[0035] FIG. 1 illustrates an example communication environment 100 in which example embodiments of the present disclosure can be implemented. As shown in FIG. 1, the communication environment 100 may include a test equipment 110 and a terminal device 120. The test equipment 110 may communicate with the terminal device 120. The terminal device 120 may be or be comprised in a device under test. In some examples, the terminal device 120 may be a UE.

[0036] It is to be understood that the number of test equipment 110 and terminal device 120 shown in FIG. 1 is given for the purpose of illustration without suggesting any limitations. The communication network 100 may include any suitable number of test equipment 110 and terminal device 120.

[0037] In some example embodiments, a link from the test equipment 110 to the terminal device 120 is referred to as a downlink (DL), and a link from the terminal device 120 to the test equipment 110 is referred to as an uplink (UL). In DL, the test equipment 110 is a transmitting (TX) device (or a transmitter) and the terminal device 120 is a receiving (RX) device (or a receiver). In UL, the terminal device 120 is a TX device (or a transmitter) and the test equipment 110 is a RX device (or a receiver).

[0038] Communications in the communication environment 100 may be implemented according to any proper communication protocol(s), comprising, but not limited to, cellularcommunication protocols of the first generation (1G), the second generation (2G), the third generation (3G), the fourth generation (4G), the fifth generation (5G), the sixth generation (6G), and the like, wireless local network communication protocols such as Institute for Electrical and Electronics Engineers (IEEE) 802.11 and the like, and / or any other protocols currently known or to be developed in the future. Moreover, the communication may utilize any proper wireless communication technology, comprising but not limited to: Code Division Multiple Access (CDMA), Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Frequency Division Duplex (FDD), Time Division Duplex (TDD), Multiple-Input / Multiple-Output (MIMO), Orthogonal Frequency Division Multiple (OFDM), Discrete Fourier Transform spread OFDM (DFT-s-OFDM) and / or any other technologies currently known or to be developed in the future.

[0039] For identification of UE mobility, a Channel State Information (CSI) measurement called Time Domain Channel Property (TDCP) was introduced in 3rdGeneration Partnership Project (3 GPP), as part of the New Radio Multiple Input Multiple Output Evolution for Uplink and Downlink (NR MIMO evo UL DL). A TDCP indicator focuses on providing the Base Station (BS) radio physical interface with CSI information regarding the relative mobility of the UE and associated Doppler characteristics of the link with the serving BS. TDCP is calculated as the normalized time correlation function from 2 or more channel measurements estimated based on Channel State Information Reference Signal (CSI-RS) for tracking Reference Signal (TRS). The TDCP indicator is beneficial for specific reconfiguration scenarios such as CSI codebook type switching, and reference signal reconfiguration based on channel conditions and variability over time. If the channel variability exceeds a certain threshold, a switch from Type-II to Type-I may occur.

[0040] The Doppler spread characteristics for a UE are influenced by its movement relative to the base station and the channel attributes associated with LoS or NLoS conditions, as shown in FIG. 2A and 2B. A key insight provided by the TDCP is the relative velocity of the UE. This CSI metric can reconstruct Doppler spread spectrum shapes by analyzing one or more time correlation coefficients.

[0041] FIG. 3 illustrates an example of how the TRS may be transmitted for measuring the TDCP. The density of TRS in time allow to better understand the time correlation properties of the channel.

[0042] The Doppler spectrum is defined as the Fourier transform of the time-correlation function of the channel. Letn(fc) be the TRS channel measured at subcarrier n, with n = 0, ...,N — 1, and time kTs, where Tsis the time interval between two consecutive TRSmeasurement occasions. It is assumed that a UE takes B such TRS measurements at time k0Ts, (k0+ 1)TS, (fc0+ B — 1)TS. The normalized wideband time-correlation function at lag ITS, averaged over the N subcarriers, is given by A(l) and described by equation (1) and equation (2). Also, an illustration of the process is provided in FIG. 4.a) where I represents lags.where B represents the number of time samples, and N represents the number of subbands or time delay taps.

[0043] In addition, some other additional discussions led to the definition regarding the number of reported lags (K) and the related delay quantity Dbasic. The number of lags Y = 1 was chosen as a default feature with delay< Dbasic symbols, only wideband quantized normalized amplitude is reported. The optional feature, Y = 1 with delay> Dbasic symbols and Y > 1, wideband quantized normalized amplitude and (optionally) phase for each delay are reported. Dbasic is a delay between two consecutive TRS channel measurements in symbols.

[0044] Given the dynamic nature of the channel, TDCP may vary in time, and the value needs to be tracked in time as the UE is expected to have variable mobility characteristics. Moreover, for certain applications like codebook switching, an accurate reporting of TDCP value quantity is highly desired. This fact motivates the need of having flexible and reconfigurable test design for UEs claiming to support TDCP feature. The present invention disclosure proposes a flexible testing framework for accuracy and performance tests, which is useful for the TDCP reporting testing. However, other future one- and multi-dimensional measurement reporting could be also covered by this disclosure. During the discussion, it was identified that Radio Resource Management (RRM) requirements might be needed for the definition of conformance tests for UEs implementing TDCP feature. RRM accuracy requirements for TDCP can be useful for guaranteeing the performance of the reports in the deployed networks, akin to other reporting like Layer- 1 Reference Signal Received Power (Ll-RSRP), Layer-1 Signal-to-Interference plus Noise Ratio (Ll-SINR).

[0045] Some related RRM requirements include Reference Signal Received Power (RSRP) accuracy requirements and test cases. These accuracy requirements are defined, and the maximum accuracy for Synchronization Signal Reference Signal Received Power (SS-RSRP) is determined considering certain conditions. Additionally, related test cases are defined toverify the UE’s capability to accurately report RSRP within the specified accuracy.

[0046] Some proposals were discussed about TDCP testing procedure. For example, two Doppler spread values, one for a low Doppler spread and the other for a high Doppler spread, should be chosen. The requirement could be defined such that specific percentage of Cumulative Distribution Function (CDF) of the reported measurement values is within certain limits. Usually, these requirements are applicable at Signal-to-Noise Ratio (SNR) greater than a certain cutoff level.

[0047] Accordingly, a proposed test is defined. The test needs to define measurements for both low Doppler spread and high Doppler spread groups. This concept can be extended beyond just two groups to encompass intermediate values. Additionally, conventional approaches require agreement on multiple testing parameters such as upper and lower limits for CDF part, necessitating more effort in parameterization to define not just one but multiple tests. In the forthcoming invention report, several ideas that address the diversity of TDCP measurements by conducting a unified test approach are introduced.

[0048] The conventional approach has the drawback that the parameter choice may be highly variable across different implementations. This means that the difference between limits could be so large that it could be hard to distinguish between a correct implementation and an incorrect implementation. As an example, if upper and lower limits are covering more than 50% of the quantization levels, a UE reporting random measurements can pass this test case. And if the upper limit is too low due to suboptimal measurement techniques, the test boundaries could be skewed toward worse performing UEs. This inaccuracy may preclude the UE vendors from developing more accurate TDCP calculation techniques.

[0049] The TDCP is defined in 3GPP in a very flexible manner that enables freedom of implementation among different manufacturers. That poses a challenge on how TDCP accuracy requirements are defined, given that different valid implementations of this feature might report different TDCP values.

[0050] In one example, one UE vendor might be using Linear Minimum Mean Square Estimator (LMMSE) which results in being less sensitive to low SNR values, while another valid implementation is not using such technique. In this case, if a specific target value for the TDCP reporting is defined, the test case would have to be designed in such a way that either implementation with LMMSE or without LMMSE would pass the test. On the other hand, the test could also be defined for a single configuration, but that would mean penalizing one of the possible value implementations.

[0051] Ideal TDCP values that theoretically can be defined with Bessel function forspecified configurations and channel conditions often are outside of the ranges of simulated (in realistic channel conditions with presence of noise) by TDCP values. This fact complicates the test design since ideal values cannot be used as a clear reference for the reported TDCP values.

[0052] From that perspective, it is desirable to have a test case design that enables verification of multiple valid TDCP implementations. In this test case, the ability of the UE to report a consistent TDCP values should be verified.

[0053] In summary, how to design a test case for TDCP that verifies the UE capability to provide TDCP reports that correlate to mobility channel conditions, without introducing reference values such as an ideal value or tolerances is desired.

[0054] According to example embodiments of the present disclosure, there is provided a solution for device test in reporting a measurement report. In this solution, a test equipment transmits a reference signal to a terminal device under a plurality of reference measurement conditions. The test equipment receives, from the terminal device 120, a first number of measurement reports related to the reference signal. Each measurement report is corresponding to one of the plurality of reference measurement conditions. The test equipment performs classification of the first number of measurement reports into a second number of categories. The second number is equal to the number of the plurality of reference measurement conditions. Each of the second number of categories corresponds to an estimated measurement condition. For each of the first number of measurement reports, the test equipment determines whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified. The test equipment determines, based on the determination of the matching, a test result for the terminal device 120. The test result indicates whether the terminal device passes a test for reporting a measurement report.

[0055] In this way, the ability of the terminal device to transmit measurement reports corresponding to different measurement conditions may be determined.

[0056] Example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0057] Now reference is made to FIG. 5, which illustrates a signaling chart of an example procedure 500 for ability tests related to measurement reports according to some example embodiments of the present disclosure. The example procedure 500 involves the test equipment 110 and the terminal device 120. The example procedure 500 may be described with reference to FIG. 1.

[0058] The test equipment 110 transmits (515) a reference signal to the terminal device 120 under a plurality of reference measurement conditions. These measurement conditions may relate to UE CSI, UE location, and UE velocity, etc., depending on the types of the measurement reports to be tested for the terminal device 120. As an example, if the test equipment 110 is to test TDCP measurement of the terminal device 120, then the plurality of reference measurement conditions may be mobility conditions because the TDCP measurement values are varied depending on the mobility. As another example, if the test equipment 110 is to test positioning-related measurements of the terminal device 120, then the plurality of reference measurement conditions may be relative positioning relationship of the terminal device 120 to the test equipment 110. It would be appreciated that the settings of the reference measurement conditions based on the types of the measurement reports are envisaged in the art.

[0059] In some example embodiments, the reference signal may also depend on the types of the measurement reports to be tested for the terminal device 120. For example, for the TDCP measurement, the reference signal may be TRS or a CSI-RS. For the positioning- related measurements, the reference signal may be a positioning reference signal (PRS).

[0060] In some example embodiments, before transmitting the reference signal under the plurality of reference measurement conditions, the test equipment 110 may transmit, to the terminal device 120, configuration information for reporting the first number of measurement reports.

[0061] The terminal device 120 receives (520) the reference signal and generates a first number of measurement reports related to the reference signal. For example, the measurement reports may include multi-dimensional CSI measurements, multi-dimensional UE location related measurements, multi-dimensional UE velocity related measurements, multi-dimensional radio-sensing reports, and the like.

[0062] In some example embodiments, the first number of measurement reports each comprises a CSI report and the plurality of reference measurement conditions comprises a plurality of channel state conditions. For example, the CSI report may include channel delay profile estimations, channel Doppler profile estimations, multi-path information reporting, channel time-frequency estimations (e.g., Precoding Matrix Indicator (PMI)), and the like.

[0063] In some example embodiments, the first number of measurement reports each comprises a TDCP measurement result, and the plurality of reference measurement conditions comprises a plurality of mobility conditions.

[0064] The terminal device 120 transmits (525) the first number of measurement reportsto the test equipment 110. These measurement reports may include measurement results of the reference signal. The test equipment 110 receives (530) the first number of measurement reports. Each measurement report is corresponding to one of the plurality of reference measurement conditions. As the test equipment 110 controls the transmission of the reference signal and the corresponding reference measurement condition, it can determine which measurement report is corresponding to which reference measurement condition.

[0065] In some example embodiments, for each of the plurality of reference measurement conditions, the test equipment 110 receives, from the terminal device 120, a respective predetermined number of measurement reports configured for the measurement condition. For example, the plurality of reference measurement conditions include Condition 1, Condition 2..., Condition K. For the Condition 1, the respective predetermined number of measurement reports may include Ni measurement reports. For the Condition 2, the respective predetermined number of measurement reports may include N2 measurement reports. For the Condition K, the respective predetermined number of measurement reports may include NK measurement reports. In other words, Ni, N2, ... , NK measurement reports are generated for the Conditions 1 to K, respectively. The first number of measurement reports is Ntotai= N1+N2+...+NK. In some examples, K is greater than or equal to 2.

[0066] The test equipment 110 performs (535) classification of the first number (Ntotai) of measurement reports into a second number of categories. The second number is equal to the number of the plurality of reference measurement conditions, and each of the second number of categories corresponds to an estimated measurement condition. That is, the aim of the classification is to classify the measurement reports as the same number of categories as the number of the reference measurement conditions.

[0067] For example, the first number of measurement reports include Ni, N2, ..., NK measurement reports. The second number of categories include Category 1, Category 2, ..., Category K. The estimated measurement conditions include Condition 1, Condition 2, ... , Condition K. For the Condition 1, the terminal device 120 generates Ni measurement reports. For the Condition 2, the terminal device 120 generates N2 measurement reports. For the Condition K, the terminal device 120 generates NK measurement reports. Ni, N2, ..., NK measurement reports are transmitted to the test equipment 110 and will be classified into Category 1, Category 2, ..., Category K.

[0068] Some example methods related to the classification of the measurement reports will be described below with reference to FIGS. 6 and 7.

[0069] Still referring to FIG. 5, for each of the first number of measurement reports, thetest equipment 110 determines (540) whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified.

[0070] For example, the nthmeasurement report amongst the Ntotai measurement reports is classified into a category corresponding to a condition knThen the estimated measurement condition of the nthmeasurement report is fcn, but the test equipment 110 knows that the reference (true) measurement condition of the nthmeasurement report should be Condition kn. If kn= kn, the estimated measurement condition matches the reference measurement condition. If knkn, the estimated measurement condition does not match the reference measurement condition.

[0071] The test equipment 110 determines (545), based on the determination of the matching, a test result for the terminal device 120. The test result indicates whether the terminal device 120 passes a test for reporting a measurement report.

[0072] In some example embodiments, if a reference measurement condition corresponding to the measurement report mismatches an estimated measurement condition corresponding to a category into which the measurement report is classified, the test equipment 110 may increment an error count. If a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified, the test equipment 110 may increment a match count. Then the test equipment 110 may determine an error ratio based on the error count and the match count and determine the test result for the second apparatus based on the error ratio.

[0073] Still referring to the example above, if knkn, one error is accounted for the nthmeasurement report. After all the Ntotai measurement reports are checked, the test equipment 110 may check the percentage of measurement reports which were correctly classified, Pcorrect=the match count / Ntotai. If P correct > P correct mm, the terminal device 120 may pass the test. In other example, depending on the test criteria, the equipment 110 may alternatively or additionally check the percentage of measurement reports which were incorrectly classified, Perror=the error count / Ntotai. As an additional or alternative criteria, if P error P error_max-> then the terminal device 120 may pass the test.

[0074] In summary, the test equipment 110 may transmit reference signals with K measurement conditions and verifies if the terminal device may transmit measurement reports corresponding to the measurement conditions. Two or more measurement conditionscan be defined. For example, mobility conditions may include low-speed condition and highspeed condition based on a criterion or threshold. Alternatively, the number of measurement conditions may be more granular if more intermediate states are included.

[0075] The measurement conditions can be emulated by the test equipment 110 (e.g., by using different conditions of Doppler spread, i.e., different velocities). After receiving the measurement reports for those measurement conditions, the test equipment 110 may perform classification of the measurement reports into K categories respectively to each measurement condition defined.

[0076] Then, the test equipment 110 may verify how well the classification into K categories matches the reference measurement condition. For example, this can be done by comparing the classification by the test equipment 110 against the true measurement condition for each measurement report. The terminal device 120 may pass the test if the test equipment 110 correctly classifies the measurement reports into categories corresponding to the correct measurement condition for at least PCorrect_min of the measurement reports.

[0077] The following will describe the methods of classification according to the example embodiments of the present disclosure.

[0078] An example is taken with N measurement reports which will be clustered to separate those measurement reports into categories corresponding to high and low Doppler measurement conditions. FIG. 6 shows how separable the TDCP reports are, considering that a TDCP report is configured to include amplitude and phase.

[0079] As shown in FIG. 6, the low noise TDCP reports represented as points on a complex plane. Here, 200 TDCP reports are shown: 100 TDCP reports corresponding to low velocity channel conditions (doppler frequency equal 30Hz) and 100 TDCP reports corresponding to high velocity channel conditions (doppler frequency equal 200Hz), each represented as a single point. Two different velocity reports may be easily separated if one can use both amplitude and phase. For example, these TDCP reports are classified into categories corresponding to Condition 610 (low velocity condition) and Condition 620 (high velocity condition) based on the two clusters of TDCP reports. But predefining strict borders for these two clusters (e.g., as shown in the figure) is not a trivial task, and these borders can vary from one UE vendor to another.

[0080] In some example embodiments, the test equipment 110 may perform classification of the first number of measurement reports by performing clustering of the first number of measurement reports using unsupervised learning. That is, a clustering algorithm may be used as an unsupervised learning step.

[0081] For example, in the case of TDCP measurement, the two measurement conditions may be two mobility conditions, i.e., low Doppler and high Doppler, where Ni and N2 reports are expected for each measurement condition. Specifically, the test equipment 110 transmits a TDCP configuration and TRS with 2 measurement conditions. The terminal device 120 receives the TDCP configuration and TRS with 2 mobility conditions, where Ni and N2 TDCP reports are expected for each mobility condition. The terminal device 120 generates Ntotai = N1+N2 reports and transmits to the test equipment 110.

[0082] The test equipment 110 performs clustering of the reports into 2 groups of Ni =N2 measurements reports each, with a simple non-parametric method (e.g., using Spectral clustering or K-means with fixed seed, which is equal to the ideal value). For the nthmeasurement report, the test equipment 110 compares the reference mobility condition for that measurement report, kn, and compares with the estimated mobility condition, kn. If knknone error is accounted for the nthTDCP measurement report. Then, the test equipment 110 determines the percentage of measurement reports, which were correctly classified, PCOrrect. If Pcorrect > Pcorrect min, the terminal device 120 passes the test.

[0083] In this way, the clustering method may be used to perform classification. In some other examples, a simplified classification method may be used based on a threshold. The following will describe by taking an example of TDCP measurement.

[0084] In some example embodiments, the test equipment 110 may apply threshold-based classification. In some cases, the first number of measurement reports each may comprise one-dimensional value for a measurement result. The test equipment 110 may perform classification of the first number of measurement reports by: sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting. Each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0085] For example, the test equipment 110 transmits a TDCP configuration and TRS with 2 measurement conditions, high Doppler and low Doppler, where Ni and N2 TDCP reports are expected for each mobility condition. Then the test equipment 110 receives Ntotai = N1+N2 reports from the terminal device 120.

[0086] In this case, the TDCP reports contain only amplitude. The test equipment 110 sorts the TDCP reports in accordance with their amplitude. The test equipment 110 classifies the first Ni sorted TDCP reports as high Doppler condition and the rest N2 TDCP reports as lowDoppler condition. Based on the classification, the test equipment 110 determines whether the reference mobility condition matches the estimated mobility condition. Based on the determination of the matching, the test equipment 110 determines whether the terminal device 120 passes the test for mobility related measurement reports.

[0087] In other cases, the TDCP reports contain both amplitude and phase. That is, the first number of measurement reports each comprises multi-dimensional values for a measurement result. Sorting multi-dimensional values will become complicated.

[0088] To apply the threshold-based classification, the test equipment 110 may perform classification of the first number of measurement reports by: converting the first number of measurement reports into respective predetermined indexes based on a mapping between indexes and multi-dimensional values; sorting the first number of measurement reports based on the respective predetermined indexes; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting. Each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition. Alternatively, one or more measurement reports may be mapped to a same index according to the mapping method.

[0089] For example, if the TDCP reports contain both amplitude and phase, the test equipment 110 uses a mapping method as the one shown in FIG. 7 to convert the complex values into an index. FIG. 7 illustrates an example of mapping method from polar complex numbers to index based on a distance from point (1,0) to a sector. Alternatively, this mapping can be done for example based on a Manhattan Distance (aka LI norm) or statistical data gathered from simulation campaigns. This mapping method may be also extended to multidimensional case via using different distance metrics or simulation data. It should be understood that any appropriate mapping method can be used, and the present disclosure is not limited thereto.

[0090] As shown in FIG. 7, there are Index 1 to Index 20. For instance, the TDCP reports include reports 1 to 9. The test equipment 110 sorts the Ntotai measurements reports in accordance with their indexes. For example, the reports 1, 3, 5 may be classified into the Index 1, the reports 6 and 9 are classified into the Index 2, and the reports 2, 4, 7 and 8 are classified into the Index 3, and so on. Then these reports are sorted in order of the indexes from small to large. The test equipment 110 classifies the first Ni sorted TDCP reports as corresponding to a high Doppler condition and the rest N2 TDCP reports as corresponding to a low Doppler condition.

[0091] In this way, a simplified classification method is used based on a threshold, and the measurement reports are sorted and classified in accordance with the method.

[0092] In some example embodiments, the first number of measurement reports each comprises values in a high dimensionality. For example, the first number of measurement reports each comprises a plurality of measurement values obtained with a plurality of lags. In this cases, the test equipment 110 may apply dimensionality reduction with principal component analysis (PCA). The test equipment 110 may perform classification of the first number of measurement reports by: determining a covariance matrix based on the first number of measurement reports; performing an eigen-value decomposition on the covariance matrix, to obtain a principal component; mapping, based on the principal component, the first number of measurement reports into the first number of one-dimensional values, respectively; sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0093] For example, in the case of TDCP reports containing multiple lags, one TDCP report may contain Amplitude 1, Phase 1; Amplitude 2, Phase 2; Amplitude 3, Phase 3 for three lags, respectively. The test equipment 110 calculates a covariance matrix C based on all the TDCP reports (e.g., Ntotai=Ni+N2). The test equipment 110 performs the eigen-value decomposition of the covariance matrix C = Qh.QT, where Q is the matrix with the eigenvectors and A contained the eigenvalues. The principal component with most energy, i.e., the eigenvector in Q with highest eigenvector, is chosen, and used to map the TDCP reports into a single dimension. That is, one TDCP report corresponds to one onedimensional value. The test equipment 110 sorts the TDCP reports in accordance with their magnitude mapped to single dimension. The test equipment 110 classifies the first Ni sorted TDCP results as high Doppler condition and the rest N2 TDCP results as low Doppler condition.

[0094] In this way, high dimensionality of measurement reports may be taken into account and comparing and classifying multi-dimensional measurement reports may be achieved. It is possible to configure measurement reports to be reported with multiple lags. The multidimensional values pass by a first step of dimensionality reduction, before sorting the measurement reports as the example embodiments described above.

[0095] For the sake of discussion, the above example embodiments take mobility measurement and TDCP reports as examples. It should be understood that the present disclosure is not limited thereto. Any appropriate measurement reports and measurement conditions can be used to verify the UE capability to provide measurement reports related to measurement conditions.

[0096] Last but not least, the advantages of the present disclosure in comparison to the prior art are that the present disclosure provides less parameters for the verification of the UE behavior. The present disclosure is robust for different implementation, for example, it guarantees that the UEs are reporting TDCP values that can be actually used for detection of the mobility condition.

[0097] FIG. 8 shows a flowchart of an example method 800 implemented at a first apparatus in accordance with some example embodiments of the present disclosure. For the purpose of discussion, the method 1200 will be described from the perspective of the test equipment 110 in FIG. 1.

[0098] At block 810, the first apparatus transmits a reference signal to the terminal device 120 under a plurality of reference measurement conditions.

[0099] At block 820, the first apparatus receives, from the terminal device 120, a first number of measurement reports related to the reference signal. Each measurement report is corresponding to one of the plurality of reference measurement conditions.

[0100] At block 830, the first apparatus performs classification of the first number of measurement reports into a second number of categories. The second number is equal to the number of the plurality of reference measurement conditions. Each of the second number of categories corresponds to an estimated measurement condition.

[0101] At block 840, for each of the first number of measurement reports, the first apparatus determines whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified.

[0102] At block 850, the first apparatus determines, based on the determination of the matching, a test result for the terminal device 120. The test result indicates whether the terminal device 120 passes a test for reporting a measurement report.

[0103] In some example embodiments, before transmitting the reference signal under the plurality of reference measurement conditions, the first apparatus transmits, to the second apparatus, configuration information for reporting the first number of measurement reports.

[0104] In some example embodiments, for each of the plurality of reference measurementconditions, the first apparatus receives, from the second apparatus, a respective predetermined number of measurement reports configured for the measurement condition.

[0105] In some example embodiments, the first number of measurement reports each comprises a CSI report.

[0106] In some example embodiments, the first number of measurement reports each comprises a TDCP measurement result, and the plurality of reference measurement conditions comprises a plurality of mobility conditions.

[0107] In some example embodiments, the first apparatus performs classification of the first number of measurement reports by performing clustering of the first number of measurement reports using unsupervised learning.

[0108] In some example embodiments, the first number of measurement reports each comprises one-dimensional value for a measurement result, and the first apparatus performs classification of the first number of measurement reports by: sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting. Each of the second number of categories corresponds to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0109] In some example embodiments, the first number of measurement reports each comprises multi-dimensional values for a measurement result, and the first apparatus performs classification of the first number of measurement reports by: converting the first number of measurement reports into respective predetermined indexes based on a mapping between indexes and multi-dimensional values; sorting the first number of measurement reports based on the respective predetermined indexes; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting. Each of the second number of categories corresponds to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0110] In some example embodiments, when the first number of measurement reports each comprises a TDCP measurement result, the one-dimensional value comprises an amplitude value for the TDCP measurement result, and the multi-dimensional values comprise an amplitude value and a phase value for the TDCP measurement result.[OHl] In some example embodiments, the first number of measurement reports each comprises a plurality of measurement values obtained with a plurality of lags, and the first apparatus performs classification of the first number of measurement reports by: determininga covariance matrix based on the first number of measurement reports; performing an eigenvalue decomposition on the covariance matrix, to obtain a principal component; mapping, based on the principal component, the first number of measurement reports into the first number of one-dimensional values, respectively; sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting. Each of the second number of categories corresponds to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0112] In some example embodiments, for each of the first number of measurement reports, in accordance with a determination that a reference measurement condition corresponding to the measurement report mismatches an estimated measurement condition corresponding to a category into which the measurement report is classified, the first apparatus increments an error count; in accordance with a determination that a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified, the first apparatus increments a match count. The first apparatus determines an error ratio based on the error count and the match count. The first apparatus determines the test result for the second apparatus based on the error ratio.

[0113] In some example embodiments, the first apparatus is or is comprised in a test equipment, and the second apparatus is or is comprised in a device under test.

[0114] In some example embodiments, a first apparatus capable of performing any of the method 800 (for example, the test equipment 110 in FIG. 1) may comprise means for performing the respective operations of the method 800. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. The first apparatus may be implemented as or included in the test equipment 110 in FIG. 1.

[0115] In some example embodiments, the first apparatus comprises: means for transmitting, at a first apparatus, a reference signal to a second apparatus under a plurality of reference measurement conditions; means for receiving, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; means for performing classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of referencemeasurement conditions, each of the second number of categories corresponding to an estimated measurement condition; means for, for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and means for determining, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

[0116] In some example embodiments, the first apparatus further comprises: means for, before transmitting the reference signal under the plurality of reference measurement conditions, transmitting, to the second apparatus, configuration information for reporting the first number of measurement reports.

[0117] In some example embodiments, the first apparatus further comprises: means for, for each of the plurality of reference measurement conditions, receiving, from the second apparatus, a respective predetermined number of measurement reports configured for the measurement condition.

[0118] In some example embodiments, the first number of measurement reports each comprises a CSI report.

[0119] In some example embodiments, the first number of measurement reports each comprises a time domain channel property (TDCP) measurement result, and the plurality of reference measurement conditions comprises a plurality of mobility conditions.

[0120] In some example embodiments, the means for performing classification of the first number of measurement reports comprises: means for performing clustering of the first number of measurement reports using unsupervised learning.

[0121] In some example embodiments, the first number of measurement reports each comprises one-dimensional value for a measurement result, and the means for performing classification of the first number of measurement reports comprises: means for sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and means for classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0122] In some example embodiments, the first number of measurement reports each comprises multi-dimensional values for a measurement result, and the means for performing classification of the first number of measurement reports comprises: means for convertingthe first number of measurement reports into respective predetermined indexes based on a mapping between indexes and multi-dimensional values; means for sorting the first number of measurement reports based on the respective predetermined indexes; and means for classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0123] In some example embodiments, when the first number of measurement reports each comprises a TDCP measurement result, the one-dimensional value comprises an amplitude value for the TDCP measurement result, and the multi-dimensional values comprise an amplitude value and a phase value for the TDCP measurement result.

[0124] In some example embodiments, the first number of measurement reports each comprises a plurality of measurement values obtained with a plurality of lags, and the means for performing classification of the first number of measurement reports comprises: means for determining a covariance matrix based on the first number of measurement reports; means for performing an eigen-value decomposition on the covariance matrix, to obtain a principal component; means for mapping, based on the principal component, the first number of measurement reports into the first number of one-dimensional values, respectively; means for sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and means for classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

[0125] In some example embodiments, the first apparatus further comprises: means for, for each of the first number of measurement reports, in accordance with a determination that a reference measurement condition corresponding to the measurement report mismatches an estimated measurement condition corresponding to a category into which the measurement report is classified, incrementing an error count; in accordance with a determination that a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified, incrementing a match count; means for determining an error ratio based on the error count and the match count; and means for determining the test result for the second apparatus based on the error ratio.

[0126] In some example embodiments, the first apparatus is or is comprised in a test equipment, and the second apparatus is or is comprised in a device under test.

[0127] In some example embodiments, the first apparatus further comprises means for performing other operations in some example embodiments of the method 800 or the test equipment 110. In some example embodiments, the means comprises at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the performance of the first apparatus.

[0128] FIG. 9 is a simplified block diagram of a device 900 that is suitable for implementing example embodiments of the present disclosure. The device 900 may be provided to implement a communication device, for example, the test equipment 110 or the terminal device 120 as shown in FIG. 1. As shown, the device 900 includes one or more processors 910, one or more memories 920 coupled to the processor 910, and one or more communication modules 940 coupled to the processor 910.

[0129] The communication module 940 is for bidirectional communications. The communication module 940 has one or more communication interfaces to facilitate communication with one or more other modules or devices. The communication interfaces may represent any interface that is necessary for communication with other network elements. In some example embodiments, the communication module 940 may include at least one antenna.

[0130] The processor 910 may be of any type suitable to the local technical network and may include one or more of the following: general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on multicore processor architecture, as non-limiting examples. The device 900 may have multiple processors, such as an application specific integrated circuit chip that is slaved in time to a clock which synchronizes the main processor.

[0131] The memory 920 may include one or more non-volatile memories and one or more volatile memories. Examples of the non-volatile memories include, but are not limited to, a Read Only Memory (ROM) 924, an electrically programmable read only memory (EPROM), a flash memory, a hard disk, a compact disc (CD), a digital video disk (DVD), an optical disk, a laser disk, and other magnetic storage and / or optical storage. Examples of the volatile memories include, but are not limited to, a random access memory (RAM) 922 and other volatile memories that will not last in the power-down duration.

[0132] A computer program 930 includes computer executable instructions that are executed by the associated processor 910. The instructions of the program 930 may includeinstructions for performing operations / acts of some example embodiments of the present disclosure. The program 930 may be stored in the memory, e.g., the ROM 924. The processor 910 may perform any suitable actions and processing by loading the program 930 into the RAM 922.

[0133] The example embodiments of the present disclosure may be implemented by means of the program 930 so that the device 900 may perform any process of the disclosure as discussed with reference to FIG. 2 to FIG. 8. The example embodiments of the present disclosure may also be implemented by hardware or by a combination of software and hardware.

[0134] In some example embodiments, the program 930 may be tangibly contained in a computer readable medium which may be included in the device 900 (such as in the memory 920) or other storage devices that are accessible by the device 900. The device 900 may load the program 930 from the computer readable medium to the RAM 922 for execution. In some example embodiments, the computer readable medium may include any types of non- transitory storage medium, such as ROM, EPROM, a flash memory, a hard disk, CD, DVD, and the like. The term “non-transitory,” as used herein, is a limitation of the medium itself (i.e., tangible, not a signal) as opposed to a limitation on data storage persistency (e.g., RAM vs. ROM).

[0135] FIG. 10 shows an example of the computer readable medium 1000 which may be in form of CD, DVD or other optical storage disk. The computer readable medium 1000 has the program 930 stored thereon.

[0136] Generally, various embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. Some aspects may be implemented in hardware, and other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device. Although various aspects of embodiments of the present disclosure are illustrated and described as block diagrams, flowcharts, or using some other pictorial representations, it is to be understood that the block, apparatus, system, technique or method described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.

[0137] Some example embodiments of the present disclosure also provide at least one computer program product tangibly stored on a computer readable medium, such as a non- transitory computer readable medium. The computer program product includes computer-executable instructions, such as those included in program modules, being executed in a device on a target physical or virtual processor, to carry out any of the methods as described above. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, or the like that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or split between program modules as desired in various embodiments. Machine-executable instructions for program modules may be executed within a local or distributed device. In a distributed device, program modules may be located in both local and remote storage media.

[0138] Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. The program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

[0139] In the context of the present disclosure, the computer program code or related data may be carried by any suitable carrier to enable the device, apparatus or processor to perform various processes and operations as described above. Examples of the carrier include a signal, computer readable medium, and the like.

[0140] The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable medium may include but not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the computer readable storage medium would include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0141] Further, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.Likewise, although several specific implementation details are contained in the above discussions, these should not be construed as limitations on the scope of the present disclosure, but rather as descriptions of features that may be specific to particular embodiments. Unless explicitly stated, certain features that are described in the context of separate embodiments may also be implemented in combination in a single embodiment.Conversely, unless explicitly stated, various features that are described in the context of a single embodiment may also be implemented in a plurality of embodiments separately or in any suitable sub-combination.

[0142] Although the present disclosure has been described in languages specific to structural features and / or methodological acts, it is to be understood that the present disclosure defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

WHAT IS CLAIMED IS:

1. A first apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the first apparatus at least to: transmit a reference signal to a second apparatus under a plurality of reference measurement conditions; receive, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; perform classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; for each of the first number of measurement reports, determine whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and determine, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

2. The first apparatus of claim 1, wherein the first apparatus is further caused to: before transmitting the reference signal under the plurality of reference measurement conditions, transmit, to the second apparatus, configuration information for reporting the first number of measurement reports.

3. The first apparatus of claim 1 or 2, wherein the first apparatus is caused to: for each of the plurality of reference measurement conditions, receive, from the second apparatus, a respective predetermined number of measurement reports configured for the measurement condition.

4. The first apparatus of any of claims 1 to 3, wherein the first number of measurement reports each comprises a channel state information (CSI) report.

5. The first apparatus of any of claims 1 to 4, wherein the first number of measurement reports each comprises a time domain channel property (TDCP) measurement result, and wherein the plurality of reference measurement conditions comprises a plurality of mobility conditions.

6. The first apparatus of any of claims 1 to 5, wherein the first apparatus is caused to perform classification of the first number of measurement reports by: performing clustering of the first number of measurement reports using unsupervised learning.

7. The first apparatus of any of claims 1 to 5, wherein the first number of measurement reports each comprises one-dimensional value for a measurement result, and wherein the first apparatus is caused to perform classification of the first number of measurement reports by: sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

8. The first apparatus of any of claims 1 to 5, wherein the first number of measurement reports each comprises multi-dimensional values for a measurement result, and wherein the first apparatus is caused to perform classification of the first number of measurement reports by: converting the first number of measurement reports into respective predetermined indexes based on a mapping between indexes and multi-dimensional values; sorting the first number of measurement reports based on the respective predetermined indexes; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

9. The first apparatus of claim 7 or 8, wherein when the first number of measurement reports each comprises a TDCP measurement result, the one-dimensional value comprises an amplitude value for the TDCP measurement result, and the multi-dimensional values comprise an amplitude value and a phase value for the TDCP measurement result.

10. The first apparatus of any of claims 1 to 5, wherein the first number of measurement reports each comprises a plurality of measurement values obtained with a plurality of lags, and wherein the first apparatus is caused to perform classification of the first number of measurement reports by: determining a covariance matrix based on the first number of measurement reports; performing an eigen-value decomposition on the covariance matrix, to obtain a principal component; mapping, based on the principal component, the first number of measurement reports into the first number of one-dimensional values, respectively; sorting the first number of measurement reports based on the one-dimensional values in the first number of measurement reports; and classifying the first number of measurement reports into the second number of categories based on a result of the sorting, wherein each of the second number of categories corresponding to a measurement condition comprises a predetermined number of measurement reports configured for the measurement condition.

11. The first apparatus of any of claims 1 to 10, wherein the first apparatus is caused to: for each of the first number of measurement reports, in accordance with a determination that a reference measurement condition corresponding to the measurement report mismatches an estimated measurement condition corresponding to a category into which the measurement report is classified, increment an error count; in accordance with a determination that a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified, increment a match count; determine an error ratio based on the error count and the match count; and determine the test result for the second apparatus based on the error ratio.

12. The first apparatus of any of claims 1 to 11, wherein the first apparatus is or is comprised in a test equipment, and the second apparatus is or is comprised in a device under test.

13. A method comprising: transmitting, at a first apparatus, a reference signal to a second apparatus under a plurality of reference measurement conditions; receiving, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; performing classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimated measurement condition corresponding to a category into which the measurement report is classified; and determining, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

14. A first apparatus comprising: means for transmitting, at a first apparatus, a reference signal to a second apparatus under a plurality of reference measurement conditions; means for receiving, from the second apparatus, a first number of measurement reports related to the reference signal, each measurement report being corresponding to one of the plurality of reference measurement conditions; means for performing classification of the first number of measurement reports into a second number of categories, the second number being equal to the number of the plurality of reference measurement conditions, each of the second number of categories corresponding to an estimated measurement condition; means for, for each of the first number of measurement reports, determining whether a reference measurement condition corresponding to the measurement report matches an estimatedmeasurement condition corresponding to a category into which the measurement report is classified; and means for determining, based on the determination of the matching, a test result for the second apparatus, the test result indicating whether the second apparatus passes a test for reporting a measurement report.

15. A computer readable medium comprising instructions stored thereon for causing an apparatus at least to perform a method of claim 13.

Images