METHOD AND APPARATUS FOR PERFORMANCE EVALUATION
The method evaluates AI-based CSI feedback performance by using reference signals to determine matching criteria, addressing the lack of evaluation methods and enhancing accuracy and efficiency in communication systems.
Patent Information
- Application Number
- BR112025016699
- Authority / Receiving Office
- BR · BR
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-02-06
- Filing Date
- 2024-01-31
- Publication Date
- 2026-07-07
AI Technical Summary
There is a lack of effective evaluation methods for the performance of AI-based and machine learning-based channel state information (CSI) feedback in communication systems, particularly in scenarios where the AI model does not match the current channel conditions, leading to suboptimal feedback accuracy and overhead.
A method and apparatus for performance evaluation that involves receiving a reference signal from a network device, determining transmission parameters based on CSI, and evaluating the performance of target objects such as CSI methods or models using correspondence and matching criteria, allowing for low-overhead evaluation of multiple target objects.
Enables accurate and efficient evaluation of CSI feedback methods and models, ensuring they match current channel conditions, thereby improving feedback accuracy and reducing overhead in communication systems.
Smart Images

Figure 00000120_0000 
Figure 00000120_0001 
Figure 00000120_0002
Abstract
Description
1 / 113 METHOD AND APPARATUS FOR PERFORMANCE EVALUATION CROSS-REFERENCE TO RELATED REQUESTS
[0001] This application claims priority over Chinese Patent Application No. 202310144794.8 filed on February 6, 2023, entitled Performance Evaluation Method and Apparatus, which is incorporated herein by reference in its entirety. FIELD
[0002] This application relates to the field of communications and, in particular, to methods and equipment for performance evaluation. FUNDAMENTALS
[0003] In communication systems, such as the new 5G radio (NR), Type II downlink codebooks (Type II DL) can provide better channel state information (CSI) feedback accuracy. However, the feedback overhead of Type II DL codebooks is relatively high. Research shows that AI-based or machine learning-based CSI compression feedback can greatly reduce CSI feedback overhead with the same CSI feedback accuracy or improve CSI feedback accuracy with the same CSI feedback overhead.
[0004] The performance of AI-based CSI feedback methods is highly correlated with the degree of matching between the AI model and the channel. If the AI model does not match the channel of a current scene (i.e., mismatch), it is not advisable to use the current AI model or AI-based CSI feedback method. Therefore, it is necessary to consider performance evaluation of AI models and / or CSI feedback methods to see if they match the current scenario. However, there is a lack of evaluation methods for the CSI compression effect of CSI feedback methods or AI / ML models in the related technique. SUMMARY
[0005] Modalities of the present application provide methods and apparatus for Petition 870250086607, dated 09 / 25 / 2025, page 5 / 120 2 / 113 performance evaluation to solve a problem of lack of relevant evaluation methods in the state of the art.
[0006] One embodiment of the present application provides a method for performance evaluation, performed by a terminal device, including: to receive a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSI is determined based on a target object and / or the CSI is transmitted based on a target object; and to evaluate the performance of the target object based on the first reference signal received.
[0007] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[0008] In one embodiment, the target object includes any one or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[0009] In one embodiment, there is a correspondence between the first reference signal and the target object.
[0010] In one embodiment, the performance evaluation of the target object based on the first reference signal received includes: to evaluate the performance of the target object based on the first reference signal received and the match.
[0011] In one embodiment, the method also includes one or more of the following: receive the initial indication information transmitted from the network device to indicate a match; transmit the second piece of information to the network device to indicate a match; or Petition 870250086607, dated 09 / 25 / 2025, p. 6 / 120 3 / 113 determine the match based on a pre-agreement with the network device.
[0012] In one form, the correspondence includes one or more of the following: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the resource configuration information corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a match between the first reference signal, the target object, and the corresponding CSI identification information; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report. Petition 870250086607, dated 09 / 25 / 2025, page 7 / 120 4 / 113
[0013] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; Timing offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or Petition 870250086607, dated 09 / 25 / 2025, page 8 / 120 5 / 113 time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[0014] In one embodiment, evaluating the performance of the target object based on the first reference signal includes: To determine an initial performance metric corresponding to the first reference signal based on the first reference signal; and to evaluate the performance of the target object based on the first performance metric.
[0015] In a given modality, the first performance metric includes at least one of the following: received power of the reference signal (RSRP); Received quality of the reference signal (RSRQ); a signal-to-noise ratio (SINR); a system performance metric; a precision metric; or a distribution metric.
[0016] In one modality, the performance evaluation of the target object based on the first performance metric includes any one or a combination of: To evaluate the performance of the target object based on the first performance metric and an initial range of values; To evaluate the performance of the target object based on the first performance metric and a performance metric corresponding to a reference object; or to evaluate the performance of the target object based on the first performance metric and one or more performance metrics corresponding to a reference signal, where a number of the reference signal is one or more.
[0017] In one embodiment, before receiving the first reference signal transmitted from the network device, the method also includes: receive a second reference signal transmitted from the network device; determine the first CSI based on the second reference signal; and Petition 870250086607, dated 09 / 25 / 2025, page 9 / 120 6 / 113 transmit the first CSI to the network device, where the first CSI is used by the network device to determine the transmission parameter of the first reference signal.
[0018] In one embodiment, the determination of the first CSI based on the second reference signal includes: determine the first CSI based on a codebook and the second reference signal; or determine the first CSI based on a first model and the second reference signal; In the case of determining the first CSI based on the first model and the second reference signal, the first CSI is used by the network device to determine the second CSI based on a second model corresponding to the first model, and the second CSI is used by the network device to determine the transmission parameter of the first reference signal.
[0019] In one embodiment, the target object includes any one or a combination of: the first model; the second model; A bilateral model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[0020] In one version, the method also includes: transmit an evaluation result to the network device.
[0021] The modalities of this application provide a method for evaluating the performance of a network device, including: To transmit a first reference signal to a terminal device, where a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), the CSI is determined based on a target object and / or the CSI is transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[0022] In one embodiment, the transmission parameter includes at least one of: Petition 870250086607, dated 09 / 25 / 2025, page 10 / 120 7 / 113 a transmission position; a beamforming parameter; or feature configuration.
[0023] In one embodiment, the target object includes any one or a combination of: a method for determining CSI; a method for transmitting CSI; or a model for determining CSI.
[0024] In one embodiment, there is a correspondence between the first reference signal and the target object.
[0025] In one embodiment, the method also includes one or more of: transmit the first indication information to the terminal device to indicate the match; to receive the second indication information transmitted from the terminal device to indicate the match; or to determine the match based on a pre-agreement with the terminal device.
[0026] In one modality, the correspondence includes one or more of: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, page 11 / 120 8 / 113 a match between the target object corresponding to the configuration information first reference signal; a match between the first identification signal corresponding to the target object; a match between the first signal and an occasion for transmitting the corresponding reference resources and the information to the reference, target object, and the identification information corresponding to the CSI; a match between the first signal of configuration information from the CSI report; a match between the first signal of resource information from the CSI report; or reference, a match between the target object and the target object information, a time offset between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI.
[0027] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first signal of Petition 870250086607, dated 09 / 25 / 2025, page 12 / 120 9 / 113 reference; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[0028] In one embodiment, before transmitting the first reference signal to the terminal device, the method also includes: transmit a second reference signal to the terminal device; Receive the first CSI determined based on the second reference signal transmitted from the terminal device; and determine the transmission parameter of the first reference signal based on the first CSI.
[0029] In one embodiment, determining the transmission parameter of the first reference signal based on the first CSI includes: Determine the transmission parameter of the first reference signal based on a codebook and the first CSI; or determine the second CSI based on a second model and the first CSI, and determine the transmission parameter of the first reference signal based on the second CSI. Petition 870250086607, dated 09 / 25 / 2025, page 13 / 120 10 / 113
[0030] In one embodiment, the target object includes any one or a combination of: a first model, where the first model is a model corresponding to the second model and used for the terminal device to determine the first CSI; the second model; a two-sided model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[0031] In one embodiment, the method further includes: receive an evaluation result transmitted from the terminal device.
[0032] Embodiments of the present application provide a terminal device including a memory, a transceiver and a processor, wherein: Memory is used to store a computer program; the transceiver is used to transmit and receive data under the control of the processor; and the processor is used to read the computer program stored in memory and perform the performance evaluation method as described above.
[0033] The embodiments of the present application provide a network device including memory, a transceiver and a processor, wherein: Memory is used to store a computer program; the transceiver is used to transmit and receive data under the control of the processor; and the processor is used to read the computer program stored in memory and perform the performance evaluation method as described above.
[0034] The embodiments of the present application provide a performance evaluation apparatus for use in a terminal device, including: A first receiving unit, used to receive a first reference signal transmitted from a network device, where a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSI is determined based on a target object and / or the CSI is transmitted based on a target object; and a first evaluation unit, used to evaluate the performance of the target object based on the first reference signal received. Petition 870250086607, dated 09 / 25 / 2025, page 14 / 120 11 / 113
[0035] The present application provides a performance evaluation device for use in a network device, including: A second transmission unit, used to transmit a first reference signal to a terminal device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), the CSI is determined based on a target object and / or the CSI is transmitted based on a target object and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[0036] Embodiments of the present application further provide a processor-readable storage medium, wherein the processor-readable storage medium stores a computer program to cause a processor to execute the method for performance evaluation performed by the terminal device as described above.
[0037] The embodiments of the present application further provide a processor-readable storage medium, wherein the processor-readable storage medium stores a computer program to cause a processor to execute the method for performance evaluation performed by the network device as described above.
[0038] In the methods and apparatus for performance evaluation provided in the embodiments of this application, upon receiving the first reference signal transmitted from the network device and CSI determined by the target object and / or CSI transmitted by the target object corresponding to the transmission parameter of the first reference signal. The CSI determined by the target object and / or the CSI transmitted by the target object may be reflected by the first reference signal. Evaluating the performance of the target object by means of the first reference signal may achieve a low overhead evaluation of the target object and the evaluation of multiple target objects. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] To illustrate the embodiments of this application more clearly, the drawings that need to be used in the embodiment descriptions are briefly described below. The drawings in the following description are some Petition 870250086607, dated 09 / 25 / 2025, page 15 / 120 12 / 113 modalities of the present application, and other designs can be obtained based on these designs without any creative work for those skilled in the art. In the designs: FIG. 1 is a schematic diagram of CSI feedback according to one embodiment of the present application; FIG. 2 is a first schematic flowchart of a method for performance evaluation according to a modality of the present application; FIG. 3 is a second schematic flowchart of a method for performance evaluation according to a modality of the present application; FIG. 4 is a first schematic structural diagram of a device for performance evaluation according to an embodiment of the present application; FIG. 5 is a second schematic structural diagram of a device for performance evaluation according to an embodiment of the present application; FIG. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application; and FIG. 7 is a schematic structural diagram of a network device according to an embodiment of the present application. DETAILED DESCRIPTION
[0040] In the modalities of this request, the term and / or describes a related relationship of associated objects and indicates that there can be three types of relationships. For example, A and / or B can represent that A exists alone, A and B exist simultaneously, and B exists alone. The character “ / ” usually indicates that the objects associated before and after are in an “or” relationship.
[0041] In the modalities of this request, the term multiple refers to two or more than two, and other quantifiers are similar.
[0042] The solutions in this application are clearly and completely described below in conjunction with the attached drawings. These embodiments are only a part of the embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application without any creative work belong to the scope of this application. Petition 870250086607, dated 09 / 25 / 2025, p. 16 / 120 13 / 113 order.
[0043] The solutions provided by the embodiments of this application may be applicable to various systems, especially a 5th generation (5G) system. For example, applicable systems may be a global mobile communications system (GSM), a code-division multiple access (CDMA) system, a wideband code-division multiple access (WCDMA) general packet radio service (GPRS) system, a long-term evolution (LTE) system, a frequency-division duplex (FDD) LTE system, a time-division duplex (TDD) LTE system, an enhanced long-term evolution (LTE-A) system, a universal mobile telecommunication system (UMTS), a worldwide microwave access interoperability system (WiMAX), a 5G New Radio (NR) system, etc. These various systems include a terminal device and a network device.The system may also include a core network component, such as an evolved packet system (EPS), a 5G (5GS) system, and the like.
[0044] The terminal device involved in the embodiments of this application may be a device that provides voice and / or data connectivity to a user, a portable device with a wireless connection function, or another processing device connected to a wireless modem. In different systems, the names of the terminal device may be different. For example, in the 5G system, the terminal device may be referred to as a user equipment (UE).A wireless terminal device can communicate with one or more central networks (CNs) via a radio access network (RAN), and the wireless terminal device can be a mobile terminal, such as a mobile phone (or referred to as a cell phone) and a computer with a mobile terminal device, for example, a handheld mobile device, a pocket-sized mobile device, a computer-built mobile device, or a vehicle-mounted mobile device, which exchanges language and / or data with the radio access network. For example, a personal communication service phone (PCS), a radio phone, a session-initiated protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), and other devices. A wireless terminal device can also be... Petition 870250086607, dated 09 / 25 / 2025, page 17 / 120 14 / 113 referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile, a remote station, an access point, a remote terminal, an access terminal, a user terminal, a user agent and a user device, which are not limited to the embodiments of this application.
[0045] The network device involved in the embodiments of this application may be a base station, and the base station may include multiple cells that provide services to a terminal. Depending on specific application scenarios, the base station may also be referred to as an access point, or it may be a device in the access network that communicates with a wireless terminal device through one or more sectors on the air interface, or other names. The network device may be used to mutually exchange received air frames with Internet Protocol (IP) packets and act as a router between a wireless terminal device and a remaining part of the access network, and the remaining part of the access network may include an IP communication network. The network device may also coordinate attribute management for an air interface.For example, the network device involved in the embodiments of the present application may be a base transceiver station (BTS) in a global system for mobile communications (GSM) or a code-division multiple access (CDMA) system; it may also be a B node in a wideband code-division multiple access (WCDMA) system; it may also be an evolutionary B node (eNB or e-Node B) in a long-term evolution (LTE) system; a 5G base station (gNB) in a 5G network architecture (next-generation system); it may also be a domestic evolved B node (HeNB); a relay node; a femto node; a pico base station (pico), etc., which are not limited to the embodiments of the present application. In some network structures, a network device may include a centralized unit node (centralized unit, CU) and a distributed unit node (distributed unit, DU), and the centralized unit and the distributed unit may also be geographically separated.
[0046] Multiple Input Multiple Output (MIMO) transmission can be performed between the network device and the terminal device using one or more antennas, and the MIMO transmission can be Single User MIMO (SU-MIMO) or MIMO Petition 870250086607, dated 09 / 25 / 2025, p. 18 / 120 15 / 113 multi-user (MU-MIMO). Depending on the shape and number of antenna combinations, MIMO transmission can be 2D-MIMO, 3D-MIMO, FD-MIMO, or massive MIMO, and can also be diversity transmission, pre-coding transmission, or beamforming transmission.
[0047] For the sake of clarity in understanding the terms of this application, the following introduces terms or grounds associated with the terms of this application.
[0048] Channel state information (CSI) describes the propagation of radio signals between transmitters and receivers, including the effects of distance, dispersion, fading, and other factors on the signals.
[0049] FIG. 1 is a schematic diagram of the CSI feedback provided in embodiments of the present application. As shown in FIG. 1, FIG. 1 provides a common communication flowchart between a UE device and a network device for CSI compression feedback. FIG. 1 can be considered as a two-sided model deployed on both the UE side and the network side. Models include, but are not limited to, artificial intelligence (AI) models, machine learning (ML) models, neural network models, data-driven technology models, etc. In FIG. 1:
[0050] On the UE side: the CSI generation part is used to compress the CSI reference signal (CSI-RS) or compress a pre-processed X channel and quantize it into binary bits for feedback to the network side. In FIG. 1, the CSI generation part is the model deployed on the UE side, also referred to as an AI / ML generation part or an AI / ML encoder, etc.
[0051] The preprocessed channel X can be obtained in the following ways: performing channel estimation in CSI-RS to obtain a channel state matrix H, preprocessing H to obtain X, and inserting X into the AI / ML generation portion.
[0052] On the network side (NW): the binary bits returned by the UE side are fed into the dequantizer for dequantization, and the CSI reconstruction part, also known as the AI / ML reconstruction part or AI / ML decoder, is used to recover the CSI. In FIG. 1, the CSI reconstruction part is model Petition 870250086607, dated 09 / 25 / 2025, page 19 / 120 16 / 113 deployed on the network side, also known as part of the AI / ML reconstruction or AI / ML decoder, etc.
[0053] In one embodiment, the network side also performs some post-processing operations.
[0054] On the UE side, the input to the CSI generation part can be a raw channel or a pre-encoding matrix. On the network side, the output to the CSI reconstruction part can also be a raw channel or a pre-encoding matrix. The input to the CSI generation part on the UE side and the output to the CSI reconstruction part can be the same or different.
[0055] Channel preprocessing on the UE side can reduce the dimensionality of the CSI generation part input or improve its generalization capability, thereby reducing the complexity and storage overhead of the CSI generation part training. Some common preprocessing operations include time-domain truncation, frequency-domain sampling, time / space / frequency domain transformation, etc.
[0056] There is a lack of evaluation methods for the CSI compression effect of CSI feedback methods or AI / ML models in the related technique.
[0057] The embodiments of this application are described clearly and completely below in conjunction with the accompanying drawings. The embodiments described are only a part of the embodiments of this application and not all of them. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0058] FIG. 2 is a first schematic flowchart of a method for performance evaluation according to an embodiment of the present application. As shown in FIG. 2, an embodiment of the present application provides a method for performance evaluation, performed by a terminal device, including: Step 110: Receive a first reference signal transmitted from a network device, where a transmission parameter of the first reference signal is determined by the network device based on state information. Petition 870250086607, dated 09 / 25 / 2025, page 20 / 120 17 / 113 of the channel (CSI), and the CSIs are determined based on a target object and / or the CSIs are transmitted based on a target object; and step 120: evaluate the performance of the target object based on the first reference signal received.
[0059] In one embodiment, the first reference signal is a downlink reference signal, such as a CSI-RS, and a demodulation reference signal (DMRS), etc.
[0060] CSI is determined based on the target object and / or CSI is transmitted based on the target object. CSI determination may include CSI compression, recovery of compressed CSI, and CSI prediction. CSI determination may refer to related techniques, which are not repeated here; CSI transmission refers to the transmission of CSI between a network device and an end device. There are several methods for transmitting CSI, which are also called CSI reporting mode or CSI feedback mode. The methods for CSI transmission may refer to related techniques and will not be repeated here.
[0061] The target object is used to determine the CSI and / or transmit the CSI, and the target object refers to the methods and / or models that need to be evaluated used in the CSI feedback. In one embodiment, the target object includes any one or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[0062] In one embodiment, the methods for determining CSI and the methods for transmitting CSI are combined as the CSI feedback method.
[0063] The method for determining the CSI may include: a method used by the terminal device to determine the CSI; and / or a method used by the network device to determine the CSI.
[0064] In one embodiment, the method used by the terminal device to determine the CSI refers to a method in which the terminal device generates the CSI and transmits it to the network device. For example, in FIG. 1, the UE generates CSI through the AI / ML generation part, which is a method for the terminal device to determine CSI. Petition 870250086607, dated 09 / 25 / 2025, p. 21 / 120 18 / 113
[0065] The method used by the network device to determine the CSI refers to a method used by the network device to retrieve the CSI transmitted from the UE, or a method used by the network device to determine the CSI for scheduling. For example, in FIG. 1, the network side uses the AI / ML reconstruction part to retrieve CSI, which is a method for the network device to determine CSI.
[0066] For the model used to determine the CSI, it can be an AI or ML model, or other non-artificial intelligence models that can achieve CSI determination and transmission. The target object can be located on the terminal device, network device, or belong to both sides of the terminal device and network device (as shown in the two-sided model in FIG. 1).
[0067] The transmission parameter of the first reference signal is determined by the network device based on the CSI, and the network device may directly or indirectly determine the transmission parameter of the first reference signal through the CSI determined by the target object and / or the CSI transmitted by the target object. In one embodiment, the CSI refers to the CSI determined by the target object and / or the CSI transmitted by the target object. The target object refers to a target object used to determine the CSI and / or a target object used to transmit the CSI.
[0068] For example, CSI can be one or more of the following: a pre-coding matrix, a raw channel, a channel quality indicator (CQI), or a classification indicator (RI).
[0069] The pre-coding matrix includes: an eigenvector; or PMI similar to eType II (e.g., an eigenvector after angle-delay domain transformation).
[0070] The raw channel includes: a raw channel in the frequency domain or a raw channel in the time domain.
[0071] For example, the raw channel is a complete multi-input multiple-output (MIMO) channel with dimensions Tx * Rx.
[0072] A number of the first reference signal can be one or more and, correspondingly, a number of the target object can also be one or more. Petition 870250086607, dated 09 / 25 / 2025, page 22 / 120 19 / 113
[0073] For example, the first reference signal number is 1, the target object number is 1, the CSI determined by the target object and / or the CSI transmitted by the target object correspond to the transmission parameter of the first reference signal, and the first reference signal is used to evaluate the performance of the target object.
[0074] For example, the number of the first reference signal is multiple, including: RS-1, RS-2 and RS-3; the number of the target object is multiple, including AI-1, AI-2 and AI-3; the CSI determined by AI-1 corresponds to the transmission parameters of RS-1, RS-1 and is used to evaluate AI-1; the CSI determined by AI-2 corresponds to the transmission parameters of RS-2, RS-2 and is used to evaluate AI-2; the CSI determined by AI-3 corresponds to the transmission parameters of RS-3, RS-3 and is used to evaluate AI-3. This application does not limit the correspondence between the first reference signal and the target object, nor does it specify how to determine the correspondence.
[0075] In one embodiment, the above examples are provided to facilitate understanding of the present application and shall not constitute any limitation to the present application.
[0076] In the performance evaluation method provided in the embodiments of this application, upon receiving the first reference signal transmitted from the network device, the transmission parameter of the first reference signal corresponds to the CSI determined by the target object and / or the CSI transmitted by the target object. The CSI determined by the target object and / or the CSI transmitted by the target object can be reflected by the first reference signal. The performance of the target object can be evaluated by means of the first reference signal to achieve a low overhead evaluation of the target object and the evaluation of multiple target objects.
[0077] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[0078] In one embodiment, beamforming is also called precoding.
[0079] In one embodiment, the first reference signal is a reference signal Petition 870250086607, dated 09 / 25 / 2025, p. 23 / 120 20 / 113 with beamforming, also referred to as a beamforming CSI-RS, which refers to a pre-coded CSI-RS or a beamforming CSI-RS.
[0080] The CSI determined by the target object and / or the CSI transmitted by the target object are associated with at least one of the transmission positions, beamforming parameter, or feature configuration of the first reference signal.
[0081] In one embodiment, the third indication information transmitted from the network device is received, wherein the third indication information is used to indicate that the first reference signal from the terminal device is a beamforming reference signal.
[0082] In the performance evaluation method provided in the embodiments of this application, the first reference signal is a beamed reference signal, the CSI determined by the target object and / or the CSI transmitted by the target object correspond to the transmission parameter of the first reference signal, and the CSI determined by the target object and / or the CSI transmitted by the target object are associated with the transmission of the first reference signal. For example, the CSI determined by the target object and / or the CSI transmitted by the target object may form the beam of the first reference signal, and the CSI determined by the target object and / or the CSI transmitted by the target object may be reflected by the first reference signal, evaluating the performance of the target object by means of the first reference signal.
[0083] In one embodiment, before receiving the first reference signal transmitted from the network device, the method also includes: receive a second reference signal transmitted from the network device; determine the first CSI based on the second reference signal; and transmit the first CSI to the network device, where the first CSI is used by the network device to determine the transmission parameter of the first reference signal.
[0084] In one embodiment, the first CSI can be used by the network device to directly determine the transmission parameter of the first reference signal, and the first CSI can also be used by the network device to indirectly determine the transmission parameter of the first reference signal. Petition 870250086607, dated 09 / 25 / 2025, page 24 / 120 21 / 113
[0085] In one embodiment, determining the first CSI based on the second reference signal includes: To determine the first CSI based on a codebook and a second reference signal; or to determine the first CSI based on a first model and a second reference signal.
[0086] In one embodiment, if the terminal device determines the first CSI based on the codebook and the second reference signal, the network device can determine the transmission parameter of the first reference signal based on the first CSI. For example, the first CSI is a pre-encoding matrix determined based on a codebook, and the network device determines the transmitted pre-encoding matrix from the terminal device based on the same codebook and uses this pre-encoding matrix to form the beam of the first reference signal.
[0087] In one embodiment, in the case of determining the first CSI based on the first model and the second reference signal, the first CSI is used to determine, by the network device, the second CSI based on the second model corresponding to the first model, and the second CSI is used to determine, by the network device, the transmission parameter of the first reference signal.
[0088] In one embodiment, if the terminal device determines the first CSI based on the first model and the second reference signal, the first CSI can be used by the network device to determine the second CSI, and the second CSI is used to determine the transmission parameter of the first reference signal. That is, the network device can determine the second CSI based on the first CSI feedback from the terminal and then use the second CSI to determine the transmission parameter of the first reference signal.
[0089] In one embodiment, the terminal device receives the second reference signal transmitted from the network device, obtains the first CSI based on the channel estimate of the second reference signal through a codebook-based CSI feedback method, and transmits the first CSI to the device of Petition 870250086607, dated 09 / 25 / 2025, p. 25 / 120 22 / 113 network. The network device determines the transmission parameter of the first reference signal through the first CSI and the codebook.
[0090] In one embodiment, the terminal device receives the second reference signal transmitted from the network device, obtains the first CSI based on the first model and channel estimation in the second reference signal through the AI-based CSI feedback method, and transmits the first CSI to the network device. The network device obtains the second CSI through the second model corresponding to the first model and determines the transmission parameter of the first reference signal based on the second CSI. In one embodiment, in the case corresponding to the example in FIG. 1, the first model is the AI model corresponding to the CSI generation part on the UE side, and the second model is the AI model corresponding to the CSI reconstruction part on the network device side.
[0091] In one embodiment, the target object includes any one or a combination of: the first model; the second model; A bilateral model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[0092] The method for determining the CSI based on the codebook includes a method for determining the first CSI based on the codebook.
[0093] In one embodiment, the first model is deployed on the end device and the second model is deployed on the network device.
[0094] In one modality, the first model and the second model have an associative relationship.
[0095] The association relationship includes one or more of: datasets used in training the first model and the second model having an association relationship; The datasets used to train the first model and the second model are the same; a training dataset used by one of the first models and the Petition 870250086607, dated 09 / 25 / 2025, page 26 / 120 23 / 113 second model, including data inferred based on the other model; A training dataset used by either the first or second model, including data inferred based on an association model corresponding to the other model; a training dataset used by one of the first models, and the second model being a dataset inferred from the other model; a training dataset used by one of the first models, and the second model being a dataset inferred based on an association model corresponding to the other model; the first model and the second model having the same model identifier (ID); The first model and the second model are being trained together; or the first model and the second model correspond to the same configuration; The configuration includes: antenna configuration, CSI-RS feature configuration, CSI report configuration, CSIRS feature set configuration, and feature configuration, etc.
[0096] For example, the training dataset used in training the first model is determined based on the second model / a model (association model) corresponding to the second model, or the training dataset used in training the second model is determined based on the first model / a model (association model) corresponding to the first model.
[0097] In one embodiment, the above association model is a different model from the first model and the second model.
[0098] The correspondence between the first model and the second model may include one of the following: a first model corresponding to a second model; a first model corresponding to multiple second models; several first models corresponding to a second model; or, several first models corresponding to several second models. Petition 870250086607, dated 09 / 25 / 2025, p. 27 / 120 24 / 113
[0099] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00100] In one embodiment, the correspondence between the first reference signal and the target object can be a direct correspondence between the first reference signal and the target object, or an indirect correspondence between the first reference signal and the target object, such as the correspondence between the first reference signal and the CSI. Since the CSI is determined and / or transmitted by the target object, determining the correspondence between the first reference signal and the CSI is equivalent to determining the correspondence between the first reference signal and the target object, and different target objects can also be distinguished by means of the CSI.
[00101] The number of the first reference signal can be one or more, and the number of the target object can be one or more. There is a correspondence between the first reference signals and the target objects, meaning that each first reference signal has a corresponding target object, or each target object has a corresponding first reference signal. By establishing a correspondence between the first reference signal and the target object, the terminal device can associate each first reference signal with each target object.
[00102] In one embodiment, the target objects are multiple methods, such as the first method and the second method. The terminal device determines the first CSI-1 by means of the first method, determines the first CSI-2 by means of the second method, and transmits the first CSI-1 and the first CSI-2 to the network device. Several first reference signals transmitted from the network device are received, and the transmission parameter of each of the first reference signals is determined based on the CSI determined by different target objects. The first reference signal corresponding to the target object is determined by means of the matching, or the target object corresponding to the first reference signal is determined by means of the matching.
[00103] In one embodiment, the target objects are multiple models, such as the first model 1 and the first model 2. The terminal device determines the first CSI-1 through the first model 1, and determines the first CSI-2 through the first model 2. Petition 870250086607, dated 09 / 25 / 2025, page 28 / 120 25 / 113 and transmits the first CSI-1 and the first CSI-2 to the network device. The first reference signal 1 and the first reference signal 2 transmitted from the network device are received. The transmission parameter of the first reference signal 1 is determined by the network device based on the first CSI-1 and the second model, and the transmission parameter of the first reference signal 2 is determined by the network device based on the first CSI-2 and the second model. The first reference signal corresponding to the target object is determined through matching (such as the first CSI-1 corresponding to the first reference signal 1), or the first reference signal that needs to match the target object is determined through matching (such as the first reference signal 2 corresponding to the first CSI-2).
[00104] In one embodiment, the target object is composed of several models, such as the second model 1 and the second model 2. The terminal determines the first CSI through the first model and transmits the first CSI to the network device and receives the first reference signal 1 and the first reference signal 2 transmitted from the network device. The transmission parameter of the first reference signal 1 is determined by the network device based on the first CSI and the second model 1, and the transmission parameter of the first reference signal 2 is determined by the network device based on the first CSI and the second model 2.The first reference signal that needs to correspond to the target object is determined through matching (e.g., the second model 1 corresponds to the first reference signal 1), or the target object that needs to correspond to the first reference signal is determined through matching (e.g., the first reference signal 2 corresponds to the second model 2). In one embodiment, since different first reference signals correspond to different second models, the second model corresponding to each first reference signal can be distinguished without matching.
[00105] The above possible implementations can also be combined. For example, there are several first models on the terminal device side and several second models on the network device side, which will not be repeated here. Petition 870250086607, dated 09 / 25 / 2025, page 29 / 120 26 / 113
[00106] In one embodiment, evaluating the performance of the target object based on the first reference signal received includes: to evaluate the performance of the target object based on the first reference signal received and the match.
[00107] In one embodiment, evaluating the performance of the target object based on the first reference signal received and the match includes: determine the target object corresponding to each first reference signal received based on the correspondence; or determine the first reference signal corresponding to each target object based on the correspondence and evaluate each target object based on the first reference signal corresponding to each target object.
[00108] In one version, the method also includes: determine the target object corresponding to each first reference signal received based on the correspondence; and evaluate each target object based on each first reference signal.
[00109] In one embodiment, if several first reference signals are received, the target object corresponding to each first reference signal can be determined based on their correspondences.
[00110] For example, the first reference signal includes: CSI-R-1, CSI-R-2, and CSI-R-3; the target object includes: ML-1, ML-2, and ML-3. The match includes: CSI-R-1 matches ML-1, CSI-R-2 matches ML-2, and CSI-R-3 matches ML-3; the terminal device can determine that CSI-R-1 matches ML-1, CSI-R-2 matches ML-2, and CSI-R-3 matches ML-3. The performance of ML-1 is evaluated by means of CSI-R-1, the performance of ML-2 is evaluated by means of CSI-R-2, and the performance of ML-3 is evaluated by means of CSI-R-3.
[00111] In one version, the method also includes: Determine the first reference signal corresponding to each target object based on the correspondence; and evaluate each target object based on the first reference signal corresponding to each target object. Petition 870250086607, dated 09 / 25 / 2025, page 30 / 120 27 / 113
[00112] For example, the first reference signal includes: CSI-R-1, CSI-R-2, and CSI-R-3; the models used to determine the CSI include: ML-1, ML-2, and ML-3. CSI-R-1 corresponds to ML-1, CSI-R-2 corresponds to ML-2, and CSI-R-3 corresponds to ML-3. In the model, ML-2 is the target object, meaning that only ML-2 needs to be evaluated. The terminal device can determine the CSI-R-2 corresponding to ML-2 and evaluate the performance of ML-2 through the CSI-R-2. The terminal device does not need to determine the models / methods corresponding to all the first reference signals, but only needs to determine the first reference signal corresponding to the target object that needs to be evaluated and evaluate it.
[00113] In one embodiment, the correspondence between the first reference signal and the target object includes one or more of: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a correspondence between the first reference signal, the target object and the Petition 870250086607, dated 09 / 25 / 2025, page 31 / 120 28 / 113 identification information corresponding to the CSI; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report.
[00114] In one embodiment, the method also includes one or more of: receive the initial indication information transmitted from the network device to indicate a match; To transmit the secondary indication information to the network device to indicate the match; or to determine the match based on a pre-agreement with the network device.
[00115] In one embodiment, the correspondence refers to a match between the first reference signal and the target object, that is, the method also includes one or more of: receive the first indication information transmitted from the network device to indicate the match between the first reference signal and the target object; transmit the second indication information to the network device to indicate the match between the first reference signal and the target object; or determine the match between the first reference signal and the target object based on a pre-agreement with the network device.
[00116] In one embodiment, receiving the first indication information transmitted from the network device to indicate the match means: a network device (such as a base station) indicates the match between the first reference signal and the target object by transmitting the first indication information to the UE. Petition 870250086607, dated 09 / 25 / 2025, page 32 / 120 29 / 113
[00117] In one mode, the correspondence is determined by the network device.
[00118] In one embodiment, if the target object is a codebook-based CSI feedback method, the first indication information transmitted from the network device may indicate the match between the first CSI and the first reference signal, i.e., the match between the codebook method used by the terminal device and the first reference signal.
[00119] In one embodiment, if the target object is a model-based CSI feedback method or model, the first indication information transmitted from the network device may indicate any one or a combination of: a correspondence between the first CSI and the first reference signal (which can be determined by a correspondence between the first CSI, the second CSI and the first reference signal); a correspondence between the first model and the first reference signal; a correspondence between the second CSI and the first reference signal; a correspondence between the second model and the first reference signal; or a correspondence between the bilateral model and the first reference signal.
[00120] For matching between the first CSI and the first reference signal or matching between the first model and the first reference signal, the terminal device may transmit the ID corresponding to the first CSI or the ID corresponding to the first model in the case of transmitting the first CSI. The network device may transmit the ID corresponding to the first CSI corresponding to the first reference signal or the ID corresponding to the first model in the case of transmitting the first reference signal.
[00121] In one embodiment, the terminal device can determine the performance of which CSI feedback algorithm, which AI model or which AI models the first reference signal is used to evaluate, that is, evaluate the performance of the target object corresponding to the first CSI.
[00122] To transmit the second indication information indicating the Petition 870250086607, dated 09 / 25 / 2025, page 33 / 120 30 / 113 correspondence to the network device, for example, the terminal device indicates associated information from the first reference signal corresponding to the target object to the network device through the second indication information. The network device transmits the first reference signal to the UE based on the second indication information, such as transmitting the first reference signal to the UE based on the resources indicated by the second indication information and transmitting the identification information associated with the first reference signal. The identification information is used to determine the target object corresponding to the first reference signal.
[00123] In one embodiment, the correspondence is determined by the terminal device.
[00124] In one embodiment, if the target object is a codebook-based CSI feedback method, the second indication information transmitted from the terminal device may indicate the correspondence between the first CSI and the first reference signal, such as the first CSI-n corresponding to the identification information n of the first reference signal and the resource configuration of the first reference signal corresponding to the first CSI-n. The network device transmits the first reference signal based on the second indication information, such as transmitting the identification information n corresponding to the first reference signal n or transmitting the first reference signal corresponding to n in the resource configuration indicated by the second indication information.The terminal device can determine the match between the first reference signal and the first CSI based on the identification information or resource configuration. The method of determining that the second indication information matches the first reference signal and the CSI may refer to the method of the second indication information matching the first reference signal and the first CSI, which is not repeated here.
[00125] In one embodiment, if the target object is a model-based CSI feedback method or a model, the second indication information transmitted from the terminal device may indicate any one or a combination of: Petition 870250086607, dated 09 / 25 / 2025, p. 34 / 120 31 / 113 a match between the first CSI and the first reference signal; a correspondence between the first model and the first reference signal; a correspondence between the second CSI and the first reference signal; a correspondence between the second model and the first reference signal; or a correspondence between the bilateral model and the first reference signal.
[00126] If the target object is a model-based CSI feedback method or template, the indication method may be referenced if the target object is a codebook-based CSI feedback method. In one embodiment, if the second indication information indicates the match between the second CSI and the first reference signal and / or the match between the second template and the first reference signal, the terminal device side may set the match in advance. For example, taking the second CSI as an example, the terminal device provides the match between the second CSI-n and the first reference signal n, and the network device distinguishes and matches the second CSI-n and the first reference signal n according to the second indication information.
[00127] Determining the match based on a pre-agreement with the network device means that both sides agree to the match through a protocol or other means, such as a pre-agreement on the match between the first reference signal and the CSI.
[00128] For example, the association relationship between the first agreed reference signal and the first CSI.
[00129] For example, the reference signal in the beam at a given time interval of the first CSI is the first reference signal corresponding to the first CSI.
[00130] In one embodiment, the above examples are provided for convenience of understanding the present application and shall not constitute any limitation to the present application.
[00131] In a model, the first indication information or the second indication information is used to indicate one or more of the following: a set of resources corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, page 35 / 120 32 / 113 identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00132] CSI information corresponding to the target object may include: Petition 870250086607, dated 09 / 25 / 2025, page 36 / 120 33 / 113 CSI report configuration information corresponding to the target object; and / or CSI report resource information corresponding to the target object.
[00133] The above information is presented below.
[00134] (1) The feature set corresponding to the first reference signal, the identification information of the feature set corresponding to the first reference signal, the transmission occasion corresponding to the feature set corresponding to the first reference signal, the identification information corresponding to the first reference signal, the transmission occasion corresponding to the first reference signal, the configuration information of the features corresponding to the first reference signal and the transmission occasion corresponding to the configuration information of the features corresponding to the first reference signal can be used to distinguish the first reference signal or the target object, to determine the correspondence between the target object and the first reference signal, to determine the target object or to determine the first reference signal corresponding to the target object.
[00135] For example, a reference signal transmitted in the feature set n is the first reference signal n; A reference signal transmitted in the resource set with identification information n is the first reference signal n; and a reference signal transmitted for the nth time is the first reference signal n; where n is greater than or equal to 1.
[00136] Regarding how to distinguish the first reference signal based on the transmission occasion corresponding to the set of resources corresponding to the first reference signal, the identification information corresponding to the first reference signal, the configuration information of the resources corresponding to the first reference signal, and the transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal, the above examples may be referenced and are not. Petition 870250086607, dated 09 / 25 / 2025, p. 37 / 120 34 / 113 repeated here.
[00137] In one embodiment, there is a correspondence between the target object and the set of resources corresponding to the first reference signal, the identification information of the set of resources corresponding to the first reference signal, the transmission occasion corresponding to the set of resources corresponding to the first reference signal, the identification information corresponding to the first reference signal, the transmission occasion corresponding to the first reference signal, the configuration information of the resources corresponding to the first reference signal, or the transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal (the correspondence may be agreed upon or indicated to the UE by the network device by means of the first indication information or indicated to the network device by the terminal device by means of the second indication information).If the initial indication information points to the feature set corresponding to the first reference signal, the terminal device can determine which first reference signal corresponds to which target object. When evaluating the performance of a target object, the terminal device can determine the first reference signal corresponding to its target object. Alternatively, if a first reference signal is used for evaluation, the terminal device can know which target object the currently used first reference signal is being used to evaluate.
[00138] (2) The identification information corresponding to the target object, the feature set corresponding to the target object, the feature set information corresponding to the target object, the transmission occasion corresponding to the feature set information corresponding to the target object, the configuration information of the features corresponding to the target object, and the transmission occasion corresponding to the configuration information of the features corresponding to the target object, etc., can be used to determine the correspondence between the target object and the first reference signal, to determine the target object, or to determine the first reference signal corresponding to the target object.
[00139] Taking the identification information corresponding to the target object Petition 870250086607, dated 09 / 25 / 2025, page 38 / 120 35 / 113 As an example, the target object or the first reference signal can be distinguished by ID, which can be used to determine the match between the target object and the first reference signal, determine the target object, or determine the first reference signal corresponding to the target object. For example, the network device can indicate the identification information of the target object corresponding to the first reference signal to the terminal device through the first indication information in the configuration information of the first reference signal or at the same time as the transmission of the first reference signal. The terminal device can then determine which target object the previously transmitted network device corresponds to through the first indication information.When evaluating the performance of a target object, the terminal device can determine the first reference signal corresponding to its target object. Alternatively, if a first reference signal is used for evaluation, the UE can know which target object is currently being evaluated.
[00140] Taking the feature set corresponding to the target object as an example, the correspondence between the target object and the first reference signal can be determined through the feature set corresponding to the target object, which can determine the correspondence between the target object and the first reference signal, determine the target object, or determine the first reference signal corresponding to the target object. For example, the network device can indicate the feature set corresponding to the target object to the terminal device, and the first reference signal corresponding to the target object is the reference signal corresponding to the feature included in the feature set. The terminal device can determine which feature set corresponds to which target object based on the feature set corresponding to the first reference signal.When evaluating the performance of a target object, the terminal device can determine the first reference signal corresponding to its target object. Alternatively, if using a first reference signal for evaluation, the terminal device can know which target object is currently being evaluated. Petition 870250086607, dated 09 / 25 / 2025, page 39 / 120 36 / 113
[00141] For the set of resources corresponding to the target object, the information of the set of resources corresponding to the target object, the transmission occasion corresponding to the information of the set of resources corresponding to the target object, the configuration information of the resources corresponding to the target object and the transmission occasion corresponding to the configuration information of the resources corresponding to the target object, etc.: In the case of a target object needing to be transmitted between a terminal device and a network device, the associated information of the resources occupied by the transmission of the target object can be used to distinguish different target objects, thus determining the correspondence between the target object and the first reference signal, determining the target object or determining the first reference signal corresponding to the target object. The introduction of the first reference signal can be referred to, not being repeated here; and in the case of a target object not needing to be transmitted between a terminal device and a network device, the network device and the UE can agree beforehand, or the network device or terminal device can configure the reference signal resource (resource set or resource configuration information, etc.).) corresponding to the target object and transmit the first reference signal on the reference signal resource corresponding to the target object. Taking the set of resources corresponding to the target object as an example, in this case, the set of resources corresponding to the target object refers to the resource used to transmit the first reference signal corresponding to the target object. For the information of the set of resources corresponding to the target object, the transmission occasion corresponding to the information of the set of resources corresponding to the target object, the configuration information of the resources corresponding to the target object, and the transmission occasion corresponding to the configuration information of the resources corresponding to the target object, examples of the set of resources corresponding to the target object can be referred to, which are not repeated here.
[00142] (3) The CSI report configuration information corresponding to Petition 870250086607, dated 09 / 25 / 2025, p. 40 / 120 37 / 113 first reference signal, the CSI report resource information corresponding to the first reference signal, the time offset information between the CSI transmission corresponding to the first reference signal and the transmission of the first reference signal, the CSI information corresponding to the target object, and the time offset information between the CSI transmission corresponding to the target object and the transmission of the first reference signal can be used to indicate the correspondence between the first reference signal and the CSI.
[00143] For CSI report configuration information corresponding to the first reference signal, it may include: a CSI report configuration corresponding to the first reference signal; and / or an occasion for transmitting the CSI report configuration corresponding to the first reference signal.
[00144] For example, if the first reference signal n corresponds to the CSI report configuration n, the CSI report configuration n corresponds to CSI-n and CSIn corresponds to the target object n, then the target object n corresponding to the first reference signal n can be determined based on the CSI report configuration n corresponding to the first reference signal n indicated by the first indication information or second indication information; and if the first indication information indicates the CSI report configuration corresponding to the first reference signal and the transmission occasion corresponding to the CSI report configuration corresponding to the first reference signal, for example, the first reference signal corresponds to the M-first most recent CSI report corresponding to the information indicated above by the base station to the UE before transmitting the first reference signal (where M is greater than or equal to 1).
[00145] For CSI report resource information corresponding to the first reference signal, it may include: a CSI reporting feature corresponding to the first reference signal; and / or Petition 870250086607, dated 09 / 25 / 2025, page 41 / 120 38 / 113 an occasion for transmitting the CSI report resource corresponding to the first reference signal.
[00146] The CSI reporting feature may include time domain and / or frequency domain features used for CSI reporting.
[00147] For example, if the first reference signal n matches the CSI report feature information n, the CSI report feature information n matches CSI-n, and CSI-n matches target object n, then the target object n corresponding to the first reference signal n can be determined based on the CSI report feature information n corresponding to the first reference signal n indicated by the first indication information or second indication information;and for the timing offset information between the transmission of the CSI corresponding to the first reference signal and the transmission of the first reference signal, the first indication information or the second indication information indicates that the timing offset information between CSI-n and the transmission of the first reference signal n is the timing offset-n, and if the timing offset between the transmission of the first reference signal n and the transmission of a CSI satisfies the timing offset-n, then the CSI is CSI-n corresponding to the first reference signal n.
[00148] For example, the network device indicates the time offset between the transmission of the first CSI and the transmission of the first reference signal to the UE.
[00149] For the CSI information corresponding to the target object, taking the CSI report configuration information corresponding to the target object as an example, target object n corresponds to CSI report configuration information n, CSI report configuration information n corresponds to CSI-n, and CSI-n corresponds to the first reference signal n. The first reference signal n corresponding to target object n can be determined based on the CSI report configuration information n corresponding to target object n indicated by the first indication information or the second indication information. Petition 870250086607, dated 09 / 25 / 2025, page 42 / 120 39 / 113 CSI report resource information corresponding to the target object refers to the CSI report configuration information corresponding to the target object, which is not repeated here.
[00150] For example, taking the first indication information that indicates the identification information corresponding to the target object as an example, the network device indicates to the UE the ID-n (identification information corresponding to the target object) of the model corresponding to the first reference signal n by means of the first indication information, and the CSI corresponding to the first reference signal is the CSI corresponding to the same ID.
[00151] For timing offset information between the transmission of the CSI corresponding to the target object and the transmission of the first reference signal, for example, the CSI corresponding to target object n is CSI-n, and the timing offset between the transmission of the CSI corresponding to the target object and the transmission of the first reference signal is the timing offset-n. The first reference signal after the transmission of the timing offset-n in CSI-n corresponds to CSI-n.
[00152] In one embodiment, the above information can be combined flexibly and is not repeated here.
[00153] In one embodiment, the network device indicates one or more of the above contents in the first indication information, or the terminal device indicates one or more of the above contents in the second indication information.
[00154] In one embodiment, the network device may indicate a first reference signal corresponding to a target object to the terminal device through the first indication information; and / or the terminal device indicates the first reference signal corresponding to the target object to the network device through the second indication information.
[00155] For example, the first reference signal n is associated with the target object n through the first indication information and / or the second indication information.
[00156] The information that can distinguish the first reference signal is Petition 870250086607, dated 09 / 25 / 2025, page 43 / 120 40 / 113 associated with information that can distinguish the target object through the first identifying information and / or the second identifying information. For example, the identifying information corresponding to the first reference signal n is associated with the identifying information corresponding to CSI-n.
[00157] In one embodiment, the network device may indicate to the terminal device that a first reference signal corresponds to a CSI and determine the match between the first reference signal and the target object by means of the match between the CSI and the target object; and / or the terminal device may indicate to the network device that a first reference signal corresponds to a CSI by means of the match between the CSI and the target object. The network device determines that a first reference signal corresponds to a target object.
[00158] In one embodiment, the first reference signal n can be associated with CSI-n by means of the first indication information or the second indication information.
[00159] In one embodiment, the first reference signal n that satisfies a first condition can be associated with the CSI-n through the first indication information or the second indication information; or the target object n that satisfies the first condition is associated with the CSI-n through the first indication information or the second indication information, that is, the first reference signal corresponds to the CSI that satisfies the first condition.
[00160] For example, before transmitting the first reference signal, the network device indicates to the terminal device that the most recent M-th transmission of the first reference signal corresponds to the first CSI-M; and before transmitting the first reference signal, the network device indicates to the UE that the first CSI corresponding to the set of reference signal resources corresponds to the first reference signal; where M is greater than or equal to 1.
[00161] In one modality, the first condition is a time condition, meaning that a time requirement is met between the first CSI corresponding to Petition 870250086607, dated 09 / 25 / 2025, p. 44 / 120 41 / 113 first reference signal and the first reference signal.
[00162] In one embodiment, the first reference signal corresponds to the CSI corresponding to the information (indicated by the first indication information or the second indication information) that satisfies the first condition; or the first reference signal corresponds to the target object corresponding to the information (indicated by the first indication information or the second indication information) that satisfies the first condition.
[00163] For example, the first condition is a timing condition, meaning that a timing requirement is met between the first CSI corresponding to the first reference signal and the first reference signal.
[00164] For the manner in which the base station indicates the CSI report configuration and / or transmission occasion corresponding to the first reference signal, in a mode, the base station indicates a classification of the first CSI corresponding to the first reference signal before transmitting the first reference signal.
[00165] In one embodiment, evaluating the performance of the target object based on the first reference signal includes: To determine an initial performance metric corresponding to the first reference signal based on the first reference signal; and to evaluate the performance of the target object based on the first performance metric.
[00166] In one embodiment, measurement and other operations are performed on the first reference signal corresponding to the target object that needs to be evaluated in order to obtain several first performance metrics corresponding to the first reference signal, and the target object is evaluated based on the first performance metric.
[00167] In a given modality, the first performance metric includes at least one of the following: received power of the reference signal (RSRP); Received quality of the reference signal (RSRQ); a signal-to-noise ratio (SINR); Petition 870250086607, dated 09 / 25 / 2025, page 45 / 120 42 / 113 a system performance metric; or a distribution metric.
[00168] In one embodiment, the system performance metric refers to metrics monitored based on system performance, such as: throughput, first throughput, second block error rate, block error rate (BLER), negative acknowledgment (NACK) and acknowledgment (ACK), etc.
[00169] In one embodiment, the first block error rate may include a BLER hypothesis.
[00170] In one embodiment, the BLER Hypothesis is a BLER determined based on the mapping.
[00171] For example, the BLER Hypothesis is determined based on the RSRP mapping corresponding to the first reference signal for the BLER of the physical downlink control channel (PDCCH).
[00172] For example, the association relationship between the RSRP corresponding to the first reference signal and the BLER corresponding to the physical uplink control channel (PUCCH) is established, the RSRP corresponding to the first reference signal is mapped to the BLER corresponding to the PUCCH, and the value of BLER is the Hypothesis BLER.
[00173] For example, the BLER hypothesis is determined based on the SINR mapping corresponding to the first reference signal for PDCCH BLER.
[00174] In one modality, it can be the transfer rate calculated using Shannon's formula.
[00175] In one embodiment, the first transfer fee may include a hypothesis transfer fee.
[00176] In one modality, the hypothesis transfer rate is a transfer rate determined based on the mapping.
[00177] For example, the hypothesis transfer rate is determined based on mapping the RSRP transfer rate corresponding to the first reference signal to the shared physical uplink channel (PUSCH). Petition 870250086607, dated 09 / 25 / 2025, page 46 / 120 43 / 113
[00178] For example, the association relationship between the SINR corresponding to the first reference signal and the transfer rate corresponding to the PUSCH is established, the SINR corresponding to the first reference signal is mapped to the transfer rate corresponding to the PUSCH, and the value of the transfer rate is the hypothesis transfer rate.
[00179] For example, the hypothesis transfer rate is determined based on mapping the SINR corresponding to the first reference signal to the PUSCH transfer rate.
[00180] For the precision metric: The accuracy metric can include any one or a combination of: generalized cosine similarity (GCS); generalized cosine squared similarity (SGCS); a mean squared error (MSE); or a normalized mean squared error (NMSE).
[00181] The accuracy metric may also include other parameter metrics that may represent accuracy, which is not repeated here.
[00182] For the distribution metric, it refers to the channel distribution corresponding to the first reference signal, such as distance.
[00183] The first performance metric may also include other metrics, such as model monitoring based on traditional CSI: schema based on additional traditional CSI report; monitoring based on input-output data: for example, data drift between based on a training dataset and an observation dataset, monitoring based on output distribution, etc. Related techniques may be referenced, but will not be listed one by one here.
[00184] In one modality, evaluating the target object's performance based on the first performance metric includes any one or a combination of: To evaluate the performance of the target object based on the first performance metric and an initial range of values; evaluate the performance of the target object based on the first metric of Petition 870250086607, dated 09 / 25 / 2025, page 47 / 120 44 / 113 performance and a performance metric corresponding to a reference object; or evaluate the performance of the target object based on the first performance metric and one or more performance metrics corresponding to a reference signal, where a number of the reference signal is one or more.
[00185] 1. The performance of the target object is evaluated based on the first performance metric and a first range of values: The target object's performance is evaluated based on a comparison between the first performance metric corresponding to the first reference signal and the first range of values: If the first performance metric is within the first range of values, performance is better and / or, if the comparison is beyond the first range of values, performance is poor; or, if the first performance metric is beyond the first range of values, performance is better and / or if the first performance metric is within the first range of values, performance is poor; and / or, the target object is available if the first performance metric is within the first range of values and / or the target object is not available if the first performance metric is beyond the first range of values; or, the target object is available if the first performance metric is beyond the first range of values and / or, the target object is not available if the first performance metric is within the first range of values;and / or, if the first performance metric is outside the first range of values, the AI / ML model fails; or if the first performance metric is within the first range of values, the AI / ML model fails.
[00186] In one modality, the association relationship between the target object's performance (availability, failure) and the first range of values depends on the specific index used for the first performance metric.
[00187] In one embodiment, the first range of values may correspond to one or more limit values, where the first range of values is the range of values Petition 870250086607, dated 09 / 25 / 2025, page 48 / 120 45 / 113 corresponding to the limit: The model's performance is evaluated based on a comparison between the first performance metric corresponding to the first reference signal and the threshold, for example, taking a threshold as an example: If the first performance metric is greater than the threshold, the target object's performance is better and / or if the first performance metric is less than the threshold, the target object's performance is poor; or, if the first performance metric is less than the threshold, the target object's performance is better and / or if the first performance metric is greater than the threshold, the target object's performance is poor; and / or, if the first performance metric is greater than the threshold, the target object will be available and / or if the first performance metric is less than the threshold, the target object will be unavailable; or, if the first performance metric is less than the threshold, the target object will be available and / or if the first performance metric is greater than the threshold, the target object will be unavailable; and / or, if the first performance metric is greater than the threshold, the target object (such as the AI / ML model) fails;Or if the first performance metric is lower than the threshold, the target object (such as AI / ML models) will fail.
[00188] 2. The target object's performance is evaluated based on the first performance metric and one or more performance metrics corresponding to a reference signal, where a reference signal number is one or more.
[00189] In one embodiment, if the reference signal includes multiple reference signals, one of the reference signals corresponds to a performance metric.
[00190] The performance of the target object is evaluated based on a comparison between the first performance metric corresponding to the first reference signal and the performance metric of the reference signal.
[00191] In one embodiment, the network device can transmit a reference signal to the terminal device, before or after any current step of the network device.
[00192] The benchmark signal performance metric can be determined in the following ways: Petition 870250086607, dated 09 / 25 / 2025, page 49 / 120 46 / 113 determine a channel estimate value based on the reference signal, determine the CSI based on the channel estimate value, and determine the reference signal performance metric based on the CSI; and determine a performance metric based on an effective channel obtained by pre-coding the channel estimate value corresponding to the reference signal using the CSI.
[00193] The reference signal is a reference signal different from the first reference signal, which may include any one or a combination of: a second reference signal, which is a reference signal used to estimate the raw channel; The beamforming of the reference signal corresponds to the CSI determined by another model, that is, the reference signal is the reference signal formed by the beam corresponding to another model; The beamforming of the reference signal corresponds to the CSI determined based on another CSI feedback method; and in one embodiment, in the case of combination, there are several reference signals, and each reference signal may not be completely identical.
[00194] For example, the reference signal is the beam reference signal corresponding to a codebook-based CSI feedback; that is, the beam formation of the reference signal is determined based on the fifth CSI, which is the feedback CSI in the codebook-based CSI feedback method.
[00195] 3. The target object's performance is evaluated based on the first performance metric and a performance metric corresponding to a reference object.
[00196] (1) Another model is used as a reference object: The performance of the target object is evaluated by comparing the first performance metric corresponding to the first reference signal with the performance metric of another model; A first performance metric for the first reference signal and a performance metric for another model are determined and compared: Petition 870250086607, dated 09 / 25 / 2025, page 50 / 120 47 / 113 if the first performance metric is better than the performance metric of another model, the target object's performance is better and / or if the first performance metric is worse than the performance metric of another model, the target object's performance is poor; and / or, if the first performance metric is better than the performance metric of another model, the target object is available and / or if the first performance metric is worse than the performance metric of another model, the target object is not available; and / or if the first performance metric is worse than the performance metric of another model, the target object fails; and / or, if the first performance metric is better than the performance metric of another model, the target object is considered to be better than the other model.
[00197] (2) Another method is used as a reference: The performance of the target object is evaluated based on a comparison of the performance metric corresponding to the first reference signal with the performance metric corresponding to another method; another method may include at least one of the following: methods for determining the CSI, methods for transmitting the CSI, and methods for CSI feedback.
[00198] Taking the reference object as another CSI feedback method as an example: A performance metric for the first reference signal and a performance metric for another CSI feedback method are determined and compared: If the first performance metric is better than the performance metric of another CSI feedback method, the target object's performance is better; and / or if the first performance metric is worse than the performance metric of another CSI feedback method, the target object's performance is poor; and / or if the first performance metric is better than the performance metric of another CSI feedback method, the target object will be available; and / or if the first performance metric is worse than the performance metric of another CSI feedback method, the target object will not be available. Petition 870250086607, dated 09 / 25 / 2025, p. 51 / 120 48 / 113 If the first performance metric is worse than the performance metric of another CSI feedback method, the target object fails; and if the first performance metric is better than the performance metric of another CSI feedback method, the target object is considered to be better than the other CSI feedback method.
[00199] In one embodiment, if the target object is a model, evaluating the performance of the target object includes: evaluating the performance of the first model; evaluating the performance of the second model; and evaluating the performance of the model pair composed of the first model and the second model.
[00200] For example, if the target object includes a two-sided model composed of the first model and the second model: The terminal device evaluates the performance of the composite model pair based on the first model and the second model based on the first reference signal, which may include: The terminal device determines the first performance metric corresponding to the first reference signal and evaluates the performance of the model pair composed of the first model and the second model based on the first performance metric.
[00201] If the first AI model and the second AI model are considered as a two-sided model, with the first AI model being one part of the two-sided model and the second AI model being another part of the two-sided model, then the performance of the two-sided model can be evaluated.
[00202] In one embodiment, if the first performance metric includes a distribution metric, the performance of the target object is evaluated based on the channel distribution corresponding to the first reference signal, where the first reference signal may include multiple reference signals.
[00203] For example, for a reference signal over a period of time; If it deviates from the reference distribution, the performance is poor; otherwise, the performance is better; and / or, if it deviates from the reference distribution, the model is not useful; otherwise, Petition 870250086607, dated 09 / 25 / 2025, page 52 / 120 49 / 113 the model is useful; and / or, if it deviates from the reference distribution, the model fails.
[00204] In one version, the method also includes: transmit an evaluation result to the network device.
[00205] In one embodiment, the result of the evaluation is transmitted to the network device so that the network device can perform relevant operations (such as decision-making).
[00206] In the performance evaluation method provided in the embodiments of this application, upon receiving the first reference signal transmitted from the network device, the CSI determined by the target object and / or the CSI transmitted by the target object corresponds to the transmission parameter of the first reference signal. The CSI determined by the target object and / or the CSI transmitted by the target object can be reflected by the first reference signal. Evaluating the performance of the target object by means of the first reference signal can achieve a low overhead evaluation of the target object and the evaluation of multiple target objects.
[00207] FIG. 3 is a second schematic flowchart of a method for performance evaluation according to an embodiment of the present application. As shown in FIG. 3, the embodiments of the present application provide a method for performance evaluation performed by a network device, including: Step 210: Transmit a first reference signal to a terminal device, where a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), CSIs are determined based on a target object and / or CSIs are transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[00208] In one embodiment, for the introduction of the first reference signal, target object, CSI and transmission parameter, the previous section may be referred to, which is not repeated here.
[00209] In the performance evaluation method provided in the embodiments of this application, when transmitting the first reference signal to the terminal device, Petition 870250086607, dated 09 / 25 / 2025, page 53 / 120 50 / 113 The CSI determined by the target object and / or the CSI transmitted by the target object corresponds to the transmission parameter of the first reference signal. The CSI determined by the target object and / or the CSI transmitted by the target object can be reflected by the first reference signal. Evaluating the target object's performance through the first reference signal can achieve a low-overhead evaluation of the target object and the evaluation of multiple target objects.
[00210] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[00211] The introduction of transmission position, beamforming parameter and resource configuration, the previous section can be referred to in the introduction mentioned above, which is not repeated here.
[00212] In one embodiment, the target object includes any one or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[00213] For an introduction to methods used to determine CSI, methods used to transmit CSI, and models used to determine CSI, see the previous section, which is not repeated here.
[00214] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00215] For the introduction of the correspondence between the first reference signal and the target object, the previous section can be referred to the introduction mentioned above, which will not be repeated here.
[00216] In one embodiment, the method also includes one or more of: transmit the initial indication information to the terminal device to indicate a match; receive the second piece of information transmitted from the terminal device to indicate a match; or Petition 870250086607, dated 09 / 25 / 2025, page 54 / 120 51 / 113 determine the match based on a pre-agreement with the terminal device.
[00217] In one embodiment, receiving the first indication information transmitted from the network device to indicate the match means: a network device (such as a base station) indicates the match between the first reference signal and the target object by transmitting the first indication information to the UE.
[00218] In one mode, the correspondence is determined by the network device.
[00219] For example, the network device indicates the match between the first reference signal and the CSI corresponding to the target object (hereinafter referred to as the target CSI) by means of the first indication information to the UE. The UE determines the match between the first reference signal and the target CSI based on the first indication information. The target object corresponds to the target CSI, and the number of target CSIs corresponding to a target object can be one or more. For example, the target object may correspond to a first CSI, or the target object may correspond to a first CSI and a second CSI.
[00220] For example, the network device indicates the set of features corresponding to the first reference signal to the terminal device through the first indication information, and the terminal device can determine which first reference signal corresponds to which target object based on the first indication information. When evaluating the performance of a target object, the UE can determine the first reference signal corresponding to its target object. Alternatively, in the case of using a first reference signal for evaluation, the terminal device can know which target object the currently used first reference signal is being used to evaluate.
[00221] For example, the network device may indicate the identification information of the target object corresponding to the first reference signal to the terminal device through the first indication information in the configuration information of the first reference signal or at the same time as the transmission of the Petition 870250086607, dated 09 / 25 / 2025, page 55 / 120 52 / 113 first reference signal. The terminal device can then determine which target object the previously transmitted network device corresponds to through the first indication information. When evaluating the performance of a target object, the terminal device can determine the first reference signal corresponding to its target object. Alternatively, in the case of using a first reference signal for evaluation, the terminal device can know which target object is currently being evaluated.
[00222] In one embodiment, the terminal device determines the target object corresponding to the first reference signal based on the correspondence between the first reference signal and the CSI corresponding to the target object. That is, the first reference signal is used to evaluate the performance of which CSI feedback algorithm, which AI model, or which AI model (to evaluate the performance of the target object corresponding to the CSI).
[00223] Mode 1-1: The network device configures one or more pieces of the following information corresponding to the target CSI in the first indication information corresponding to the first reference signal: Identification information (e.g., ID) of the first reference signal and / or a transmission occasion corresponding to the first reference signal; Identification information (e.g., ID) of the first set of reference signal resources and / or a transmission occasion corresponding to the first reference signal; or configuration information of resources of the first reference signal and / or a transmission occasion corresponding to the first reference signal; and the CSI corresponding to the target object corresponding to the first reference signal includes: CSI corresponding to the above information. For example, the first reference signal corresponds to the CSI corresponding to the reference signal (e.g., the CSI is determined based on the reference signal ID identified by the reference signal).
[00224] In one embodiment, the first reference signal corresponds to the CSI that satisfies the first condition and matches the information above. For example, the Petition 870250086607, dated 09 / 25 / 2025, p. 56 / 120 53 / 113 first reference signal corresponds to the first CSI corresponding to the reference signal feature set / M-th most recent reference signal indicated by the network device to the UE before transmitting the first reference signal (where M is greater than or equal to 1). For example, the first condition is a timing condition, meaning that a timing requirement is met between the CSI corresponding to the first reference signal and the first reference signal.
[00225] The network device indicates the correspondence between the first reference signal and the CSI report configuration information and / or the time-domain and / or frequency-domain CSI report resource information for the terminal device. The CSI corresponding to the first reference signal includes: the CSI corresponding to the CSI report configuration information and / or the time-domain and / or frequency-domain CSI report resource information.
[00226] For example, the CSI report configuration information corresponding to the first reference signal and / or a transmission occasion corresponding to the first reference signal is indicated.
[00227] In one embodiment, the first reference signal corresponds to the CSI that satisfies the first condition and matches the above information. For example, the first reference signal corresponds to the most recent M-th CSI report indicated by the network device to the UE before transmitting the first reference signal (where M is greater than or equal to 1). For example, the first condition is a timing condition, meaning that a timing requirement is met between the CSI corresponding to the first reference signal and the first reference signal.
[00228] For the manner in which the network device indicates the CSI report configuration information and / or the transmission occasion corresponding to the first reference signal, in one embodiment, the network device indicates a CSI classification corresponding to the first reference signal before transmitting the first reference signal.
[00229] Mode 1-3: the network device indicates the identification information of the target object corresponding to the first reference signal to the terminal device.
[00230] For example, the network device indicates the model ID corresponding to Petition 870250086607, dated 09 / 25 / 2025, page 57 / 120 54 / 113 is the first reference signal for the terminal device, and the CSI corresponding to the first reference signal is the CSI corresponding to the same model ID.
[00231] Mode 1-4: the network device indicates the time offset (time offset information) of the CSI transmission occasion and the transmission occasion of the first reference signal to the terminal device.
[00232] To receive the second indication information transmitted from the terminal device to indicate the match, in one mode, the match is determined by the terminal device.
[00233] In one embodiment, the UE indicates the associated information of the first reference signal corresponding to the target object to the network device by means of the second indication information; and the network device can determine at least one of the following based on the second indication information: a correspondence between the target object and the first reference signal; a correspondence between the first reference signal and the CSI corresponding to the target object; or a feature in the time domain and / or frequency domain corresponding to the transmission of the first reference signal of the target object.
[00234] Some examples are shown below.
[00235] Mode 2-1: the UE indicates the identification information corresponding to the target object to the network device through the second indication information; or the UE indicates the identification information, such as the identity (ID) corresponding to the CSI corresponding to the target object to the network device through the second indication information.
[00236] The network device indicates, based on the second indication information, the identification information (such as ID) corresponding to the first reference signal in the case of transmission of the first reference signal. The CSI corresponding to the same identification information (such as ID) corresponds to the first reference signal, or the target object corresponding to the same information. Petition 870250086607, dated 09 / 25 / 2025, page 58 / 120 55 / 113 identification (as ID) corresponds to the first reference signal.
[00237] Some examples of identifying information include: the resource ID corresponding to the first reference signal and the resource set ID corresponding to the first reference signal.
[00238] Mode 2-2: the UE indicates the resource configuration information (time domain and / or frequency domain resource, signal resource, channel resource, etc.) of the first reference signal corresponding to the CSI to the network device through the second indication information; or the UE indicates the resource configuration information of the first reference signal corresponding to the target object to the network device through the second indication information.
[00239] Resource allocation information may include: time domain and / or frequency domain resource, signal resource, channel resource, etc.
[00240] For example, the network device is configured with multiple time-domain and / or frequency-domain resource information for the first reference signal. When the UE indicates the time-domain and / or frequency-domain resource of the first reference signal corresponding to the first CSI for the network device through the second indication information, it selects the time-domain and / or frequency-domain resource indicated by the second indication information from the multiple time-domain and / or frequency-domain resource information to transmit the first reference signal. The UE can determine the first CSI corresponding to the first reference signal by receiving the time-domain and / or frequency-domain resources of the first reference signal.
[00241] For example, the UE indicates the resource set corresponding to the first reference signal to the network device through the second indication information. The network device can determine which resource set corresponds to which first reference signal based on the second indication information and transmit the first reference signal in the corresponding resource set. The UE can determine the target object corresponding to the first signal. Petition 870250086607, dated 09 / 25 / 2025, page 59 / 120 56 / 113 reference based on the feature set corresponding to the first reference signal. When evaluating the performance of a target object, the UE can determine the first reference signal corresponding to its target object. Alternatively, if using a first reference signal for evaluation, the UE can know which target object is currently being evaluated by the first reference signal.
[00242] Mode 2-3: The UE displays the model-related information (such as model ID, etc.) corresponding to the first reference signal for the network device via the second display information.
[00243] In one mode, the above indication information and the first CSI are transmitted together.
[00244] In one embodiment, the above indication information is not transmitted together with the first CSI, but the first CSI has an agreed-upon association relationship (e.g., agreed-upon by protocol) with the above information. (E.g., the agreed-upon time-domain relationship).
[00245] For example, if the UE indicates the identification information of the target object corresponding to the first reference signal to the network device through the second indication information, and the network device indicates, based on the second indication information, the identification information of the target object corresponding to the first reference signal to the UE through the configuration information of the first reference signal or at the same time as the transmission of the first reference signal, the UE can determine to which target object the first reference signal currently transmitted by the network device corresponds through the first indication information. When evaluating the performance of a target object, the UE can determine the first reference signal corresponding to its target object.Alternatively, if a first reference signal is used for evaluation, the UE can determine which target object the first reference signal currently in use is being used to evaluate.
[00246] To determine the match based on a pre-agreement with the terminal device, the network device and the terminal device transmit the first reference signal according to the pre-agreed match between the first Petition 870250086607, dated 09 / 25 / 2025, page 60 / 120 57 / 113 reference signal and the target object. For example, the network device transmits the first reference signal on the pre-agreed resource, transmits the corresponding identification information in the case of transmission of the first reference signal, etc. The terminal device determines the target object corresponding to the first reference signal or the first reference object needed to evaluate the target object based on the pre-agreement.
[00247] For example, the network device and the terminal device agree beforehand on the association relationship between the first reference signal and the first CSI, where the first CSI corresponds to the target object: A reference signal in a beam at a given time interval of the first CSI is the first reference signal corresponding to the first CSI.
[00248] In one embodiment, the above introduction can be mutually referenced and supplemented with the introduction on the terminal side.
[00249] In one embodiment, the correspondence includes one or more of the following: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, page 61 / 120 58 / 113 a match between the first identification signal corresponding to the target object; a match between the first signal of identification information corresponding to the CSI; a match between the first signal of configuration information from the CSI report; a match between the first signal of resource information from the CSI report; or reference and reference, reference, reference, a match between the target object and the information, the information, the target object, the target object, the time offset ...
[00250] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first signal of Petition 870250086607, dated 09 / 25 / 2025, page 62 / 120 59 / 113 reference; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or timing offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00251] In one embodiment, before transmitting the first reference signal to the terminal device, the method also includes: transmit a second reference signal to the terminal device; Receive the first CSI determined based on the second reference signal transmitted from the terminal device; and determine the transmission parameter of the first reference signal based on the first CSI.
[00252] In one embodiment, determining the transmission parameter of the first reference signal based on the first CSI includes: Determine the transmission parameter of the first reference signal based on a codebook and the first CSI; or determine the second CSI based on a second model and the first CSI, and determine the transmission parameter of the first reference signal based on the second CSI.
[00253] In one embodiment, the network device transmits a second reference signal to the terminal device, which receives the second reference signal transmitted from the network device. The terminal device processes the second Petition 870250086607, dated 09 / 25 / 2025, page 63 / 120 60 / 113 reference signal using a codebook-based CSI feedback method (target object) to obtain the first CSI. The terminal device transmits the first CSI to the network device, which determines the transmission parameter of the first reference signal through the first CSI. The network device then transmits the first reference signal to the terminal device.
[00254] In one embodiment, the network device transmits the second reference signal to the terminal device, the terminal device receives the second reference signal transmitted from the network device, processes the second reference signal based on the first model through the model-based CSI feedback method, and obtains the first CSI. The terminal device transmits the first CSI to the network device, the network device obtains the second CSI through the second model, determines the transmission parameter of the first reference signal based on the second CSI, and the network device transmits the first reference signal to the terminal device. In one embodiment, the target object may include a first model, a second model, or a pair of models composed of the first model and the second model.In one embodiment, the first model is used to determine the first CSI, the second model is used to determine the second CSI, and both the first CSI and the second CSI correspond to the first reference signal.
[00255] In one embodiment, the target object includes any one or a combination of: a first model, wherein the first model is a model corresponding to the second model and used for the terminal device to determine the first CSI; the second model; A two-sided model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[00256] The method for determining the first CSI based on the codebook includes a method for determining the first CSI based on the codebook.
[00257] In one embodiment, for the correspondence between the first model, the second model, the first model and the second model, the previous section may be Petition 870250086607, dated 09 / 25 / 2025, p. 64 / 120 61 / 113 referred to, which is not repeated here.
[00258] In one version, the method also includes: to receive an evaluation result transmitted from the terminal device.
[00259] In one embodiment, the network device may receive the evaluation result transmitted from the terminal device and perform subsequent operations, such as making decisions based on the evaluation result. The embodiments of this application do not limit the subsequent operations of the network device and may refer to related techniques, which are not repeated herein.
[00260] Below, the method for evaluating performance provided by the modalities of this application is presented through several examples.
[00261] Mode I
[00262] Taking the AI model-based CSI feedback method as an introductory example, other models (such as ML models and non-artificial intelligence models) have the same methods and will not be repeated here. The first AI model below is a possible implementation of the first model, and the second AI model is a possible implementation of the second model. The network device is a base station.
[00263] The base station transmits a second reference signal.
[00264] The EU receives the second reference signal.
[00265] The EU determines the first CSI based on the second reference signal and the first AI model.
[00266] The EU broadcasts the first CSI.
[00267] The base station receives the first CSI.
[00268] The base station determines the second CSI based on the first CSI and the second AI model.
[00269] The base station transmits the first reference signal based on the second CSI.
[00270] The EU receives the first reference signal.
[00271] The UE evaluates the performance of the AI-based CSI feedback method based on the first reference signal or evaluates the performance of the first model. Petition 870250086607, dated 09 / 25 / 2025, page 65 / 120 62 / 113 AI / second AI model / first AI model and second pair of AI models based on the first reference signal.
[00272] In one embodiment, the base station transmits the first reference signal based on the second CSI, including: The base station determines the beamforming parameter of the first reference signal based on the second CSI and transmits the first reference signal based on the beamforming parameters.
[00273] In one embodiment, the first AI model and the second AI model have an associative relationship.
[00274] The association relationship includes one or more of the following: The datasets used to train the two models have an association relationship. the same set of data; a training set used for one of the models, including data inferred from another model or from a model (corresponding to the other model); a training set used for one of the models being a dataset inferred based on another model or a model (corresponding to the other model) (for example, the training dataset used to train the first AI model is determined based on the second AI model / an AI model corresponding to the second AI model, or the training dataset used to train the second AI model is determined based on the first AI model / an AI model corresponding to the first AI model); two models with the same model ID; two models being trained together; two models corresponding to the same configuration (antenna configuration, CSI-RS feature configuration, CSI report configuration, CSI-RS feature set configuration, and feature configuration, etc.).
[00275] A correspondence between the first AI model and the second AI model could be: one-to-one (a first AI model corresponding to a second model of Petition 870250086607, dated 09 / 25 / 2025, page 66 / 120 63 / 113 AI); One-to-many (a first AI model corresponding to several second AI models); Multiple to one (several initial AI models corresponding to one subsequent AI model); or, multiple to multiple (several initial AI models corresponding to several subsequent AI models).
[00276] The EU assesses, based on the first reference signal, the performance of the AI-based CSI feedback method, which may include: The UE determines the first performance metric corresponding to the first reference signal and evaluates the performance of the AI-based CSI feedback method based on that first performance metric.
[00277] The EU assesses the performance of the first AI model based on the first benchmark signal, which may include: The UE determines the first performance metric corresponding to the first reference signal and evaluates the performance of the first AI model based on that first performance metric.
[00278] The EU assesses the performance of the second AI model based on the first benchmark signal, which may include: The UE determines the first performance metric corresponding to the first reference signal and evaluates the performance of the second AI model based on the first performance metric.
[00279] The EU assesses the performance of the bilateral model based on the first AI model and the second AI model using the first reference signal, which may include: The EU determines the first performance metric corresponding to the first reference signal and evaluates the performance of a first AI model and the second pair of AI models based on the first performance metric.
[00280] If the first AI model and the second AI model are considered as one AI model, that is, a bilateral model composed of the first model and Petition 870250086607, dated 09 / 25 / 2025, page 67 / 120 64 / 113 by the second model, the first AI model is one part of the bilateral model and the second AI model is another part of the bilateral model, so the target object can be a bilateral model composed of the first model and the second model.
[00281] Examples of the first performance metric include: RS RP; RSRQ; SINR; BLER hypothesis; hypothesis transfer rate; a precision metric; or a distribution metric.
[00282] BLER Hypothesis: For example: an association relationship between the RSRP of the signal and the BLER corresponding to the PUCCH is established, the RSRP corresponding to the first reference signal is mapped to the BLER corresponding to the PUCCH, and the BLER value is the Hypothesis BLER.
[00283] Hypothesis transfer rate: For example: a throughput is calculated based on the SINR received from the first reference signal, which is the throughput of the hypothesis. In one modality, it may be the throughput calculated using Shannon's formula.
[00284] Precision metric: For example, CSMS, GCS, NMSE, and MSE, etc.; and the accuracy metrics include: the accuracy metric determined based on the third CSI corresponding to the first CSI and the fourth CSI corresponding to the first reference signal determined by the UE.
[00285] The fourth CSI corresponding to the first reference signal is the CSI determined by the UE based on the channel corresponding to the first reference signal, and the third CSI is the CSI used to determine the first CSI (e.g., the input CSI of the second AI / ML model).
[00286] Distribution metrics: the distribution of corresponding channels, such as Petition 870250086607, dated 09 / 25 / 2025, p. 68 / 120 65 / 113 distance etc.
[00287] It cannot be ruled out that there may be other metrics.
[00288] A method for performance evaluation is presented below. For ease of description, the first performance metric is represented as Q1.
[00289] When the target object is an AI-based CSI feedback method, the following are some methods for the UE to evaluate the target object's performance based on the first performance metric.
[00290] Method 1: The target object's performance is evaluated based on a comparison between the first performance metric and the threshold, where the target object is a CSI feedback method based on AI models, for example: If the first performance metric is greater than the threshold, performance is better and / or if the first performance metric is less than the threshold, performance is poor; or, if the first performance metric is less than the threshold, performance is better and / or if the first performance metric is greater than the threshold, performance is poor; and / or, if the first performance metric is greater than the threshold, it can be used and / or if the first performance metric is less than the threshold, it will not be available; or if the first performance metric is less than the threshold, it will be available and / or if the first performance metric is greater than the threshold, it will not be available.
[00291] The first performance metric being RSRP / SINR / transfer rate / hypothesis transfer rate is taken as an example. Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first reference signal. The RSRP of the first reference signal is compared to the first threshold value T1. If Q1>=T1, this indicates that the performance of the AI-based CSI feedback methods is better; if Q1< T1, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00292] Taking the first performance metric as the BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information. Petition 870250086607, dated 09 / 25 / 2025, page 69 / 120 66 / 113 corresponding to the first reference signal. If Q1<=T1, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method has failed.
[00293] Taking the first performance metric as SGCS / GCS / NMSE / MSE as an example: Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the second reference signal (e.g., effective channel obtained by processing the channel estimate value). If Q1<=T1, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method has failed.
[00294] Taking the first performance metric as the distribution parameter as an example: Q1 could be the distribution parameter corresponding to the first reference signal (e.g., the distribution parameter corresponding to the channel estimate of the first reference signal). For some distribution parameters, if Q1<=T1, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method has failed. For distribution parameters, if Q1>=T1, this indicates that the performance of the AI-based CSI feedback method is better; if Q1 <T1, isso indica que o desempenho do método de feedback de CSI baseado em IA é ruim ou indica que o método de feedback de CSI baseado em IA falha.
[00295] Method 2: The target object's performance is evaluated based on a comparison between the first performance metric and the second performance metric corresponding to the second reference signal, where the target object is a CSI feedback method based on an AI model (the behavior on the base station side involves transmitting a second reference signal to the UE, which can be done before or after any current step on the base station side).
[00296] To facilitate description, the second performance metric is represented Petition 870250086607, dated 09 / 25 / 2025, pp. 70 / 120 67 / 113 as Q2.
[00297] In one modality, the second performance metric is of the same type as the first performance metric.
[00298] The second performance metric can be determined in the following ways: To determine the channel estimate value based on the second reference signal, to determine the third CSI based on the channel estimate value, and to determine the second performance metric based on the third CSI; and to determine a performance metric based on an effective channel obtained by pre-coding the channel estimate value corresponding to the second reference signal using the third CSI.
[00299] Taking the performance metric (first performance metric and second performance metric) as RSRP / SINR / hypothesis transfer rate / hypothesis transfer rate as an example. Q1 is the RSRP / SINR / hypothesis transfer rate / hypothesis transfer rate corresponding to the first reference signal and Q2 is the RSRP / SINR / hypothesis transfer rate / hypothesis transfer rate corresponding to the second reference signal. If Q1>=Q2, this indicates that the performance of the AI-based CSI feedback method is better; if Q1< Q2, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00300] Taking the performance metric as a BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal, and Q2 is the BLER hypothesis corresponding to the channel state information corresponding to the second reference signal. If Q1<=Q2, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q2, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method has failed.
[00301] Taking the performance metric as a distribution parameter as an example: Q1 can be the distribution parameter corresponding to the first signal of Petition 870250086607, dated 09 / 25 / 2025, page 71 / 120 68 / 113 reference (for example, the distribution parameter corresponding to the channel estimate of the first reference signal) and Q2 can be the distribution parameter based on the second reference signal. For distribution parameters, if Q1<=Q2, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q2, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails. For some distribution parameters, if Q1>=Q2, this indicates that the performance of the AI-based CSI feedback method is better; if Q1<Q2, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00302] Method 3: The performance of the target object is evaluated based on a comparison between the first performance metric and the third performance metric corresponding to the third reference signal, where the target object is a CSI feedback method based on an AI model.
[00303] In one embodiment, the beamforming of the third reference signal corresponds to the CSI determined by the third AI model.
[00304] In other words, the third reference signal is the beam reference signal corresponding to the third AI model.
[00305] In one embodiment, the beamforming of the third reference signal corresponds to the CSI determined based on another CSI feedback method.
[00306] For example, the third reference signal is the beam reference signal corresponding to the codebook-based CSI feedback method; that is, the beam formation of the third reference signal is determined based on the fifth CSI, which is the CSI fed back under the codebook-based CSI feedback method.
[00307] For ease of description, the third performance metric is represented as Q3.
[00308] Some examples include the following.
[00309] Taking the performance metric (first performance metric and third performance metric) being RSRP / SINR / throughput / throughput Petition 870250086607, dated 09 / 25 / 2025, p. 72 / 120 69 / 113 Hypothesis transfer as an example: Q1 is the RSRP / SINR / hypothesis transfer rate corresponding to the first reference signal, and Q3 is the RSRP / SINR / hypothesis transfer rate corresponding to the third reference signal. If Q1>=Q3, this indicates that the target object's performance is better; if Q1<Q3, this indicates that the AI-based CSI feedback method's performance is poor or indicates that the AI-based CSI feedback method fails.
[00310] Taking the performance metric as a BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal, and Q3 is the BLER hypothesis corresponding to the channel state information corresponding to the third reference signal. If Q1<=Q3, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00311] Taking the performance metric as SGCS / GCS / NMSE / MSE as an example. Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the third reference signal (e.g., effective channel obtained by processing the channel estimate value). Q3 is the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the third reference signal (e.g., channel estimate value) and the CSI obtained from the third reference signal (e.g., effective channel obtained by processing the channel estimate value). If Q1<=Q3, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method has failed.
[00312] Taking the performance metric as a distribution parameter as an example: Q1 can be the distribution parameter corresponding to the first reference signal (for example, the distribution parameter corresponding to the estimate of Petition 870250086607, dated 09 / 25 / 2025, page 73 / 120 70 / 113 channel of the first reference signal) and Q3 is the distribution parameter corresponding to the third reference signal. For distribution parameters, if Q1<=Q3, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails. For some distribution parameters, if Q1>=Q3, this indicates that the performance of the AI-based CSI feedback method is better; if Q1<Q3, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00313] Method 4: The target object's performance is evaluated based on a comparison between the first performance metric and the performance metric of another AI model. The target object is the AI-based CSI feedback method, and the reference object is another AI model different from the target object; and the performance metric of the first reference signal and the performance metric of the other AI model are determined and compared: If the first performance metric is better than the performance metric of another AI model, the target object's performance is better; and / or if the first performance metric is worse than the performance metric of another AI model, the target object's performance is poor; and / or if the first performance metric is better than the performance metric of another AI model, the target object is available; and / or if the first performance metric is worse than the performance metric of another AI model, the target object is unavailable; and / or if the first performance metric is worse than the performance metric of another AI model, the target object fails; and / or if the first performance metric is better than the performance metric of another AI model, the target object (such as an AI model) is considered to be better than the other AI model; and / or the target object is considered to be worse than the other AI model.
[00314] It is assumed that another AI model is a fourth AI model. To facilitate the Petition 870250086607, dated 09 / 25 / 2025, page 74 / 120 71 / 113 description, the performance metric of the fourth AI model is represented as Q4.
[00315] Some examples include the following.
[00316] Taking the performance metric (first performance metric and fourth performance metric) being RSRP / SINR / transfer rate / hypothesis transfer rate as an example: Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first reference signal and Q4 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the fourth AI model. If Q1>=Q4, this indicates that the performance of the AI-based CSI feedback method is better; if Q1< Q4, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00317] Taking the performance metric being the BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal and Q4 is the BLER hypothesis corresponding to the fourth AI model. If Q1<=Q4, this indicates that the performance of the AI-based CSI feedback method is better; if Q1> Q4, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00318] Taking the performance metric SGCS / GCS / NMSE / MSE as an example. Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the second reference signal (e.g., effective channel obtained by processing the channel estimate value). Q4 is the SGCS / GCS / NMSE / MSE corresponding to the fourth AI model. If Q1<=Q4, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q4, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00319] Taking the performance metric as a distribution parameter as an example: Q1 can be the distribution parameter corresponding to the first reference signal (for example, the distribution parameter corresponding to the estimate of Petition 870250086607, dated 09 / 25 / 2025, page 75 / 120 72 / 113 channel of the first reference signal) and Q4 is the distribution parameter corresponding to the fourth AI model. For distribution parameters, if Q1<=Q4, this indicates that the performance of the AI-based CSI feedback method is better; if Q1>Q4, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails. For some distribution parameters, if Q1>=Q4, this indicates that the performance of the AI-based CSI feedback method is better; if Q1<Q4, this indicates that the performance of the AI-based CSI feedback method is poor or indicates that the AI-based CSI feedback method fails.
[00320] In one embodiment, Method 4 and Method 3 can be used in combination. For example, the beamforming of the third reference signal in method 3 corresponds to the CSI determined by the third AI model, which is a combination of method 3 and method 4.
[00321] Method 5: The performance of the AI-based CSI feedback method is evaluated based on a comparison between the first performance metric and the performance metric of the second CSI feedback method, with the second CSI feedback method as the reference object; and a performance metric of the first reference signal and a performance metric of the second CSI feedback method are determined and compared: If the performance metric of the first CSI feedback method is better than the performance metric of the second CSI feedback method, the target object's performance is better, and / or if the performance metric of the first CSI feedback method is worse than the performance metric of the second CSI feedback method, the target object's performance is poor; and / or if the first performance metric is better than the performance metric of the second CSI feedback method, the target object will be available, and / or if the first performance metric is worse than the performance metric of the second CSI feedback method, the target object will be unavailable. if the performance metric of the first CSI feedback method is worse than Petition 870250086607, dated 09 / 25 / 2025, page 76 / 120 73 / 113 that the performance metric of the second CSI feedback method, the target object (based on the AI model's CSI feedback method) fails; and if the first performance metric is better than the second CSI feedback method, the target object is considered to be better than the second CSI feedback method.
[00322] For ease of description, the performance metric of the second CSI feedback method is represented as Q5 (fifth performance metric).
[00323] Some examples include the following.
[00324] Taking the performance metric (first performance metric and fifth performance metric) being RSRP / SINR / transfer rate / hypothesis transfer rate as an example: Q5 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the second CSI feedback method. If Q1>=Q5, this indicates that the performance of the AI-based CSI feedback methods is better / the performance of the AI-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1< Q5, this indicates that the performance of the AI-based CSI feedback methods is poor / the performance of the AI-based CSI feedback methods is not as good as the performance of the second CSI feedback method, or indicates that the AI-based CSI feedback method fails.
[00325] Taking the performance metric as a BLER hypothesis as an example: Q5 is the BLER hypothesis corresponding to the second CSI feedback method. If Q1<=Q5, this indicates that the performance of the AI-based CSI feedback method is better / the performance of the AI-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1> Q5, this indicates that the performance of the AI-based CSI feedback methods is poor / the performance of the AI-based CSI feedback methods is not as good as the performance of the second CSI feedback method, or indicates that the AI-based CSI feedback method fails.
[00326] Taking the performance metric as a distribution parameter as an example: Q5 is the distribution parameter corresponding to the second method of Petition 870250086607, dated 09 / 25 / 2025, page 77 / 120 74 / 113 CSI feedback. For distribution parameters, if Q1<=Q5, this indicates that the performance of AI-based CSI feedback methods is better / the performance of the AI-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1> Q5, this indicates that the performance of AI-based CSI feedback methods is poor / the performance of AI-based CSI feedback methods is not as good as the performance of the second CSI feedback method, or indicates that the AI-based CSI feedback method fails.For distribution parameters, if Q1<=Q5, this indicates that the performance of AI-based CSI feedback methods is better / the performance of the AI-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1> Q5, this indicates that the performance of AI-based CSI feedback methods is poor, or indicates that the AI-based CSI feedback method fails / the performance of AI-based CSI feedback methods is not as good as the performance of the second CSI feedback method.
[00327] In one embodiment, Method 5 can also be combined with Method 3. For example, the beamforming of the third reference signal corresponds to the CSI determined based on another CSI feedback method.
[00328] Method 6: The performance of the AI-based CSI feedback method is evaluated based on the distribution of channels corresponding to the first reference signal.
[00329] At this point, the first reference signal may be multiple.
[00330] For example, it is a reference signal for a period of time; If it deviates from the reference distribution, the performance is poor; otherwise, the performance is better; and / or, if it deviates from the reference distribution, the model is not useful; otherwise, the model is useful; and / or, if it deviates from the reference distribution, the model fails.
[00331] In this mode, a first AI model and the second pair of AI models can be considered as a whole AI model, i.e., the UE can evaluate the performance of the first AI model and the second pair of AI models (a Petition 870250086607, dated 09 / 25 / 2025, page 78 / 120 75 / 113 two-sided model composed of the first model and the second model) based on the first reference signal.
[00332] Mode II
[00333] The base station transmits a second reference signal.
[00334] The EU receives the second reference signal.
[00335] The UE determines the first CSI based on the second reference signal and a codebook.
[00336] The EU broadcasts the first CSI.
[00337] The base station receives the first CSI.
[00338] The base station transmits a first reference signal based on the first CSI.
[00339] The EU receives the first reference signal.
[00340] The UE evaluates the performance of the codebook-based CSI feedback method based on the first reference signal.
[00341] In one embodiment, the base station transmits a first reference signal based on the first CSI, including: The base station determines the beamforming parameter of the first reference signal based on the first CSI and transmits the first reference signal based on the beamforming parameter.
[00342] The UE evaluates the performance of a codebook-based CSI feedback method based on the first reference signal, which may include: The UE determines the first performance metric corresponding to the first reference signal and evaluates the performance of the codebook-based CSI feedback method based on that first performance metric.
[00343] Examples of the first performance metric include: RS RP; RSRQ; SINR; BLER hypothesis; For example: an association relationship between the RSRP of the signal and the BLER. Petition 870250086607, dated 09 / 25 / 2025, p. 79 / 120 76 / 113 corresponding to PUCCH is established, the RSRP corresponding to the first reference signal is mapped to the BLER corresponding to PUCCH, and the BLER value is the BLER Hypothesis.
[00344] Hypothesis transfer rate: For example: a throughput is calculated based on the SINR received from the first reference signal, which is the hypothesized throughput. In one modality, it may be the throughput calculated using Shannon's formula.
[00345] A precision metric: For example, CSMS, GCS, NMSE, and MSE, etc.; and the accuracy metrics include: the accuracy metric determined based on the third CSI corresponding to the first CSI and the fourth CSI corresponding to the first reference signal determined by the UE.
[00346] The fourth CSI corresponding to the first reference signal is the CSI determined by the UE based on the channel corresponding to the first reference signal, and the third CSI is the CSI used to determine the first CSI (e.g., the input CSI of the second AI model).
[00347] Distribution metric: the distribution of channels corresponding to the first reference signal, such as distance, etc.
[00348] It cannot be ruled out that there may be other metrics.
[00349] For ease of description, the first performance metric is represented as Q1.
[00350] The methods for the UE to evaluate the performance of codebook-based CSI feedback methods based on the first performance metric are as follows.
[00351] Method 1: The performance of the target object is evaluated based on a comparison between the first performance metric and a threshold, where the target object is a codebook-based CSI feedback method, for example: If the first performance metric is greater than the threshold, performance is better and / or if the first performance metric is less than the threshold, performance is poor; or, if the first performance metric is less than the threshold, the Petition 870250086607, dated 09 / 25 / 2025, pp. 80 / 120 77 / 113 performance is better and / or if the first performance metric is greater than the threshold, the performance is poor; and / or, if the first performance metric is greater than the threshold, it can be used and / or if the first performance metric is less than the threshold, it will not be available; or if the first performance metric is less than the threshold, it will be available and / or if the first performance metric is greater than the threshold, it will not be available.
[00352] The first performance metric being RSRP / SINR / transfer rate / hypothesis transfer rate is taken as an example. Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first reference signal. The RSRP of the first reference signal is compared with the first threshold value T1, if Q1>=T1, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1< T1, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00353] Taking the first performance metric as an example, the BLER hypothesis: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal. If Q1<=T1, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00354] Taking the first performance metric as SGCS / GCS / NMSE / MSE as an example: Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the second reference signal (e.g., effective channel obtained by processing the channel estimate value). If Q1<=T1, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method Petition 870250086607, dated 09 / 25 / 2025, p. 81 / 120 78 / 113 of the codes failed.
[00355] Taking the first performance metric as the distribution parameter as an example: Q1 could be the distribution parameter corresponding to the first reference signal (e.g., the distribution parameter corresponding to the channel estimate of the first reference signal). For distribution parameters, if Q1<=T1, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>T1, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails. For distribution parameters, if Q1>=T1, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1 <T1, isso indica que o desempenho do método de feedback de CSI baseado em livro de códigos é ruim ou indica que o método de feedback de CSI baseado em livro de códigos falha.
[00356] Method 2: The target object's performance is evaluated based on a comparison between the first performance metric and the second performance metric corresponding to the second reference signal, where the target object is a codebook-based CSI feedback method (the behavior on the base station side involves transmitting a second reference signal to the UE, which can be done before or after any current step on the base station side).
[00357] For ease of description, the second performance metric is represented as Q2.
[00358] In one modality, the second performance metric is of the same type as the first performance metric.
[00359] In one embodiment, the second reference signal is a reference signal used to determine the second CSI.
[00360] The second performance metric can be determined in the following ways: determine the channel estimate value based on the second reference signal, determine the third CSI based on the channel estimate value, and determine the second performance metric based on the third CSI; and Petition 870250086607, dated 09 / 25 / 2025, page 82 / 120 79 / 113 determine a performance metric based on an effective channel obtained by pre-coding the estimated channel value corresponding to the second reference signal using the third CSI.
[00361] Taking the performance metric (first performance metric and second performance metric) as RSRP / SINR / transfer rate / hypothesis transfer rate as an example. Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first reference signal and Q2 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the second reference signal. If Q1>=Q2, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1< Q2, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00362] Taking the performance metric as a BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal and Q2 is the BLER hypothesis corresponding to the channel state information corresponding to the second reference signal. If Q1<=Q2, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q2, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00363] Taking the performance metric as a distribution parameter as an example: Q1 could be the distribution parameter corresponding to the first reference signal (e.g., the distribution parameter corresponding to the channel estimate of the first reference signal), Q2 could be the distribution parameter based on the second reference signal. For distribution parameters, if Q1<=Q2, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q2, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method has failed. For distribution parameters, if Q1>=Q2, this Petition 870250086607, dated 09 / 25 / 2025, page 83 / 120 80 / 113 indicates that the performance of the codebook-based CSI feedback method is better; if Q1 < Q2, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00364] Method 3: The performance of the target object is evaluated based on a comparison between the first performance metric and the third performance metric corresponding to the third reference signal, where the target object is a codebook-based CSI feedback method.
[00365] In one embodiment, the beamforming of the third reference signal corresponds to the CSI determined by the third AI model.
[00366] In other words, the third reference signal is the reference signal formed by the beam corresponding to the third AI model.
[00367] In one embodiment, the beamforming of the third reference signal corresponds to the CSI determined based on another CSI feedback method.
[00368] For example, the third reference signal is the beamforming reference signal corresponding to the codebook-based CSI feedback method; that is, the beamforming of the third reference signal is determined based on the fifth CSI, which is the CSI fed back under the codebook-based CSI feedback method.
[00369] For ease of description, the third performance metric is represented as Q3.
[00370] Some examples include the following.
[00371] Taking the performance metric (first performance metric and third performance metric) being RSRP / SINR / transfer rate / hypothesis transfer rate as an example: Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first reference signal and Q3 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the third reference signal. If Q1>=Q3, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1< Q3, this indicates that the performance of the codebook-based CSI feedback method is better. Petition 870250086607, dated 09 / 25 / 2025, page 84 / 120 81 / 113 codebook is bad or indicates that the CSI codebook-based feedback method fails.
[00372] Taking the performance metric as a BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal, and Q3 is the BLER hypothesis corresponding to the channel state information corresponding to the third reference signal. If Q1<=Q3, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00373] Taking the performance metric as SGCS / GCS / NMSE / MSE as an example. Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the third reference signal (e.g., effective channel obtained by processing the channel estimate value). Q3 is the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the third reference signal (e.g., channel estimate value) and the CSI obtained from the third reference signal (e.g., effective channel obtained by processing the channel estimate value). If Q1<=Q3, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method has failed.
[00374] Taking the performance metric as a distribution parameter as an example: Q1 could be the distribution parameter corresponding to the first reference signal (e.g., the distribution parameter corresponding to the channel estimate of the first reference signal) and Q3 is the distribution parameter corresponding to the third reference signal. For distribution parameters, if Q1<=Q3, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q3, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the method of Petition 870250086607, dated 09 / 25 / 2025, page 85 / 120 82 / 113 Codebook-based CSI feedback fails. For distribution parameters, if Q1>=Q3, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1< Q3, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00375] Method 4: The performance of the codebook-based CSI feedback method is evaluated based on a comparison between the performance metric of the first performance metric and the fourth AI model; and a performance metric of the first reference signal and a performance metric of the fourth AI model are determined and compared: If the first performance metric is better than the performance metric of the fourth AI model, the target object's performance will be better; and / or if the first performance metric is worse than the performance metric of the fourth AI model, the target object's performance will be poor; and / or if the first performance metric is better than the performance metric of the fourth AI model, the target object will be available; and / or if the first performance metric is worse than the performance metric of the fourth AI model, the target object will not be available; and / or if the first performance metric is worse than the performance metric of the fourth AI model, the target object fails; and / or if the first performance metric is better than the fourth AI model, the target object is considered to be better than the fourth AI model; and / or the target object is considered to be worse than the fourth AI model.
[00376] For ease of description, the performance metric of the fourth AI model is represented as Q4 (fourth performance metric).
[00377] Some examples include the following.
[00378] Taking the performance metric (first performance metric and fourth performance metric) being RSRP / SINR / transfer rate / hypothesis transfer rate as an example: Q1 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the first signal of Petition 870250086607, dated 09 / 25 / 2025, page 86 / 120 83 / 113 reference and Q4 is the RSRP / SINR / throughput / throughput hypothesis corresponding to the fourth AI model. If Q1>=Q4, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1< Q4, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00379] Taking the performance metric being the BLER hypothesis as an example: Q1 is the BLER hypothesis corresponding to the channel state information corresponding to the first reference signal, and Q4 is the BLER hypothesis corresponding to the fourth AI model. If Q1<=Q4, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1> Q4, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00380] Taking the performance metric SGCS / GCS / NMSE / MSE as an example. Q1 can be the SGCS / GCS / NMSE / MSE calculated based on the CSI obtained from the first reference signal (e.g., channel estimate value) and the CSI obtained from the second reference signal (e.g., effective channel obtained by processing the channel estimate value). Q4 is the SGCS / GCS / NMSE / MSE corresponding to the fourth AI model. If Q1<=Q4, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q4, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00381] Taking the performance metric as a distribution parameter as an example: Q1 could be the distribution parameter corresponding to the first reference signal (e.g., the distribution parameter corresponding to the channel estimate of the first reference signal) and Q4 is the distribution parameter corresponding to the fourth AI model. For distribution parameters, if Q1<=Q4, this indicates that the performance of the codebook-based CSI feedback method is better; if Q1>Q4, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails. For distribution parameters, if Q1>=Q4, this Petition 870250086607, dated 09 / 25 / 2025, page 87 / 120 84 / 113 indicates that the performance of the codebook-based CSI feedback method is better; if Q1 < Q4, this indicates that the performance of the codebook-based CSI feedback method is poor or indicates that the codebook-based CSI feedback method fails.
[00382] Method 4 and Method 3 can be used in combination. For example, the beamforming of the third reference signal in method 3 corresponds to the CSI determined by the third AI model, which is a combination of method 3 and method 4.
[00383] Method 5: The performance of the codebook-based CSI feedback method is evaluated based on a comparison between the performance metric of the first performance metric and the second CSI feedback method; and a first performance metric of the first reference signal and a first performance metric of a fifth performance metric of the second CSI feedback method are determined and compared: If the first performance metric is better than the performance metric of the second CSI feedback method, the performance is better; and / or if the performance metric is worse than the performance metric of the second CSI feedback method, the performance is poor; and / or if the first performance metric is better than the performance metric of the second CSI feedback method, the target object will be available; and / or if the first performance metric is worse than the performance metric of the second CSI feedback method, the target object will be unavailable. If the first performance metric is worse than the performance metric of the second CSI feedback method, the target object will fail; and if the first performance metric is better than the second CSI feedback method, the target object is considered to be better than the second CSI feedback method.
[00384] For ease of description, the performance metric of the second CSI feedback method is represented as Q5 (fifth performance metric).
[00385] Some examples include the following. Petition 870250086607, dated 09 / 25 / 2025, p. 88 / 120 85 / 113
[00386] Taking the performance metric (first performance metric and fifth performance metric) being RSRP / SINR / transfer rate / hypothesis transfer rate as an example: Q5 is the RSRP / SINR / transfer rate / hypothesis transfer rate corresponding to the second CSI feedback method. If Q1>=Q5, this indicates that the performance of the codebook-based CSI feedback method is better / the performance of the codebook-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1< Q5, this indicates that the performance of the codebook-based CSI feedback method is poor / the performance of the codebook-based CSI feedback method is not as good as the performance of the second CSI feedback method, or indicates that the codebook-based CSI feedback method fails.
[00387] Taking the performance metric as a BLER hypothesis as an example: Q5 is the BLER hypothesis corresponding to the second CSI feedback method. If Q1<=Q5, this indicates that the performance of the codebook-based CSI feedback method is better / the performance of the codebook-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1> Q5, this indicates that the performance of the codebook-based CSI feedback method is poor / the performance of the codebook-based CSI feedback method is not as good as the performance of the second CSI feedback method, or indicates that the codebook-based CSI feedback method fails.
[00388] Taking the performance metric as a distribution parameter as an example: Q5 is the distribution parameter corresponding to the second CSI feedback method. For distribution parameters: If Q1<=Q5, this indicates that the performance of the codebook-based CSI feedback method is better / the performance of the codebook-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1>Q5, this indicates that the performance of the codebook-based CSI feedback method is poor / the performance of the codebook-based CSI feedback method is not Petition 870250086607, dated 09 / 25 / 2025, page 89 / 120 86 / 113 as good as the performance of the second CSI feedback method, or indicates that the codebook-based CSI feedback method fails. For distribution parameters, if Q1>=Q5, this indicates that the performance of the codebook-based CSI feedback method is better / the performance of the codebook-based CSI feedback method is better than the performance of the second CSI feedback method; if Q1< Q5, this indicates that the performance of the codebook-based CSI feedback method is poor, or indicates that the codebook-based CSI feedback method fails / the performance of the codebook-based CSI feedback method is not as good as the performance of the second CSI feedback method.
[00389] Method 5 can also be combined with Method 3. For example, the beamforming of the third reference signal corresponds to the CSI determined based on another CSI feedback method.
[00390] Mode 3: method for indicating the correspondence between the first reference signal and the CSI corresponding to the target object
[00391] Mode 1: The base station indicates the match between the first reference signal and the CSI corresponding to the target object to the UE. The UE determines, based on the indication, the match between the CSI corresponding to the target object and the first reference signal (in one embodiment, it further determines which CSI feedback algorithm / AI model or AI models are used to evaluate the performance of (evaluating the performance of the CSI feedback algorithm / AI model corresponding to the CSI corresponding to the target object)).
[00392] Mode 1-1: The base station configures one or more parts of the following information to match the CSI corresponding to the target object in the first indication information: Identification information (e.g., ID) of the first reference signal and / or a transmission occasion corresponding to the first reference signal; Identification information (e.g., ID) of the first set of reference signal resources and / or a transmission occasion corresponding to the first reference signal; or Petition 870250086607, dated 09 / 25 / 2025, pp. 90 / 120 87 / 113 configuration of resources of the first reference signal and / or a transmission occasion corresponding to the first reference signal; The CSI corresponding to the target object of the first reference signal includes: CSI corresponding to the information above.
[00393] For example, the first reference signal corresponds to the CSI corresponding to the identity of the first reference signal (for example, the CSI corresponding to the target object is determined based on the reference signal corresponding to the identity of the reference signal).
[00394] In one embodiment, the first reference signal corresponds to the CSI that satisfies the first condition and matches the above information. For example, before transmitting the first reference signal, the CSI corresponding to the reference signal feature set / M-th most recent reference signal indicated by the base station to the UE (where M is greater than or equal to 1). For example, the first condition is a timing condition, meaning that a timing requirement is met between the CSI corresponding to the target object corresponding to the first reference signal and the first reference signal.
[00395] Mode 1-2: The base station indicates the match between the first reference signal and the CSI report configuration information and / or the time-domain and / or frequency-domain resource information of the CSI report for the UE. The CSI corresponding to the target object corresponding to the first reference signal includes: the CSI corresponding to the target object corresponding to the CSI report configuration information and / or the time-domain and / or frequency-domain resource information corresponding to the CSI report.
[00396] For example, the CSI report configuration corresponding to the first reference signal and / or its corresponding transmission occasion is indicated.
[00397] In one embodiment, the first reference signal corresponds to the CSI that satisfies the first condition and corresponds to the above information. For example, before transmitting the first reference signal, the information indicated by the base station to the UE corresponds to the most recent M-th CSI report (where M is greater than Petition 870250086607, dated 09 / 25 / 2025, pp. 91 / 120 88 / 113 or equal to 1). For example, the first condition is a timing condition, meaning that a timing requirement is met between the CSI corresponding to the first reference signal and the first reference signal.
[00398] For the manner in which the base station indicates the CSI report configuration information and / or the transmission occasion corresponding to the first reference signal, in a mode, the base station indicates a CSI classification corresponding to the target object before transmitting the first reference signal.
[00399] Mode 1-3: the base station indicates the AI model ID corresponding to the first reference signal for the UE: The CSI corresponding to the first reference signal is the CSI with the same AI model ID.
[00400] Mode 1-4: the base station indicates the time offset of the CSI transmission occasion corresponding to the target object and the transmission occasion of the first reference signal to the UE.
[00401] Mode 2: The UE indicates to the base station the second indication of the first reference signal corresponding to the CSI corresponding to the target object. The base station can determine at least one of the following based on the indication: a match between the first reference signal and the CSI corresponding to the target object; or a time-domain and / or frequency-domain feature of the first reference signal corresponding to the transmission target object.
[00402] Mode 2-1: the UE indicates ID information corresponding to the CSI corresponding to the target object, and the base station indicates the ID information corresponding to the first reference signal in the case of transmission of the first reference signal. The CSI corresponding to the same ID corresponds to the first reference signal.
[00403] Some examples of ID information include: the resource ID of the first referral signal and the resource set ID of the first referral signal.
[00404] Mode 2-2: the EU indicates the resource information (resource in the domain of Petition 870250086607, dated 09 / 25 / 2025, pp. 92-120 89 / 113 time and / or frequency domain, signal resource, channel resource, etc.) of the first reference signal corresponding to the CSI corresponding to the target object.
[00405] In one embodiment, the base station configures multiple time-domain and / or frequency-domain resource information for the first reference signal. By indicating the time-domain and / or frequency-domain resource of the first reference signal corresponding to the CSI corresponding to the target object, the UE selects one or more parts of the multiple time-domain and / or frequency-domain resource information.
[00406] Mode 2-3: The UE displays the information associated with the AI model (model ID, etc.) corresponding to the first reference signal corresponding to the CSI corresponding to the target object.
[00407] In one embodiment, the above indication information and the CSI corresponding to the target object are transmitted together.
[00408] In one embodiment, the above indication information is not transmitted together with the CSI corresponding to the target object, but the CSI corresponding to the target object has an agreed association relationship (e.g., protocol agreement) (e.g., agreed time domain relationship) with the above information.
[00409] Mode 3: the association relationship between the first agreed reference signal and the CSI corresponding to the target object.
[00410] 3-1 Mode: the reference beam signal at a given time interval between the CSI corresponding to the target object is the first reference signal corresponding to the CSI corresponding to the target object.
[00411] In one embodiment, the above examples are provided to facilitate understanding of the present application and shall not constitute any limitation to the present application.
[00412] In the related technique, although the concept of beamforming CSI-RS also exists, beamforming CSI-RS is used to determine the optimal downlink transmission beam and is not used to evaluate the performance of CSI feedback algorithms. Furthermore, in the related technique, the shape of Petition 870250086607, dated 09 / 25 / 2025, page 93 / 120 90 / 113 Determining the beamforming parameters of the CSI-RS is determined by the base station itself, without the need to establish an association relationship with the CSI feedback / other reference signals, nor does it require the base station and the terminal to reach a consensus on their association relationship with the CSI feedback / other reference signals.
[00413] In the performance evaluation method provided in the embodiments of this application, CSI is used to form the beam of the first reference signal, and the first reference signal is transmitted to the UE to reflect the CSI through the beam-formed reference signal (first reference signal). By transmitting the beam-formed first reference signal using CSI to the UE in this manner, CSI transmission can be achieved with less overhead. Furthermore, there is only one solution in the related technique that calculates the intermediate KPI based on the recovered CSI compared to the target CSI and evaluates the performance of AI models based on the intermediate KPI. This application provides further solutions for evaluating the performance of CSI feedback methods and / or AI models based on the first reference signals carrying CSI information. This method can also be extended to evaluate the performance of non-AI CSI feedback methods.
[00414] With reference to FIG. 4, FIG. 4 is a first schematic structural diagram of a performance evaluation apparatus according to an embodiment of the present application. As shown in FIG. 4, the embodiments of the present application provide a performance evaluation apparatus that can be used in a terminal device. The apparatus includes: a first receiving unit 410, used to receive a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSI is determined based on a target object and / or the CSI is transmitted based on a target object; and a first evaluation unit 420, used to evaluate the performance of the target object based on the first reference signal received. Petition 870250086607, dated 09 / 25 / 2025, page 94 / 120 91 / 113
[00415] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[00416] In one embodiment, the target object includes any one or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[00417] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00418] In one embodiment, the first evaluation unit 420 is used to evaluate the target object's performance based on the first reference signal received; and the first evaluation unit 420 is used to evaluate the target object's performance based on the first reference signal received and the match.
[00419] In one embodiment, the device also includes one or more of the following: a first receiving unit 410, used to receive the first indication information transmitted from the network device to indicate the match; A first transmitting unit, used to transmit the second indication information to the network device to indicate the match; or a first determining unit, used to determine the match based on a pre-agreement with the network device.
[00420] In one embodiment, the correspondence includes one or more of the following: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first signal of Petition 870250086607, dated 09 / 25 / 2025, page 95 / 120 92 / 113 reference; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a match between the first reference signal, the target object, and the corresponding CSI identification information; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report.
[00421] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, page 96 / 120 93 / 113 configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00422] In one embodiment, the first evaluation unit 420 is used to evaluate the performance of the target object based on the first reference signal, including: The first evaluation unit 420, used to determine a first performance metric corresponding to the first reference signal based on the first reference signal; and the first evaluation unit 420, used to evaluate the performance of the target object based on the first performance metric. Petition 870250086607, dated 09 / 25 / 2025, page 97 / 120 94 / 113
[00423] In a given modality, the first performance metric includes at least one of the following: received power of the reference signal (RSRP); Received quality of the reference signal (RSRQ); a signal-to-noise ratio (SINR); a system performance metric; a precision metric; or a distribution metric.
[00424] In one embodiment, the first evaluation unit 420 used to evaluate the target object's performance based on the first performance metric includes any one or a combination of: The first evaluation unit, 420, is used to assess the performance of the target object based on the first performance metric and an initial range of values; the first evaluation unit 420, used to evaluate the performance of the target object based on the first performance metric and a performance metric corresponding to a reference object; or the first evaluation unit 420, used to evaluate the performance of the target object based on the first performance metric and one or more performance metrics corresponding to a reference signal, where a number of the reference signal is one or more.
[00425] In one embodiment, the first receiving unit 410 is also used to receive a second reference signal transmitted from the network device; and the apparatus further includes a first CSI determination unit, used to determine the first CSI based on the second reference signal; and the first transmitting unit is further used to transmit the first CSI to the network device, wherein the first CSI is used to determine, by the network device, the transmission parameter of the first reference signal.
[00426] In one embodiment, the first CSI determination used to determine the first CSI based on the second reference signal includes: Petition 870250086607, dated 09 / 25 / 2025, pages 98 / 120 95 / 113 the first CSI determination unit, used to determine the first CSI based on a codebook and the second reference signal; or the first CSI determination unit, used to determine the first CSI based on a first model and the second reference signal; In the case of determining the first CSI based on the first model and the second reference signal, the first CSI is used by the network device to determine the second CSI based on a second model corresponding to the first model, and the second CSI is used by the network device to determine the transmission parameter of the first reference signal.
[00427] In one embodiment, the target object includes any one or a combination of: the first model; the second model; A bilateral model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[00428] In one embodiment, the first transmission unit is still used to transmit an evaluation result to the network device.
[00429] The methods and apparatus provided in each embodiment of this application are based on the same application concept. Since the method for performance evaluation performed by the terminal device and the apparatus for performance evaluation for use in the terminal device have similar principles for solving problems and can achieve the same technical effects, the implementation of the apparatus and the method can be mutually referenced and repetition is not repetitive.
[00430] With reference to FIG. 5, FIG. 5 is a second schematic structural diagram of an apparatus for performance evaluation according to an embodiment of this application. As shown in FIG. 5, the embodiments of this application provide an apparatus for performance evaluation that can be used in a network device. The apparatus includes: A second 510 transmission unit is used to transmit a first reference signal to a terminal device, where a transmission parameter of the first reference signal is determined by the network device based on the Petition 870250086607, dated 09 / 25 / 2025, pp. 99 / 120 96 / 113 channel status information (CSI), CSIs are determined based on a target object and / or CSIs are transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[00431] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[00432] In one embodiment, the target object includes any or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[00433] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00434] In one embodiment, the device also includes any one or a combination of: the second transmission unit 510, still used to transmit the first indication information to the terminal device to indicate the match; a second receiving unit, used to receive the second indication information transmitted from the terminal device to indicate the match; or a second determining unit, used to determine the match based on a pre-agreement with the terminal device.
[00435] In one modality, the correspondence includes one or more of: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, pages 100 / 120 97 / 113 a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a match between the first reference signal, the target object, and the corresponding CSI identification information; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report.
[00436] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; configuration information for the features corresponding to the first signal of Petition 870250086607, dated 09 / 25 / 2025, pages 101 / 120 98 / 113 reference; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00437] In one embodiment, the second 510 transmission unit is also used to transmit a second reference signal to the terminal device; The second receiving unit is also used to receive the first CSI determined based on the second reference signal transmitted from the terminal device; and the apparatus also includes a parameter determination unit, used to determine the transmission parameter of the first reference signal based on the first CSI. Petition 870250086607, dated 09 / 25 / 2025, pages 102 / 120 99 / 113
[00438] In one embodiment, the parameter determination unit for determining the transmission parameter of the first reference signal based on the first CSI includes: The parameter determination unit, used to determine the transmission parameter of the first reference signal based on a codebook and the first CSI; or the parameter determination unit, used to determine the second CSI based on a second model and the first CSI, and to determine the transmission parameter of the first reference signal based on the second CSI.
[00439] In one embodiment, the target object includes any one or a combination of: a first model, wherein the first model is a model corresponding to the second model and used for the terminal device to determine the first CSI; the second model; A two-sided model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[00440] In one embodiment, the second receiving unit is also used to receive an evaluation result transmitted from the terminal device.
[00441] The methods and devices provided in each embodiment of this application are based on the same application concept. Since the method for evaluating performance performed by the network device and the device for evaluating performance for use in the network device have similar principles for solving problems and can achieve the same technical effects, the implementation of the device and the method can be mutually referenced and repetition is not repetitive.
[00442] It should be noted that the division of units in the embodiments of the present application is schematic and is only a logical function division, and there may be other modes of division in the actual implementation. Furthermore, the functional units in the various embodiments of the present application may be integrated into a processing unit, or each unit may exist physically alone, or two or more units may be integrated into a unit. The integrated unit above Petition 870250086607, dated 09 / 25 / 2025, pp. 103 / 120 100 / 113 mentioned can be implemented in the form of a functional unit of hardware or software.
[00443] If the integrated unit is implemented in the form of a functional software unit and sold or used as a separate product, it may be stored on a computer-readable storage medium. Based on such understanding, the technical solutions of the present application, in essence or a part of the technical solutions that contribute to the state of the art, or all or part of the technical solutions, may be incorporated in the form of a software product, which is stored on a storage medium, including various instructions to cause a computer device (which may be a personal computer, server or network device, etc.) or a processor to execute all or part of the steps of the methods described in the respective embodiments of the present application.The storage media described above includes various media that can store program code, such as a USB drive, a portable hard drive, read-only memory (ROM), random access memory (RAM), a magnetic disk, or a compact disc.
[00444] FIG. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in FIG. 6, the terminal includes a memory 620, a transceiver 600 and a processor 610; the processor 610 and the memory 620 can also be physically arranged separately.
[00445] Memory 620 is used to store a computer program; transceiver 600 is used to transmit and receive data under the control of processor 610; processor 610 is used to call the computer program stored in memory 620 to execute any of the performance evaluation methods performed by the terminal device provided in this application according to the executable instructions obtained, such as: Receiving a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSI is determined based on a target object and / or the CSI is transmitted. Petition 870250086607, dated 09 / 25 / 2025, pp. 104 / 120 101 / 113 based on a target object; and evaluate the target object's performance based on the first reference signal received.
[00446] In one embodiment, transceiver 600 is used to receive and transmit data under the control of processor 610.
[00447] In FIG. 6, the 640 bus interface may include any number of interconnected buses and bridges, one or more processors represented by the 610 processor, and several memory circuits represented by the 620 memory connected to each other. The 640 bus interface may also connect various other circuits, such as peripheral devices, voltage regulators, and power management circuits, which are well known in this field and therefore will not be described in more detail in this application. The bus interface provides an interface. The 600 transceiver may include various elements, namely, include a transmitter and a receiver, units to provide communication with various other devices through transmission media, including wireless channels, wired channels, fiber optic cables, and the like.For different terminals, it may also include a 630 user interface, which can be an interface capable of connecting the necessary device externally or internally, and the connected device includes, but is not limited to, a keyboard, a screen, a speaker, a microphone, a joystick, and the like.
[00448] Processor 610 is responsible for managing the bus architecture and general processing, and memory 620 can store data used by processor 610 when performing operations.
[00449] In one embodiment, the 610 processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a complex programmable logic device (CPLD). The processor may also use a multi-core architecture.
[00450] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or Petition 870250086607, dated 09 / 25 / 2025, pp. 105 / 120 102 / 113 resource configuration.
[00451] In one embodiment, the target object includes any one or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[00452] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00453] In one embodiment, evaluating the performance of the target object based on the first reference signal received includes: to evaluate the performance of the target object based on the first reference signal received and the match.
[00454] In one modality, the operations also include one or more of the following: receive the initial indication information transmitted from the network device to indicate a match; To transmit the second piece of information to the network device to indicate the match; or to determine the match based on a pre-agreement with the network device.
[00455] In one form, the correspondence includes one or more of the following: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; Petition 870250086607, dated 09 / 25 / 2025, pages 106 / 120 103 / 113 a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a match between the first reference signal, the target object, and the corresponding CSI identification information; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report.
[00456] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first signal Petition 870250086607, dated 09 / 25 / 2025, pages 107 / 120 Reference 104 / 113; CSI report resource information corresponding to the first reference signal; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00457] In one embodiment, evaluating the target object's performance based on the first reference signal includes: To determine an initial performance metric corresponding to the first reference signal based on the first reference signal; and to evaluate the performance of the target object based on the first performance metric.
[00458] In a given modality, the first performance metric includes at least one of the following: received power of the reference signal (RSRP); Received quality of the reference signal (RSRQ); a signal-to-noise ratio (SINR); a system performance metric; Petition 870250086607, dated 09 / 25 / 2025, pages 108 / 120 105 / 113 is a precision metric; or a distribution metric.
[00459] In one embodiment, the performance evaluation of the target object based on the first performance metric includes any one or a combination of: To evaluate the performance of the target object based on the first performance metric and an initial range of values; To evaluate the performance of the target object based on the first performance metric and a performance metric corresponding to a reference object; or to evaluate the performance of the target object based on the first performance metric and one or more performance metrics corresponding to a reference signal, where a number of the reference signal is one or more.
[00460] In one embodiment, before receiving the first reference signal transmitted from the network device, the method also includes: receive a second reference signal transmitted from the network device; determine the first CSI based on the second reference signal; and transmit the first CSI to the network device, where the first CSI is used by the network device to determine the transmission parameter of the first reference signal.
[00461] In one embodiment, determining the first CSI based on the second reference signal includes: determine the first CSI based on a codebook and the second reference signal; or determine the first CSI based on a first model and the second reference signal; In the case of determining the first CSI based on the first model and the second reference signal, the first CSI is used by the network device to determine the second CSI based on a second model corresponding to the first model, and the second CSI is used by the network device to determine the transmission parameter of the first reference signal. Petition 870250086607, dated 09 / 25 / 2025, pages 109 / 120 106 / 113
[00462] In one embodiment, the target object includes any one or a combination of: the first model; the second model; A bilateral model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[00463] In one modality, the operations also include: transmit an evaluation result to the network device.
[00464] It should be noted that the terminal device provided in the embodiments of this application can implement all the steps of the method for performance evaluation performed by the terminal device described above and can achieve the same technical effects. Therefore, the same parts and beneficial effects as the embodiments of the method in this embodiment will not be described here.
[00465] FIG. 7 is a schematic structural diagram of a network device according to an embodiment of the present application. As shown in FIG. 7, the network device includes a memory 720, a transceiver 700 and a processor 710, wherein the memory 720 is used to store a computer program, the transceiver 700 is used to receive and transmit data under the control of the processor 710 and the processor 710 is used to read the computer program in the memory 720 and perform the following operations: To transmit a first reference signal to a terminal device, where a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), the CSI is determined based on a target object and / or the CSI is transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[00466] In one embodiment, transceiver 700 is used to receive and transmit data under the control of processor 710.
[00467] In FIG. 7, a bus architecture can include any number of interconnected buses and bridges, which are linked together through various Petition 870250086607, dated 09 / 25 / 2025, pages 110 / 120 107 / 113 circuits of one or more processors represented by the 710 processor and one or more memories represented by the 720 memory. The bus architecture can also connect various other circuits, such as peripherals, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described in more detail in this application. The bus interface provides an interface. The 700 transceiver can include several elements, i.e., include a transmitter and a receiver, units to provide communication with various other devices through transmission media, including wireless channels, wired channels, fiber optic cables, and the like. The 710 processor is responsible for managing the bus architecture and overall processing, and the 720 memory can store data used by the 710 processor when performing operations.
[00468] The 710 processor can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a complex programmable logic device (CPLD). The processor can also use a multi-core architecture.
[00469] In one embodiment, the transmission parameter includes at least one of: a transmission position; a beamforming parameter; or feature configuration.
[00470] In one embodiment, the target object includes any or a combination of: a method for determining the CSI; a method for transmitting CSI; or a model for determining CSI.
[00471] In one embodiment, there is a correspondence between the first reference signal and the target object.
[00472] In one modality, the operations also include one or more of: transmit the initial indication information to the terminal device to indicate a match; receive the second piece of information transmitted from the terminal device to indicate a match; or Petition 870250086607, dated 09 / 25 / 2025, pp. 111 / 120 108 / 113 determine the match based on a pre-agreement with the terminal device.
[00473] In one modality, the correspondence includes one or more of: a correspondence between the target object and a set of features corresponding to the first reference signal; a match between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of resources corresponding to the first reference signal; a match between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a match between the target object and the configuration information of the resources corresponding to the first reference signal; a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the corresponding identification information of the target object; a match between the first reference signal, the target object, and the corresponding CSI identification information; a match between the first reference signal, the target object, and the configuration information in the CSI report; a match between the first reference signal, the target object, and the CSI report resource information; or a match between the target object and the time offset information between an occasion of transmission of the first reference signal and an occasion of transmission of the CSI report. Petition 870250086607, dated 09 / 25 / 2025, pages 112 / 120 109 / 113
[00474] In a modality, the first indication information or the second indication information is used to indicate one or more of: a set of resources corresponding to the first reference signal; Identification information for a set of resources corresponding to the first reference signal; a transmission occasion corresponding to a set of resources corresponding to the first reference signal; Identification information corresponding to the first reference signal; a transmission occasion corresponding to the first reference signal; Configuration information for the resources corresponding to the first reference signal; a transmission opportunity corresponding to the configuration information of the resources corresponding to the first reference signal; CSI report configuration information corresponding to the first reference signal; CSI report resource information corresponding to the first reference signal; Time offset information between a CSI transmission corresponding to the first reference signal and a transmission of the first reference signal; Identification information corresponding to the target object; a set of resources corresponding to the target object; Identifying information for a set of resources corresponding to the target object; a transmission occasion corresponding to a set of resources corresponding to the target object; Configuration information for the resources corresponding to the target object; a transmission opportunity corresponding to the configuration information of the resources corresponding to the target object; CSI information corresponding to the target object; or Petition 870250086607, dated 09 / 25 / 2025, pages 113 / 120 110 / 113 time offset information between a CSI transmission corresponding to the target object and a transmission of the first reference signal.
[00475] In one embodiment, before transmitting the first reference signal to the terminal device, the method also includes: transmit a second reference signal to the terminal device; Receive the first CSI determined based on the second reference signal transmitted from the terminal device; and determine the transmission parameter of the first reference signal based on the first CSI.
[00476] In one embodiment, determining the transmission parameter of the first reference signal based on the first CSI includes: Determine the transmission parameter of the first reference signal based on a codebook and the first CSI; or determine the second CSI based on a second model and the first CSI, and determine the transmission parameter of the first reference signal based on the second CSI.
[00477] In one embodiment, the target object includes any one or a combination of: a first model, wherein the first model is a model corresponding to the second model and used for the terminal device to determine the first CSI; the second model; A two-sided model composed of the first model and the second model; or a method for determining the first CSI based on a codebook.
[00478] In one modality, the operations also include: to receive an evaluation result transmitted from the terminal device.
[00479] It should be noted that the network device provided in the embodiments of this application can implement all the steps of the method for performance evaluation performed by the network device and can achieve the same technical effects. Therefore, the same parts and beneficial effects as the embodiments of the method in this embodiment will not be described here. Petition 870250086607, dated 09 / 25 / 2025, pages 114 / 120 111 / 113
[00480] The embodiments of the present application further provide a processor-readable storage medium that stores a computer program to enable the processor to execute the performance evaluation method performed by the terminal device provided in the embodiments above, including: receiving a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSI is determined based on a target object and / or the CSI is transmitted based on a target object; and performance evaluation of the target object based on the first reference signal received.
[00481] The embodiments of the present application further provide a processor-readable storage medium that stores a computer program to enable the processor to execute the performance evaluation method performed by the network device provided in the embodiments above, including: To transmit a first reference signal to a terminal device, where a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), the CSI is determined based on a target object and / or the CSI is transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
[00482] Processor-readable storage media may be any available data storage medium or device that can be accessed by the computer, including, but not limited to, magnetic storage (e.g., a floppy disk, a hard disk, a magnetic tape, a magneto-optical (MO) disk, etc.), optical memory (such as CD, DVD, BD, HVD, etc.) and semiconductor memory (such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state drive (SSD)), etc.
[00483] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems or program products of Petition 870250086607, dated 09 / 25 / 2025, pages 115 / 120 112 / 113 computer. Therefore, the present application may take the form of a fully hardware implementation, a fully software implementation, or a combination of software and hardware implementation. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.
[00484] The present application is described with reference to flowcharts and / or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams and combinations thereof can be implemented by computer-executable instructions. These computer-executable instructions can be supplied to processors of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, and the instructions executed by the computer processor or other programmable data processing device form a means to perform the functions specified in one or more flows in a flowchart and / or one or more blocks of a block diagram.
[00485] These processor-executable instructions may also be stored in processor-readable memory capable of directing a computer or other programmable data processing device to operate in a particular manner, and the instructions stored in processor-readable memory may result in a fabrication including instruction means, the instruction means may perform the functions specified in one or more flows of the flowchart and / or one or more blocks of the block diagram.
[00486] These processor-executable instructions can also be loaded into a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce an implemented process. Petition 870250086607, dated 09 / 25 / 2025, pages 116 / 120 113 / 113 by computer and instructions performed on the computer or other programmable devices provide steps to execute the functions specified in one or more flowchart flows and / or one or more blocks of the block diagram.
[00487] It is evident to those skilled in the art that various modifications and variations can be made to the present application without departing from the scope of the present application.
[00488] As such, provided that such modifications and variations of the present application fall within the scope of the claims of the present application and its equivalents, the present application is also intended to cover such modifications and variations. Petition 870250086607, dated 09 / 25 / 2025, pages 117 / 120
Claims
1 / 6 CLAIMS 1. A method for evaluating the performance of a terminal device, characterized in that it comprises: receiving a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), and the CSIs are determined based on a target object and / or the CSIs are transmitted based on a target object; and evaluating the performance of the target object based on the first reference signal received.
2. A method according to claim 1, characterized in that the transmission parameter comprises at least one of: a transmission position; a beamforming parameter; or a feature configuration; and / or wherein the target object comprises at least one of: a method for determining the CSI; a method for transmitting CSI; or a model for determining the CSI.
3. Method, according to claim 1, characterized in that there is a correspondence between the first reference signal and the target object.
4. Method, according to claim 3, characterized in that the performance evaluation of the target object based on the first received reference signal comprises: evaluating the performance of the target object based on the first received reference signal and the correspondence.
5. Method, according to claim 1, characterized in that the method further comprises one or more of: Petition 870250087164, dated 09 / 26 / 2025, page 5 / 39 2 / 6 transmitting an evaluation result to the network device; receiving the first indication information transmitted from the network device to indicate the match; transmitting the second indication information to the network device to indicate a first match; or determining a first match based on a pre-agreement with the network device; wherein the first match is a match between the first reference signal and the target object.
6. A method, according to any one of claims 3 to 5, characterized in that the correspondence comprises one or more of: a correspondence between the target object and a set of features corresponding to the first reference signal; a correspondence between the target object and the identification information of a set of features corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to a set of features corresponding to the first reference signal; a correspondence between the target object and the identification information corresponding to the first reference signal; a correspondence between the target object and a transmission occasion corresponding to the first reference signal; a correspondence between the target object and the configuration information of the features corresponding to the first reference signal;a match between the target object and a transmission occasion corresponding to the configuration information of the resources corresponding to the first reference signal; a match between the first reference signal and the identification information corresponding to the target object; a match between the first reference signal, the target object and the identification information corresponding to the CSI; a match between the first reference signal, the target object and the configuration information of the CSI report; a match between the first reference signal, the target object and the resource information of the CSI report; or a match between the target object and the time offset information between a transmission occasion of the first reference signal and a transmission occasion of the CSI.
7. A method, according to any one of claims 1 to 5, characterized in that evaluating the performance of the target object based on the first reference signal comprises: determining a first performance metric corresponding to the first reference signal based on the first reference signal; and evaluating the performance of the target object based on the first performance metric; wherein the first performance metric comprises at least one of: received reference signal power (RSRP); received reference signal quality (RSRQ); a signal-to-interference-to-noise ratio (SINR); a system performance metric; an accuracy metric; or a distribution metric.
8. Method, according to claim 7, characterized in that the performance evaluation of the target object based on the first performance metric comprises any one or a combination of: evaluating the performance of the target object based on the first performance metric and a first range of values; evaluating the performance of the target object based on the first performance metric and a performance metric corresponding to a reference object; or evaluating the performance of the target object based on the first performance metric and one or more performance metrics corresponding to a reference signal, in Petition 870250087164, dated 09 / 26 / 2025, page 7 / 39 4 / 6, where a number of the reference signal is one or more.
9. A method, according to any one of claims 1 to 5, characterized in that, before receiving the first reference signal transmitted from the network device, the method further comprises: receiving a second reference signal transmitted from the network device; determining the first CSI based on the second reference signal; and transmitting the first CSI to the network device, wherein the first CSI is used to determine, by the network device, the transmission parameter of the first reference signal.
10. A method for evaluating performance, carried out by a network device, characterized in that it comprises: transmitting a first reference signal to a terminal device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI), the CSIs are determined based on a target object and / or the CSIs are transmitted based on a target object, and the first reference signal is used for the terminal device to evaluate the performance of the target object.
11. A method according to claim 10, characterized in that the transmission parameter comprises at least one of: a transmission position; a beamforming parameter; or a feature configuration; and / or wherein the target object comprises any one or a combination of: a method for determining CSI; a method for transmitting CSI; or a model for determining CSI.
12. Method, according to claim 10, characterized in that there is a correspondence between the first reference signal and the target object.
13. Method, according to claim 10, characterized in that Petition 870250087164, dated 09 / 26 / 2025, p. 8 / 39 5 / 6 the method also comprises one or more of: receiving an evaluation result transmitted from the terminal device; transmitting the first indication information to the terminal device to indicate a first match; receiving the second indication information transmitted from the terminal device to indicate a first match; or determining a first match based on a pre-agreement with the terminal device; wherein the first match is a match between the first reference signal and the target object.
14. A method according to any one of claims 10 to 13, characterized in that before transmitting the first reference signal to the terminal device, the method further comprises: transmitting a second reference signal to the terminal device; receiving the first CSI determined based on the second reference signal transmitted from the terminal device; and determining the transmission parameter of the first reference signal based on the first CSI.
15. Terminal device, characterized in that it comprises a memory, a transceiver, and a processor, wherein: the memory is used to store a computer program; the transceiver is used to transmit and receive data under the control of the processor; and the processor is used to read the computer program stored in memory and perform the following operations: receive a first reference signal transmitted from a network device, wherein a transmission parameter of the first reference signal is determined by the network device based on channel state information (CSI) and the CSIs are determined based on a target object and / or the CSIs are transmitted based on a target object; and evaluate the performance of the target object based on the first reference signal received. Petition 870250087164, dated 09 / 26 / 2025, page 9 / 39 6 / 6
