Measurement methods, apparatus, equipment and storage media

Abstract

This application discloses a measurement method, apparatus, device, and storage medium, belonging to the field of communications. The measurement method of this application includes: a first communication device determining measurement information required for a target measurement of performance indication information; the first communication device using a target artificial intelligence model, based on the measurement information, performing the target measurement, and obtaining a target measurement result of the target measurement; the first communication device sending first information to a second communication device; wherein the first information includes the target measurement result.

Description

Technical Field

[0001] This application belongs to the field of communication technology, specifically relating to a measurement method, apparatus, device, and storage medium. Background Technology

[0002] When AI is applied to wireless communication, AI models need to be deployed in various network entities. These entities need to monitor the predictive performance metrics of the AI ​​models running in terminals or network nodes to ensure the quality of communication services.

[0003] However, there is currently no effective way to monitor the predictive performance of AI models, and the quality of communication services cannot be guaranteed. Summary of the Invention

[0004] This application provides a measurement method, apparatus, device, and storage medium that can solve the problem that there is currently no effective way to monitor the predictive performance indicators of AI models, and the quality of communication services cannot be guaranteed.

[0005] Firstly, a measurement method is provided, the method comprising:

[0006] The first communication device determines the measurement information required for the target measurement of the performance indication information;

[0007] The first communication device employs a target artificial intelligence model, performs the target measurement based on the measurement information, and obtains the target measurement result of the target measurement;

[0008] The first communication device sends first information to the second communication device;

[0009] The first information includes the target measurement results.

[0010] Secondly, a measurement method is provided, the method comprising:

[0011] The third communication device instructs the first communication device on the measurement information required for the target measurement of the performance indication information.

[0012] Thirdly, a measurement method is provided, the method comprising:

[0013] The second communication device receives the first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model;

[0014] The first information includes the target measurement results for the target.

[0015] Fourthly, a measuring device is provided, comprising:

[0016] The first determining module is used to determine the measurement information required for the target measurement of the performance indication information;

[0017] The execution module is used to employ a target artificial intelligence model, based on the measurement information, to perform the target measurement and obtain the target measurement result.

[0018] The sending module is used to send the first information to the second communication device;

[0019] The first information includes the target measurement results.

[0020] Fifthly, a measuring device is provided, comprising:

[0021] The indicator module is used to indicate to the first communication device the measurement information required for the target measurement of the performance indicator information.

[0022] Sixthly, a measuring device is provided, comprising:

[0023] The receiving module is used to receive first information sent by the first communication device after it performs target measurement based on measurement information using a target artificial intelligence model;

[0024] The first information includes the target measurement results for the target.

[0025] In a seventh aspect, a first communication device is provided, the first communication device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect.

[0026] Eighthly, a third communication device is provided, the third communication device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the second aspect.

[0027] In a ninth aspect, a second communication device is provided, the second communication device including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the third aspect.

[0028] In a tenth aspect, a first communication device is provided, including a processor and a communication interface, wherein the processor is used for:

[0029] Determine the measurement information required for the target measurement of the performance indication information;

[0030] Using a target artificial intelligence model, based on the measurement information, the target measurement is performed to obtain the target measurement result.

[0031] The communication interface is used for:

[0032] Send the first message to the second communication device;

[0033] The first information includes the target measurement results.

[0034] Eleventhly, a third communication device is provided, including a processor and a communication interface, wherein the communication interface is used for:

[0035] Instruct the first communication device on the measurement information required for the target measurement of the performance indication information.

[0036] In a twelfth aspect, a second communication device is provided, including a processor and a communication interface, wherein the communication interface is used for:

[0037] Receive the first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model;

[0038] The first information includes the target measurement results for the target.

[0039] In a thirteenth aspect, a measurement system is provided, comprising: a first communication device, a second communication device, and a third communication device, wherein the first communication device is configured to perform the steps of the measurement method as described in the first aspect, the third communication device is configured to perform the steps of the measurement method as described in the second aspect, and the second communication device is configured to perform the steps of the measurement method as described in the third aspect.

[0040] In a fourteenth aspect, a readable storage medium is provided, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the measurement method as described in the first aspect, or the steps of the measurement method as described in the second aspect, or the steps of the measurement method as described in the third aspect.

[0041] In a fifteenth aspect, a chip is provided, the chip including a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the steps of the measurement method as described in the first aspect, or the steps of the measurement method as described in the second aspect, or the steps of the measurement method as described in the third aspect.

[0042] In a sixteenth aspect, a computer program / program product is provided, which is stored in a storage medium and is executed by at least one processor to implement the steps of the measurement method as described in the first aspect, or the steps of the measurement method as described in the second aspect, or the steps of the measurement method as described in the third aspect.

[0043] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system. Attached Figure Description

[0044] Figure 1 This diagram illustrates a block diagram of a wireless communication system to which embodiments of this application may be applied;

[0045] Figure 2 This is a schematic diagram of the neural network provided in an embodiment of this application;

[0046] Figure 3 A schematic diagram of a neuron provided in an embodiment of this application.

[0047] Figure 4 This is one of the flowcharts illustrating the measurement method provided in the embodiments of this application;

[0048] Figure 5 This is a second schematic flowchart of the measurement method provided in the embodiments of this application;

[0049] Figure 6 This is the third flowchart illustrating the measurement method provided in the embodiments of this application;

[0050] Figure 7 This is one of the structural schematic diagrams of the measuring device provided in the embodiments of this application;

[0051] Figure 8 This is a second schematic diagram of the measuring device provided in the embodiments of this application;

[0052] Figure 9 This is the third schematic diagram of the measuring device provided in the embodiments of this application;

[0053] Figure 10 This is a schematic diagram of the structure of the communication device provided in the embodiments of this application;

[0054] Figure 11A schematic diagram of the hardware structure of a first communication device according to an embodiment of this application;

[0055] Figure 12 A schematic diagram of the hardware structure of a third communication device according to an embodiment of this application;

[0056] Figure 13 A schematic diagram of the hardware structure of a second communication device according to an embodiment of this application. Detailed Implementation

[0057] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0058] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same class, not limited in number; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0059] It is worth noting that the technologies described in this application are not limited to Long Term Evolution (LTE) / LTE-Advanced (LTE-A) systems, but can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency Division Multiple Access (SC-FDMA), and other systems. The terms "system" and "network" in this application are often used interchangeably, and the described technologies can be used with the systems and radio technologies mentioned above, as well as with other systems and radio technologies. The following description describes New Radio (NR) systems for illustrative purposes, and NR terminology is used in most of the following description; however, these technologies can also be applied to applications beyond NR systems, such as 6th generation (6G) radio systems. th Generation 6G communication system.

[0060] Figure 1This diagram illustrates a block diagram of a wireless communication system applicable to embodiments of this application. The wireless communication system includes a terminal 11 and a network-side device 12. Terminal 11 can be a mobile phone, tablet computer, laptop computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, vehicle-mounted device (VUE), pedestrian terminal (PUE), smart home (home devices with wireless communication capabilities, such as refrigerators, televisions, washing machines, or furniture), game console, personal computer (PC), ATM, or self-service machine, etc. Wearable devices include: smartwatches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart chains, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. It should be noted that the specific type of terminal 11 is not limited in this embodiment. Network-side equipment 12 may include access network equipment or core network equipment. Access network equipment 12 may also be referred to as radio access network equipment, radio access network (RAN), radio access network function, or radio access network unit. Access network equipment 12 may include base stations, WLAN access points, or WiFi nodes, etc. Base stations may be referred to as Node B, evolved Node B (eNB), access point, base transceiver station (BTS), radio base station, radio transceiver, Basic Service Set (BSS), Extended Service Set (ESS), home B node, home evolved B node, Transmitting Receiving Point (TRP), or any other suitable term in the field, as long as the same technical effect is achieved. The base station is not limited to specific technical terms. It should be noted that in this application embodiment, only a base station in an NR system is used as an example for description, and the specific type of base station is not limited.Core network equipment may include, but is not limited to, at least one of the following: core network node, core network function, Mobility Management Entity (MME), Access and Mobility Management Function (AMF), Session Management Function (SMF), User Plane Function (UPF), Policy Control Function (PCF), Policy and Charging Rules Function (PCRF), Edge Application Server Discovery Function (EASDF), Unified Data Management (UDM), Unified Data Repository (UDR), Home Subscriber Server (HSS), Centralized network configuration (CNC), Network Repository Function (NRF), Network Exposure Function (NEF), Local NEF (or L-NEF), Binding Support Function (BSF), and Application Function. Function (AF), etc. It should be noted that the embodiments of this application only use the core network equipment in the NR system as an example for introduction, and do not limit the specific type of core network equipment.

[0061] First, let's introduce the following content:

[0062] Artificial intelligence (AI) has been widely applied in various fields. Integrating AI into wireless communication networks to significantly improve technical indicators such as throughput, latency, and user capacity is an important task for future wireless communication networks. AI modules can be implemented in various ways, such as neural networks, decision trees, support vector machines, or Bayesian classifiers. This application uses neural networks as an example for illustration, but does not limit the specific type of AI module.

[0063] Figure 2 This is a schematic diagram of the neural network provided in an embodiment of this application. Figure 3A schematic diagram of a neuron provided in an embodiment of this application, as shown below. Figure 2 and Figure 3 As shown, a neural network consists of neurons, where a1, a2, ..., aK are the inputs, w is the weight (multiplicative coefficient), b is the bias (additive coefficient), and σ(.) is the activation function. Common activation functions include Sigmoid, tanh, or ReLU (Rectified Linear Unit), etc.

[0064] The parameters of a neural network are optimized using gradient optimization algorithms. Gradient optimization algorithms are a class of algorithms that minimize or maximize an objective function (sometimes called a loss function), which is often a mathematical combination of model parameters and data. For example, given data X and its corresponding label Y, a neural network model f(.) can be constructed. With the model, the predicted output f(x) can be obtained from the input x, and the difference between the predicted value and the true value (f(x)-Y) can be calculated; this is the loss function. Suitable values ​​W and b can be found to minimize the value of the loss function. The smaller the loss value, the closer the model is to the reality.

[0065] Most common optimization algorithms are based on the BP (error back propagation) algorithm. The basic idea of ​​the BP algorithm is that the learning process consists of two parts: forward propagation of the signal and backward propagation of the error. During forward propagation, the input sample is introduced from the input layer, processed layer by layer by the hidden layers, and then propagated to the output layer. If the actual output of the output layer does not match the expected output, the process transitions to the error back propagation stage. Error back propagation involves propagating the output error back to the input layer layer by layer through the hidden layers, distributing the error to all units in each layer, thus obtaining the error signal of each unit. This error signal serves as the basis for adjusting the weights of each unit. This process of adjusting the weights through forward and backward propagation is cyclical. This continuous adjustment of weights is the learning and training process of the network. This process continues until the error of the network output is reduced to an acceptable level, or until the predetermined number of learning iterations is reached.

[0066] Common optimization algorithms include gradient descent, stochastic gradient descent (SGD), mini-batch gradient descent, momentum descent, Nesterov (named after the inventor, specifically stochastic gradient descent with momentum), Adagrad (Adaptive Gradient Descent), Adadelta, RMSprop (root mean square prop), or Adam (Adaptive Moment Estimation), etc.

[0067] During error backpropagation, these optimization algorithms calculate the gradient based on the error / loss obtained from the loss function with respect to the current neuron, add the learning rate and the effects of previous gradients / derivatives / partial derivatives, and then pass the gradient to the previous layer.

[0068] The measurement methods, apparatus, devices, and storage media provided in this application will be described in detail below with reference to the accompanying drawings and through some embodiments and application scenarios.

[0069] Figure 4 This is one of the flowcharts illustrating the measurement method provided in the embodiments of this application, such as... Figure 4 As shown, the method includes the following steps:

[0070] Step 401: The first communication device determines the measurement information required for the target measurement of the performance indication information;

[0071] Step 402: The first communication device uses a target artificial intelligence model to perform the target measurement based on the measurement information, and obtains the target measurement result of the target measurement;

[0072] Step 403: The first communication device sends first information to the second communication device;

[0073] The first information includes the target measurement results.

[0074] Optionally, the first communication device may be a terminal with an artificial intelligence model deployed or a network node with an artificial intelligence model deployed.

[0075] Optionally, the second communication device can be a network-side device;

[0076] Optionally, the second communication device may be a network node different from the first communication device;

[0077] For example, the second communication device can be a core network node, including NWDAF or LMF, etc.

[0078] For example, the second communication device can be a neural network processing node;

[0079] For example, the second communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0080] For example, there can be multiple second communication devices; or they can be a combination of the aforementioned multiple nodes.

[0081] Specifically, the interaction of performance indication information between the second communication device (such as a network entity) and the first communication device (such as a terminal or network node) is beneficial for the second communication device to monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0082] Therefore, the first communication device can use a target artificial intelligence model to perform target measurements on performance indication information and send the obtained target measurement results to the second communication device so that the second communication device can monitor the performance of the artificial intelligence model of the first communication device.

[0083] Optionally, before the first communication device performs the target measurement of the performance indication information, the first communication device may first determine the measurement information required for the target measurement of the performance indication information.

[0084] Optionally, after determining the measurement information, the first communication device may use a target artificial intelligence model to perform the target measurement based on the measurement information and obtain the target measurement result.

[0085] Optionally, after the first communication device obtains the target measurement result, it can report the target measurement result to the second communication device through the first information.

[0086] Optionally, the target artificial intelligence model may be pre-configured for the first communication device by a second or third communication device or other network-side device;

[0087] Optionally, the target artificial intelligence model may be trained by the first communication device itself.

[0088] Optionally, the third communication device may be a network-side device;

[0089] Optionally, the third communication device may be a network entity;

[0090] Optionally, the third communication device may be a network node;

[0091] Optionally, the third communication device may be the same as the second communication device;

[0092] Optionally, the third communication device may be a different communication device from the second communication device.

[0093] For example, the third communication device can be a core network node, including network data analytics function (NWDAF), location management function (LMF), etc.

[0094] For example, a third communication device can be a neural network processing node;

[0095] For example, the third communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0096] For example, there can be multiple third communication devices; or they can be a combination of the aforementioned multiple nodes.

[0097] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0098] Optionally, the first information may also include the measurement information.

[0099] Specifically, the first communication device can also report measurement information to the second communication device through the first information, so that the second communication device can know the relevant information when the target artificial intelligence model performs the target measurement;

[0100] Optionally, the target measurement results and measurement information can be reported simultaneously;

[0101] Optionally, the target measurement results and measurement information may not be reported simultaneously;

[0102] Optionally, the measurement information includes at least one of the following:

[0103] First indication information used to indicate the model category of the target artificial intelligence model;

[0104] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0105] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0106] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0107] Fifth indication information used to indicate the performance indication information;

[0108] Sixth indication information used to indicate the type of measurement for the target measurement;

[0109] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0110] Optionally, the measurement information may include first indication information for indicating the model category of the target artificial intelligence model;

[0111] Optionally, any information that can indicate the model category of the target artificial intelligence model can be used as the first indication information;

[0112] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly the model category of the target artificial intelligence model;

[0113] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly an identifier of the model category of the target artificial intelligence model;

[0114] Optionally, the measurement information may include second indication information for indicating the effectiveness of the target artificial intelligence model;

[0115] Optionally, any information that can indicate the effectiveness of the target artificial intelligence model can be used as the second indicative information;

[0116] Optionally, the second indication information used to indicate the effectiveness of the target artificial intelligence model can be directly the effectiveness of the target artificial intelligence model;

[0117] Optionally, the second indication information used to indicate the validity of the target artificial intelligence model can be directly an identifier of the validity of the target artificial intelligence model;

[0118] Optionally, the measurement information may include third indication information for indicating at least one measurement object;

[0119] Optionally, any information that can indicate at least one object being measured can be used as the first indication information;

[0120] Optionally, the third indication information used to indicate at least one measurement object can be directly at least one measurement object;

[0121] Optionally, the third indication information used to indicate at least one measurement object may be directly the identifier of each of the at least one measurement object;

[0122] Optionally, the measurement information may include fourth indication information, such as measurement timestamp information, to indicate the target measurement;

[0123] Optionally, any information that can provide a measurement timestamp to indicate the target measurement can be used as the first indication information;

[0124] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information of the target measurement;

[0125] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information identifier of the target measurement;

[0126] Optionally, the measurement information may include fifth indication information for indicating the performance indication information;

[0127] Optionally, any information that can indicate performance can be used as the fifth indication information;

[0128] Optionally, the fifth indication information used to indicate the performance indication information can be directly the performance indication information;

[0129] Optionally, the fifth indication information used to indicate the performance indication information can be directly identified by the performance indication information;

[0130] Optionally, the measurement information may also include sixth indication information for indicating the type of measurement of the target measurement;

[0131] Optionally, any information that can realize the measurement of the target can be used as the sixth indication information;

[0132] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly the measurement type of the target measurement;

[0133] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly an identifier of the measurement type of the target measurement;

[0134] Optionally, the measurement information may also include a seventh indication information for indicating the quantization method of the target measurement result;

[0135] Optionally, any information that can achieve a quantification method to indicate the measurement results of the target can be used as the seventh and sixth indication information;

[0136] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly the quantization method of the target measurement result;

[0137] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly an identifier of the quantization method of the target measurement result;

[0138] Optionally, the target measurement includes: measurement of the at least one measurement object;

[0139] For example, the target measurement for performance indication information could be the mean square error of the measurement; the target measurement could include the measurement of the object being measured, which could include channel state information, location information, or beam information, etc. Based on the measurement results of the measurement of the object being measured, the target measurement result for the target performance information is obtained.

[0140] Optionally, the model category of the target artificial intelligence model may include CNN, RNN, or Transformer, etc., and may also include the specific model of the target artificial intelligence model. For example, multiple RNN models may be deployed, and the specific model of the target artificial intelligence model may be a specific RNN model.

[0141] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including at least one of the following:

[0142] The first communication device determines the measurement information based on the instruction from the third communication device;

[0143] The first communication device determines the measurement information based on a predefined protocol;

[0144] The first communication device determines the measurement information based on pre-set parameters;

[0145] The first communication device determines the measurement information based on default measurement information.

[0146] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including any one or more of the following determination methods (a)-(d):

[0147] (a) The first communication device determines the measurement information based on an instruction from the third communication device; or

[0148] (b) The first communication device determines the measurement information based on a predefined protocol; or

[0149] (c) The first communication device determines the measurement information based on a pre-set configuration; or

[0150] (d) The first communication device determines the measurement information based on the default measurement information.

[0151] Specifically, the first communication device can determine the measurement information based on the instructions of the third communication device;

[0152] Optionally, the third communication device may be a network-side device;

[0153] Optionally, the third communication device may be a network entity;

[0154] Optionally, the third communication device may be a network node;

[0155] Optionally, the third communication device may be the same as the second communication device;

[0156] Optionally, the third communication device may be a different communication device from the second communication device.

[0157] For example, the third communication device can be a core network node, including NWDAF or LMF, etc.

[0158] For example, a third communication device can be a neural network processing node;

[0159] For example, the third communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0160] For example, there can be multiple third communication devices; or they can be a combination of the aforementioned multiple nodes.

[0161] Optionally, the first communication device determines the measurement information based on a predefined protocol;

[0162] Optionally, the first communication device determines the measurement information based on preset settings;

[0163] Optionally, the first communication device determines the measurement information based on default measurement information;

[0164] Optionally, when determining the measurement information, the first communication device may use any one of the determination methods (a)-(d) above;

[0165] Optionally, when determining the measurement information, the first communication device may use any of the determination methods described in (a)-(d) above, wherein each determination method determines a portion of the measurement information;

[0166] For example, at least one measurement object, the measurement timestamp information of the target measurement, and performance indication information can be determined based on the indication of a third communication device; the validity of the target artificial intelligence model and the model category of the target artificial intelligence model can be determined based on pre-set parameters.

[0167] For example, the measurement timestamp information of the target measurement can be determined based on the instruction of a third communication device; performance indication information, the validity of the target artificial intelligence model, the model category of the target artificial intelligence model, and at least one measurement object can be determined based on pre-set parameters; for example, the model category of the target artificial intelligence model and at least one measurement object can be determined based on a protocol pre-defined parameter; performance indication information, the measurement timestamp information of the target measurement, and the validity of the target artificial intelligence model can be determined based on pre-set parameters.

[0168] Optionally, the priority of the determination methods corresponding to (a)-(d) can also be determined. When two or more determination methods determine the same measurement information at the same time, the specific measurement information to be used can be determined based on the priority.

[0169] For example, the priority order of the determination methods corresponding to (a)-(d) is (a) > (b) > (c) > (d), where the higher the order, the higher the priority. If the third communication device indicates that the model category of the target artificial intelligence model is category CNN, and the protocol predefines the model category of the target artificial intelligence model as category RNN, since the priority of the determination method corresponding to the instruction of the third communication device is higher than the determination method corresponding to the predefined protocol, the model category of the target artificial intelligence model can be determined to be category CNN.

[0170] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including:

[0171] The first communication device determines the model category of the target artificial intelligence model;

[0172] The first communication device determines the at least one measurement object based on the first association relationship and the model category;

[0173] The first association relationship is used to indicate the association relationship between the at least one measurement object and the model category.

[0174] Optionally, there can be a correlation between the measurement object and the model category of the target artificial intelligence model;

[0175] Optionally, the first communication device may first determine the model category of the target artificial intelligence model, and then determine at least one measurement object associated with the model category;

[0176] Optionally, the association between the model category and the measurement object can be a first association, which can be pre-set, indicated by the network-side device, indicated by the third communication device, or predefined by the protocol. This application embodiment does not limit this.

[0177] For example, the target AI model can be an RNN model, and the measurement object can include CSI, meaning the target measurement can include CSI prediction.

[0178] Optionally, the target artificial intelligence model and the performance indicator information can be associated; the association between the target artificial intelligence model and the performance indicator information can be a second association, which can be pre-set, indicated by a network-side device, indicated by a third communication device, or predefined by a protocol. This application embodiment does not limit this.

[0179] For example, if the target artificial intelligence model is an AI-based CSI estimation model, then it is necessary to measure the performance indicator information of the AI-based CSI estimation model. The performance indicator information associated with this model can be preset as the mean squared error.

[0180] Optionally, there may be no pre-defined association between the target artificial intelligence model and the performance indication information. After determining the target artificial intelligence model, the performance indication information may be further determined based on the indications of the second or third communication device or network-side device.

[0181] For example, if the target artificial intelligence model is an AI-based CSI estimation model, then it is necessary to measure the performance indication information of the AI-based CSI estimation model. The performance indication information associated with this model can be determined as the mean square error based on the indications of a second communication device, a third communication device, or a network-side device.

[0182] Optionally, the measurement type includes at least one of the following:

[0183] Periodic measurement; semi-periodic measurement; non-periodic measurement.

[0184] Optionally, the measurement type may include any one or more of the following:

[0185] Periodic measurement; or semi-periodic measurement; or non-periodic measurement.

[0186] Optionally, if the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

[0187] Optionally, if the target measurement is a periodic measurement, the measurement timestamp information may include the first measurement period corresponding to the target measurement;

[0188] Optionally, the first communication device may periodically perform target measurements based on a first measurement cycle, such as the measurement window running once every 10ms.

[0189] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement;

[0190] The first reference time includes at least one of the following:

[0191] The first communication device determines the time of the measurement information;

[0192] The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer;

[0193] The m-th time unit in the first measurement cycle and / or the second measurement cycle, wherein the first measurement cycle and / or the second measurement cycle is the reporting cycle corresponding to the first communication device sending the first information to the second communication device, and m is a positive integer;

[0194] The measurement time of historical measurements;

[0195] The historical measurement information and the reporting time of the measurement results;

[0196] The first relative time of the historical reference signal corresponding to the historical measurement.

[0197] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first absolute time corresponding to the target measurement;

[0198] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first relative time corresponding to the target measurement;

[0199] Optionally, the first relative time may include a first relative time relative to a first reference time;

[0200] Optionally, the first reference information may include any one or more of the following:

[0201] The first communication device determines the timing of the measurement information, such as by measuring at a specific time unit after receiving an indication of the measurement type; or

[0202] The third communication device indicates the measurement information at the nth time unit, where n is a positive integer. For example, the first communication device can perform the measurement at the nth time unit after the third communication device indicates the measurement type; or

[0203] The measurement time of historical measurements, such as when the first communication device can perform the measurement at a point after a first preset time period has elapsed relative to the measurement time of a certain historical measurement; or

[0204] The reporting time of the historical measurement information and results can be specified, for example, the first communication device can perform the measurement at a point after a second preset time period has elapsed since the reporting time of a certain historical measurement; or

[0205] The first relative time of the historical reference signal corresponding to the historical measurement can be measured by the first communication device at a time when the transmission time of a certain historical reference signal has passed a third preset time period.

[0206] Optionally, the time units for the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement may include common communication time units such as TTI, symbol, slot, frame, subframe, radio frame, second, minute, hour, day, or month.

[0207] Optionally, the time unit may include a reference signal period or prediction period or a time unit or half-time unit or a symbol (OFDM symbol) or a subframe or radio frame or a millisecond or second, etc.

[0208] Optionally, the measurement timestamp information includes the training period of the target artificial intelligence model.

[0209] Optionally, the timestamp information may also include the training period of the target AI model, to instruct the first communication device to train the target AI model based on the training period;

[0210] The training period can include a relative period and / or an absolute period;

[0211] For example, when the training period includes a relative period, it can mean training E epochs with a batch size of B.

[0212] For example, when the training period includes the absolute period, it can mean training S time units or F frames, etc.

[0213] Optionally, the first communication device employs a target artificial intelligence model to perform the target measurement based on the measurement information, including at least one of the following:

[0214] When the measurement type includes periodic measurement, the target measurement is performed based on the first measurement cycle of the periodic measurement;

[0215] When the measurement type includes periodic measurement, the target measurement is performed based on the error measurement window information of the periodic measurement; wherein, the error measurement window information includes the window start time position and / or window duration information;

[0216] When the measurement type includes a semi-periodic measurement, the target measurement is performed based on the second measurement cycle of the semi-periodic measurement;

[0217] When the measurement type includes semi-periodic or non-periodic measurements, the target measurement is performed based on a burst measurement indication;

[0218] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively performs the target measurement.

[0219] Optionally, when the measurement type includes periodic measurement, the first communication device employs a target artificial intelligence model to perform the target measurement based on the measurement information. Specifically, this may include performing the target measurement based on a first measurement cycle of the periodic measurement.

[0220] Optionally, when the measurement type includes periodic measurement, the first communication device employs a target artificial intelligence model to perform the target measurement based on the measurement information. Specifically, this may include performing the target measurement based on the error measurement window information of the periodic measurement; wherein the error measurement window information includes the window start time position and / or window duration information.

[0221] Optionally, when the measurement type includes a semi-periodic measurement, the first communication device employs a target artificial intelligence model to perform the target measurement based on the measurement information. Specifically, this may include performing the target measurement based on a second measurement cycle of the semi-periodic measurement.

[0222] Optionally, when the measurement type includes semi-periodic measurement or non-periodic measurement, the first communication device uses a target artificial intelligence model to perform the target measurement based on the measurement information, which may specifically include: performing the target measurement based on a burst measurement indication;

[0223] Optionally, when the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device uses a target artificial intelligence model to perform the target measurement based on the measurement information, which may specifically include: the first communication device actively performing the target measurement.

[0224] Optionally, the periodic measurement may include the first communication device periodically triggering the target measurement based on a first measurement period, such as measuring once every 10ms;

[0225] Optionally, the semi-periodic reporting may include the first communication device periodically triggering target measurement based on the second measurement period, and may also perform target measurement when receiving a sudden measurement indication and / or triggering active measurement;

[0226] Optionally, non-periodic reporting may include the first communication device not performing periodic measurements;

[0227] Optionally, non-periodic reporting may include a first communication device performing target measurements when it receives a burst measurement indication and / or triggers an active measurement.

[0228] Optionally, the first communication device determines the measurement information based on an instruction from the third communication device, including:

[0229] If the indication from the third communication device includes periodic measurement trigger information, then the measurement type is determined to include the periodic measurement.

[0230] The periodic measurement trigger information includes at least one of the following:

[0231] First measurement type indication information, which is used to directly indicate that the measurement type includes the periodic measurement;

[0232] The error measurement window information of the periodic measurement;

[0233] The first measurement cycle of the periodic measurement.

[0234] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the periodic measurement by indicating periodic measurement trigger information;

[0235] Specifically, the periodic measurement trigger information includes one or more of the following:

[0236] First measurement type indication information, which is used to directly indicate that the measurement type includes the periodic measurement; or

[0237] The error measurement window information of the periodic measurement; or

[0238] The first measurement cycle of the periodic measurement.

[0239] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may directly indicate to the first communication device that the measurement type includes the periodic measurement by indicating a first measurement type indication information;

[0240] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate to the first communication device that the measurement type includes the periodic measurement by indicating error measurement window information of the periodic measurement; and the first communication device may obtain the error measurement window of the periodic measurement while determining that the measurement type includes the periodic measurement.

[0241] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the periodic measurement by indicating a first measurement period of the periodic measurement; the first communication device may know the first measurement period at the same time as determining that the measurement type includes the periodic measurement.

[0242] Optionally, the first communication device determines the measurement information based on an instruction from the third communication device, including:

[0243] If the indication from the third communication device includes half-periodic measurement trigger information, it is determined that the measurement type includes the half-periodic measurement;

[0244] The semi-periodic measurement trigger information includes at least one of the following:

[0245] Second measurement type indication information, which is used to directly indicate that the measurement type includes the semi-periodic measurement;

[0246] The second measurement period of the semi-periodic measurement;

[0247] Emergency measurement indication.

[0248] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the half-periodic measurement by indicating a half-periodic measurement trigger information;

[0249] Specifically, the semi-periodic measurement trigger information includes one or more of the following:

[0250] Second measurement type indication information, which is used to directly indicate that the measurement type includes the semi-periodic measurement; or

[0251] The second measurement period of the semi-periodic measurement; or

[0252] Emergency measurement indication.

[0253] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may directly indicate to the first communication device that the measurement type includes the semi-periodic measurement by indicating a second measurement type indication information;

[0254] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the semi-periodic measurement by indicating the second measurement period of the semi-periodic measurement; the first communication device may know the second measurement period at the same time as determining that the measurement type includes the semi-periodic measurement.

[0255] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate to the first communication device that the measurement type includes the semi-periodic measurement by indicating a burst measurement instruction; and the first communication device may know that a burst measurement is to be performed upon determining that the measurement type includes the semi-periodic measurement.

[0256] Optionally, semi-periodic measurement can refer to measurement based on a second measurement period, and also to burst measurement based on a received burst measurement indication.

[0257] Optionally, the burst measurement indication may include a bit portion indicating that the measurement type includes the semi-periodic measurement;

[0258] Optionally, the burst measurement indication may not include any content indicating that the measurement type includes the semi-periodic measurement. In this case, the first communication device needs to receive the second measurement type indication information and / or the second measurement cycle of the semi-periodic measurement first or simultaneously to determine that the measurement type includes the non-periodic measurement.

[0259] Optionally, the first communication device determines the measurement information based on an instruction from the third communication device, including:

[0260] If the indication from the third communication device includes non-periodic measurement trigger information, it is determined that the measurement type includes the non-periodic measurement.

[0261] The non-periodic measurement trigger information includes at least one of the following:

[0262] Third measurement type indication information, the third measurement type indication information being used to indicate that the measurement type includes the non-periodic measurement;

[0263] Emergency measurement indication.

[0264] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the non-periodic measurement by indicating non-periodic measurement trigger information;

[0265] Specifically, the non-periodic measurement trigger information includes one or more of the following:

[0266] Third measurement type indication information, the third measurement type indication information being used to indicate that the measurement type includes the non-periodic measurement; or

[0267] Emergency measurement indication.

[0268] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may directly indicate to the first communication device that the measurement type includes the non-periodic measurement by indicating a third measurement type indication information;

[0269] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may indicate to the first communication device that the measurement type includes the non-periodic measurement by indicating a burst measurement instruction; the first communication device may know that a burst measurement is to be performed when it determines that the measurement type includes the non-periodic measurement.

[0270] Alternatively, non-periodic measurement may be that the first communication device does not perform periodic target measurements.

[0271] Optionally, the burst measurement indication may include a bit portion indicating that the measurement type includes the non-periodic measurement;

[0272] Optionally, the burst measurement indication may not include any content indicating that the measurement type includes the non-periodic measurement. In this case, the first communication device needs to receive the third measurement type indication information first or simultaneously to determine that the measurement type includes the non-periodic measurement.

[0273] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including at least one of the following:

[0274] If the first communication device determines that the performance indication information includes real-time performance indication information, it determines that the target measurement includes real-time measurement;

[0275] If the first communication device determines that the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, then the target measurement includes statistical measurement.

[0276] Optionally, the performance indication information may include real-time performance indication information;

[0277] Optionally, the real-time performance indication information can be performance indication information for one or more predefined measurement time points or measurement locations;

[0278] Optionally, the performance indication information may include statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0279] Optionally, the performance indication information may include real-time performance indication information and statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0280] Optionally, when the performance indication information includes real-time performance indication information, the target measurement includes real-time measurement for one or more predefined measurement time points or measurement locations;

[0281] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement includes measurement and statistics for multiple consecutive measurement time points or multiple consecutive measurement locations.

[0282] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on the category of performance indication information.

[0283] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria acquired along with the performance indication information;

[0284] Optionally, the first communication device can determine whether the target measurement is an instantaneous measurement or a statistical measurement based on a preset measurement criterion;

[0285] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria predefined in the protocol.

[0286] Optionally, the real-time performance indication information includes at least one of the following:

[0287] The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements;

[0288] The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following:

[0289] Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

[0290] Optionally, real-time performance indication information may include the following two types: (e)-(f)

[0291] (e) First type: Model instantaneous errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE) and other model-related performance metrics; and distance performance instantaneous metrics, such as cosine distance and other distance-related performance metrics.

[0292] (f) Second type: Real-time indicators of communication performance, such as real-time SNR, SINR, packet error rate, outage probability, or cell / beam handover probability.

[0293] Optionally, the statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations may include the following two types (g)-(h):

[0294] (g) The third type: model statistical errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE); and distance performance statistics, such as the statistical values ​​of performance metrics like cosine distance, such as mean, variance, or 90% CDF.

[0295] (h) Fourth type: Statistical indicators of communication performance, such as SNR, SINR, packet error rate, outage probability, or cell / beam switching probability, such as mean, variance, or 90% CDF.

[0296] Optionally, if the performance indication information includes real-time performance indication information, the target measurement result includes the real-time result of the real-time measurement;

[0297] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement result includes the statistical result of the statistical measurement.

[0298] Optionally, the quantization method includes at least one of the following:

[0299] The error quantization precision in the target measurement result is specified in bits.

[0300] The error level of the target measurement result.

[0301] Optionally, the quantification method may include any one or more of the following:

[0302] The precision of the error quantization of the target measurement result is specified in decimal places. For example, if the measurement error is accurate to the tenths place, then 10.11 is quantized as 10.1; or

[0303] The error levels of the target measurement results are categorized as follows: for example, a channel estimation error of less than -30dB is considered level 1, -30dB to -20dB is considered level 1, and so on.

[0304] Optionally, the first communication device sends first information to the second communication device, including:

[0305] The first communication device determines the reporting method;

[0306] The first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information;

[0307] The reporting methods include:

[0308] Periodic reporting;

[0309] Semi-periodic reporting;

[0310] Non-periodic reporting.

[0311] Optionally, the first communication device may first determine the reporting method, and then send the first information to the second communication device based on the reporting method.

[0312] Optionally, the reporting method may include any one or more of the following:

[0313] Periodic reporting; or

[0314] Semi-periodic reporting; or

[0315] Non-periodic reporting.

[0316] Optionally, if the reporting method includes periodic reporting, the first communication device may periodically send the first information to the second communication device;

[0317] Optionally, if the reporting method includes semi-periodic reporting, the first communication device may send the first information to the second communication device semi-periodicly;

[0318] Optionally, if the reporting method includes non-periodic reporting, the first communication device may send the first information to the second communication device non-periodicly.

[0319] Optionally, the first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information, including at least one of the following:

[0320] When the reporting method includes periodic reporting, the first information is sent to the second communication device based on the first reporting period of the periodic reporting;

[0321] When the reporting method includes semi-periodic reporting, the first information is sent to the second communication device based on the second reporting period of the semi-periodic reporting;

[0322] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first information is sent to the second communication device based on the burst reporting instruction;

[0323] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively sends the first information to the second communication device.

[0324] Optionally, when the reporting method includes periodic reporting, the first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information, which may specifically include: sending the first information to the second communication device based on the first reporting period of the periodic reporting;

[0325] Optionally, when the reporting method includes semi-periodic reporting, the first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information, which may specifically include: sending the first information to the second communication device based on the second reporting period of the semi-periodic reporting;

[0326] Optionally, when the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information, which may specifically include: sending the first information to the second communication device based on a burst reporting instruction;

[0327] Optionally, when the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information. Specifically, this may include the first communication device actively sending the first information to the second communication device.

[0328] Optionally, periodic reporting may include the first communication device periodically triggering the first information reporting based on a first reporting period, such as reporting once every 10ms;

[0329] Optionally, the semi-periodic reporting may include the first communication device periodically triggering the reporting of the first information based on the second reporting period, and may also report the first information when receiving a sudden reporting instruction and / or triggering active reporting.

[0330] Optionally, non-periodic reporting may include the first communication device not performing periodic reporting;

[0331] Optionally, non-periodic reporting may include the first communication device reporting first information when it receives a sudden reporting instruction and / or triggers an active reporting situation.

[0332] Optionally, the first communication device actively sends the first information to the second communication device, including:

[0333] If the target measurement result is greater than the first threshold, the first communication device actively sends the first information to the second communication device;

[0334] The first threshold is either preset, predefined by the protocol, or indicated by a third communication device.

[0335] Optionally, if the target measurement result is greater than the first threshold, the terminal may proactively report the first information to the second communication device;

[0336] Optionally, the first threshold may be preset, predefined by the protocol, or indicated by a third communication device.

[0337] Optionally, the first communication device determines the reporting method, including at least one of the following:

[0338] The first communication device determines the reporting method based on the instruction from the third communication device;

[0339] The first communication device determines the reporting method based on a predefined protocol;

[0340] The first communication device determines the reporting method based on preset settings;

[0341] The first communication device determines the reporting method for the first information based on the default reporting method.

[0342] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including any one or more of the following determination methods (i)-(l):

[0343] (i) The first communication device determines the reporting method based on the instruction of the third communication device; or

[0344] (j) The first communication device determines the reporting method based on a predefined protocol; or

[0345] (k) The first communication device determines the reporting method based on a pre-set configuration; or

[0346] (l) The first communication device determines the reporting method of the first information based on the default reporting method.

[0347] Specifically, the first communication device can determine the reporting method based on the instruction of the third communication device;

[0348] Optionally, the third communication device may be a network-side device;

[0349] Optionally, the third communication device may be a network entity;

[0350] Optionally, the third communication device may be a network node;

[0351] Optionally, the third communication device may be the same as the second communication device;

[0352] Optionally, the third communication device may be a different communication device from the second communication device.

[0353] Optionally, the first communication device may determine the reporting method based on a predefined protocol;

[0354] Optionally, the first communication device may determine the reporting method based on preset settings;

[0355] Optionally, the first communication device may determine the reporting method of the first information based on the default reporting method;

[0356] Optionally, when determining the reporting method, the first communication device may use any one of the methods (i)-(l) above;

[0357] Optionally, when determining the reporting method, the first communication device may use any of the above-mentioned (i)-(l) determination methods. The priority of the determination methods corresponding to (i)-(l) can be determined. When two or more determination methods determine the same measurement information at the same time, the specific measurement information to be used can be determined based on the priority.

[0358] For example, the priority order of the determination methods corresponding to (i)-(l) is (i) < (j) < (k) < (l), where the higher the order, the higher the priority. If the third communication device indicates that the reporting method is periodic reporting, and the protocol predefines the reporting method as non-periodic reporting, since the priority of the determination method corresponding to the indication of the third communication device is lower than the determination method corresponding to the protocol predefinement, it can be determined that the reporting method is non-periodic reporting.

[0359] Optionally, the first communication device determines the reporting method based on an instruction from the third communication device, including:

[0360] If the indication from the third communication device includes periodic reporting trigger information, then the reporting method is determined to include the periodic reporting.

[0361] The periodically reported trigger information includes at least one of the following:

[0362] First reporting method indication information, the first reporting method indication information is used to directly indicate that the reporting method includes the periodic reporting;

[0363] The first reporting period of the periodic reporting.

[0364] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may instruct the first communication device to include the periodic reporting method by instructing the periodic reporting of trigger information.

[0365] Specifically, the periodic reporting trigger information includes at least one of the following:

[0366] First reporting method indication information, the first reporting method indication information is used to directly indicate that the reporting method includes the periodic reporting; or

[0367] The first reporting period of the periodic reporting.

[0368] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may directly instruct the first communication device that the reporting method includes the periodic reporting by instructing the first reporting method instruction information;

[0369] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate that the reporting method of the first communication device includes the periodic reporting by indicating a first reporting period; the first communication device may know the first reporting period at the same time as determining that the reporting method includes the periodic reporting.

[0370] Optionally, the first communication device determines the reporting method based on an instruction from the third communication device, including:

[0371] If the indication from the third communication device includes semi-periodic reporting trigger information, then the reporting method is determined to include the semi-periodic reporting.

[0372] The semi-periodic reporting trigger information includes at least one of the following:

[0373] Second reporting method indication information, the second reporting method indication information is used to indicate that the reporting method includes the semi-periodic reporting;

[0374] The second reporting period of the semi-periodic reporting;

[0375] The emergency reporting instructions.

[0376] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may instruct the first communication device to include the semi-periodic reporting in the reporting method by instructing the semi-periodic reporting trigger information.

[0377] Specifically, the semi-periodic reporting trigger information includes at least one of the following:

[0378] Second reporting method indication information, the second reporting method indication information is used to indicate that the reporting method includes the semi-periodic reporting; or

[0379] The second reporting period of the semi-periodic reporting; or

[0380] The emergency reporting instructions.

[0381] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may directly instruct the first communication device that the reporting method includes the semi-periodic reporting by instructing the second reporting method instruction information;

[0382] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate that the reporting method of the first communication device includes the semi-periodic reporting by indicating a second reporting period of semi-periodic reporting; the first communication device may know the second reporting period at the same time as determining that the reporting method includes the semi-periodic reporting.

[0383] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate that the reporting method of the first communication device includes the semi-periodic reporting by indicating a burst reporting instruction; and the first communication device may know that a burst reporting is required when it determines that the reporting method includes the semi-periodic reporting.

[0384] Optionally, the burst reporting indication may include a bit portion indicating that the reporting method includes semi-periodic reporting;

[0385] Optionally, the emergency reporting instruction may not include any content indicating that the reporting method includes semi-periodic reporting. In this case, the first communication device needs to first receive the second reporting method instruction information and / or the second reporting period of semi-periodic reporting to determine whether the reporting method includes semi-periodic reporting.

[0386] Optionally, the first communication device determines the reporting method based on an instruction from the third communication device, including:

[0387] If the indication from the third communication device includes non-periodic reporting trigger information, then the reporting method is determined to include the non-periodic reporting.

[0388] The semi-periodic reporting trigger information includes at least one of the following:

[0389] The third reporting method indication information is used to directly indicate that the reporting method includes the non-periodic reporting;

[0390] The emergency reporting instructions.

[0391] Optionally, the first communication device may receive an instruction from the third communication device; wherein the third communication device may instruct the first communication device to include the non-periodic reporting method by instructing non-periodic reporting trigger information.

[0392] Specifically, the non-periodic reporting trigger information includes at least one of the following:

[0393] The third reporting method indication information is used to directly indicate that the reporting method includes the non-periodic reporting; or

[0394] The emergency reporting instructions.

[0395] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may directly instruct the first communication device that the reporting method includes the non-periodic reporting by instructing the third reporting method instruction information;

[0396] Optionally, the first communication device may receive an instruction from the third communication device; wherein, the third communication device may indicate that the reporting method of the first communication device includes the non-periodic reporting by indicating a burst reporting instruction; the first communication device may know that a burst reporting is required when it determines that the reporting method includes the non-periodic reporting.

[0397] Optionally, the burst reporting indication may include a bit portion indicating that the reporting method includes non-periodic reporting;

[0398] Optionally, the emergency reporting instruction may not include any content indicating that the reporting method includes non-periodic reporting. In this case, the first communication device needs to first receive the second reporting method instruction information and / or the second reporting period of semi-periodic reporting to determine whether the reporting method includes non-periodic reporting.

[0399] Optionally, when the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information includes the second absolute time and / or the second relative time relative to the second reference time of the first information reporting;

[0400] The second reference time includes at least one of the following:

[0401] The first communication device determines the time of the measurement information;

[0402] The third communication device indicates the p-th time unit after the time of the measurement information, where p is a positive integer;

[0403] The qth time unit in the first reporting cycle and / or the second reporting cycle, where q is a positive integer;

[0404] The reporting time of the first historical information;

[0405] The reception time of the historical reference signal;

[0406] The transmission time of the historical reference signal.

[0407] Optionally, when the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information may include the second absolute time corresponding to the first information reporting;

[0408] Optionally, when the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information may include the second relative time corresponding to the first information reporting;

[0409] Optionally, the second relative time may include a second relative time relative to the second reference time;

[0410] Optionally, the second reference information may include any one or more of the following:

[0411] The time at which the first communication device determines the measurement information may be a second relative time, such as a time after the first communication device determines the measurement information; or

[0412] The p-th time unit following the time when the third communication device indicates the measurement information, where p is a positive integer, can be a second relative time relative to the p-th time unit after the time when the third communication device indicates the measurement information, such as a certain moment after the p-th time unit after the time when the third communication device indicates the measurement information; or

[0413] The q-th time unit in the first reporting cycle and / or the second reporting cycle, where q is a positive integer, can be a second relative time relative to the q-th time unit in the first reporting cycle and / or the second reporting cycle, such as a time after the q-th time unit in the first reporting cycle and / or the second reporting cycle; or

[0414] The reporting time of the first historical information report can be a second relative time, such as a time after the first historical information report; or

[0415] The reception time of the historical reference signal can be, for example, a second relative time to the reception time of the historical reference signal, such as a time after the reception time of the historical reference signal; or

[0416] The transmission time of the historical reference signal can be, for example, a second relative time relative to the transmission time of the historical reference signal, such as a time after the transmission time of the historical reference signal.

[0417] Optionally, the historical reference signal can be a previously transmitted synchronization signal block (SSB), CSI-RS, sounding reference signal (SRS), etc.

[0418] Optionally, the time units of the second absolute time and / or the second relative time relative to the second reference time corresponding to the first information report may include common communication time units such as TTI, symbol, slot, frame, subframe, radio frame, second, minute, hour, day, month, etc.

[0419] Optionally, the time unit may include a reference signal period or prediction period or a time unit or half-time unit or a symbol (OFDM symbol) or a subframe or radio frame or a millisecond or second, etc.

[0420] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including:

[0421] The first communication device determines the comparison result between the performance of the target artificial intelligence model and the performance threshold;

[0422] Based on the comparison results, the first communication device determines the validity indication information of the target artificial intelligence model.

[0423] Optionally, the first communication device can compare the performance of the target artificial intelligence model with its performance threshold and determine the comparison result;

[0424] Optionally, after determining the comparison result, the first communication device may determine the validity indication information of the target artificial intelligence model based on the comparison result; for example, if the comparison result is that the performance of the target artificial intelligence model is greater than or equal to the performance threshold, then the validity indication information of the target artificial intelligence model is determined to include validity; for example, if the comparison result is that the performance of the target artificial intelligence model is less than the performance threshold, then the validity indication information of the target artificial intelligence model is determined to include invalidity.

[0425] Optionally, the first information includes measurement information of at least one of the target measurements and target measurement results of each of the at least one target measurement.

[0426] Optionally, the first information may include at least one target measurement result for each of the target measurements;

[0427] Optionally, the first information may include measurement information of at least one of the target measurements and target measurement results of each of the at least one target measurement;

[0428] For example, a single report can include measurement information and results for multiple performance indicators, such as those for different models, those for different training iterations of the same model, and those for different measurement times of the same model.

[0429] Optionally, the method further includes:

[0430] The first communication device determines the transmission resources for the first information based on the resource allocation information of the third communication device.

[0431] The transmission resources include at least one of the following:

[0432] Time resource information;

[0433] Frequency resource information;

[0434] Antenna port information;

[0435] Beam indication information.

[0436] Optionally, the first communication device may determine the transmission resources of the first information based on the resource allocation information of the third communication device, and complete the transmission of the first information based on the transmission resources of the first information;

[0437] The transmission resources include at least one of the following:

[0438] Time resource information; or

[0439] Frequency resource information; or

[0440] Antenna port information; or

[0441] Beam indication information.

[0442] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0443] Figure 5 This is a second schematic flowchart of the measurement method provided in the embodiments of this application, as shown below. Figure 5 As shown, the method includes the following steps:

[0444] Step 501: The third communication device instructs the first communication device on the measurement information required for the target measurement of the performance indication information.

[0445] Optionally, the third communication device may be a network-side device;

[0446] Optionally, the third communication device may be a network entity;

[0447] Optionally, the third communication device may be a network node;

[0448] Optionally, the third communication device may be the same as the second communication device;

[0449] Optionally, the third communication device may be a different communication device from the second communication device.

[0450] For example, the third communication device can be a core network node, including NWDAF or LMF, etc.

[0451] For example, a third communication device can be a neural network processing node;

[0452] For example, the third communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0453] For example, there can be multiple third communication devices; or they can be a combination of the aforementioned multiple nodes.

[0454] Specifically, the third communication device can instruct the first communication device on the measurement information required for the target measurement of the performance indication information; after obtaining the measurement information, the first communication device can use the target artificial intelligence model to perform the target measurement of the performance indication information and send the obtained target measurement results to the second communication device so that the second communication device can monitor the performance of the artificial intelligence model of the first communication device.

[0455] Once the first communication device determines the measurement information, it can use a target artificial intelligence model to perform the target measurement based on the measurement information and obtain the target measurement result.

[0456] Optionally, after the first communication device obtains the target measurement result, it can report the target measurement result to the second communication device through the first information.

[0457] Optionally, the target artificial intelligence model may be pre-configured for the first communication device by a second or third communication device or other network-side device;

[0458] Optionally, the target artificial intelligence model may be trained by the first communication device itself.

[0459] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0460] Optionally, the measurement information includes at least one of the following:

[0461] First indication information used to indicate the model category of the target artificial intelligence model;

[0462] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0463] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0464] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0465] Fifth indication information used to indicate the performance indication information;

[0466] Sixth indication information used to indicate the type of measurement for the target measurement;

[0467] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0468] Optionally, the measurement information may include first indication information for indicating the model category of the target artificial intelligence model;

[0469] Optionally, any information that can indicate the model category of the target artificial intelligence model can be used as the first indication information;

[0470] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly the model category of the target artificial intelligence model;

[0471] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly an identifier of the model category of the target artificial intelligence model;

[0472] Optionally, the measurement information may include second indication information for indicating the effectiveness of the target artificial intelligence model;

[0473] Optionally, any information that can indicate the effectiveness of the target artificial intelligence model can be used as the second indicative information;

[0474] Optionally, the second indication information used to indicate the effectiveness of the target artificial intelligence model can be directly the effectiveness of the target artificial intelligence model;

[0475] Optionally, the second indication information used to indicate the validity of the target artificial intelligence model can be directly an identifier of the validity of the target artificial intelligence model;

[0476] Optionally, the measurement information may include third indication information for indicating at least one measurement object;

[0477] Optionally, any information that can indicate at least one object being measured can be used as the first indication information;

[0478] Optionally, the third indication information used to indicate at least one measurement object can be directly at least one measurement object;

[0479] Optionally, the third indication information used to indicate at least one measurement object may be directly the identifier of each of the at least one measurement object;

[0480] Optionally, the measurement information may include fourth indication information, such as measurement timestamp information, to indicate the target measurement;

[0481] Optionally, any information that can provide a measurement timestamp to indicate the target measurement can be used as the first indication information;

[0482] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information of the target measurement;

[0483] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information identifier of the target measurement;

[0484] Optionally, the measurement information may include fifth indication information for indicating the performance indication information;

[0485] Optionally, any information that can indicate performance can be used as the fifth indication information;

[0486] Optionally, the fifth indication information used to indicate the performance indication information can be directly the performance indication information;

[0487] Optionally, the fifth indication information used to indicate the performance indication information can be directly identified by the performance indication information;

[0488] Optionally, the measurement information may also include sixth indication information for indicating the type of measurement of the target measurement;

[0489] Optionally, any information that can realize the measurement of the target can be used as the sixth indication information;

[0490] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly the measurement type of the target measurement;

[0491] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly an identifier of the measurement type of the target measurement;

[0492] Optionally, the measurement information may also include a seventh indication information for indicating the quantization method of the target measurement result;

[0493] Optionally, any information that can achieve a quantification method to indicate the measurement results of the target can be used as the seventh and sixth indication information;

[0494] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly the quantization method of the target measurement result;

[0495] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly an identifier of the quantization method of the target measurement result;

[0496] Optionally, the target measurement includes: measurement of the at least one measurement object;

[0497] For example, the target measurement for performance indication information could be the mean square error of the measurement; the target measurement could include the measurement of the object being measured, which could include channel state information, location information, or beam information, etc. Based on the measurement results of the measurement of the object being measured, the target measurement result for the target performance information is obtained.

[0498] Optionally, the model category of the target artificial intelligence model may include CNN, RNN, or Transformer, etc., and may also include the specific model of the target artificial intelligence model. For example, multiple RNN models may be deployed, and the specific model of the target artificial intelligence model may be a specific RNN model.

[0499] Optionally, the measurement type includes at least one of the following:

[0500] Periodic measurement; semi-periodic measurement; non-periodic measurement.

[0501] Optionally, the measurement type may include any one or more of the following:

[0502] Periodic measurement; or semi-periodic measurement; or non-periodic measurement.

[0503] Optionally, if the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

[0504] Optionally, if the target measurement is a periodic measurement, the measurement timestamp information may include the first measurement period corresponding to the target measurement;

[0505] Optionally, the first communication device may periodically perform target measurements based on a first measurement cycle, such as the measurement window running once every 10ms.

[0506] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement;

[0507] The first reference time includes at least one of the following:

[0508] The first communication device determines the time of the measurement information;

[0509] The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer;

[0510] The m-th time unit in the first measurement cycle and / or the second measurement cycle, wherein the first measurement cycle and / or the second measurement cycle is the reporting cycle corresponding to the first communication device sending the first information to the second communication device, and m is a positive integer;

[0511] The measurement time of historical measurements;

[0512] The historical measurement information and the reporting time of the measurement results;

[0513] The first relative time of the historical reference signal corresponding to the historical measurement.

[0514] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first absolute time corresponding to the target measurement;

[0515] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first relative time corresponding to the target measurement;

[0516] Optionally, the first relative time may include a first relative time relative to a first reference time;

[0517] Optionally, the first reference information may include any one or more of the following:

[0518] The first communication device determines the timing of the measurement information, such as by measuring at a specific time unit after receiving an indication of the measurement type; or

[0519] The third communication device indicates the measurement information at the nth time unit, where n is a positive integer. For example, the first communication device can perform the measurement at the nth time unit after the third communication device indicates the measurement type; or

[0520] The measurement time of historical measurements, such as when the first communication device can perform the measurement at a point after a first preset time period has elapsed relative to the measurement time of a certain historical measurement; or

[0521] The reporting time of the historical measurement information and results can be specified, for example, the first communication device can perform the measurement at a point after a second preset time period has elapsed since the reporting time of a certain historical measurement; or

[0522] The first relative time of the historical reference signal corresponding to the historical measurement can be measured by the first communication device at a time when the transmission time of a certain historical reference signal has passed a third preset time period.

[0523] Optionally, the time units for the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement may include common communication time units such as TTI, symbol, slot, frame, subframe, radio frame, second, minute, hour, day, or month.

[0524] Optionally, the time unit may include a reference signal period or prediction period or a time unit or half-time unit or a symbol (OFDM symbol) or a subframe or radio frame or a millisecond or second, etc.

[0525] Optionally, the measurement timestamp information includes the training period of the target artificial intelligence model.

[0526] Optionally, the timestamp information may also include the training period of the target AI model, to instruct the first communication device to train the target AI model based on the training period;

[0527] The training period can include a relative period and / or an absolute period;

[0528] For example, when the training period includes a relative period, it can mean training E epochs with a batch size of B.

[0529] For example, when the training period includes the absolute period, it can mean training S time units or F frames, etc.

[0530] Optionally, the performance indication information may include real-time performance indication information;

[0531] Optionally, the real-time performance indication information can be performance indication information for one or more predefined measurement time points or measurement locations;

[0532] Optionally, the performance indication information may include statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0533] Optionally, the performance indication information may include real-time performance indication information and statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0534] Optionally, when the performance indication information includes real-time performance indication information, the target measurement includes real-time measurement for one or more predefined measurement time points or measurement locations;

[0535] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement includes measurement and statistics for multiple consecutive measurement time points or multiple consecutive measurement locations.

[0536] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on the category of performance indication information.

[0537] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria acquired along with the performance indication information;

[0538] Optionally, the first communication device can determine whether the target measurement is an instantaneous measurement or a statistical measurement based on a preset measurement criterion;

[0539] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria predefined in the protocol.

[0540] Optionally, the real-time performance indication information includes at least one of the following:

[0541] The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements;

[0542] The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following:

[0543] Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

[0544] Optionally, real-time performance indication information may include the following two types: (e)-(f)

[0545] (e) First type: Model instantaneous errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE) and other model-related performance metrics; and distance performance instantaneous metrics, such as cosine distance and other distance-related performance metrics.

[0546] (f) Second type: Real-time indicators of communication performance, such as real-time SNR, SINR, packet error rate, outage probability, or cell / beam handover probability.

[0547] Optionally, the statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations may include the following two types (g)-(h):

[0548] (g) The third type: model statistical errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE); and distance performance statistics, such as the statistical values ​​of performance metrics like cosine distance, such as mean, variance, or 90% CDF.

[0549] (h) Fourth type: Statistical indicators of communication performance, such as SNR, SINR, packet error rate, outage probability, or cell / beam switching probability, such as mean, variance, or 90% CDF.

[0550] Optionally, if the performance indication information includes real-time performance indication information, the target measurement result includes the real-time result of the real-time measurement;

[0551] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement result includes the statistical result of the statistical measurement.

[0552] Optionally, the quantization method includes at least one of the following:

[0553] The error quantization precision in the target measurement result is specified in bits.

[0554] The error level of the target measurement result.

[0555] Optionally, the quantification method may include any one or more of the following:

[0556] The precision of the error quantization of the target measurement result is specified in decimal places. For example, if the measurement error is accurate to the tenths place, then 10.11 is quantized as 10.1; or

[0557] The error levels of the target measurement results are categorized as follows: for example, a channel estimation error of less than -30dB is considered level 1, -30dB to -20dB is considered level 1, and so on.

[0558] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0559] Figure 6 This is the third flowchart illustrating the measurement method provided in the embodiments of this application, as shown below. Figure 6 As shown, the method includes the following steps:

[0560] Step 601: The second communication device receives the first information sent by the first communication device after it performs target measurement of performance indication information based on measurement information using the target artificial intelligence model;

[0561] The first information includes the target measurement results for the target.

[0562] Optionally, the second communication device may receive first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model;

[0563] The interaction of performance indication information between the second communication device (such as a network entity) and the first communication device (such as a terminal or network node) is beneficial for the second communication device to monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0564] Therefore, the first communication device can use a target artificial intelligence model to perform target measurements on the performance indication information and send the obtained target measurement results to the second communication device. After receiving the first information, the second communication device can obtain the target measurement results therein, and thus can monitor the performance of the artificial intelligence model of the first communication device.

[0565] Optionally, before the first communication device performs the target measurement of the performance indication information, the first communication device may first determine the measurement information required for the target measurement of the performance indication information.

[0566] Optionally, after determining the measurement information, the first communication device may use a target artificial intelligence model to perform the target measurement based on the measurement information and obtain the target measurement result.

[0567] Optionally, after the first communication device obtains the target measurement result, it can report the target measurement result to the second communication device through the first information.

[0568] Optionally, the first communication device may be a terminal with an artificial intelligence model deployed or a network node with an artificial intelligence model deployed.

[0569] Optionally, the second communication device can be a network-side device;

[0570] Optionally, the second communication device may be a network node different from the first communication device;

[0571] For example, the second communication device can be a core network node, including NWDAF or LMF, etc.

[0572] For example, the second communication device can be a neural network processing node;

[0573] For example, the second communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0574] For example, there can be multiple second communication devices; or they can be a combination of the aforementioned multiple nodes.

[0575] Optionally, the target artificial intelligence model may be pre-configured for the first communication device by a second or third communication device or other network-side device;

[0576] Optionally, the target artificial intelligence model may be trained by the first communication device itself.

[0577] Optionally, the third communication device may be a network-side device;

[0578] Optionally, the third communication device may be a network entity;

[0579] Optionally, the third communication device may be a network node;

[0580] Optionally, the third communication device may be the same as the second communication device;

[0581] Optionally, the third communication device may be a different communication device from the second communication device.

[0582] For example, the third communication device can be a core network node, including NWDAF or LMF, etc.

[0583] For example, a third communication device can be a neural network processing node;

[0584] For example, the third communication device can be an access network node, such as a base station or a newly defined neural network processing node;

[0585] For example, there can be multiple third communication devices; or they can be a combination of the aforementioned multiple nodes.

[0586] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0587] Optionally, the first information may also include the measurement information.

[0588] Specifically, the first communication device can also report measurement information to the second communication device through the first information, so that the second communication device can know the relevant information when the target artificial intelligence model performs the target measurement;

[0589] Optionally, the target measurement results and measurement information can be reported simultaneously;

[0590] Optionally, the target measurement results and measurement information may not be reported simultaneously;

[0591] Optionally, the measurement information includes at least one of the following:

[0592] First indication information used to indicate the model category of the target artificial intelligence model;

[0593] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0594] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0595] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0596] Fifth indication information used to indicate the performance indication information;

[0597] Sixth indication information used to indicate the type of measurement for the target measurement;

[0598] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0599] Optionally, the measurement information may include first indication information for indicating the model category of the target artificial intelligence model;

[0600] Optionally, any information that can indicate the model category of the target artificial intelligence model can be used as the first indication information;

[0601] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly the model category of the target artificial intelligence model;

[0602] Optionally, the first indication information used to indicate the model category of the target artificial intelligence model can be directly an identifier of the model category of the target artificial intelligence model;

[0603] Optionally, the measurement information may include second indication information for indicating the effectiveness of the target artificial intelligence model;

[0604] Optionally, any information that can indicate the effectiveness of the target artificial intelligence model can be used as the second indicative information;

[0605] Optionally, the second indication information used to indicate the effectiveness of the target artificial intelligence model can be directly the effectiveness of the target artificial intelligence model;

[0606] Optionally, the second indication information used to indicate the validity of the target artificial intelligence model can be directly an identifier of the validity of the target artificial intelligence model;

[0607] Optionally, the measurement information may include third indication information for indicating at least one measurement object;

[0608] Optionally, any information that can indicate at least one object being measured can be used as the first indication information;

[0609] Optionally, the third indication information used to indicate at least one measurement object can be directly at least one measurement object;

[0610] Optionally, the third indication information used to indicate at least one measurement object may be directly the identifier of each of the at least one measurement object;

[0611] Optionally, the measurement information may include fourth indication information, such as measurement timestamp information, to indicate the target measurement;

[0612] Optionally, any information that can provide a measurement timestamp to indicate the target measurement can be used as the first indication information;

[0613] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information of the target measurement;

[0614] Optionally, the fourth indication information used to indicate the measurement timestamp information of the target measurement can be directly the measurement timestamp information identifier of the target measurement;

[0615] Optionally, the measurement information may include fifth indication information for indicating the performance indication information;

[0616] Optionally, any information that can indicate performance can be used as the fifth indication information;

[0617] Optionally, the fifth indication information used to indicate the performance indication information can be directly the performance indication information;

[0618] Optionally, the fifth indication information used to indicate the performance indication information can be directly identified by the performance indication information;

[0619] Optionally, the measurement information may also include sixth indication information for indicating the type of measurement of the target measurement;

[0620] Optionally, any information that can realize the measurement of the target can be used as the sixth indication information;

[0621] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly the measurement type of the target measurement;

[0622] Optionally, the sixth indication information used to indicate the measurement type of the target measurement can be directly an identifier of the measurement type of the target measurement;

[0623] Optionally, the measurement information may also include a seventh indication information for indicating the quantization method of the target measurement result;

[0624] Optionally, any information that can achieve a quantification method to indicate the measurement results of the target can be used as the seventh and sixth indication information;

[0625] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly the quantization method of the target measurement result;

[0626] Optionally, the seventh indication information used to indicate the quantization method of the target measurement result can be directly an identifier of the quantization method of the target measurement result;

[0627] Optionally, the target measurement includes: measurement of the at least one measurement object;

[0628] For example, the target measurement for performance indication information could be the mean square error of the measurement; the target measurement could include the measurement of the object being measured, which could include channel state information, location information, or beam information, etc. Based on the measurement results of the measurement of the object being measured, the target measurement result for the target performance information is obtained.

[0629] Optionally, the model category of the target artificial intelligence model may include CNN, RNN, or Transformer, etc., and may also include the specific model of the target artificial intelligence model. For example, multiple RNN models may be deployed, and the specific model of the target artificial intelligence model may be a specific RNN model.

[0630] Optionally, the measurement type includes at least one of the following:

[0631] Periodic measurement; semi-periodic measurement; non-periodic measurement.

[0632] Optionally, the measurement type may include any one or more of the following:

[0633] Periodic measurement; or semi-periodic measurement; or non-periodic measurement.

[0634] Optionally, if the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

[0635] Optionally, if the target measurement is a periodic measurement, the measurement timestamp information may include the first measurement period corresponding to the target measurement;

[0636] Optionally, the first communication device may periodically perform target measurements based on a first measurement cycle, such as the measurement window running once every 10ms.

[0637] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement;

[0638] The first reference time includes at least one of the following:

[0639] The first communication device determines the time of the measurement information;

[0640] The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer;

[0641] The m-th time unit in the first measurement cycle and / or the second measurement cycle, wherein the first measurement cycle and / or the second measurement cycle is the reporting cycle corresponding to the first communication device sending the first information to the second communication device, and m is a positive integer;

[0642] The measurement time of historical measurements;

[0643] The historical measurement information and the reporting time of the measurement results;

[0644] The first relative time of the historical reference signal corresponding to the historical measurement.

[0645] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first absolute time corresponding to the target measurement;

[0646] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information may include the first relative time corresponding to the target measurement;

[0647] Optionally, the first relative time may include a first relative time relative to a first reference time;

[0648] Optionally, the first reference information may include any one or more of the following:

[0649] The first communication device determines the timing of the measurement information, such as by measuring at a specific time unit after receiving an indication of the measurement type; or

[0650] The third communication device indicates the measurement information at the nth time unit, where n is a positive integer. For example, the first communication device can perform the measurement at the nth time unit after the third communication device indicates the measurement type; or

[0651] The measurement time of historical measurements, such as when the first communication device can perform the measurement at a point after a first preset time period has elapsed relative to the measurement time of a certain historical measurement; or

[0652] The reporting time of the historical measurement information and results can be specified, for example, the first communication device can perform the measurement at a point after a second preset time period has elapsed since the reporting time of a certain historical measurement; or

[0653] The first relative time of the historical reference signal corresponding to the historical measurement can be measured by the first communication device at a time when the transmission time of a certain historical reference signal has passed a third preset time period.

[0654] Optionally, the time units for the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement may include common communication time units such as TTI, symbol, slot, frame, subframe, radio frame, second, minute, hour, day, or month.

[0655] Optionally, the time unit may include a reference signal period or prediction period or a time unit or half-time unit or a symbol (OFDM symbol) or a subframe or radio frame or a millisecond or second, etc.

[0656] Optionally, the measurement timestamp information includes the training period of the target artificial intelligence model.

[0657] Optionally, the timestamp information may also include the training period of the target AI model, to instruct the first communication device to train the target AI model based on the training period;

[0658] The training period can include a relative period and / or an absolute period;

[0659] For example, when the training period includes a relative period, it can mean training E epochs with a batch size of B.

[0660] For example, when the training period includes the absolute period, it can mean training S time units or F frames, etc.

[0661] Optionally, the performance indication information may include real-time performance indication information;

[0662] Optionally, the real-time performance indication information can be performance indication information for one or more predefined measurement time points or measurement locations;

[0663] Optionally, the performance indication information may include statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0664] Optionally, the performance indication information may include real-time performance indication information and statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations;

[0665] Optionally, when the performance indication information includes real-time performance indication information, the target measurement includes real-time measurement for one or more predefined measurement time points or measurement locations;

[0666] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement includes measurement and statistics for multiple consecutive measurement time points or multiple consecutive measurement locations.

[0667] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on the category of performance indication information.

[0668] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria acquired along with the performance indication information;

[0669] Optionally, the first communication device can determine whether the target measurement is an instantaneous measurement or a statistical measurement based on a preset measurement criterion;

[0670] Optionally, the first communication device may determine whether the target measurement is an instantaneous measurement or a statistical measurement based on measurement criteria predefined in the protocol.

[0671] Optionally, the real-time performance indication information includes at least one of the following:

[0672] The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements;

[0673] The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following:

[0674] Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

[0675] Optionally, real-time performance indication information may include the following two types: (e)-(f)

[0676] (e) First type: Model instantaneous errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE) and other model-related performance metrics; and distance performance instantaneous metrics, such as cosine distance and other distance-related performance metrics.

[0677] (f) Second type: Real-time indicators of communication performance, such as real-time SNR, SINR, packet error rate, outage probability, or cell / beam handover probability.

[0678] Optionally, the statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations may include the following two types (g)-(h):

[0679] (g) The third type: model statistical errors, such as cross-entropy, mean squared error (MSE), and mean absolute error (MAE); and distance performance statistics, such as the statistical values ​​of performance metrics like cosine distance, such as mean, variance, or 90% CDF.

[0680] (h) Fourth type: Statistical indicators of communication performance, such as SNR, SINR, packet error rate, outage probability, or cell / beam switching probability, such as mean, variance, or 90% CDF.

[0681] Optionally, if the performance indication information includes real-time performance indication information, the target measurement result includes the real-time result of the real-time measurement;

[0682] Optionally, when the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, the target measurement result includes the statistical result of the statistical measurement.

[0683] Optionally, the quantization method includes at least one of the following:

[0684] The error quantization precision in the target measurement result is specified in bits.

[0685] The error level of the target measurement result.

[0686] Optionally, the quantification method may include any one or more of the following:

[0687] The precision of the error quantization of the target measurement result is specified in decimal places. For example, if the measurement error is accurate to the tenths place, then 10.11 is quantized as 10.1; or

[0688] The error levels of the target measurement results are categorized as follows: for example, a channel estimation error of less than -30dB is considered level 1, -30dB to -20dB is considered level 1, and so on.

[0689] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0690] The measurement method provided in this application can be executed by a measuring device. This application uses a measuring device executing the measurement method as an example to illustrate the measuring device provided in this application.

[0691] Figure 7 This is one of the structural schematic diagrams of the measuring device provided in the embodiments of this application, such as... Figure 7 As shown, the measuring device 700 includes a first determining module 701, an execution module 702, and a sending module 703; wherein:

[0692] The first determining module 701 is used to determine the measurement information required for the target measurement of the performance indication information;

[0693] The execution module 702 is used to employ a target artificial intelligence model, based on the measurement information, to perform the target measurement and obtain the target measurement result.

[0694] The sending module 703 is used to send the first information to the second communication device;

[0695] The first information includes the target measurement results.

[0696] Optionally, the measuring device 700 can determine the measurement information required for the target measurement of the performance indication information through the first determining module 701; then, based on the measurement information, the target measurement can be performed by the execution module 702 using a target artificial intelligence model to obtain the target measurement result; then, the first information including the target measurement result can be sent to the second communication device through the sending module 703.

[0697] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0698] Optionally, the first information may also include the measurement information.

[0699] Optionally, the measurement information includes at least one of the following:

[0700] First indication information used to indicate the model category of the target artificial intelligence model;

[0701] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0702] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0703] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0704] Fifth indication information used to indicate the performance indication information;

[0705] Sixth indication information used to indicate the type of measurement for the target measurement;

[0706] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0707] Optionally, the first determining module 701 is specifically used for at least one of the following:

[0708] The first communication device determines the measurement information based on the instruction from the third communication device;

[0709] The first communication device determines the measurement information based on a predefined protocol;

[0710] The first communication device determines the measurement information based on pre-set parameters;

[0711] The first communication device determines the measurement information based on default measurement information.

[0712] Optionally, the first determining module 701 is specifically used for:

[0713] The first communication device determines the model category of the target artificial intelligence model;

[0714] The first communication device determines the at least one measurement object based on the first association relationship and the model category;

[0715] The first association relationship is used to indicate the association relationship between the at least one measurement object and the model category.

[0716] Optionally, the measurement type includes at least one of the following:

[0717] Periodic measurement; semi-periodic measurement; non-periodic measurement.

[0718] Optionally, if the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

[0719] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement;

[0720] The first reference time includes at least one of the following:

[0721] The first communication device determines the time of the measurement information;

[0722] The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer;

[0723] The m-th time unit in the first measurement cycle and / or the second measurement cycle, where m is a positive integer;

[0724] The measurement time of historical measurements;

[0725] The historical measurement information and the reporting time of the measurement results;

[0726] The relative time of the historical reference signal corresponding to the historical measurement.

[0727] Optionally, the measurement timestamp information includes the training period of the target artificial intelligence model.

[0728] Optionally, the execution module 702 is specifically used for at least one of the following:

[0729] When the measurement type includes periodic measurement, the target measurement is performed based on the first measurement cycle of the periodic measurement;

[0730] When the measurement type includes periodic measurement, the target measurement is performed based on the error measurement window information of the periodic measurement; wherein, the error measurement window information includes the window start time position and / or window duration information;

[0731] When the measurement type includes a semi-periodic measurement, the target measurement is performed based on the second measurement cycle of the semi-periodic measurement;

[0732] When the measurement type includes semi-periodic or non-periodic measurements, the target measurement is performed based on a burst measurement indication;

[0733] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively performs the target measurement.

[0734] Optionally, the first determining module 701 is specifically used for:

[0735] If the indication from the third communication device includes periodic measurement trigger information, then the measurement type is determined to include the periodic measurement.

[0736] The periodic measurement trigger information includes at least one of the following:

[0737] First measurement type indication information, which is used to directly indicate that the measurement type includes the periodic measurement;

[0738] The error measurement window information of the periodic measurement;

[0739] The first measurement cycle of the periodic measurement.

[0740] Optionally, the first determining module 701 is specifically used for:

[0741] If the indication from the third communication device includes half-periodic measurement trigger information, it is determined that the measurement type includes the half-periodic measurement;

[0742] The semi-periodic measurement trigger information includes at least one of the following:

[0743] Second measurement type indication information, which is used to directly indicate that the measurement type includes the semi-periodic measurement;

[0744] The second measurement period of the semi-periodic measurement;

[0745] Emergency measurement indication.

[0746] Optionally, the first determining module 701 is specifically used for:

[0747] If the indication from the third communication device includes non-periodic measurement trigger information, it is determined that the measurement type includes the non-periodic measurement.

[0748] The non-periodic measurement trigger information includes at least one of the following:

[0749] Third measurement type indication information, the third measurement type indication information being used to indicate that the measurement type includes the non-periodic measurement;

[0750] Emergency measurement indication.

[0751] Optionally, the first determining module 701 is specifically used for at least one of the following:

[0752] If the first communication device determines that the performance indication information includes real-time performance indication information, it determines that the target measurement includes real-time measurement;

[0753] If the first communication device determines that the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, then the target measurement includes statistical measurement.

[0754] Optionally, the real-time performance indication information includes at least one of the following:

[0755] The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements;

[0756] The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following:

[0757] Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

[0758] Optionally, the quantization method includes at least one of the following:

[0759] The error quantization precision in the target measurement result is specified in bits.

[0760] The error level of the target measurement result.

[0761] Optionally, the sending module 703 is specifically used for:

[0762] The first communication device determines the reporting method and the reporting timestamp information;

[0763] The first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information;

[0764] The reporting methods include:

[0765] Periodic reporting;

[0766] Semi-periodic reporting;

[0767] Non-periodic reporting.

[0768] Optionally, the sending module 703 is specifically used for at least one of the following:

[0769] When the reporting method includes periodic reporting, the first information is sent to the second communication device based on the first reporting period of the periodic reporting;

[0770] When the reporting method includes semi-periodic reporting, the first information is sent to the second communication device based on the second reporting period of the semi-periodic reporting;

[0771] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first information is sent to the second communication device based on the burst reporting instruction;

[0772] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively sends the first information to the second communication device.

[0773] Optionally, the sending module 703 is specifically used for:

[0774] If the target measurement result is greater than the first threshold, the first communication device actively sends the first information to the second communication device;

[0775] The first threshold is either preset, predefined by the protocol, or indicated by a third communication device.

[0776] Optionally, the sending module 703 is specifically used for at least one of the following:

[0777] The first communication device determines the reporting method based on the instruction from the third communication device;

[0778] The first communication device determines the reporting method based on a predefined protocol;

[0779] The first communication device determines the reporting method based on preset settings;

[0780] The first communication device determines the reporting method based on default measurement information.

[0781] Optionally, the sending module 703 is specifically used for:

[0782] If the indication from the third communication device includes periodic reporting trigger information, then the reporting method is determined to include the periodic reporting.

[0783] The periodically reported trigger information includes at least one of the following:

[0784] First reporting method indication information, the first reporting method indication information is used to directly indicate that the reporting method includes the periodic reporting;

[0785] The first reporting period of the periodic reporting.

[0786] Optionally, the sending module 703 is specifically used for:

[0787] If the indication from the third communication device includes semi-periodic reporting trigger information, then the reporting method is determined to include the semi-periodic reporting.

[0788] The semi-periodic reporting trigger information includes at least one of the following:

[0789] Second reporting method indication information, the second reporting method indication information is used to indicate that the reporting method includes the semi-periodic reporting;

[0790] The second reporting period of the semi-periodic reporting;

[0791] The emergency reporting instructions.

[0792] Optionally, the sending module 703 is specifically used for:

[0793] If the indication from the third communication device includes non-periodic reporting trigger information, then the reporting method is determined to include the non-periodic reporting.

[0794] The semi-periodic reporting trigger information includes at least one of the following:

[0795] The third reporting method indication information is used to directly indicate that the reporting method includes the non-periodic reporting;

[0796] The emergency reporting instructions.

[0797] Optionally, when the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information includes the second absolute time and / or the second relative time relative to the second reference time of the first information reporting;

[0798] The second reference time includes at least one of the following:

[0799] The first communication device determines the time of the measurement information;

[0800] The third communication device indicates the p-th time unit after the time of the measurement information, where p is a positive integer;

[0801] The qth time unit in the first reporting cycle and / or the second reporting cycle, where q is a positive integer;

[0802] The reporting time of the first historical information;

[0803] The reception time of the historical reference signal;

[0804] The transmission time of the historical reference signal.

[0805] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including:

[0806] The first communication device determines the comparison result between the performance of the target artificial intelligence model and the performance threshold;

[0807] Based on the comparison results, the first communication device determines the validity indication information of the target artificial intelligence model.

[0808] Optionally, the first information includes measurement information of at least one of the target measurements and target measurement results of each of the at least one target measurement.

[0809] Optionally, the device further includes:

[0810] The second determining module is used to determine the transmission resources of the first information based on the resource allocation information of the third communication device.

[0811] The transmission resources include at least one of the following:

[0812] Time resource information;

[0813] Frequency resource information;

[0814] Antenna port information;

[0815] Beam indication information.

[0816] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0817] Figure 8 This is a second schematic diagram of the measuring device provided in the embodiments of this application, as shown below. Figure 8 As shown, the measuring device 800 includes: an indicating module 801; wherein:

[0818] The indication module 801 is used to indicate to the first communication device the measurement information required for the target measurement of the performance indication information.

[0819] Optionally, the measuring device 800 may instruct the first communication device via the indicating module 80 to provide the measurement information required for the target measurement of the performance indication information.

[0820] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0821] Optionally, the measurement information includes at least one of the following:

[0822] First indication information used to indicate the model category of the target artificial intelligence model;

[0823] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0824] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0825] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0826] Fifth indication information used to indicate the performance indication information;

[0827] Sixth indication information used to indicate the type of measurement for the target measurement;

[0828] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0829] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0830] Figure 9 This is the third schematic diagram of the measuring device provided in the embodiments of this application, as shown below. Figure 9 As shown, the measuring device 900 includes: a receiving module 901; wherein:

[0831] The receiving module 901 is used to receive first information sent by the first communication device after it performs a target measurement based on the measurement information using the target artificial intelligence model;

[0832] The first information includes the target measurement results for the target.

[0833] Optionally, the measuring device 900 may receive first information through the receiving module 900, which is sent by the first communication device after performing target measurement of performance indication information based on the measurement information using the target artificial intelligence model.

[0834] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0835] Optionally, the first information may also include the measurement information.

[0836] Optionally, the measurement information includes at least one of the following:

[0837] First indication information used to indicate the model category of the target artificial intelligence model;

[0838] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0839] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0840] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0841] Fifth indication information used to indicate the performance indication information;

[0842] Sixth indication information used to indicate the type of measurement for the target measurement;

[0843] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0844] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0845] The measuring device in this application embodiment can be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices besides a terminal. For example, the terminal can include, but is not limited to, the type of terminal 11 listed above; other devices can be servers, network attached storage (NAS), etc., and this application embodiment does not specifically limit the type.

[0846] The measuring device provided in this application embodiment can achieve... Figures 4 to 6 The various processes implemented in the method embodiments achieve the same technical effect, and will not be described again here to avoid repetition.

[0847] Optional, Figure 10 This is a schematic diagram of the structure of the communication device provided in the embodiments of this application, such as... Figure 10 As shown in the illustration, this application also provides a communication device 1000, including a processor 1001 and a memory 1002. The memory 1002 stores programs or instructions that can run on the processor 1001. For example, when the communication device 1000 is a terminal, the program or instructions executed by the processor 1001 implement the various steps of the above-described measurement method embodiments and achieve the same technical effect. When the communication device 1000 is a network-side device, the program or instructions executed by the processor 1001 implement the various steps of the above-described measurement method embodiments and achieve the same technical effect. To avoid repetition, further details are omitted here.

[0848] This application embodiment also provides a first communication device, including a processor and a communication interface, wherein the processor is used for:

[0849] Determine the measurement information required for the target measurement of the performance indication information;

[0850] Using a target artificial intelligence model, based on the measurement information, the target measurement is performed to obtain the target measurement result.

[0851] The communication interface is used for:

[0852] Send the first message to the second communication device;

[0853] The first information includes the target measurement results.

[0854] This first communication device embodiment corresponds to the aforementioned first communication device-side method embodiment. All implementation processes and methods of the aforementioned method embodiment can be applied to this first communication device embodiment and achieve the same technical effect. Specifically, Figure 11 A schematic diagram of the hardware structure of a first communication device according to an embodiment of this application.

[0855] The first communication device 1100 includes, but is not limited to, at least some of the following components: radio frequency unit 1101, network module 1102, audio output unit 1103, input unit 1104, sensor 1105, display unit 1106, user input unit 1107, interface unit 1108, memory 1109, and processor 1110.

[0856] Those skilled in the art will understand that the first communication device 1100 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 11 The structure of the first communication device shown in the figure does not constitute a limitation on the first communication device. The first communication device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0857] It should be understood that, in this embodiment, the input unit 1104 may include a graphics processing unit (GPU) 11041 and a microphone 11042. The GPU 11041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1106 may include a display panel 11061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1107 includes at least one of a touch panel 11071 and other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here.

[0858] In this embodiment, after receiving downlink data from the network-side device, the radio frequency unit 1101 can transmit it to the processor 1110 for processing; in addition, the radio frequency unit 1101 can send uplink data to the network-side device. Typically, the radio frequency unit 1101 includes, but is not limited to, antennas, amplifiers, transceivers, couplers, low-noise amplifiers, duplexers, etc.

[0859] The memory 1109 can be used to store software programs or instructions and various data. The memory 1109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback function, image playback function, etc.). Furthermore, the memory 1109 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1109 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0860] Processor 1110 may include one or more processing units; optionally, processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 1110.

[0861] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0862] The processor 1110 is used for:

[0863] Determine the measurement information required for the target measurement of the performance indication information;

[0864] Using a target artificial intelligence model, based on the measurement information, the target measurement is performed to obtain the target measurement result.

[0865] Send the first message to the second communication device;

[0866] The first information includes the target measurement result.

[0867] Optionally, the first information may also include the measurement information.

[0868] Optionally, the measurement information includes at least one of the following:

[0869] First indication information used to indicate the model category of the target artificial intelligence model;

[0870] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[0871] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[0872] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[0873] Fifth indication information used to indicate the performance indication information;

[0874] Sixth indication information used to indicate the type of measurement for the target measurement;

[0875] The seventh indication information is used to indicate the quantification method of the target measurement result.

[0876] Optionally, the processor 1110 is used for at least one of the following:

[0877] The first communication device determines the measurement information based on the instruction from the third communication device;

[0878] The first communication device determines the measurement information based on a predefined protocol;

[0879] The first communication device determines the measurement information based on pre-set parameters;

[0880] The first communication device determines the measurement information based on the system's default measurement information.

[0881] Optionally, the processor 1110 is used for:

[0882] The first communication device determines the model category of the target artificial intelligence model;

[0883] The first communication device determines the at least one measurement object based on the first association relationship and the model category;

[0884] The first association relationship is used to indicate the association relationship between the at least one measurement object and the model category.

[0885] Optionally, the measurement type includes at least one of the following:

[0886] Periodic measurement; semi-periodic measurement; non-periodic measurement.

[0887] Optionally, if the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

[0888] Optionally, when the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes the first absolute time and / or the first relative time relative to the first reference time corresponding to the target measurement;

[0889] The first reference time includes at least one of the following:

[0890] The first communication device determines the time of the measurement information;

[0891] The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer;

[0892] The m-th time unit in the first measurement cycle and / or the second measurement cycle, where m is a positive integer;

[0893] The measurement time of historical measurements;

[0894] The historical measurement information and the reporting time of the measurement results;

[0895] The relative time of the historical reference signal corresponding to the historical measurement.

[0896] Optionally, the measurement timestamp information includes the training period of the target artificial intelligence model.

[0897] Optionally, the processor 1110 is used for at least one of the following:

[0898] When the measurement type includes periodic measurement, the target measurement is performed based on the first measurement cycle of the periodic measurement;

[0899] When the measurement type includes periodic measurement, the target measurement is performed based on the error measurement window information of the periodic measurement; wherein, the error measurement window information includes the window start time position and / or window duration information;

[0900] When the measurement type includes a semi-periodic measurement, the target measurement is performed based on the second measurement cycle of the semi-periodic measurement;

[0901] When the measurement type includes semi-periodic or non-periodic measurements, the target measurement is performed based on a burst measurement indication;

[0902] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively performs the target measurement.

[0903] Optionally, the processor 1110 is used for:

[0904] If the indication from the third communication device includes periodic measurement trigger information, then the measurement type is determined to include the periodic measurement.

[0905] The periodic measurement trigger information includes at least one of the following:

[0906] First measurement type indication information, which is used to directly indicate that the measurement type includes the periodic measurement;

[0907] The error measurement window information of the periodic measurement;

[0908] The first measurement cycle of the periodic measurement.

[0909] Optionally, the processor 1110 is used for:

[0910] If the indication from the third communication device includes half-periodic measurement trigger information, it is determined that the measurement type includes the half-periodic measurement;

[0911] The semi-periodic measurement trigger information includes at least one of the following:

[0912] Second measurement type indication information, which is used to directly indicate that the measurement type includes the semi-periodic measurement;

[0913] The second measurement period of the semi-periodic measurement;

[0914] Emergency measurement indication.

[0915] Optionally, the processor 1110 is used for:

[0916] If the indication from the third communication device includes non-periodic measurement trigger information, it is determined that the measurement type includes the non-periodic measurement.

[0917] The non-periodic measurement trigger information includes at least one of the following:

[0918] Third measurement type indication information, the third measurement type indication information being used to indicate that the measurement type includes the non-periodic measurement;

[0919] Emergency measurement indication.

[0920] Optionally, the processor 1110 is used for at least one of the following:

[0921] If the first communication device determines that the performance indication information includes real-time performance indication information, it determines that the target measurement includes real-time measurement;

[0922] If the first communication device determines that the performance indication information includes statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations, then the target measurement includes statistical measurement.

[0923] Optionally, the real-time performance indication information includes at least one of the following:

[0924] The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements;

[0925] The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following:

[0926] Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

[0927] Optionally, the quantization method includes at least one of the following:

[0928] The error quantization precision in the target measurement result is specified in bits.

[0929] The error level of the target measurement result.

[0930] Optionally, the processor 1110 is used for:

[0931] The first communication device determines the reporting method and the reporting timestamp information;

[0932] The first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information;

[0933] The reporting methods include:

[0934] Periodic reporting;

[0935] Semi-periodic reporting;

[0936] Non-periodic reporting.

[0937] Optionally, the processor 1110 is used for at least one of the following:

[0938] When the reporting method includes periodic reporting, the first information is sent to the second communication device based on the first reporting period of the periodic reporting;

[0939] When the reporting method includes semi-periodic reporting, the first information is sent to the second communication device based on the second reporting period of the semi-periodic reporting;

[0940] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first information is sent to the second communication device based on the burst reporting instruction;

[0941] When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively sends the first information to the second communication device.

[0942] Optionally, the processor 1110 is used for:

[0943] If the target measurement result is greater than the first threshold, the first communication device actively sends the first information to the second communication device;

[0944] The first threshold is either preset, predefined by the protocol, or indicated by a third communication device.

[0945] Optionally, the processor 1110 is used for at least one of the following:

[0946] The first communication device determines the reporting method based on the instruction from the third communication device;

[0947] The first communication device determines the reporting method based on a predefined protocol;

[0948] The first communication device determines the reporting method based on preset settings;

[0949] The first communication device determines the reporting method based on the system's default measurement information.

[0950] Optionally, the processor 1110 is used for:

[0951] If the indication from the third communication device includes periodic reporting trigger information, then the reporting method is determined to include the periodic reporting.

[0952] The periodically reported trigger information includes at least one of the following:

[0953] First reporting method indication information, the first reporting method indication information is used to directly indicate that the reporting method includes the periodic reporting;

[0954] The first reporting period of the periodic reporting.

[0955] Optionally, the processor 1110 is used for:

[0956] If the indication from the third communication device includes semi-periodic reporting trigger information, then the reporting method is determined to include the semi-periodic reporting.

[0957] The semi-periodic reporting trigger information includes at least one of the following:

[0958] Second reporting method indication information, the second reporting method indication information is used to indicate that the reporting method includes the semi-periodic reporting;

[0959] The second reporting period of the semi-periodic reporting;

[0960] The emergency reporting instructions.

[0961] Optionally, the processor 1110 is used for:

[0962] If the indication from the third communication device includes non-periodic reporting trigger information, then the reporting method is determined to include the non-periodic reporting.

[0963] The semi-periodic reporting trigger information includes at least one of the following:

[0964] The third reporting method indication information is used to directly indicate that the reporting method includes the non-periodic reporting;

[0965] The emergency reporting instructions.

[0966] Optionally, when the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information includes the second absolute time and / or the second relative time relative to the second reference time of the first information reporting;

[0967] The second reference time includes at least one of the following:

[0968] The first communication device determines the time of the measurement information;

[0969] The third communication device indicates the p-th time unit after the time of the measurement information, where p is a positive integer;

[0970] The qth time unit in the first reporting cycle and / or the second reporting cycle, where q is a positive integer;

[0971] The reporting time of the first historical information;

[0972] The reception time of the historical reference signal;

[0973] The transmission time of the historical reference signal.

[0974] Optionally, the first communication device determines the measurement information required for the target measurement of the performance indication information, including:

[0975] The first communication device determines the comparison result between the performance of the target artificial intelligence model and the performance threshold;

[0976] Based on the comparison results, the first communication device determines the validity indication information of the target artificial intelligence model.

[0977] Optionally, the first information includes measurement information of at least one of the target measurements and target measurement results of each of the at least one target measurement.

[0978] Optionally, the processor 1110 is used for:

[0979] Based on the resource allocation information of the third communication device, determine the transmission resources of the first information;

[0980] The transmission resources include at least one of the following:

[0981] Time resource information;

[0982] Frequency resource information;

[0983] Antenna port information;

[0984] Beam indication information.

[0985] In this embodiment, a target artificial intelligence model can be used to perform target measurement based on the measurement information required for the target measurement of performance indication information. After obtaining the target measurement result, the target measurement result is reported to the second communication device, so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side. In this way, the performance of the artificial intelligence model of the first communication device can be monitored in real time, thereby ensuring the quality of communication services within the communication system.

[0986] This application embodiment also provides a third communication device, including a processor and a communication interface, wherein the communication interface is used for:

[0987] Instruct the first communication device on the measurement information required for the target measurement of the performance indication information.

[0988] This third communication device embodiment corresponds to the above-described third communication device method embodiment. All implementation processes and methods of the above-described method embodiment can be applied to this third communication device embodiment and can achieve the same technical effect.

[0989] Specifically, embodiments of this application also provide a third communication device. Figure 12 To illustrate the hardware structure of a third communication device according to an embodiment of this application, as shown in the diagram... Figure 12 As shown, the third communication device 1200 includes: an antenna 1201, a radio frequency (RF) device 1202, a baseband device 1203, a processor 1204, and a memory 1205. The antenna 1201 is connected to the RF device 1202. In the uplink direction, the RF device 1202 receives information through the antenna 1201 and transmits the received information to the baseband device 1203 for processing. In the downlink direction, the baseband device 1203 processes the information to be transmitted and sends it to the RF device 1202, which then processes the received information and transmits it through the antenna 1201.

[0990] The method executed by the third communication device in the above embodiments can be implemented in the baseband device 1203, which includes a baseband processor.

[0991] The baseband device 1203 may include, for example, at least one baseband board on which multiple chips are disposed, such as... Figure 12 As shown, one of the chips is, for example, a baseband processor, which is connected to the memory 1205 via a bus interface to call the program in the memory 1205 and execute the third communication device operation shown in the above method embodiment.

[0992] The third communication device may also include a network interface 1206, such as a common public radio interface (CPRI).

[0993] Specifically, the third communication device 1200 of this embodiment further includes: instructions or programs stored in memory 1205 and executable on processor 1204, wherein processor 1204 calls the instructions or programs in memory 1205 to execute. Figure 8 The methods executed by each module shown achieve the same technical effect, and to avoid repetition, they will not be described in detail here.

[0994] The processor 1204 is used for:

[0995] Instruct the first communication device on the measurement information required for the target measurement of the performance indication information.

[0996] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[0997] Optionally, the measurement information includes at least one of the following:

[0998] First indication information used to indicate the model category of the target artificial intelligence model;

[0999] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[1000] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[1001] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[1002] Fifth indication information used to indicate the performance indication information;

[1003] Sixth indication information used to indicate the type of measurement for the target measurement;

[1004] The seventh indication information is used to indicate the quantification method of the target measurement result.

[1005] In this embodiment, measurement information can be indicated to the first communication device so that the first communication device can perform target measurement by using the target artificial intelligence model based on the measurement information required for the target measurement of the performance indication information, obtain the target measurement result of the target measurement, and then report the target measurement result to the second communication device so that the second communication device can obtain the measurement result output by the target artificial intelligence model on the first communication device side, and thus can monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[1006] This application embodiment also provides a second communication device, including a processor and a communication interface, wherein the communication interface is used for:

[1007] Receive the first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model;

[1008] The first information includes the target measurement results for the target.

[1009] This second communication device embodiment corresponds to the above-described second communication device method embodiment. All implementation processes and methods of the above-described method embodiment can be applied to this second communication device embodiment and can achieve the same technical effect.

[1010] Specifically, embodiments of this application also provide a second communication device. Figure 13 To illustrate the hardware structure of a second communication device according to an embodiment of this application, as shown in the diagram... Figure 13 As shown, the second communication device 1300 includes: an antenna 1301, a radio frequency (RF) device 1302, a baseband device 1303, a processor 1304, and a memory 1305. The antenna 1301 is connected to the RF device 1302. In the uplink direction, the RF device 1302 receives information through the antenna 1301 and transmits the received information to the baseband device 1303 for processing. In the downlink direction, the baseband device 1303 processes the information to be transmitted and sends it to the RF device 1302. The RF device 1302 processes the received information and transmits it through the antenna 1301.

[1011] The method executed by the second communication device in the above embodiments can be implemented in the baseband device 1303, which includes a baseband processor.

[1012] The baseband device 1303 may, for example, include at least one baseband board on which multiple chips are disposed, such as... Figure 13As shown, one of the chips is, for example, a baseband processor, which is connected to the memory 1305 via a bus interface to call the program in the memory 1305 and execute the second communication device operation shown in the above method embodiment.

[1013] The second communication device may also include a network interface 1306, such as a common public radio interface (CPRI).

[1014] Specifically, the second communication device 1300 of this embodiment further includes: instructions or programs stored in memory 1305 and executable on processor 1304, wherein processor 1304 calls the instructions or programs in memory 1305 to execute. Figure 9 The methods executed by each module shown achieve the same technical effect, and to avoid repetition, they will not be described in detail here.

[1015] The processor 1303 is used for:

[1016] Receive the first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model;

[1017] The first information includes the target measurement results for the target.

[1018] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[1019] Optionally, the first information may also include the measurement information.

[1020] Optionally, the measurement information includes at least one of the following:

[1021] First indication information used to indicate the model category of the target artificial intelligence model;

[1022] Second indication information used to indicate the effectiveness of the target artificial intelligence model;

[1023] Third indication information for indicating at least one measurement object; wherein, the target measurement includes: measurement of the at least one measurement object;

[1024] Fourth indication information used to indicate the measurement timestamp information of the target measurement;

[1025] Fifth indication information used to indicate the performance indication information;

[1026] Sixth indication information used to indicate the type of measurement for the target measurement;

[1027] The seventh indication information is used to indicate the quantification method of the target measurement result.

[1028] In this embodiment, the second communication device can receive the target measurement results reported by the first communication device after it performs target measurement based on the target artificial intelligence model and the target measurement information required by the target artificial intelligence model for performance indication information. The second communication device can obtain the measurement results output by the target artificial intelligence model on the first communication device side, and thus monitor the performance of the artificial intelligence model of the first communication device in real time, thereby ensuring the quality of communication services within the communication system.

[1029] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described measurement method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[1030] The processor is the processor in the terminal described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[1031] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above measurement method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[1032] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[1033] This application also provides a computer program / program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above measurement method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[1034] This application also provides a measurement system, including: a first communication device, a second communication device, and a third communication device. The first communication device can be used to perform the steps of the measurement method described above, the second communication device can be used to perform the steps of the measurement method described above, and the third communication device can be used to perform the steps of the measurement method described above.

[1035] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[1036] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[1037] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A measurement method, characterized in that, include: The first communication device determines the measurement information required for the target measurement of the performance indication information; The first communication device employs a target artificial intelligence model, performs the target measurement based on the measurement information, and obtains the target measurement result of the target measurement; The first communication device sends first information to the second communication device; Wherein, the first information includes the target measurement result and / or the measurement information; The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Second indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model; The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

2. The measurement method according to claim 1, characterized in that, The measurement information also includes at least one of the following: First indication information used to indicate the model category of the target artificial intelligence model; Third indication information used to indicate at least one object being measured; Fourth indication information used to indicate the measurement timestamp information of the target measurement; Fifth indication information used to indicate the performance indication information; Sixth indication information used to indicate the type of measurement for the target measurement; The seventh indication information is used to indicate the quantification method of the target measurement result.

3. The measurement method according to claim 2, characterized in that, The first communication device determines the measurement information required for the target measurement of the performance indication information, including at least one of the following: The first communication device determines the measurement information based on the instruction from the third communication device; The first communication device determines the measurement information based on a predefined protocol; The first communication device determines the measurement information based on pre-set parameters; The first communication device determines the measurement information based on default measurement information.

4. The measurement method according to claim 3, characterized in that, The first communication device determines the measurement information required for the target measurement of the performance indication information, including: The first communication device determines the model category of the target artificial intelligence model; The first communication device determines the at least one measurement object based on the first association relationship and the model category; The first association relationship is used to indicate the association relationship between the at least one measurement object and the model category.

5. The measurement method according to claim 3, characterized in that, The measurement type includes at least one of the following: Periodic measurement; semi-periodic measurement; non-periodic measurement.

6. The measurement method according to claim 5, characterized in that, When the measurement type includes the periodic measurement, the measurement timestamp information includes the first measurement period corresponding to the target measurement.

7. The measurement method according to claim 5, characterized in that, When the measurement type includes the semi-periodic measurement or the non-periodic measurement, the measurement timestamp information includes: the first absolute time corresponding to the target measurement and / or the first relative time relative to the first reference time; The first reference time includes at least one of the following: The first communication device determines the time of the measurement information; The third communication device indicates the nth time unit after the time of the measurement information, where n is a positive integer; The m-th time unit in the first measurement cycle and / or the second measurement cycle, where m is a positive integer; The measurement time of historical measurements; The historical measurement information and the reporting time of the measurement results; The relative time of the historical reference signal corresponding to the historical measurement.

8. The measurement method according to any one of claims 5-7, characterized in that, The timestamp information includes the training period of the target AI model.

9. The measurement method according to any one of claims 5-7, characterized in that, The first communication device employs a target artificial intelligence model and performs the target measurement based on the measurement information, including at least one of the following: When the measurement type includes the periodic measurement, the target measurement is performed based on the first measurement cycle of the periodic measurement; When the measurement type includes the periodic measurement, the target measurement is performed based on the error measurement window information of the periodic measurement; wherein the error measurement window information includes the window start time position and / or window duration information; When the measurement type includes the semi-periodic measurement, the target measurement is performed based on the second measurement cycle of the semi-periodic measurement; When the measurement type includes the semi-periodic measurement or the non-periodic measurement, the target measurement is performed based on the burst measurement indication; When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively performs the target measurement.

10. The measurement method according to claim 9, characterized in that, The first communication device determines the measurement information based on the instruction from the third communication device, including: If the indication from the third communication device includes periodic measurement trigger information, it is determined that the measurement type in the measurement information includes the periodic measurement. The periodic measurement trigger information includes at least one of the following: First measurement type indication information, which is used to directly indicate that the measurement type includes the periodic measurement; The error measurement window information of the periodic measurement; The first measurement cycle of the periodic measurement.

11. The measurement method according to claim 9, characterized in that, The first communication device determines the measurement information based on the instruction from the third communication device, including: If the indication from the third communication device includes semi-periodic measurement trigger information, it is determined that the measurement type in the measurement information includes the semi-periodic measurement. The semi-periodic measurement trigger information includes at least one of the following: Second measurement type indication information, which is used to directly indicate that the measurement type includes the semi-periodic measurement; The second measurement period of the semi-periodic measurement; Emergency measurement indication.

12. The measurement method according to claim 9, characterized in that, The first communication device determines the measurement information based on the instruction from the third communication device, including: If the indication from the third communication device includes non-periodic measurement trigger information, it is determined that the measurement type in the measurement information includes the non-periodic measurement. The non-periodic measurement trigger information includes at least one of the following: Third measurement type indication information, the third measurement type indication information being used to indicate that the measurement type includes the non-periodic measurement; Emergency measurement indication.

13. The measurement method according to any one of claims 2-7, characterized in that, The first communication device determines the measurement information required for the target measurement of the performance indication information, including at least one of the following: If the first communication device determines that the performance indication information includes the real-time performance indication information, it determines that the target measurement in the measurement information includes the real-time measurement; If the first communication device determines that the performance indication information includes statistical performance indication information for the plurality of continuous measurement time points or the plurality of continuous measurement locations, it determines that the target measurement in the measurement information includes statistical measurement.

14. The measurement method according to claim 13, characterized in that, The real-time performance indication information includes at least one of the following: The model's instantaneous error, instantaneous distance performance metrics, and instantaneous communication performance metrics; wherein, the target measurement results include the instantaneous results of instantaneous measurements; The statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations includes at least one of the following: Model statistical error, distance performance statistical indicators, and communication performance statistical indicators; wherein, the target measurement results include the statistical results of the statistical measurements.

15. The measurement method according to any one of claims 2-7, characterized in that, The quantification method includes at least one of the following: The error quantization precision in the target measurement result is specified in bits. The error level of the target measurement result.

16. The measurement method according to any one of claims 2-7, characterized in that, The first communication device sends first information to the second communication device, including: The first communication device determines the reporting method and the reporting timestamp information; The first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information; The reporting methods include: Periodic reporting; Semi-periodic reporting; Non-periodic reporting.

17. The measurement method according to claim 16, characterized in that, The first communication device sends the first information to the second communication device based on the reporting method and the reporting timestamp information, including at least one of the following: When the reporting method includes periodic reporting, the first information is sent to the second communication device based on the first reporting period of the periodic reporting; When the reporting method includes semi-periodic reporting, the first information is sent to the second communication device based on the second reporting period of the semi-periodic reporting; When the reporting method includes semi-periodic reporting or non-periodic reporting, the first information is sent to the second communication device based on the burst reporting instruction; When the reporting method includes semi-periodic reporting or non-periodic reporting, the first communication device actively sends the first information to the second communication device.

18. The measurement method according to claim 17, characterized in that, The first communication device actively sends the first information to the second communication device, including: If the target measurement result is greater than the first threshold, the first communication device actively sends the first information to the second communication device; The first threshold is either preset, predefined by the protocol, or indicated by a third communication device.

19. The measurement method according to claim 16, characterized in that, The first communication device determines the reporting method, including at least one of the following: The first communication device determines the reporting method based on the instruction from the third communication device; The first communication device determines the reporting method based on a predefined protocol; The first communication device determines the reporting method based on preset settings; The first communication device determines the reporting method based on the system's default measurement information.

20. The measurement method according to claim 19, characterized in that, The first communication device determines the reporting method based on the instruction of the third communication device, including: If the indication from the third communication device includes periodic reporting trigger information, then the reporting method is determined to include the periodic reporting. The periodically reported trigger information includes at least one of the following: First reporting method indication information, the first reporting method indication information is used to directly indicate that the reporting method includes the periodic reporting; The first reporting period of the periodic reporting.

21. The measurement method according to claim 19, characterized in that, The first communication device determines the reporting method based on the instruction of the third communication device, including: If the indication from the third communication device includes semi-periodic reporting trigger information, then the reporting method is determined to include the semi-periodic reporting. The semi-periodic reporting trigger information includes at least one of the following: Second reporting method indication information, the second reporting method indication information is used to indicate that the reporting method includes the semi-periodic reporting; The second reporting period of the semi-periodic reporting; Emergency reporting instructions.

22. The measurement method according to claim 19, characterized in that, The first communication device determines the reporting method based on the instruction of the third communication device, including: If the indication from the third communication device includes non-periodic reporting trigger information, then the reporting method is determined to include the non-periodic reporting. The semi-periodic reporting trigger information includes at least one of the following: The third reporting method indication information is used to directly indicate that the reporting method includes the non-periodic reporting; Emergency reporting instructions.

23. The measurement method according to claim 16, characterized in that, When the reporting method includes the semi-periodic reporting, and / or when the reporting method includes the non-periodic reporting, the reporting timestamp information includes the second absolute time and / or the second relative time relative to the second reference time of the first information reporting; The second reference time includes at least one of the following: The first communication device determines the time of the measurement information; The third communication device indicates the p-th time unit after the time of the measurement information, where p is a positive integer; The qth time unit in the first reporting cycle and / or the second reporting cycle, where q is a positive integer; The reporting time of the first historical information; The reception time of the historical reference signal; The transmission time of the historical reference signal.

24. The measurement method according to any one of claims 1-7, characterized in that, The first communication device determines the measurement information required for the target measurement of the performance indication information, including: The first communication device determines the comparison result between the performance of the target artificial intelligence model and the performance threshold; Based on the comparison results, the first communication device determines the validity indication information of the target artificial intelligence model.

25. The measurement method according to any one of claims 1-7, characterized in that, The first information includes measurement information of at least one of the target measurements and the target measurement results of each of the at least one target measurement.

26. The measurement method according to any one of claims 1-7, characterized in that, The method further includes: The first communication device determines the transmission resources for the first information based on the resource allocation information of the third communication device. The transmission resources include at least one of the following: Time resource information; Frequency resource information; Antenna port information; Beam indication information.

27. A measurement method, characterized in that, include: The third communication device instructs the first communication device on the measurement information required for the target measurement of the performance indication information; The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Secondary indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model; The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

28. The measurement method according to claim 27, characterized in that, The measurement information includes at least one of the following: First indication information used to indicate the model category of the target artificial intelligence model; Third indication information used to indicate at least one object being measured; Fourth indication information used to indicate the measurement timestamp information of the target measurement; Fifth indication information used to indicate the performance indication information; Sixth indication information used to indicate the type of measurement for the target measurement; The seventh indication information is used to indicate the quantification method of the target measurement results.

29. A measurement method, characterized in that, include: The second communication device receives the first information sent by the first communication device after it performs a target measurement of performance indication information based on measurement information using a target artificial intelligence model; The first information includes the target measurement result and / or the measurement information for the target. The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Second indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model; The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

30. The measurement method according to claim 29, characterized in that, The measurement information includes at least one of the following: First indication information used to indicate the model category of the target artificial intelligence model; Third indication information used to indicate at least one object being measured; Fourth indication information used to indicate the measurement timestamp information of the target measurement; Fifth indication information used to indicate the performance indication information; Sixth indication information used to indicate the type of measurement for the target measurement; The seventh indication information is used to indicate the quantification method of the target measurement result.

31. A measuring device, characterized in that, include: The first determining module is used to determine the measurement information required for the target measurement of the performance indication information; The execution module is used to employ a target artificial intelligence model, based on the measurement information, to perform the target measurement and obtain the target measurement result. The sending module is used to send the first information to the second communication device; Wherein, the first information includes the target measurement result and / or the measurement information; The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Second indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model; The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

32. A measuring device, characterized in that, include: The indicator module is used to indicate to the first communication device the measurement information required for the target measurement of the performance indicator information; The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Secondary indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model; The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

33. A measuring device, characterized in that, include: The receiving module is used to receive first information sent by the first communication device after it performs target measurement based on measurement information using a target artificial intelligence model; The first information includes the target measurement result and / or the measurement information for the target. The target measurement includes the measurement of at least one measurement object, which includes at least one of channel state information, location information, and beam information. The measurement information includes: Second indication information used to indicate the effectiveness of the target artificial intelligence model; The second indication information is determined based on the performance and performance threshold of the target artificial intelligence model. The performance indication information includes at least one of the following: Real-time performance indicators; Statistical performance indication information for multiple consecutive measurement time points or multiple consecutive measurement locations.

34. A first communication device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the measurement method as described in any one of claims 1 to 26.

35. A third communication device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the measurement method as described in claim 27 or 28.

36. A second communication device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the measurement method as described in claim 29 or 30.

37. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the measurement method as described in any one of claims 1 to 26, or the steps of the measurement method as described in claim 27 or 28, or the steps of the measurement method as described in claim 29 or 30.

Images