Communication control method

Abstract

One aspect of the present invention relates to a communication control method in user equipment of a mobile communication system. The communication control method includes a step in which the user equipment executes fine adjustment on a first trained AI / ML model on the basis of a first time required for executing fine adjustment of the first trained AI / ML model, a second time required for executing performance evaluation of the first trained AI / ML model, and an evaluation result of the performance evaluation. Here, the fine adjustment involves training the first trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

Description

Communication Control Method

[0001] The present disclosure relates to a communication control method.

[0002] In recent years, the Third Generation Partnership Project (3GPP) (registered trademark; the same applies hereinafter), a standardization project for mobile communication systems, has been studying the application of artificial intelligence (AI) technology, particularly machine learning (ML) technology, to wireless communication (air interface) of mobile communication systems.

[0003] 3GPP TR 38.843 V18.0.0 (2023-12)

[0004] A communication control method according to a first aspect is a communication control method for a user device in a mobile communication system. The communication control method includes a step of fine-tuning a first trained AI / ML model by the user device based on a first time required to perform fine-tuning of the first trained AI / ML model, a second time required to perform performance evaluation of the first trained AI / ML model, and an evaluation result of the performance evaluation. Here, the fine-tuning is training the first trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0005] A communication control method according to a second aspect is a communication control method in a network node of a mobile communication system. The communication control method includes a step of fine-tuning the second trained AI / ML model by the network node based on a third time required to perform fine-tuning of the second trained AI / ML model, a fourth time required to perform performance evaluation of the second trained AI / ML model, and an evaluation result of the performance evaluation. Here, the fine-tuning is training the second trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0006] FIG. 1 is a diagram showing an example of the configuration of a mobile communication system according to the first embodiment. FIG. 2 is a diagram showing an example of the configuration of a UE (user equipment) according to the first embodiment. FIG. 3 is a diagram showing an example of the configuration of a gNB (base station) according to the first embodiment. FIG. 4 is a diagram showing an example of the configuration of a protocol stack according to the first embodiment. FIG. 5 is a diagram showing an example of the configuration of a protocol stack according to the first embodiment. FIG. 6 is a diagram showing an example of the configuration of functional blocks of AI / ML technology according to the first embodiment. FIG. 7 is a diagram showing an example of operation in AI / ML technology according to the first embodiment. FIG. 8 is a diagram showing an example of the arrangement of functional blocks of AI / ML technology according to the first embodiment. FIG. 9 is a diagram showing an example of operation according to the first embodiment. FIG. 10 is a diagram showing an example of operation according to the first embodiment. FIG. 11 is a diagram showing an example of a setting message according to the first embodiment. FIG. 12 is a diagram showing an example of operation according to the first embodiment. FIG. 13 is a diagram showing an example of operation according to the first embodiment. FIG. 14 is a diagram showing an example of operation according to the first embodiment. FIG. 15 is a diagram showing an example of operation according to the first embodiment. FIG. 16 is a diagram showing an example of operation according to the second embodiment. FIG. 17 is a diagram illustrating an example of operation according to the second embodiment. FIG. 18 is a diagram illustrating an example of operation according to the second embodiment. FIG. 19 is a diagram illustrating an example of operation according to the second embodiment. FIG. 20 is a diagram illustrating an example of operation according to the second embodiment. FIG. 21 is a diagram illustrating an example of operation according to the third embodiment. FIG. 22 is a diagram illustrating an example of operation according to the third embodiment. FIG. 23 is a diagram illustrating an example of operation according to the fourth embodiment. FIG. 24 is a diagram illustrating an example of operation according to the fifth embodiment. FIG. 25 is a diagram illustrating an example of operation according to the fifth embodiment. FIG. 26 is a diagram illustrating an example of operation according to the fifth embodiment.

[0007] The present disclosure aims to appropriately perform fine-tuning on a trained AI / ML model.

[0008] [First embodiment] A mobile communication system according to a first embodiment will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0009] (Configuration of mobile communication system) The configuration of a mobile communication system according to the first embodiment will be described. FIG. 1 is a diagram showing an example of the configuration of a mobile communication system 1 according to the first embodiment. The mobile communication system 1 conforms to the 5th Generation System (5GS) of the 3GPP standard. Although 5GS will be described below as an example, the mobile communication system may also be at least partially applied to an LTE (Long Term Evolution) system. The mobile communication system may also be at least partially applied to a sixth generation (6G) system or later system.

[0010] The mobile communication system 1 includes a user equipment (UE) 100, a 5G radio access network (NG-RAN: Next Generation Radio Access Network) 10, and a 5G core network (5GC: 5G Core Network) 20. Hereinafter, the NG-RAN 10 may be simply referred to as the RAN 10. Furthermore, the 5GC 20 may be simply referred to as the core network (CN) 20. Furthermore, devices included in the core network CN may be referred to as core network devices.

[0011] The UE 100 is a mobile wireless communication device. The UE 100 may be any device that is used by a user. For example, the UE 100 may be a mobile phone terminal (including a smartphone) and / or a tablet terminal, a notebook PC, a communication module (including a communication card or a chipset), a sensor or a device provided in a sensor, a vehicle or a device provided in a vehicle (Vehicle UE), or an aircraft or a device provided in an aircraft (Aerial UE).

[0012] The NG-RAN 10 includes a base station (called a "gNB" in a 5G system) 200. The gNBs 200 are connected to each other via an Xn interface, which is an interface between base stations. The gNB 200 manages one or more cells. The gNB 200 performs wireless communication with a UE 100 that has established a connection with its own cell. The gNB 200 has a radio resource management (RRM) function, a routing function for user data (hereinafter simply referred to as "data"), a measurement control function for mobility control and scheduling, and the like. The term "cell" is used to indicate the smallest unit of a wireless communication area. The term "cell" is also used to indicate a function or resource for wireless communication with the UE 100. One cell belongs to one carrier frequency (hereinafter simply referred to as "frequency").

[0013] In addition, gNBs can also be connected to the Evolved Packet Core (EPC), which is the core network of LTE. LTE base stations can also be connected to 5GC. LTE base stations and gNBs can also be connected via an inter-base station interface.

[0014] The 5GC20 includes an AMF (Access and Mobility Management Function) and a UPF (User Plane Function) 300. The AMF performs various mobility controls for the UE 100. The AMF manages the mobility of the UE 100 by communicating with the UE 100 using NAS (Non-Access Stratum) signaling. The UPF controls data forwarding. The AMF and UPF 300 are connected to the gNB 200 via an NG interface, which is an interface between a base station and a core network. The AMF and UPF 300 may be core network devices included in the CN 20. The core network device and the gNB 200 may be collectively referred to as a network device.

[0015] 2 is a diagram showing an example of the configuration of a UE 100 (user equipment) according to the first embodiment. The UE 100 includes a receiving unit 110, a transmitting unit 120, and a control unit 130. The receiving unit 110 and the transmitting unit 120 constitute a communication unit that performs wireless communication with the gNB 200. The UE 100 is an example of a communication device.

[0016] The receiving unit 110 performs various types of reception under the control of the control unit 130. The receiving unit 110 includes an antenna and a receiver. The receiver converts a radio signal received by the antenna into a baseband signal (received signal) and outputs the baseband signal to the control unit 130.

[0017] The transmitting unit 120 performs various transmissions under the control of the control unit 130. The transmitting unit 120 includes an antenna and a transmitter. The transmitter converts a baseband signal (transmission signal) output by the control unit 130 into a radio signal and transmits it from the antenna.

[0018] The control unit 130 performs various controls and processes in the UE 100. Such processes include processes of each layer described below. The control unit 130 includes at least one processor and at least one memory. The memory stores programs executed by the processor and information used in the processes by the processor. The processor may include a baseband processor and a CPU (Central Processing Unit). The baseband processor performs modulation / demodulation, encoding / decoding, etc. of baseband signals. The CPU executes programs stored in the memory to perform various processes. Note that the processes or operations performed in the UE 100 may be performed in the control unit 130.

[0019] 3 is a diagram showing an example of the configuration of a gNB 200 (base station) according to the first embodiment. The gNB 200 includes a transmitter 210, a receiver 220, a controller 230, and a backhaul communication unit 250. The transmitter 210 and the receiver 220 constitute a communication unit that performs wireless communication with the UE 100. The backhaul communication unit 250 constitutes a network communication unit that communicates with the CN 20. The gNB 200 is another example of a communication device. Alternatively, the gNB 200 may be an example of a network node.

[0020] The transmitting unit 210 performs various transmissions under the control of the control unit 230. The transmitting unit 210 includes an antenna and a transmitter. The transmitter converts a baseband signal (transmission signal) output by the control unit 230 into a radio signal and transmits it from the antenna.

[0021] The receiving unit 220 performs various types of reception under the control of the control unit 230. The receiving unit 220 includes an antenna and a receiver. The receiver converts a radio signal received by the antenna into a baseband signal (received signal) and outputs the baseband signal to the control unit 230.

[0022] The control unit 230 performs various controls and processes in the gNB 200. Such processes include processes for each layer described below. The control unit 230 includes at least one processor and at least one memory. The memory stores programs executed by the processor and information used in the processes by the processor. The processor may include a baseband processor and a CPU. The baseband processor performs modulation / demodulation, encoding / decoding, etc. of baseband signals. The CPU executes programs stored in the memory to perform various processes. Note that the processes or operations performed in the gNB 200 may be performed by the control unit 230.

[0023] The backhaul communication unit 250 is connected to adjacent base stations via an Xn interface, which is an interface between base stations. The backhaul communication unit 250 is connected to the AMF / UPF 300 via an NG interface, which is an interface between a base station and a core network. The gNB 200 may be configured (i.e., functionally divided) with a central unit (CU) and a distributed unit (DU), and the two units may be connected via an F1 interface, which is a fronthaul interface.

[0024] FIG. 4 is a diagram showing an example of the configuration of a protocol stack of a radio interface of a user plane that handles data.

[0025] The user plane air interface protocol includes a physical (PHY) layer, a medium access control (MAC) layer, a radio link control (RLC) layer, a packet data convergence protocol (PDCP) layer, and a service data adaptation protocol (SDAP) layer.

[0026] The PHY layer performs encoding / decoding, modulation / demodulation, antenna mapping / demapping, and resource mapping / demapping. Data and control information are transmitted between the PHY layer of UE100 and the PHY layer of gNB200 via a physical channel. The PHY layer of UE100 receives downlink control information (DCI) transmitted from gNB200 on a physical downlink control channel (PDCCH). Specifically, UE100 performs blind decoding of the PDCCH using a radio network temporary identifier (RNTI) and acquires successfully decoded DCI as DCI addressed to the UE. The DCI transmitted from gNB200 has a CRC (Cyclic Redundancy Code) parity bit scrambled by the RNTI added.

[0027] In NR, UE100 can use a bandwidth narrower than the system bandwidth (i.e., the cell bandwidth). The gNB200 configures the UE100 with a bandwidth portion (BWP) consisting of contiguous PRBs (Physical Resource Blocks). The UE100 transmits and receives data and control signals in the active BWP. For example, up to four BWPs may be configurable for the UE100. Each BWP may have a different subcarrier spacing. The BWPs may overlap in frequency. When multiple BWPs are configured for the UE100, the gNB200 can specify which BWP to apply by controlling the downlink. This allows the gNB200 to dynamically adjust the UE bandwidth according to the amount of data traffic of the UE100, etc., thereby reducing UE power consumption.

[0028] The gNB 200 can configure, for example, up to three control resource sets (CORESETs) for each of up to four BWPs on the serving cell. The CORESET is a radio resource for control information to be received by the UE 100. Up to 12 or more CORESETs may be configured on the serving cell for the UE 100. Each CORESET may have an index of 0 to 11 or more. The CORESET may consist of six resource blocks (PRBs) and one, two, or three consecutive Orthogonal Frequency Division Multiplex (OFDM) symbols in the time domain.

[0029] The MAC layer performs data priority control, retransmission processing using Hybrid Automatic Repeat reQuest (HARQ), random access procedures, etc. Data and control information are transmitted between the MAC layer of the UE 100 and the MAC layer of the gNB 200 via a transport channel. The MAC layer of the gNB 200 includes a scheduler. The scheduler determines the uplink and downlink transport format (transport block size, modulation and coding scheme (MCS)) and the resource blocks to be allocated to the UE 100.

[0030] The RLC layer transmits data to the receiving RLC layer using the functions of the MAC layer and PHY layer. Data and control information are transmitted between the RLC layer of the UE 100 and the RLC layer of the gNB 200 via a logical channel.

[0031] The PDCP layer performs header compression / decompression, encryption / decryption, and the like.

[0032] The SDAP layer maps IP flows, which are units for Quality of Service (QoS) control by the core network, to radio bearers, which are units for QoS control by the access stratum (AS). Note that if the RAN is connected to the EPC, SDAP may not be required.

[0033] FIG. 5 is a diagram showing the configuration of a protocol stack of a radio interface of a control plane that handles signaling (control signals).

[0034] The protocol stack of the radio interface of the control plane includes a radio resource control (RRC) layer and a non-access stratum (NAS) instead of the SDAP layer shown in FIG.

[0035] RRC signaling for various settings is transmitted between the RRC layer of UE100 and the RRC layer of gNB200. The RRC layer controls logical channels, transport channels, and physical channels according to the establishment, re-establishment, and release of radio bearers. When there is a connection (RRC connection) between the RRC of UE100 and the RRC of gNB200, UE100 is in an RRC connected state. When there is no connection (RRC connection) between the RRC of UE100 and the RRC of gNB200, UE100 is in an RRC idle state. When the connection between the RRC of UE100 and the RRC of gNB200 is suspended, UE100 is in an RRC inactive state.

[0036] The NAS, which is located above the RRC layer, performs session management, mobility management, etc. NAS signaling is transmitted between the NAS of the UE 100 and the NAS of the AMF 300. Note that the UE 100 has an application layer and the like in addition to the radio interface protocol. Also, the layer below the NAS is called an Access Stratum (AS).

[0037] (AI / ML Technology) Next, the AI / ML technology according to the embodiment will be described. Fig. 6 is a diagram showing an example of the configuration of functional blocks of the AI / ML technology in the mobile communication system 1 according to the first embodiment.

[0038] The functional block configuration example shown in FIG. 6 includes a data collection unit (Data Collection) A1, a model training unit (Model Training) A2, a model inference unit (Inference) A3, a management unit (Management) A5, and a model storage unit (Model Storage) A6.

[0039] The functional block configuration example shown in FIG. 6 represents a functional framework of a general AI / ML technology. Therefore, depending on a hypothetical use case, some of the functional block configuration example (e.g., model recording unit A6, etc.) may not be included in the functional block configuration example. The functional block configuration example shown in FIG. 6 may also be distributed between the UE 100 and a network-side device. Alternatively, some functions of the functional block configuration example (e.g., model learning unit A2 or model inference unit A3, etc.) may be located in both the UE 100 and the network-side device.

[0040] The data collection unit A1 provides input data to the model learning unit A2, the model inference unit A3, and the management unit A5. The input data includes training data for the model learning unit A2, inference data for the model inference unit A3, and monitoring data for the management unit A5.

[0041] The training data is data required as input when the AI / ML model is learning. The inference data is data required as input when the AI / ML model is inferring. The monitoring data is data required as input when the AI / ML model is managing.

[0042] In addition, data collection may refer to the process of collecting data at a network node, a management entity, or a UE 100, for example, to train an AI / ML model, manage an AI / ML model, and perform inference on an AI / ML model.

[0043] The model learning unit A2 performs AI / ML model training, AI / ML model validation, and AI / ML model testing.

[0044] AI / ML model learning is the process of learning an AI / ML model from input / output relationships to obtain a trained AI / ML model to be used for inference. For example, considering y = ax + b, AI / ML model learning may be the process of optimizing a (slope) and b (intercept) by providing input (x) and output (y) (i.e., providing learning data).

[0045] Generally, machine learning includes supervised learning, unsupervised learning, and reinforcement learning. Supervised learning is a method that uses correct answer data as training data. Unsupervised learning is a method that does not use correct answer data as training data. For example, unsupervised learning memorizes feature points from a large amount of training data and determines the correct answer (estimates the range). Reinforcement learning is a method that assigns a score to the output result and learns how to maximize the score. Although supervised learning will be described below, either unsupervised learning or reinforcement learning may be applied as machine learning.

[0046] The model learning unit A2 outputs a trained AI / ML model (Trained Model) obtained by AI / ML model learning to the model recording unit A6, and also outputs an updated AI / ML model (Updated Model) obtained by relearning the trained AI / ML model to the model recording unit A6.

[0047] In the following, AI / ML model learning may be referred to as "model learning" or "learning."

[0048] The model inference unit A3 performs AI / ML model inference. Specifically, the model inference unit A3 applies the inference data provided by the data collection unit A1 to the trained AI / ML model (or updated AI / ML model) to obtain inference output data. For example, in the equation y = ax + b, x corresponds to the inference data and y corresponds to the inference output data. Note that "y = ax + b" is an AI / ML model. A model with optimized slope and intercept, for example, "y = 5x + 3," is a trained AI / ML model. There are various model approaches, including linear regression analysis, neural networks, and decision tree analysis. The above "y = ax + b" can also be considered a type of linear regression analysis.

[0049] The model inference unit A3 outputs inference output data to the management unit A5. The model inference unit A3 also receives management instructions from the management unit A5. For example, the management instructions include selection of an AI / ML model, activation (deactivation) of an AI / ML model, switching of an AI / ML model, and fallback (performing inference without using an AI / ML model). The model inference unit A3 performs model inference in accordance with the management instructions.

[0050] Note that AI / ML model inference is, for example, a process of obtaining a set of outputs from a set of inputs using a trained AI / ML model (or an updated AI / ML model). Alternatively, model inference may be a process of obtaining inference output data from inference data using a trained AI / ML model (or an updated AI / ML model). Hereinafter, AI / ML model inference may be referred to as "model inference" or "inference."

[0051] In the following, an AI / ML model that is currently being trained (or updated) may be referred to as a training AI / ML model (or an updating AI / ML model). In the following, when there is no need to distinguish between a training (or updating) AI / ML model and a trained (or updated) AI / ML model, they may be simply referred to as an "AI / ML model."

[0052] The management unit A5 supervises operations on the AI / ML model (selection, activation, deactivation, switching, fallback, etc.). The management unit A5 also supervises monitoring of the AI / ML model. The management unit A5 can also perform operations to ensure appropriate inference operations based on monitoring data and inference output data. To this end, the management unit A5 outputs a model transfer and / or model delivery request (Model Transfer / Delivery Request) to the model recording unit A6, and causes the trained (or updated) AI / ML model recorded in the model recording unit A6 to be output to the model inference unit A3. The management unit A5 also outputs management instructions to the model inference unit A3 and supervises operations on the AI / ML model. Furthermore, the management unit A5 can output performance feedback and a re-learning request to the model learning unit A2, causing the model learning unit A2 to re-learn the AI / ML model (i.e., update the learned AI / ML model).

[0053] FIG. 7 is a diagram illustrating an example of operation in the AI / ML technique according to the first embodiment.

[0054] In Fig. 7, the transmitting entity TE is an entity capable of performing model inference and transmitting inference output data to the receiving entity RE. Meanwhile, the receiving entity RE is an entity capable of receiving inference output data from the transmitting entity TE. Model training may be performed in the transmitting entity TE. The model training may also be performed in the receiving entity RE. If the model training is performed in the receiving entity RE, the trained AI / ML model may be transmitted from the receiving entity RE to the transmitting entity TE.

[0055] The entity may be, for example, a device, a functional block included in the device, or a hardware block included in the device.

[0056] For example, the transmitting entity TE may be the UE 100, and the receiving entity RE may be the gNB 200 or a core network device. Alternatively, the transmitting entity TE may be the gNB 200 or a core network device, and the receiving entity RE may be the UE 100.

[0057] As shown in Fig. 7 , in step S1, the transmitting entity TE transmits control data related to AI / ML technology to the receiving entity RE and receives the control data from the receiving entity RE. The control data may be an RRC message, which is signaling of the RRC layer (i.e., Layer 3). The control data may be a MAC Control Element (CE), which is signaling of the MAC layer (i.e., Layer 2). The control data may be Downlink Control Information (DCI), which is signaling of the PHY layer (i.e., Layer 1). The downlink signaling may be UE-specific signaling. The downlink signaling may be broadcast signaling. The control data may be a control message in a control layer (e.g., an AI / ML layer) dedicated to artificial intelligence or machine learning. Alternatively, the control data may be a NAS message in the NAS layer. The control data may include a performance feedback request and / or a re-learning request transmitted from the management unit A5 to the model learning unit A2. Alternatively, the control data may include a model transfer request and / or a model delivery request sent from the management unit A5 to the model recording unit A6, or a management instruction sent from the management unit A5 to the model inference unit A3.

[0058] (Layout Examples and Use Cases) Next, a description will be given of how the functional blocks shown in Fig. 6 are arranged in the mobile communication system 1. Below, layout examples of the functional blocks will be described along with specific use cases.

[0059] For example, there are three use cases in which AI / ML technology is applied:

[0060] (X1.1) "CSI (Channel State Information) Feedback Enhancement"

[0061] (X1.2) "Beam management"

[0062] (X1.3) “Positioning accuracy enhancement”

[0063] (X1.1) Example of functional block arrangement in "CSI feedback improvement" "CSI feedback improvement" represents a use case in which AI / ML technology is applied to CSI fed back from UE100 to gNB200, for example. CSI is information about the channel state in the downlink between UE100 and gNB200. The CSI includes at least one of a channel quality indicator (CQI), a precoding matrix indicator (PMI), and a rank indicator (RI). The gNB200 performs, for example, downlink scheduling based on the CSI feedback from UE100.

[0064] 8 is a diagram showing an example of the arrangement of each functional block in "CSI feedback improvement". In the example of "CSI feedback improvement" shown in FIG. 8, a data collection unit A1, a model learning unit A2, and a model inference unit A3 are included in the control unit 130 of the UE 100. On the other hand, a data processing unit A4 is included in the control unit 230 of the gNB 200. That is, model learning and model inference are performed in the UE 100. FIG. 8 shows an example in which the transmitting entity TE is the UE 100 and the receiving entity RE is the gNB 200.

[0065] In "CSI feedback improvement", the gNB 200 transmits a reference signal for the UE 100 to estimate the downlink channel state. As the reference signal, a CSI reference signal (CSI-RS) will be described as an example below, but the reference signal may be a demodulation reference signal (DMRS).

[0066] First, in model learning, UE100 (receiving unit 110) receives a first reference signal from gNB200 using a first resource. Then, UE100 (model learning unit A2) derives a learned model for inferring CSI from the reference signal using learning data including the first reference signal and CSI. Such a first reference signal is sometimes referred to as a full CSI-RS.

[0067] For example, the CSI generation unit 131 performs channel estimation using the received signal (CSI-RS) received by the receiving unit 110 to generate CSI. The transmitting unit 120 transmits the generated CSI to the gNB 200. The model learning unit A2 performs model learning using a set of the received signal (CSI-RS) and the CSI as learning data, and derives a learned model for inferring the CSI from the received signal (CSI-RS).

[0068] Second, in model inference, the receiver 110 receives a second reference signal from the gNB 200 using a second resource that is less than the first resource. Then, the model inference unit A3 uses the trained model to infer CSI as inference result data using the second reference signal as inference data. Hereinafter, such a second reference signal may be referred to as a partial CSI-RS or a punctured CSI-RS.

[0069] For example, the model inference unit A3 inputs the partial CSI-RS received by the receiving unit 110 as inference data into the trained model, and infers CSI from the CSI-RS. The transmitting unit 120 transmits the inferred CSI to the gNB 200.

[0070] This enables UE 100 to feed back (or transmit) accurate (complete) CSI to gNB 200 from the small amount of CSI-RS (partial CSI-RS) received from gNB 200. For example, gNB 200 can reduce (puncture) CSI-RS when intended to reduce overhead. In addition, UE 100 can respond to situations where the radio conditions deteriorate and some CSI-RS cannot be received normally.

[0071] FIG. 9 is a diagram illustrating an example of operation in "CSI feedback improvement" according to the first embodiment.

[0072] 9, in step S10, the gNB 200 may notify or set the CSI-RS transmission pattern (puncture pattern) in the inference mode to the UE 100 as control data. For example, the gNB 200 transmits to the UE 100 the antenna port and / or time-frequency resource that transmits or does not transmit the CSI-RS in the inference mode.

[0073] In step S11, gNB200 may send a switching notification to UE100 to start learning mode.

[0074] In step S12, the UE 100 starts a learning mode.

[0075] In step S13, the gNB 200 transmits the full CSI-RS. The receiver 110 of the UE 100 receives the full CSI-RS, and the CSI generator 131 generates (or estimates) CSI based on the full CSI-RS. In the learning mode, the data collector A1 collects the full CSI-RS and CSI. The model learning unit A2 uses the full CSI-RS and the CSI as learning data to create a learned AI / ML model.

[0076] In step S14, UE100 transmits the generated CSI to gNB200.

[0077] Thereafter, in step S15, when the model learning is completed, the UE 100 transmits a completion notification indicating that the model learning is completed to the gNB 200. The UE 100 may transmit a completion notification when the creation of the learned model is completed.

[0078] In step S16, in response to receiving the completion notification, gNB200 sends a switching notification to UE100 to switch UE100 from learning mode to inference mode.

[0079] In step S17, in response to receiving the switching notification, the UE 100 switches from the learning mode to the inference mode.

[0080] In step S18, the gNB 200 transmits a partial CSI-RS. The receiver 110 of the UE 100 receives the partial CSI-RS. In the inference mode, the data collector A1 collects the partial CSI-RS. The model inference unit A3 inputs the partial CSI-RS as inference data into the trained model, and obtains CSI as the inference result.

[0081] In step S19, the UE 100 feeds back (or transmits) the CSI, which is the inference result, to the gNB 200 as inference result data. In the UE 100, by repeating model learning in the learning mode, a trained model with a predetermined accuracy or higher can be generated. It is expected that the inference result using the trained model generated in this way will also have a predetermined accuracy or higher.

[0082] In addition, in step S20, if UE100 determines that model learning is necessary, it may send a notification indicating that model learning is necessary to gNB200 as control data.

[0083] In the example shown in Fig. 9, an example has been described in which the training data is "(full) CSI-RS" and "CSI", and the inference data is "(partial) CSI-RS". Hereinafter, the training data and / or the inference data may be referred to as a "dataset".

[0084] In "improving CSI feedback," in addition to "CSI-RS" and "CSI," at least one of the following data or information may be used as a data set:

[0085] (Y1) RSRP (Reference Signals Received Power), RSRQ (Reference Signal Received Quality), SINR (Signal-to-interference-plus-noise ratio), or AD converter output waveform (these measurements may be CSI-RS or other received signals received from gNB200).

[0086] (Y2) Bit Error Rate (BER) or Block Error Rate (BLER) (The total number of transmitted bits (or the total number of transmitted blocks) is known, and the BER (or BLER) may be measured based on the CSI-RS.)

[0087] (Y3) The movement speed of UE100 (which may be measured by a speed sensor within UE100). The data set to be used for machine learning may be set. For example, the following processing may be performed. That is, UE100 transmits capability information indicating which type of input data it can handle in machine learning to gNB200 as control data. The capability information may represent, for example, any of the data or information shown in (Y1) to (Y3). The capability information may be information in which learning data and inference data are separately specified. Then, gNB200 transmits data type information to be used as the data set to UE100 as control data. The data type information may represent, for example, any of the data or information shown in (Y1) to (Y3). Furthermore, the data type information may specify separately data type information to be used as learning data and data type information to be used as inference data.

[0088] An example of the arrangement of functional blocks in (X1.1) "CSI feedback" has been described above. The above-mentioned arrangement example is just one example, and in 3GPP, the arrangement example of functional blocks is still in the process of being studied. Similarly, (X1.2) "Beam management" and (X1.3) "Position accuracy improvement" are also still in the process of being studied.

[0089] (X1.4) Example of Model Transfer Next, we will explain the transfer of an AI / ML model (Model Transfer). Note that the terms "transfer of an AI / ML model" and "delivery of an AI / ML model" have the same meaning.

[0090] (X1.4.1) First operation pattern related to model forwarding Figure 10 is a diagram showing an example of an operation of the first operation pattern related to model forwarding according to the first embodiment. In the example shown in Figure 10, the receiving entity RE will be described as mainly being the UE 100, but the receiving entity RE may be the gNB 200 or the AMF 300. Also, in the example shown in Figure 10, the transmitting entity TE will be described as being the gNB 200, but the transmitting entity TE may be the UE 100 or the AMF 300.

[0091] 10, in step S25, the gNB 200 transmits a capability inquiry message to the UE 100 to request transmission of a message including an information element (IE) indicating the execution capability for the learning process. The UE 100 receives the capability inquiry message. However, the gNB 200 may transmit the capability inquiry message when it executes the learning process (when it determines that it will execute the learning process).

[0092] In step S26, the UE 100 transmits to the gNB 200 a message including an information element indicating execution capabilities for the learning process (in another respect, the execution environment for the learning process). The gNB 200 receives the message. The message may be an RRC message (for example, a "UE Capability" message or a newly defined message (for example, a "UE AI Capability" message, etc.). Alternatively, the transmitting entity TE may be the AMF 300, and the message may be a NAS message. Alternatively, if a new layer is defined for performing or controlling the learning process (AI / ML process), the message may be a message of the new layer.

[0093] The information element indicating the execution capability related to the learning process may be an information element indicating the capability of a processor for executing the learning process and / or an information element indicating the capability of a memory for executing the learning process. Specifically, the information element indicating the processor capability may be an information element indicating the product number (or model number) of the AI ​​processor. Specifically, the information element indicating the memory capability may be information indicating the memory capacity.

[0094] Alternatively, the information element indicating the execution capability of the learning process may be an information element indicating the execution capability of the inference process (model inference). Specifically, the information element indicating the execution capability of the inference process may be an information element indicating whether a deep neural network model is supported or an information element indicating the time (or response time) required to execute the inference process.

[0095] Alternatively, the information element indicating the execution capability related to the learning process may be an information element indicating the execution capability of the learning process (model learning). Specifically, the information element indicating the execution capability of the learning process may be an information element indicating the number of concurrent executions of the learning process or an information element indicating the processing capacity of the learning process.

[0096] In step S27, gNB200 determines the model to be configured (or deployed) in UE100 based on the information elements contained in the message received in step S26.

[0097] In step S28, gNB200 transmits a message including the model determined in step S27 to UE100. UE100 receives the message and performs a learning process (i.e., a model learning process and / or a model inference process) using the model included in the message. A specific example of step S28 will be described in the following second operation pattern.

[0098] (X1.4.2) Second Operation Pattern Related to Model Transfer FIG. 11 is a diagram showing an example of a configuration message including a model and additional information according to the first embodiment. The configuration message may be an RRC message transmitted from the gNB 200 to the UE 100 (for example, an "RRC Reconfiguration" message, or a newly defined message (for example, an "AI Deployment" message or an "AI Reconfiguration" message, etc.). Alternatively, the configuration message may be a NAS message transmitted from the AMF 300 to the UE 100. Alternatively, when a new layer for performing or controlling machine learning processing (AI / ML processing) is defined, the message may be a message of the new layer.

[0099] In the example of FIG. 11, the setting message includes three models (Model #1 to #3). Each model is included as a container in the setting message. However, the setting message may include only one model. The setting message further includes, as additional information, three individual additional information (Info #1 to #3) provided individually corresponding to each of the three models (Model #1 to #3), and common additional information (Meta-Info) commonly associated with the three models (Model #1 to #3). Each of the individual additional information (Info #1 to #3) includes information unique to the corresponding model. The common additional information (Meta-Info) includes information common to all models in the setting message.

[0100] The individual additional information may be a model index indicating an index (index number) assigned to each model, or may be a model execution condition indicating the performance (e.g., processing delay) required to apply (execute) the model.

[0101] The individual additional information or the common additional information may be a model usage that specifies a function to which a model is to be applied (e.g., "CSI feedback," "beam management," "positioning," etc.). The individual additional information or the common additional information may be a model selection criterion that applies (executes) a corresponding model depending on whether a specified criterion (e.g., a moving speed) is satisfied.

[0102] (Fine-tuning and re-learning according to the first embodiment) Depending on the use case or scenario, delivering / transferring the trained AI / ML model to the UE 100 may be beneficial, even at the expense of overhead and delay. However, in general, it may not be appropriate in some cases, taking into account the storage capacity of the UE 100, etc.

[0103] Here, when focusing on fine-tuning and / or relearning of the trained AI / ML model, it is conceivable that the fine-tuning and / or relearning may replace the transfer of the trained AI / ML model. That is, it is conceivable that the transfer of the trained AI / ML model may not be necessary if the fine-tuning and / or relearning is performed appropriately. This makes it possible, for example, in the mobile communication system 1, to perform appropriate model inference operations using the updated AI / ML model after updating, without considering the storage capacity of the UE 100 or network overhead and delays.

[0104] Therefore, in the first embodiment, attention is paid to fine tuning and relearning. In particular, attention is paid to fine tuning in the first embodiment. First, how relearning is handled in 3GPP will be described.

[0105] (Relearning According to First Embodiment) 3GPP defines life cycle management (LCM) for AI / ML models. From the perspective of LCM, processes are performed on an AI / ML model in the following order: model learning (i.e., "learning"), model inference (i.e., "inference"), model monitoring, and model update. Each process is not strictly defined in 3GPP, but it is assumed that relearning is performed at the model update stage after model monitoring. In other words, it is assumed that model monitoring is performed on a trained AI / ML model, and that relearning is performed on the trained AI / ML model based on the results of the model monitoring.

[0106] On the other hand, in the functional block configuration shown in Fig. 6, the management unit A5 issues a re-learning request to the model training unit A2, which causes the model training unit A2 to execute re-learning. Therefore, from the viewpoint of the functional block configuration shown in Fig. 6, after management in the management unit A5, re-learning is performed in the model training unit A2.

[0107] A specific explanation will be given using a use case. Figures 12 and 13 are diagrams showing an operation example according to the first embodiment. In particular, Figures 12 and 13 show an operation example in a UE-side model (a model in which inference is performed on the UE 100 side) in the use case of "beam management." Also, Figures 12 and 13 show an operation example from inference to relearning.

[0108] As shown in Figures 12 and 13, after inference (step S30 in Figure 12), management (step S40) is performed, and then relearning (step S50 in Figure 13) is performed. In particular, in the examples shown in Figures 12 and 13, monitoring is performed in management (step S40). In the use case of "beam management" in the UE side model, 3GPP specifies cases where monitoring is performed by the UE 100 and cases where monitoring is performed by the gNB 200. Specifically, there are the following three cases.

[0109] (Z1) When monitoring is performed on the UE 100 side, and control (selection, (de)activation, switching, fallback, etc., hereinafter sometimes referred to as "model control") of the learned AI / ML model on the UE side is also performed on the UE 100 side.

[0110] (Z2) When monitoring is performed on the UE 100 side and model control for the learned AI / ML model on the UE side is performed on the gNB 200 side

[0111] (Z3) When gNB200 monitors and controls the trained AI / ML model on the UE side In FIG. 12, steps S41 and S42 represent the above-described case of (Z1). That is, in step S41, the control unit 130 of UE100 monitors the performance of the inference (step S30) performed by UE100. Then, in step S42, the control unit 130 performs model control based on the monitoring result. The control unit 130 may perform model control based on the monitoring result that the inference performance is equal to or less than a performance threshold. As model control, the control unit 130 may perform re-learning of the trained AI / ML model. Here, the performance threshold is a threshold used to determine whether the inference performance (or accuracy) of the trained AI / ML model is good or bad. The control unit 130 may compare the inference results (or monitoring results, or the difference between the inference results and the monitoring results) of the trained AI / ML model with a performance threshold to determine the performance of the trained AI / ML model.

[0112] Steps S43 to S45 represent the case of (Z2) described above. That is, in step S43, the control unit 130 of the UE 100 monitors the performance of the inference (step S30) performed by the UE 100. In step S44, the transmission unit 120 of the UE 100 transmits the monitoring result to the gNB 200. The transmission unit 120 may transmit control data including the monitoring result to the gNB 200. The reception unit 220 of the gNB 200 receives the monitoring result. In step S45, the control unit 230 of the gNB 200 decides to perform model control based on the monitoring result, and instructs the UE 100 to perform model control. The transmission unit 210 of the gNB 200 transmits the instruction to the UE 100. The instruction may also be transmitted included in the control data. The reception unit 110 of the UE 100 receives the instruction. The control unit 130 of the UE 100 may decide to re-learn the trained AI / ML model in accordance with the instruction to execute model control.

[0113] Steps S46 to S49 represent the case of (Z3) described above. That is, in step S46, the control unit 130 of the UE 100 calculates a performance metric (or performance metrics) related to the performance of the inference (step S30) performed by the UE 100. The performance metric represents, for example, an evaluation index of the trained AI / ML model when the inference is performed. Specifically, the performance metric is a value for analyzing the accuracy of the current inference, i.e., the confidence level, and may be, for example, squared generalized cosine similarity (SGCS), throughput, or block error rate (BLER). The performance metric may also include CPU usage, memory usage, inference time, and / or data usage during the inference. The transmission unit 120 of the UE 100 transmits the performance metric to the gNB 200. The transmission unit 120 may transmit control data including the performance metric to the gNB 200. The receiver 220 of the gNB 200 receives the performance metric. In step S48, the control unit 230 of the gNB 200 monitors the performance of the inference (step S30) using the performance metric. When the control unit 230 obtains a detection result based on the monitoring result that the inference performance of the trained AI / ML model on the UE 100 side is below a performance threshold, the control unit 230 instructs the UE 100 to perform model control. The model control instruction may be a re-learning instruction, as in step S45. The receiver 110 of the UE 100 receives the model control instruction. The control unit 130 of the UE 100 may decide to perform re-learning in accordance with the model control instruction.

[0114] Then, in step S50 shown in Fig. 13, re-learning is performed. The re-learning may be performed in UE 100. That is, in step S51, control unit 130 of UE 100 generates learning data. Then, in step S52, control unit 130 uses the learning data to perform re-learning on the trained AI / ML model.

[0115] Alternatively, the re-learning may be performed by an OTT (Over The Top) server 500. The trained AI / ML model may be stored in the OTT server 500. Note that the OTT server may be an external server located outside the mobile communication system 1. In this case, in step S53, the control unit 130 of the UE 100 generates training data, and in step S54, the transmission unit 120 of the UE 100 transmits the training data to the OTT server 500. In step S55, the OTT server 500 performs the re-learning.

[0116] (Communication Control Method According to First Embodiment) The operation examples shown in Figs. 12 and 13 are examples of operation related to relearning. Currently, 3GPP does not strictly distinguish between relearning and fine-tuning. In the first embodiment, fine-tuning is distinguished from relearning, and fine-tuning of a trained AI / ML model is appropriately performed in the mobile communication system 1. This makes it possible, for example, in the mobile communication system 1, to create an updated AI / ML model more quickly than in the case of relearning, and to perform inference using the updated AI / ML model more quickly than in the case of relearning.

[0117] That is, the first embodiment aims to enable appropriate fine-tuning of a trained AI / ML model.

[0118] In the first embodiment, in order to distinguish between fine adjustment and relearning, fine adjustment and relearning are defined as follows.

[0119] That is, fine-tuning may involve, for example, training a trained AI / ML model using training data with a data volume equal to or less than a data volume threshold. Alternatively, fine-tuning may involve training a trained AI / ML model using training data with a data volume equal to or less than a data volume threshold, and further training layers (hereinafter sometimes referred to as a "predetermined number of layers") that are equal to or less than a layer threshold and include the final layer among multiple layers up to the final layer that constitute the trained AI / ML model. Fine-tuning (the parameters of) a predetermined number of layers among multiple layers included in the trained AI / ML model makes it possible to adapt the model to a specific new task or a specific new dataset.

[0120] On the other hand, re-learning may refer to, for example, training a trained AI / ML model using training data with a data volume greater than the data volume threshold. Alternatively, re-learning may refer to training a trained AI / ML model using training data with a data volume greater than the data volume threshold, and may further refer to training layers including the final layer that are greater than the layer threshold and that constitute a plurality of layers up to the final layer that constitute the trained AI / ML model.

[0121] Comparing fine-tuning and relearning, we can say the following:

[0122] First, fine-tuning requires less data to train than re-training, and therefore can obtain an updated AI / ML model faster than re-training.

[0123] Second, fine-tuning allows training for fewer layers than re-training, making it possible to adapt an updated AI / ML model to a specific new task or a specific new dataset. On the other hand, re-training changes parameters for many layers of a trained AI / ML model compared to fine-tuning. Therefore, re-training makes it possible to create a new updated AI / ML model that corresponds to a new dataset compared to fine-tuning.

[0124] Third, re-learning takes longer processing time than fine-tuning, and may require a lot of time, whereas fine-tuning can be performed faster and more easily than re-learning.

[0125] The fine tuning may be called model fine tuning, and the relearning may be called model re-learning.

[0126] In the first embodiment, to distinguish fine-tuning from relearning and to appropriately perform fine-tuning, the fine-tuning is performed as follows. That is, a user device (e.g., UE 100) performs fine-tuning on a trained AI / ML model based on a fine-tuning execution time indicating the time required for fine-tuning the trained AI / ML model. Here, fine-tuning refers to training the trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0127] As described above, in the first embodiment, the fine-tuning is performed in the UE 100 based on the fine-tuning execution time, and it is also possible to perform the fine-tuning when the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold, and not perform the fine-tuning when the fine-tuning execution time requires more time than the fine-tuning execution time threshold. This allows the UE 100 to perform the fine-tuning based on a certain judgment, for example, and thus makes it possible to appropriately perform the fine-tuning on the trained AI / ML model.

[0128] Furthermore, for example, although it is not necessary to train the entire trained AI / ML model to obtain an updated AI / ML model, training the entire trained AI / ML model may not always be efficient. By performing fine-tuning, it is also possible to train a portion of the trained AI / ML model to efficiently obtain an updated AI / ML model.

[0129] (Example of Operation According to First Embodiment) Next, an example of operation according to the first embodiment will be described.

[0130] 14 and 15 are diagrams showing an example of operation according to the first embodiment. Note that in FIGS. 14 and 15, gNB200 and network device 400 are shown, but "gNB200" indicates a case where processing is performed by gNB200 alone among network devices 400. "gNB200" may also be a network node. On the other hand, "network device 400" indicates a case where processing is performed by any of network devices 400 including gNB200. Also, FIGS. 14 and 15 are use cases of beam management, and show an example of operation in the case of a UE-side model.

[0131] 14 and 15, information such as conditions and instructions, data, or messages are transmitted and received between the UE 100 and the gNB 200. These pieces of information may be transmitted and received using the control data described above. In the following description, the fact that transmission and reception are performed using control data may be omitted.

[0132] 14 and 15, information, data, or messages such as an AI / ML model are transmitted and received between the UE 100 and the network device 400. This information may be transmitted and received using a predetermined message according to a predetermined protocol set between the UE 100 and the network device 400. For example, the predetermined message may be control data if the network device 400 is a gNB 200, or may be a NAS message if the network device 400 is an AMF. In the following description, the fact that transmission and reception are performed using a predetermined message may be omitted.

[0133] 14, in step S60, network device 400 transmits (transfers) the trained AI / ML model to UE 100. Receiving unit 110 of UE 100 receives the trained AI / ML model.

[0134] In step S61, the network device 400 transmits, to the UE 100, parameters for calculating the fine-tuning execution time (hereinafter, may be referred to as "fine-tuning execution time calculation parameters").

[0135] First, the parameters for calculating the fine-tuning execution time may include information representing the type of the trained AI / ML model (step S60). The information representing the type may be, for example, ensemble learning, neural network, or the like. Ensemble learning is, for example, a machine learning method that combines multiple trained AI / ML models to obtain an output. Random forest, which is one method of ensemble learning, may be indicated as information representing the type of model. Random forest is a machine learning method that uses ensemble learning with decision trees.

[0136] Second, the parameters for calculating the fine-tuning execution time may include the complexity of the trained AI / ML model (step S60). Specifically, the complexity may be expressed by the number of neurons and hidden layers of the trained AI / ML model, the number of data items to be handled, the number of calculations of the loss function, and / or the number of calculations of the gradient.

[0137] Thirdly, a sample may be transmitted from network device 400 to UE 100 together with a parameter for calculating the fine-tuning execution time. The sample represents, for example, the fine-tuning execution time when a CPU (or GPU) performs fine-tuning using a predetermined number of pieces of learning data with a predetermined memory capacity.

[0138] Fourth, the fine-tuning execution time calculation parameters may include identification information of the trained AI / ML model for which the fine-tuning execution time is to be calculated. The identification information may be the model ID, function name, or model name of the trained AI / ML model.

[0139] The trained AI / ML model (step S60) and the parameters for calculating the fine-tuning execution time (step S61) may be transmitted in a single message, or may be transmitted in separate messages as shown in FIG. 14.

[0140] In step S62, the OTT server 500 may transmit the trained AI / ML model to the UE 100. Also, in step S63, the OTT server 500 may transmit parameters for calculating the fine-tuning execution time to the UE 100. In step S63, the OTT server may transmit the above-described sample to the UE 100. Taking into account the processing load on the network side, the OTT server may train the AI / ML model and generate the trained AI / ML model. Taking into account such a case, steps S62 and S63 may be performed. The OTT server 500 may perform steps S62 and S63 using messages according to a protocol established between the OTT server 500 and the UE 100. The receiving unit 110 of the UE 100 receives the trained AI / ML model and the parameters for calculating the fine-tuning execution time.

[0141] In step S64, the control unit 130 of the UE 100 calculates the fine-tuning execution time for the trained AI / ML model using the fine-tuning execution time calculation parameters. The control unit 130 may perform fine-tuning on the trained AI / ML model and calculate (or measure) the fine-tuning execution time by actual measurement. The fine-tuning execution time may represent the time from the start to the end of the fine-tuning.

[0142] In step S65, the transmitter 120 of the UE 100 transmits the fine-tuning execution time to the gNB 200. The receiver 220 of the gNB 200 receives the fine-tuning execution time.

[0143] In step S66, the control unit 130 of the UE 100 performs inference on the trained AI / ML model received in step S60 (or step S62).

[0144] In step S67, management is performed in the mobile communication system 1.

[0145] In the first embodiment, management will be explained for each of the cases (Z1) to (Z3).

[0146] (1-1) When monitoring and model control are performed on the UE side (in the case of (Z1))

[0147] In the case of (Z1), steps S68 to S71 are executed.

[0148] Specifically, in step S68, the control unit 230 of gNB200 determines fine-tuning execution conditions indicating the conditions for performing fine-tuning of the learned AI / ML model in UE100 based on the fine-tuning execution time received in step S65.

[0149] First, the fine-tuning execution condition may include a fine-tuning execution time threshold. In the UE 100, the fine-tuning may be performed when the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold, and the fine-tuning may not be performed when the fine-tuning execution time takes longer than the fine-tuning execution time threshold. Alternatively, the reverse may be true. The fine-tuning execution condition may include information indicating that the fine-tuning is performed if the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold (or information indicating that the fine-tuning is not performed if the fine-tuning execution time exceeds the fine-tuning execution time threshold).

[0150] Second, the fine-tuning execution condition may include information about model control when fine-tuning is not executed. The information about model control may be, for example, information indicating performing re-learning, falling back to legacy (i.e., obtaining output without using a trained AI / ML model), or doing nothing.

[0151] Third, the fine-tuning execution conditions may include conditions for using the updated AI / ML model after fine-tuning. The conditions for using the updated AI / ML model may be expressed, for example, by time and / or location. The location may be expressed, for example, by any one of a cell ID, a RAN-based Notification Area (RNA), and a Public Land Mobile Network (PLMN).

[0152] Fourth, the fine-tuning execution condition may include a transmission request for the data set (learning data) used in the fine-tuning. When the transmission request is included, the transmitter 120 of the UE 100 transmits the data set used in the fine-tuning to the gNB 200.

[0153] Fifth, the fine-tuning execution condition may include information regarding whether or not to register the updated AI / ML model after the fine-tuning is performed. When the fine-tuning execution condition includes the information, the UE 100 transmits to the gNB 200 information indicating whether or not to register the updated AI / ML model.

[0154] Sixth, the fine-tuning execution condition may include information instructing that the fine-tuning be performed. Alternatively, the fine-tuning execution condition may include information instructing that the fine-tuning not be performed. The control unit 130 of the UE 100 may determine whether or not to perform the fine-tuning according to the instruction information. In this case, the control unit 230 of the gNB 200 may determine whether or not to perform the fine-tuning in the UE 100 based on the fine-tuning execution time received from the UE 100 in step S65.

[0155] Seventh, the fine-tuning execution conditions may include identification information (such as a model ID or function name) of the trained AI / ML model on which fine-tuning is to be performed.

[0156] In step S69, the transmitter 210 of the gNB 200 transmits the fine-tuning execution condition to the UE 100. The receiver 220 of the UE 100 receives the fine-tuning execution condition.

[0157] In step S70, the control unit 130 of the UE 100 monitors the inference performance of the trained AI / ML model (step S66). Based on the monitoring results, the control unit 130 detects that the inference performance (or accuracy) of the trained AI / ML model is poor, i.e., that the monitoring results are below a performance threshold. The monitoring results indicate, for example, data measured using a legacy method that does not use AI / ML functions (e.g., RSRP (Reference Signal Received Power) or beam angle in the "beam management" use case). The monitoring results may also include CPU (or GPU) usage, memory usage, available memory capacity, and / or monitoring time. The performance threshold may be a value corresponding to these indicators of the monitoring results. When the monitoring results are below the performance threshold, the control unit 130 may execute the subsequent step S71.

[0158] In step S71, the control unit 130 of the UE 100 determines whether or not to perform fine-tuning based on the fine-tuning execution conditions received in step S69. Specifically, the control unit 130 determines whether the fine-tuning execution time satisfies the fine-tuning execution conditions based on the fine-tuning execution time calculated in step S64 and the fine-tuning execution conditions received in step S69. If the control unit 130 determines that the fine-tuning execution conditions are satisfied, the control unit 130 determines to perform fine-tuning. For example, the control unit 130 may determine to perform fine-tuning if the fine-tuning execution time is equal to or less than a fine-tuning execution time threshold included in the fine-tuning execution conditions. On the other hand, if the control unit 130 determines that the fine-tuning execution time does not satisfy the fine-tuning execution conditions, the control unit 130 may determine not to perform fine-tuning. For example, if the fine-tuning execution time requires more time than the fine-tuning execution time threshold, the control unit 130 may determine not to perform fine-tuning. If the fine-tuning execution conditions include information instructing the execution of fine-tuning (or information instructing not to perform fine-tuning), the control unit 130 may determine whether or not to perform fine-tuning in accordance with the instruction information.

[0159] (1-2) When monitoring is performed on the UE 100 side and model control is performed on the gNB 200 side (in the case of (Z2))

[0160] In the case of (Z2), steps S75 to S78 shown in FIG. 15 are executed.

[0161] That is, in step S75, the control unit 130 of the UE 100 monitors the performance of the inference (step S66) for the trained AI / ML model.

[0162] In step S76, the transmitter 120 of the UE 100 transmits the monitoring result to the gNB 200. The receiver 220 of the gNB 200 receives the monitoring result. The control unit 230 of the gNB 200 detects, based on the monitoring result, that the performance of the trained AI / ML model is poor, i.e., that the monitoring result is below the performance threshold. The control unit 230 may perform step S77 when the monitoring result is below the performance threshold.

[0163] In step S77, the control unit 230 of the gNB 200 determines whether or not to perform fine-tuning in the UE 100 based on the fine-tuning execution time received in step S65. The determination itself may be the same as step S71. That is, the control unit 230 may decide to perform fine-tuning if the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold, and may decide not to perform fine-tuning if the fine-tuning execution time takes longer than the fine-tuning execution time threshold. The fine-tuning execution time threshold may be stored in advance in the memory of the gNB 200. Here, the following description will be given assuming that the control unit 230 determines to perform fine-tuning based on the fine-tuning execution time.

[0164] In step S78, the transmitter 210 of the gNB 200 transmits a fine-tuning execution instruction to the UE 100 to instruct the UE 100 to perform fine-tuning. The receiver 110 of the UE 100 receives the fine-tuning execution instruction. The control unit 130 of the UE 100 may decide to perform fine-tuning in accordance with the fine-tuning execution instruction. The fine-tuning execution instruction may include identification information (such as a model ID or a function name) of the trained AI / ML model to be subjected to fine-tuning execution. The transmitter 210 of the gNB 200 may instruct the UE 100 not to perform fine-tuning. The control unit 130 of the UE 100 may decide not to perform fine-tuning in response to receiving the instruction.

[0165] (1-3) When monitoring and model control are performed on the gNB200 side (in the case of (Z3))

[0166] In the case of (Z3), steps S79 to S83 are executed.

[0167] That is, in step S79, the control unit 130 of the UE 100 calculates the inference metric by executing inference of the trained AI / ML model (step S66). The inference metric may be the same as that in step S46 of FIG.

[0168] In step S80, the transmitter 120 of the UE 100 transmits the inference metric to the gNB 200. The receiver 220 of the gNB 200 receives the performance metric.

[0169] In step S81, the control unit 230 of the gNB 200 monitors the performance of the inference (step S66) performed by the UE 100. Similar to step S76, the control unit 230 detects, based on the monitoring results, that the inference performance of the trained AI / ML model is poor (i.e., the monitoring results are below the performance threshold). At this time, the control unit 230 may monitor the inference performance using performance metrics received in advance from the UE 100. The control unit 230 may perform the subsequent step S82 by detecting that the monitoring results are below the performance threshold.

[0170] In step S82, the control unit 230 of the gNB 200 determines whether to perform fine-tuning in the UE 100 based on the fine-tuning execution time received in step S65. The determination itself may be the same as step S77. Here, the following description will be given assuming that the control unit 230 decides to perform fine-tuning.

[0171] In step S83, the transmitter 210 of the gNB 200 transmits a fine-tuning execution instruction to the UE 100 to instruct the UE 100 to perform fine-tuning. The transmission of the fine-tuning execution instruction itself may be the same as step S78. The receiver 110 of the UE 100 receives the fine-tuning execution instruction. The control unit 130 of the UE 100 may decide to perform fine-tuning according to the fine-tuning execution instruction.

[0172] (1-4) Fine Adjustment Then, in step S84, fine adjustment is performed.

[0173] First, the fine adjustment may be performed on the UE 100 side. That is, in step S85, the control unit 130 of the UE 100 generates learning data to be used for the fine adjustment. In step S86, the control unit 130 uses the learning data to perform fine adjustment on the trained AI / ML model.

[0174] Second, the fine-tuning may be performed on the OTT server 500 side. The OTT server 500 may hold the trained AI / ML model to be fine-tuned. In this case, in step S87, the control unit 130 of the UE 100 generates training data to be used for the fine-tuning. In step S88, the transmission unit 120 of the UE 100 transmits the training data to the OTT server 500. The OTT server 500 receives the training data and uses the training data to perform fine-tuning on the trained AI / ML model.

[0175] (Another operation example 1 according to the first embodiment) In the first embodiment, a UE-side model in which inference is performed using a trained AI / ML model on the UE 100 side has been described as an example, but the type of inference is not limited to the UE-side model.

[0176] For example, in the first embodiment, it can also be implemented in a two-sided model in which inference is performed on both the UE 100 side and the gNB 200 side. In this case, it can be implemented by applying the operation examples shown in FIGS. 14 and 15 to the inference performed on the UE 100 side. Also, for the inference performed on the gNB 200 side, the control unit 230 calculates and monitors the fine-tuning execution time for the trained AI / ML model on the gNB 200 side, and when the performance is below the performance threshold, determines whether the fine-tuning execution condition is met (or whether the fine-tuning execution time is below the fine-tuning execution time threshold). Then, if the control unit 230 performs fine-tuning according to the determination result, it can also be implemented for the inference performed on the gNB 200 side. Also, the first embodiment can be applied to a network-side model in which inference is performed on the network side (gNB 200, core network, LMF (Location Management Function), or OTT server). For example, in Figures 14 and 15, by replacing "UE 100" with "network side", it is also possible to implement a network side model. In this case, step S60 and step S61 may not be performed, and the network device 400 itself may hold the model, parameters, etc.

[0177] (Another operation example 2 according to the first embodiment) In the first embodiment, an example (step S65) in which UE100 transmits the fine-tuning execution time to gNB200 was described, but UE100 does not have to transmit the fine-tuning execution time to gNB200.

[0178] For example, when monitoring and model control are performed on the UE100 side (steps S68 to S71 in Figure 14), the control unit 130 of UE100 may store the fine-tuning execution time in a memory or the like without transmitting it to gNB200, and after monitoring (step S70), may determine whether to perform fine-tuning based on the fine-tuning execution conditions received from gNB200 (step S69).

[0179] (Another operation example 3 according to the first embodiment) In the first embodiment, when monitoring is performed on the UE 100 side and model control is performed on the gNB 200 side (steps S75 to S78 in FIG. 15), an example has been described in which the UE 100 separately transmits the fine-tuning execution time (step S65) and the monitoring result (step S76). For example, instead of transmitting the fine-tuning execution time in step S65, the UE 100 may transmit the fine-tuning execution time together with the monitoring result in step S76. Since the gNB 200 can acquire the fine-tuning execution time, the subsequent steps can be performed in the same manner as in the first embodiment.

[0180] (Another Operation Example 4 According to First Embodiment) In the first embodiment, beam management has been described as an example of a use case, but the use case is not limited to beam management. For example, the first embodiment can also be applied to CSI feedback improvement (X1.1) or position accuracy improvement (X1.3).

[0181] Second Embodiment Next, a second embodiment will be described, focusing on the differences from the first embodiment.

[0182] In the first embodiment, a description was given of performing fine-tuning in consideration of the fine-tuning execution time. In the second embodiment, a description is given of evaluating the performance of a trained AI / ML model and performing fine-tuning based on the evaluation results. In particular, in the second embodiment, when a performance evaluation is performed, the time required for the performance evaluation is calculated, and whether or not to perform the performance evaluation is determined based on the time required for the performance evaluation.

[0183] Specifically, first, the user device (e.g., UE 100) performs performance evaluation based on a performance evaluation execution time indicating the time required for performance evaluation of the trained AI / ML model. Second, the user device performs fine-tuning of the trained AI / ML model based on the evaluation results of the performance evaluation. Here, the fine-tuning is training the trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0184] In this way, the UE 100 is configured to perform performance evaluation based on the performance evaluation execution time of the trained AI / ML model. Therefore, for example, the UE 100 can perform performance evaluation when the performance evaluation execution time is equal to or less than the performance evaluation time threshold, and can also not perform performance evaluation when the performance evaluation execution time is longer than the performance evaluation time threshold. This makes it possible, for example, for the UE 100 to reduce the performance evaluation execution time. Furthermore, by reducing the performance evaluation execution time, the UE 100 can also reduce the time until the execution of fine-tuning is completed, making it possible to perform fine-tuning appropriately from a time perspective.

[0185] Furthermore, by evaluating the performance of the trained AI / ML model, the UE 100 can also understand when the trained AI / ML model obtains optimal inference result data at a specific time or location but does not necessarily obtain optimal inference result data at other times or locations (commonly referred to as "overlearning"). Generally, when a trained AI / ML model is trained using training data obtained at a specific time or location, it is expected that optimal inference results will be obtained at that specific time or location. Performance evaluation can also capture the characteristics of such a trained AI / ML model. Furthermore, the UE 100 can perform fine-tuning when the performance evaluation result of the trained AI / ML model is equal to or greater than a threshold (e.g., a performance evaluation result threshold), thereby increasing the likelihood of obtaining optimal inference result data from the updated AI / ML model to a certain level. Therefore, fine-tuning can be performed appropriately in the mobile communication system 1.

[0186] (Evaluation Index Used in Second Embodiment) Here, the evaluation index of the trained AI / ML model used in the second embodiment will be described.

[0187] Generally, regression evaluation and classification evaluation are sometimes used as evaluation indices for AI / ML models.

[0188] Regression evaluation is, for example, evaluation using the difference between a predicted value (e.g., inference result data) and an actual value (e.g., an output result obtained without using an AI / ML model (i.e., legacy)). Examples of regression evaluation include mean squared error (MSE), normalized mean squared error (NMSE), and mean absolute error (MAE). MSE, for example, represents the root mean square of the difference between a predicted value and an actual value. NMSE, for example, represents the normalized root mean square of the difference between a predicted value and an actual value. NMSE, for example, represents the root mean square of the difference between a predicted value and an actual value. MAE, for example, represents the root mean square of the difference between a true value and a predicted value. Each evaluation index ranges from "0" to "1," and the closer to "0" the index is, the better the performance, while the closer to "1" the index is, the worse the performance.

[0189] On the other hand, classification evaluation is a method of evaluation using, for example, the proportion of correct answers to predictions. Examples of classification evaluation include precision, accuracy, and recall. Precision represents, for example, the proportion of correct answers among all predictions. Precision represents, for example, the proportion of actual positives among those predicted as positive. Recall represents, for example, the proportion of predicted positives among those actually positive.

[0190] In the second embodiment, evaluation of a trained AI / ML model is referred to as “performance evaluation.” In the second embodiment, the evaluation method used in the “performance evaluation” is described as using NMSE, but an evaluation method other than NMSE may also be used.

[0191] As described above, in the second embodiment, the mobile communication system 1 determines whether to perform performance evaluation based on the performance evaluation execution time required for the performance evaluation. Then, when it is determined to perform performance evaluation, the mobile communication system 1 performs performance evaluation on the trained AI / ML model and performs fine-tuning based on the evaluation results.

[0192] (Example of Operation According to Second Embodiment) Next, an example of operation according to the second embodiment will be described.

[0193] 16 to 20 are diagrams showing an example of operation according to the second embodiment. In Fig. 16 to Fig. 20, an example of operation in the case of a UE-side model, which is a use case of beam management, will be described. Also, as shown in Fig. 17 to Fig. 19, management will be described using examples (Z1) to (Z3) in the same way as in the first embodiment.

[0194] 16, in step S90, network device 400 transfers (or transmits) the trained AI / ML model to UE 100. Receiving unit 110 of UE 100 receives the trained AI / ML model.

[0195] In step S91, the network device 400 transmits a performance evaluation time calculation parameter to the UE 100. The performance evaluation calculation parameter represents a parameter used to calculate a performance evaluation execution time.

[0196] First, the performance evaluation calculation parameters may include, for example, the number of datasets (or the amount of data) used in the performance evaluation. The number of datasets used in the performance evaluation may be the same as or smaller than the number of training datasets used in the trained AI / ML model. In the case where the dataset in UE100 includes data for which a performance evaluation index can be calculated using a purely mathematical method, such as NMSE, for example, a predicted value (a value obtained by inference) and a correct answer value (ground truth data), the performance evaluation index may be calculated using a mathematical method, and the calculation time may be the performance evaluation execution time. Furthermore, in the case where the dataset in UE100 includes input data and a correct answer value, the number of datasets equal to the number of datasets may be input into the trained AI / ML model to perform inference, and performance evaluation may be performed on the inference result and the correct answer value to calculate the performance evaluation execution time. The performance evaluation execution time may represent the time from the start of inference in the trained AI / ML model (or the start of evaluation of the trained AI / ML model) to the acquisition of the evaluation result of the performance evaluation for the trained AI / ML model.

[0197] Second, the performance evaluation calculation parameters may include an evaluation method (such as NMSE) used in the performance evaluation. The UE 100 executes the performance evaluation using the evaluation method and calculates the performance evaluation execution time. Note that, similar to the first embodiment, the network device 400 may transmit to the UE 100 samples calculated using the performance evaluation time calculation parameters.

[0198] Note that the model transfer and the transmission of the performance evaluation calculation parameters and samples may be performed from the OTT server instead of from the network device 400 (steps S92 and S93).

[0199] In step S94, the network device 400 transmits a performance evaluation time calculation dataset to the UE 100. The performance evaluation time calculation dataset is a dataset used to calculate the performance evaluation execution time. As described above, the UE 100 may calculate a performance evaluation index using a mathematical method (e.g., NMSE) and use the calculation time as the performance evaluation execution time. The UE 100 may also perform inference to calculate the performance evaluation execution time. The receiving unit 110 of the UE 100 receives the performance evaluation time calculation dataset.

[0200] In addition, in UE100, if the data volume of the data set is equal to or greater than a predetermined threshold, it may not be possible to calculate the performance evaluation execution time using the data set. Alternatively, in UE100, the size of the trained AI / ML model received in step S90 may be larger than a predetermined value and may not be stored in memory. Therefore, in step S95, UE100 may transmit the received data set to gNB200. This is to allow gNB200 to calculate the performance evaluation execution time. Also, in step S96, a network device 400 other than gNB200 may transmit the data set to gNB200 to allow gNB200 to calculate the performance evaluation execution time.

[0201] The data set may also be transmitted from the OTT server 500 to the UE 100 (step S97). In this case, the UE 100 may transmit the received data set to the gNB 200 (step S98), causing the gNB 200 to calculate the performance evaluation execution time.

[0202] In step S99, the network device 400 transmits the current index to the UE 100. The current index represents the evaluation result when performance evaluation is currently performed. For example, if performance evaluation is performed using NMSE, NMSE = 0.2, etc., becomes the current index. If learning is performed in the network device 400, the network device 400 possesses a data set of predicted values ​​and correct values, and therefore, is able to evaluate the performance of the model. The network device 400 can transmit the acquired evaluation result as the current index to the UE 100. The UE 100 can use the current index in subsequent performance evaluation (step S117 in FIG. 17).

[0203] Note that the performance evaluation execution time may be calculated in the gNB200, and taking such a case into consideration, the UE may transmit the current indicator received in step S99 to the gNB200 (step S100). In addition, a network device 400 other than the gNB200 may also transmit the current indicator to the gNB200 (step S101).

[0204] In addition, the current indicator may be transmitted from the OTT server 500 to the UE 100 (step S102), and the UE 100 may transmit the current indicator received from the OTT server 500 to the gNB 200 in order to cause the gNB 200 to perform calculation of the performance evaluation execution time (step S103).

[0205] In step S104, the control unit 130 of the UE 100 calculates the execution time of the performance evaluation using the performance evaluation time calculation parameters. As described above, the control unit 130 may calculate the performance evaluation index using a mathematical method (e.g., NMSE, etc.) and use the calculation time as the performance evaluation execution time. The control unit 130 may also perform inference to calculate the performance evaluation execution time. The control unit 130 may calculate (or measure) the time required to execute the performance evaluation and use the calculated time as the performance evaluation execution time.

[0206] In step S105, the transmitter 120 of the UE 100 transmits the performance evaluation execution time to the gNB 200. The receiver 220 of the gNB 200 receives the performance evaluation execution time.

[0207] In step S106, the control unit 130 of the UE 100 performs inference on the trained AI / ML model received in step S90.

[0208] Then, in step S110 (FIG. 17), management is performed in the mobile communication system 1.

[0209] (2-1) When monitoring and model control are performed on the UE 100 side (in the case of (Z1))

[0210] In the case of (Z1), steps S111 to S118 are executed.

[0211] That is, in step S111, the control unit 230 of the gNB 200 determines a performance evaluation execution condition indicating a condition for executing performance evaluation in the UE 100. The control unit 230 may determine the performance evaluation execution condition based on the performance evaluation execution time received in step S105.

[0212] First, the performance evaluation execution condition may include a performance evaluation time threshold. In the UE 100, the performance evaluation may be performed when the performance evaluation execution time is equal to or less than the performance evaluation time threshold, and the performance evaluation may not be performed when the performance evaluation execution time is longer than the performance evaluation time threshold. The performance evaluation execution condition may include information indicating that the performance evaluation is performed when the performance evaluation time is equal to or less than the performance evaluation time threshold (or information indicating that the performance evaluation is not performed when the performance evaluation time is longer than the performance evaluation time threshold).

[0213] Second, the performance evaluation execution condition may include information instructing to perform performance evaluation. Alternatively, the performance evaluation execution condition may include information instructing not to perform performance evaluation. The control unit 230 of the gNB 200 may determine to perform (or not perform) performance evaluation in the UE 100 based on the performance evaluation execution time received in step S105.

[0214] Third, the performance evaluation condition may include information on an evaluation method (for example, NMSE) to be used when the performance evaluation is performed. The UE 100 performs the performance evaluation using the evaluation method.

[0215] Fourth, the performance evaluation conditions may include identification information (such as a model ID or function name) of the trained AI / ML model on which performance evaluation is to be performed.

[0216] In step S112, the transmitter 210 of the gNB 200 transmits the performance evaluation execution condition to the UE 100. The receiver 110 of the UE 100 receives the performance evaluation execution condition.

[0217] In step S113, the control unit 230 of the gNB 200 determines a fine-tuning execution condition indicating the condition for performing fine-tuning in the UE 100. The fine-tuning execution condition may be the same as the fine-tuning execution condition described in the first embodiment (step S68 in FIG. 14).

[0218] However, the fine-tuning execution condition according to the second embodiment includes a performance evaluation result threshold that indicates a threshold for the evaluation result of the performance evaluation. For example, the UE 100 uses the performance evaluation result threshold to determine whether or not to perform fine-tuning. The fine-tuning execution condition according to the second embodiment may include information indicating that fine-tuning is to be performed when the evaluation result of the performance evaluation is equal to or greater than the performance evaluation result threshold (or information indicating that fine-tuning is not to be performed when the evaluation result is less than the performance evaluation result threshold). Alternatively, it may include information instructing re-learning to be performed when fine-tuning is not to be performed.

[0219] The fine-tuning execution conditions according to the second embodiment do not necessarily have to include the fine-tuning execution time threshold described in the first embodiment.

[0220] In step S114, the transmitter 210 of the gNB 200 transmits the fine-tuning execution condition to the UE 100. The receiver 110 of the UE 100 receives the fine-tuning execution condition.

[0221] In step S115, the control unit 130 of the UE 100 monitors the inference of the trained AI / ML model (step S106). As a result of the monitoring, the control unit 130 detects that the performance of the trained AI / ML model is equal to or lower than a performance threshold (i.e., the performance is poor). The control unit 130 may perform the subsequent step S116 by detecting that the performance of the trained AI / ML model is equal to or lower than the performance threshold.

[0222] In step S116, the control unit 130 of the UE 100 determines whether or not to perform performance evaluation based on the performance evaluation execution conditions received in step S112. Specifically, the control unit 130 determines whether or not to perform performance evaluation based on the performance evaluation execution time calculated in step S104 and the performance evaluation execution conditions received in step S112. For example, the control unit 130 executes performance evaluation when the performance evaluation execution time is equal to or less than the performance evaluation time threshold included in the performance evaluation execution conditions, and does not execute performance evaluation when the performance evaluation execution time exceeds the performance evaluation time threshold. In the following description, it is assumed that the control unit 130 executes performance evaluation.

[0223] In step S117, the control unit 130 of the UE 100 performs performance evaluation on the trained AI / ML model. For example, the control unit 130 performs performance evaluation using an evaluation method (e.g., NMSE) included in the performance evaluation conditions.

[0224] In step S118, the control unit 130 of the UE 100 determines whether to perform fine-tuning. Specifically, the control unit 130 determines whether to perform fine-tuning based on the evaluation result of the performance evaluation performed in step S117 and the fine-tuning execution conditions. For example, the control unit 130 performs fine-tuning when the evaluation result of the performance evaluation is equal to or greater than the performance evaluation result threshold (i.e., the evaluation result is good), and does not perform fine-tuning when the evaluation result of the performance evaluation is less than the performance evaluation result threshold (i.e., the evaluation result is poor). This is because, for example, if fine-tuning is performed on the trained AI / ML model when the evaluation result is less than the performance evaluation result threshold, the impact on the trained AI / ML model (step S115) that is equal to or less than the performance threshold is greater than a certain level, and it is predicted that even if fine-tuning is performed, the trained AI / ML model cannot be improved, or over-training occurs, resulting in a deterioration in the overall performance of the AI / ML model. In such cases, re-learning may be preferable to fine-tuning. On the other hand, if the evaluation result is equal to or greater than the performance evaluation result threshold, even if fine-tuning is performed on the trained AI / ML model, the impact can be suppressed to a certain level, and it is predicted that performance will be improved. The following description will be given assuming that the control unit 130 decides to perform fine-tuning in step S118.

[0225] (2-2) When monitoring is performed on the UE 100 side and model control is performed on the gNB 200 side (in the case of (Z2))

[0226] In the case of (Z2), steps S120 to S127 shown in FIG. 18 are executed.

[0227] That is, in step S120, the control unit 130 of the UE 100 monitors the inference of the trained AI / ML model.

[0228] In step S121, the transmitter 120 of the UE 100 transmits the monitoring result to the gNB 200. The receiver 220 of the gNB 200 receives the monitoring result.

[0229] In step S122, the control unit 230 of the gNB 200 detects, based on the monitoring results, that the performance of the trained AI / ML model is below a performance threshold (i.e., poor performance). The control unit 230 then determines whether to perform performance evaluation in the UE 100. Specifically, the control unit 230 determines whether to perform performance evaluation based on the performance evaluation execution time received in step S105 (FIG. 16). The determination of whether to perform performance evaluation may be the same as that in step S116 (FIG. 17). That is, the control unit 230 may decide to perform performance evaluation when the performance evaluation execution time received in step S105 is below the performance evaluation time threshold, and may decide not to perform performance evaluation when the performance evaluation execution time received in step S105 exceeds the performance evaluation time threshold. The following description will be given assuming that the control unit 230 decides to perform performance evaluation based on the performance evaluation execution time.

[0230] In step S123, the transmitter 210 of the gNB 200 transmits a performance evaluation execution instruction (or performance evaluation execution instruction) to the UE 100 to instruct the UE 100 to perform performance evaluation. The performance evaluation execution instruction may include identification information (e.g., a model ID or a function name) of the trained AI / ML model to be subjected to performance evaluation. The performance evaluation execution instruction may be instruction information instructing the UE 100 not to perform performance evaluation. The receiver 110 of the UE 100 receives the performance evaluation execution instruction.

[0231] In step S124, the control unit 130 of the UE 100 executes performance evaluation in response to receiving the performance evaluation execution instruction. The execution of performance evaluation itself may be the same as step S117 (FIG. 17).

[0232] In step S125, the transmitter 120 of the UE 100 transmits the evaluation result of the performance evaluation to the gNB 200. The receiver 220 of the gNB 200 receives the evaluation result.

[0233] In step S126, the control unit 230 of the gNB 200 determines whether or not to perform fine-tuning in the UE 100 based on the evaluation result of the performance evaluation received in step S125. The decision on whether or not to perform fine-tuning may be the same as step S118 (FIG. 17). That is, the control unit 230 may decide to perform fine-tuning when the evaluation result received in step S125 is equal to or greater than the performance evaluation result threshold, and may decide not to perform fine-tuning when the evaluation result received in step S125 is less than the performance evaluation result threshold. Alternatively, the control unit 230 may decide to perform re-learning when not performing fine-tuning. In the following, it is assumed that the control unit 230 decides to perform fine-tuning based on the evaluation result.

[0234] In step S127, the transmitter 210 of the gNB 200 transmits a fine-tuning execution instruction to the UE 100 to instruct the UE 100 to perform fine-tuning. The fine-tuning execution instruction may include identification information (e.g., a model ID or a function name) of the trained AI / ML model to be subjected to fine-tuning. The fine-tuning execution instruction may be instruction information instructing the UE 100 not to perform fine-tuning. The receiver 110 of the UE 100 receives the fine-tuning execution instruction. The control unit 130 of the UE 100 may decide to perform fine-tuning in response to receiving the fine-tuning execution instruction.

[0235] (2-3) When monitoring and model control are performed on the gNB200 side (in the case of (Z3))

[0236] In the case of (Z3), steps S130 to S138 shown in FIG. 19 are executed.

[0237] That is, in step S130, the control unit 130 of the UE 100 calculates a performance metric for the inference of the trained AI / ML model (step S106).

[0238] In step S131, the transmitter 120 of the UE 100 transmits the performance metric to the gNB 200. The receiver 220 of the gNB 200 receives the performance metric.

[0239] In step S132, the control unit 230 of the gNB 200 uses a performance metric to monitor the inference (step S106) being performed by the UE 100. The control unit 230 detects that the monitoring result is below the performance threshold, i.e., the performance of the trained AI / ML model is poor.

[0240] In step S133, the control unit 230 of the gNB 200 determines whether to perform performance evaluation. This determination may be the same as step S122. That is, the control unit 230 may determine whether to perform performance evaluation using the performance evaluation execution time and the performance evaluation time threshold.

[0241] The subsequent steps S134 to S138 are the same as those in the example of the case (Z2) (steps S123 to S127). The control unit 130 of the UE 100 may determine to perform the fine-tuning in response to receiving the fine-tuning execution instruction (step S138).

[0242] (2-4) Fine Adjustment Then, in step S140 of Fig. 20, fine adjustment is performed. The fine adjustment itself may be performed on the UE 100 side (steps S141 and S142) as in the first embodiment, or may be performed on the OTT server 500 side (steps S143 to S145). Each operation (steps S141 to S145) is also the same as each operation (steps S85 to S89) in the first embodiment.

[0243] (Another Operation Example 1 According to Second Embodiment) In the second embodiment, an example has been described in which the model transfer (step S90), the transmission of the parameters for calculating performance evaluation time (step S91), the transmission of the data set for calculating performance evaluation time (step S94), and the transmission of the current index (step S99) are performed using separate messages. For example, the parameters, the data set, and the index, and the model transfer may be performed using a single message.

[0244] (Another Operation Example 2 According to the Second Embodiment) In the second embodiment, an example of a UE-side model has been described, but this is not limited thereto and a two-side model can also be implemented. That is, the operation examples shown in FIGS. 16 to 20 can be applied to the inference performed on the UE 100 side. Furthermore, for the inference performed on the gNB 200 side, the control unit 230 calculates the performance evaluation execution time for the trained AI / ML model on the gNB 200 side, performs monitoring, and when the monitoring result is equal to or less than the performance threshold, determines whether the performance evaluation execution condition is met (or whether the performance evaluation execution time is equal to or less than the performance evaluation time threshold). Then, the control unit 230 performs performance evaluation according to the determination result, and, for example, as in step S126, compares the evaluation result of the performance evaluation with the performance evaluation result threshold to determine whether to perform fine-tuning. Furthermore, the second embodiment can also be applied to a network-side model. For example, by replacing "UE 100" with "network side" in FIGS. 16 to 20, the second embodiment can also be implemented in a network-side model. In this case, model transfer (step S90), parameter transmission (step S91), data set transmission (step S94), and current indicator transmission (step S99) do not need to be performed, and the network device 400 itself may hold the trained AI / ML model, parameters, data set, and current indicator.

[0245] (Another Operation Example 3 According to the Second Embodiment) In the second embodiment, an example has been described in which the UE 100 transmits the performance evaluation execution time to the gNB 200, but this is not limiting. For example, when monitoring and model control are performed on the UE 100 side (FIG. 17), the control unit 130 of the UE 100 may store the performance evaluation execution time in a memory or the like without transmitting it, and after monitoring (step S120), may determine whether or not to perform performance evaluation based on the performance evaluation execution conditions (step S114) received from the gNB 200.

[0246] (Another Operation Example 4 According to the Second Embodiment) The transmitter 120 of the UE 100 may transmit the performance evaluation execution time together with the monitoring result in step S121, instead of transmitting the performance evaluation execution time in step S105. The UE 100 can transmit the monitoring result and the performance evaluation execution time in one message.

[0247] (Another Operation Example 5 According to Second Embodiment) In the second embodiment, beam management has been described as an example of a use case, but the use case is not limited to beam management. For example, the first embodiment can also be applied to CSI feedback improvement (X1.1) or position accuracy improvement (X1.3).

[0248] Third Embodiment Next, a third embodiment will be described, focusing on differences from the first embodiment.

[0249] In the first embodiment, the execution of fine-tuning based on the fine-tuning execution time was described (steps S68 to S71). In the third embodiment, an example will be described in which it is determined whether to execute fine-tuning based on the number of times that the inference result of the trained AI / ML model is detected to be equal to or less than the performance threshold (i.e., the accuracy of the inference is poor).

[0250] Specifically, first, a user device (e.g., UE100) receives fine-tuning execution conditions from a network node (e.g., gNB200) indicating conditions for performing fine-tuning of the trained AI / ML model. Second, the user device performs inference using the trained AI / ML model. Third, the user device performs fine-tuning. Here, the fine-tuning execution conditions include a performance threshold and a predetermined number of times. Fourth, fine-tuning is performed in response to detecting a predetermined number of times that the inference result of the trained AI / ML model is below the performance threshold. Here, fine-tuning means training the trained AI / ML model using training data with a data volume below a data volume threshold.

[0251] In this way, in UE100, fine-tuning is performed in response to the fact that the inference result of the trained AI / ML model is below the performance threshold, that is, the performance of the trained AI / ML model is detected a predetermined number of times. As a result, for example, in UE100, it is no longer necessary to determine whether or not to perform fine-tuning each time it detects that the performance of the trained AI / ML model is poor (steps S70 and S71 in FIG. 14), and it is also possible to reduce the processing of UE100. In addition, for example, UE100 can determine whether or not to perform fine-tuning in accordance with instructions from gNB200, so it is possible to appropriately perform fine-tuning.

[0252] (Example of Operation According to Third Embodiment) Next, an example of operation according to the third embodiment will be described.

[0253] FIG. 21 is a diagram illustrating an example of operation according to the third embodiment.

[0254] 21, in step S150, network device 400 transfers (or transmits) the trained AI / ML model to UE 100. Receiving unit 110 of UE 100 receives the trained AI / ML model.

[0255] In step S151, the transmitter 210 of the gNB 200 transmits the fine-tuning execution condition to the UE 100.

[0256] First, the fine-tuning execution condition includes the above-described performance threshold. As in the first embodiment, the performance threshold is, for example, a threshold for determining the performance of the trained AI / ML model. For example, when the inference result of the trained AI / ML model is equal to or less than the performance threshold, the UE 100 determines that the performance of the trained AI / ML model is poor (in the third embodiment, the inference accuracy is poor). When the inference result is greater than the performance threshold, the UE 100 determines that the inference result of the trained AI / ML model is good (in the third embodiment, the inference accuracy is good). Here, the inference result may include, for example, the CPU usage rate or memory usage rate when the inference is performed, the amount of inference data used when the inference is performed, or the amount of inference result data. Furthermore, the performance threshold may be a threshold corresponding to each indicator of the inference result.

[0257] Second, the fine-tuning execution condition includes a predetermined number of times representing a threshold value for the number of times. The UE 100 executes the fine-tuning when it detects that the inference result of the trained AI / ML model is equal to or less than the performance threshold a predetermined number of times. The predetermined number of times may be a consecutive number of times or a cumulative number of times. In the case of a cumulative number of times, the fine-tuning execution condition may include a period of time.

[0258] Third, the fine-tuning execution condition may include a report instruction (or a report request) that instructs (or requests) a report on whether or not fine-tuning has been performed. When the UE 100 performs fine-tuning, the UE 100 transmits information indicating that fine-tuning has been performed to the network device 400 in accordance with the report instruction. The report instruction may include a transmission destination indicating to which node the report should be transmitted. Alternatively, the report instruction may include information instructing transmission of a dataset of inference data used for inference, along with whether or not fine-tuning has been performed.

[0259] Fourth, the fine-tuning execution condition may include the same information as the fine-tuning execution condition described in the first embodiment (or the second embodiment).

[0260] In step S152-1, the control unit 130 of the UE 100 performs inference using the trained AI / ML model received in step S150.

[0261] In step S153-1, the control unit 130 of the UE 100 evaluates the inference result. Step S153-1 may be the monitoring (step S70) in the first embodiment.

[0262] In step S154-1, the control unit 130 of the UE 100 detects that the inference result is equal to or less than the performance threshold.

[0263] The control unit 130 of the UE 100 performs step S152-1 to step S154-1 n times (n is a natural number) (step S152-n to step S154-n).

[0264] That is, in step S155, the control unit 130 of the UE 100 detects that the inference result is equal to or less than the performance threshold a predetermined number of times (for example, n times).

[0265] In step S156, the control unit 130 of UE 100 performs fine-tuning on the trained AI / ML model received in step S150 because the fine-tuning execution condition is met (the inference result has been detected to be below the performance threshold a predetermined number of times).

[0266] In step S157, the transmitter 120 of the UE 100 transmits information indicating that the fine adjustment has been performed to the gNB 200. The transmitter 120 may transmit the information in accordance with a reporting instruction included in the fine adjustment execution condition.

[0267] In step S158, the transmitting unit 120 of the UE 100 transmits information indicating that the fine-tuning has been performed and a data set of the inference data used in the inference to the network device 400. The transmitting unit 120 may transmit this information in accordance with a report instruction included in the fine-tuning execution condition.

[0268] (Another Operation Example 1 According to the Third Embodiment) In the third embodiment, an operation example related to fine adjustment has been described. For example, the third embodiment can apply the performance evaluation described in the second embodiment. That is, in the UE 100, whether or not to perform performance evaluation is determined based on the number of times that it has detected that the inference result of the trained AI / ML model is equal to or less than the performance threshold.

[0269] Specifically, first, the user equipment (e.g., UE100) receives performance evaluation execution conditions indicating conditions for executing performance evaluation of the trained AI / ML model from a network node (e.g., gNB200). Second, the user equipment executes inference using the trained AI / ML model. Third, the user equipment executes performance evaluation in response to detecting a predetermined number of times that the inference result of the trained AI / ML model is equal to or less than a performance threshold. Here, the performance evaluation execution conditions include the performance threshold and the predetermined number of times.

[0270] In this way, the UE 100 performs performance evaluation in response to the detection that the inference result of the trained AI / ML model is below the performance threshold, i.e., the performance of the trained AI / ML model is poor a predetermined number of times. As a result, for example, the UE 100 does not need to determine whether or not to perform performance evaluation each time it detects that the performance of the trained AI / ML model is poor (steps S115 and S116 in FIG. 17), thereby reducing the processing load of the UE 100. Furthermore, for example, the UE 100 can determine whether or not to perform performance evaluation in accordance with instructions from the gNB 200, making it possible to appropriately perform performance evaluation.

[0271] FIG. 22 is a diagram illustrating another example of operation according to the third embodiment.

[0272] After performing model transfer (step S150 in FIG. 21 ), the transmitter 210 of the gNB 200 transmits, in step S160, the performance evaluation execution condition to the UE 100. The receiver 110 of the UE 100 receives the performance evaluation execution condition.

[0273] First, the performance evaluation execution conditions include a performance threshold. As in the first embodiment, the performance threshold is, for example, a threshold for determining the inference performance of the trained AI / ML model. The performance determination method may be the same as in the third embodiment.

[0274] Second, the performance evaluation execution condition includes a predetermined number of times representing a threshold value for the number of times. For example, the UE 100 executes performance evaluation when it detects that the inference result of the trained AI / ML model is equal to or less than the performance threshold a predetermined number of times. The predetermined number of times may be a consecutive number of times or a cumulative number of times. In the case of a cumulative number of times, the performance evaluation condition may include a period of time.

[0275] Third, the performance evaluation execution condition may include a report instruction for instructing to report whether or not the performance evaluation has been executed. The report instruction may include information for instructing to report the evaluation results of the performance evaluation as the report content.

[0276] Fourth, the performance evaluation execution conditions may include an evaluation method (for example, NMSE) to be used when executing the performance evaluation.

[0277] Fifth, the performance evaluation execution conditions may include identification information (e.g., model ID or function name) of the trained AI / ML model for which performance evaluation is to be performed.

[0278] Steps S161-1 to S164 are the same as steps S152-1 to S155 in the third embodiment.

[0279] In step S164, the control unit 130 of the UE 100 detects that the inference result is equal to or less than the performance threshold a predetermined number of times (for example, n times).

[0280] In step S165, the control unit 130 of the UE 100 executes performance evaluation to satisfy the performance evaluation execution condition.

[0281] In step S166, the transmitter 120 of the UE 100 transmits information indicating that the inference result is below the performance threshold (i.e., the accuracy of the inference is poor) and the evaluation result to the gNB 200. The transmitter 120 may transmit this information in accordance with a reporting instruction included in the performance evaluation execution conditions. The receiver 220 of the gNB 200 receives the information indicating that the inference result is below the performance threshold and the evaluation result.

[0282] In step S167, the control unit 230 of the gNB 200 determines to perform fine-tuning based on the fact that the inference result is below the performance threshold and the evaluation result, and the transmission unit 210 transmits a fine-tuning execution instruction to the UE 100 to instruct the UE 100 to perform fine-tuning. Alternatively, the control unit 230 may determine to perform re-learning instead of fine-tuning according to the evaluation result, and the transmission unit 210 may transmit a re-learning execution instruction to the UE 100 indicating that re-learning is to be performed. This is because, when the evaluation result is poorer than a certain level, it may be better for the UE 100 to perform re-learning rather than fine-tuning.

[0283] Fourth Embodiment Next, a fourth embodiment will be described.

[0284] In the fourth embodiment, an example will be described in which the UE 100 reports the recorded log to the gNB 200. Specifically, first, the user equipment (e.g., the UE 100) receives a reporting condition indicating a condition for reporting information about fine-tuning (and / or information about performance evaluation) from a network node (e.g., the gNB 200). Second, the user equipment transmits information about fine-tuning (and / or information about performance evaluation) to the network node according to the reporting condition.

[0285] Thus, in the fourth embodiment, the UE 100 can appropriately report information regarding fine-tuning (and / or information regarding performance evaluation) to the gNB 200 in accordance with the reporting conditions received from the gNB 200. Then, the gNB 200 can change the execution conditions of the fine-tuning and / or the execution conditions of the performance evaluation based on the reported information. This makes it possible to appropriately execute use cases using an AI / ML model in the mobile communication system 1, for example.

[0286] (Example of Operation According to Fourth Embodiment) FIG. 23 is a diagram showing an example of operation according to the fourth embodiment.

[0287] 23, in step S170, network device 400 transfers (or transmits) the trained AI / ML model to UE 100. Receiving unit 110 of UE 100 receives the trained AI / ML model.

[0288] In step S171, gNB200 transmits the reporting condition to UE100. The receiving unit 110 of UE100 receives the reporting condition.

[0289] First, the reporting conditions may include information indicating the type of information to be reported. For example, the information indicating the type may include information indicating whether information related to fine-tuning should be reported, information related to performance evaluation should be reported, or information related to both fine-tuning and performance evaluation should be reported. The transmitter 210 of the gNB 200 may transmit information indicating the type depending on whether the UE 100 is performing fine-tuning, performance evaluation, or both.

[0290] Second, the report condition may include report target information indicating information to be reported. The report target information may include at least any of the following. Note that the report target information may represent information to be transmitted as log information in the UE 100. Furthermore, the report target information may be information related to performance evaluation or information related to fine-tuning.

[0291] (U1) Whether or not performance evaluation and / or fine tuning is performed;

[0292] (U2) Time taken for performance evaluation and / or fine tuning;

[0293] (U3) Dataset used for performance evaluation and / or fine-tuning;

[0294] (U4) Factors (or causes) for performance evaluation and / or fine-tuning;

[0295] (U5) timestamp,

[0296] (U6) Location information,

[0297] (U7) Identification information of the trained AI / ML model used for performance evaluation and / or fine-tuning (e.g., model name, model ID, or function name),

[0298] (U8) Evaluation method used for performance evaluation Third, the reporting conditions may include information indicating that a log is to be transmitted in response to a log transmission request from gNB200.

[0299] Fourth, the report condition may include a log transmission condition indicating a condition for transmitting a log. The log transmission condition may be that at least one of the pieces of report target information has been acquired, or that the data volume of at least one of the pieces of report target information has reached or exceeded a data volume threshold. In the latter case, the data volume threshold may be included in the log transmission condition.

[0300] Fifth, the reporting condition may include information indicating whether the reporting should be performed when the UE 100 is in an RRC connected state or when the UE 100 is in an RRC idle state or an RRC inactive state. In the former case, the reporting condition may be included in a reporting configuration (MeansConfig) of an individual RRC message (e.g., an RRCReconfiguration message or an RRCResume message) and transmitted as an immediate (Immediate) MDT (Minimalization of Drive Tests). In the latter case, the reporting condition may be included in a logged measurement configuration (LoggedMeasurementConfiguration) message and transmitted as a logged MDT.

[0301] In step S172, the control unit 130 of the UE 100 performs inference on the trained AI / ML model received in step S170.

[0302] In step S173, the control unit 130 of the UE 100 performs performance evaluation based on the inference result.

[0303] In step S174, the control unit 130 of the UE 100 performs fine tuning on the trained AI / ML model.

[0304] In step S175, the control unit 130 of the UE 100 records in a memory the log used in the performance evaluation and fine-tuning. The control unit 130 may record the log in the memory in accordance with the report target information included in the report condition.

[0305] In step S176, the control unit 130 of the UE 100 detects that the log transmission condition is met.

[0306] In step S177, the transmitter 210 of the gNB 200 transmits a log transmission request to the UE 100. The receiver 110 of the UE 100 receives the log transmission request.

[0307] In step S178, in response to receiving the log transmission request, the transmitter 120 of the UE 100 transmits the log recorded in step S175 to the gNB 200. The transmitter 120 may transmit the log by including it in a measurement report (MeasurementReport).

[0308] Fifth Embodiment Next, a fifth embodiment will be described.

[0309] The fifth embodiment is an embodiment that combines the first embodiment (the embodiment of fine-tuning) and the second embodiment (the embodiment of performance evaluation). That is, the fifth embodiment is an example in which whether or not to perform fine-tuning in the UE 100 is determined based on the fine-tuning execution time, the performance evaluation execution time, and the evaluation result of the performance evaluation.

[0310] Specifically, a user device (e.g., UE100) performs fine-tuning of a first trained AI / ML model (e.g., a trained AI / ML model on the UE100 side) based on a first time required to perform fine-tuning of the first trained AI / ML model, a second time required to perform performance evaluation of the first trained AI / ML model, and the evaluation result of the performance evaluation. Here, the fine-tuning is training the first trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0311] As described above, in the fifth embodiment, whether or not to perform fine-tuning is determined based on the first time, the second time, and the evaluation result of the performance evaluation. Therefore, it is possible to perform fine-tuning in less time than when fine-tuning is performed without considering these parameters. Furthermore, in the fifth embodiment, for example, fine-tuning may be performed when the first time is equal to or less than the fine-tuning execution time threshold, the second time is also equal to or less than the performance evaluation time threshold, and the evaluation result is equal to or greater than the performance threshold. Fine-tuning may not be performed under other conditions. Therefore, in the mobile communication system 1, fine-tuning is performed under certain judgment, making it possible to appropriately perform fine-tuning on the trained AI / ML model.

[0312] (Example of Operation According to Fifth Embodiment) Next, an example of operation according to the fifth embodiment will be described.

[0313] 24 to 26 are diagrams illustrating an example of operation according to the fifth embodiment. Note that the example of operation illustrated in Fig. 24 to 26 is an example of CSI compression, which is a sub-use case of CSI feedback, and illustrates an example of a two-sided model.

[0314] In the CSI compression, for example, the UE 100 transmits compressed CSI to the gNB 200, and the gNB 200 reconstructs the pre-compressed CSI. The AI / ML method is used for CSI compression and CSI reconstruction, and a two-sided model is configured by an inference unit on the UE 100 side that performs CSI compression and an inference unit on the UE 100 side that performs CSI reconstruction. The CSI to be compressed is, for example, CSI feedback information generated by the CSI generation unit 131 using legacy processing.

[0315] As shown in FIG. 24, for a two-sided model, the network device 400 transmits a trained AI / ML model for the UE 100 (e.g., a first trained AI / ML model) to the UE 100 (step S180), and transmits a trained AI / ML model for the gNB 200 (e.g., a second trained AI / ML model) to the gNB 200 (step S181).

[0316] As in the first embodiment, the network device 400 transmits a parameter for calculating the fine-tuning execution time (e.g., a first parameter) to the UE 100 (step S182). In addition, the network device 400 also transmits a parameter for calculating the fine-tuning execution time (e.g., a third parameter) to the gNB 200 in order to calculate the fine-tuning execution time in the gNB 200 (step S185).

[0317] The control unit 130 of the UE 100 calculates the fine-tuning execution time (e.g., the first time) using the fine-tuning execution time calculation parameters (step S183), and the transmission unit 120 of the UE 100 transmits the fine-tuning execution time on the UE 100 side to the gNB 200 (step S184). Meanwhile, the control unit 230 of the gNB 200 also calculates the fine-tuning execution time (e.g., the third time) using the fine-tuning execution time calculation parameters (step S186).

[0318] As in the second embodiment, the network device 400 transmits performance evaluation time calculation parameters (e.g., second parameters), a performance evaluation time calculation dataset, and a current indicator to the UE 100 (steps S187 to S189). The control unit 130 of the UE 100 uses these received parameters to calculate a performance evaluation execution time (e.g., second time) for the trained AI / ML model on the UE 100 side (step S190). The transmission unit 120 of the UE 100 transmits the performance evaluation execution time on the UE 100 side to the gNB 200 (step S191).

[0319] On the other hand, since the network device 400 also performs inference on the trained AI / ML model for the gNB 200 and calculates the performance evaluation execution time, the network device 400 transmits parameters for calculating the performance evaluation time (e.g., the fourth parameter), a data set for calculating the performance evaluation time, and the current indicators to the gNB 200 (steps S192 to S194). The control unit 230 of the gNB 200 uses these received parameters to calculate the performance evaluation execution time (e.g., the fourth time) for the trained AI / ML model on the gNB 200 side (step S195).

[0320] In step S200 (FIG. 25), inference is performed in the mobile communication system 1. Because it is a two-sided model, inference is performed in the UE 100 and the gNB 200 (steps S202 and S204). In the example of FIG. 25, the control unit 130 of the UE 100 generates inference data to be used in the trained AI / ML model on the UE side (step S201) and performs inference using the inference data (step S202). Then, the transmission unit 120 of the UE 100 transmits the inference result data to the gNB 200 as inference data on the gNB 200 side (step S203). The control unit 230 of the gNB 200 inputs the inference result data as inference data for the trained AI / ML model on the gNB 200 side and performs inference (step S204).

[0321] In step S205, monitoring is performed in the mobile communication system 1. Because of the two-sided model, the control unit 130 of the UE 100 monitors the inference on the UE 100 side (step S202) (step S206), and the control unit 230 of the gNB 200 monitors the inference on the gNB 200 side (step S204) (step S208). The transmission unit 120 of the UE 100 transmits its monitoring results to the gNB 200.

[0322] In step S210 (FIG. 26), management is performed in the mobile communication system 1. In the fifth embodiment, there is fine-tuning of the trained AI / ML model on the UE 100 side and fine-tuning of the trained AI / ML model on the gNB 200 side. However, with regard to the fine-tuning performed on the UE 100 side, there are cases where the gNB 200 makes the fine-tuning decision, and cases where the UE 100 itself makes the fine-tuning decision.

[0323] (V1) When gNB200 determines fine-tuning on the UE100 side When gNB200 determines fine-tuning on the UE100 side, gNB200 performs steps S211 to S213.

[0324] That is, in step S211, the control unit 230 of the gNB 200 determines whether or not to perform performance evaluation in the UE 100. The determination itself may be the same as step S122 (FIG. 18) of the second embodiment. That is, the control unit 230 detects that the performance of the learned AI / ML model on the UE 100 side is equal to or lower than the performance threshold based on the monitoring result received in step S207. Then, the control unit 230 determines whether or not to perform performance evaluation in the UE 100 based on the performance evaluation execution time and the performance evaluation time threshold received in step S191.

[0325] In step S212, the control unit 230 of the gNB 200 determines whether or not to perform fine-tuning. The control unit 230 performs fine-tuning when the performance evaluation execution time is equal to or less than the performance evaluation time threshold (i.e., to perform performance evaluation), the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold, and the evaluation result from the performance evaluation is equal to or greater than the performance evaluation result threshold (i.e., the evaluation result is good). In this way, the control unit 230 determines whether or not to perform fine-tuning by combining the performance evaluation execution time, the fine-tuning execution time, and the evaluation result from the performance evaluation.

[0326] The evaluation results from the performance evaluation are evaluation results for the trained AI / ML model on the UE 100 side. Therefore, the control unit 130 of the UE 100 evaluates the trained AI / ML model, and the transmission unit 120 of the UE 100 transmits the evaluation results to the gNB 200. This allows the gNB 200 to obtain the evaluation results of the trained AI / ML model on the UE 100 side. The control unit 230 of the gNB 200 can then use the evaluation results to determine whether or not to perform fine-tuning.

[0327] In the following description, it is assumed that the control unit 230 determines to perform fine adjustment.

[0328] In step S213, the transmitter 210 of the gNB 200 transmits a fine-tuning execution instruction to the UE 100 to instruct the UE 100 to perform fine-tuning. The receiver 110 of the UE 100 receives the fine-tuning execution instruction, and the control unit 130 of the UE 100 decides to perform fine-tuning.

[0329] (V2) When the UE 100 Determines Fine Adjustment on the UE 100 Side by Itself When the UE 100 determines fine adjustment on the UE 100 side by itself, the UE 100 performs step S214 and step S215.

[0330] That is, in step S214, the control unit 130 of the UE 100 determines whether or not to perform performance evaluation. The determination of whether or not to perform performance evaluation may be the same as step S211. That is, the control unit 130 monitors the trained AI / ML model on the UE side (step S206) and detects that the performance of the model is equal to or lower than the performance threshold, and compares the performance evaluation execution time calculated in step S190 with the performance evaluation time threshold to determine whether or not to perform performance evaluation. Here, the following description will be given assuming that the control unit 130 determines to perform performance evaluation.

[0331] In step S215, the control unit 130 of the UE 100 determines whether or not to perform fine-tuning. The determination of whether or not to perform fine-tuning may be the same as that in step S212. That is, the control unit 130 may perform fine-tuning when the performance evaluation execution time is equal to or less than the performance evaluation time threshold (i.e., performance evaluation is to be performed), the fine-tuning execution time is equal to or less than the fine-tuning execution time threshold, and the evaluation result of the performance evaluation is equal to or greater than the performance evaluation result threshold (i.e., the evaluation result is good). In the following description, it is assumed that the control unit 130 determines to perform fine-tuning and decides to perform fine-tuning.

[0332] The management (step S210) has been described above. The control unit 230 of the gNB 200 may also determine whether or not to perform fine-tuning on its own trained AI / ML model. In this case, when the control unit 230 monitors the trained AI / ML model on the gNB 200 side (step S208) and detects that the performance of the trained AI / ML model is below a performance threshold (i.e., poor performance), it determines whether or not to perform fine-tuning. That is, the control unit 230 may determine whether or not to perform fine-tuning on the trained AI / ML model based on the fine-tuning execution time (e.g., the third time) calculated in step S186, the performance evaluation execution time (e.g., the fourth time) calculated in step S195, and the evaluation result of the performance evaluation of the trained AI / ML model on the gNB 200 side. Specifically, the control unit 230 performs fine-tuning on the trained AI / ML model on the gNB 200 side when the performance evaluation execution time is less than or equal to the performance evaluation time threshold, the fine-tuning execution time is less than or equal to the fine-tuning execution time threshold, and the evaluation result from the performance evaluation is greater than or equal to the performance evaluation result threshold.

[0333] In step S216, fine-tuning is performed in the mobile communication system 1. That is, on the UE 100 side, the control unit 130 generates learning data (step S217), and uses the generated learning data to perform fine-tuning on the trained AI / ML model on the UE 100 side (step S218). On the other hand, on the gNB 200 side, the control unit 230 generates learning data (step S219), and uses the generated learning data to perform fine-tuning on the trained AI / ML model on the gNB 200 side (step S220).

[0334] (Another Operation Example 1 According to the Fifth Embodiment) In the fifth embodiment, the case of a two-side model has been described, but this is not limited to this. For example, the fifth embodiment can also be applied to a UE-side model. In this case, in Figures 24 to 26, it is possible to implement the fifth embodiment by not performing some of the processing performed on the gNB 200 side (such as steps S186, S195, S219, and S220). The fifth embodiment can also be applied to a network-side model. For example, in Figures 24 to 26, it is possible to implement the fifth embodiment in a network-side model by replacing "UE 100" with "network side." In this case, model transfer (step S180), parameter transmission (steps S182 and S187), data set transmission (step S188), and current indicator transmission (step S189) do not need to be performed, and the network device 400 itself may retain the trained AI / ML model, parameters, data set, and current indicator.

[0335] Furthermore, in the fifth embodiment, a use case of CSI compression has been described, but the present invention is also applicable to use cases other than CSI compression.

[0336] (Another Operation Example 2 According to the Fifth Embodiment) The fifth embodiment can be applied to the third embodiment. That is, in the mobile communication system 1, it may be determined whether to perform fine-tuning based on the number of times that the inference result (or monitoring result) of the trained AI / ML model is detected to be equal to or lower than the performance threshold (i.e., the inference accuracy is poor). Specifically, steps S151 to S158 shown in FIG. 21 may be executed instead of steps S211 to S215 in FIG. 26 .

[0337] Also, the fifth embodiment can be applied to the fourth embodiment. That is, the gNB 200 transmits reporting conditions to the UE 100, and the UE 100 may transmit the recorded log to the gNB 200 according to the reporting conditions. Specifically, between step S180 (model transfer) of FIG. 24 and step S200 (inference) of FIG. 25, step S171 (transmission of reporting conditions) of FIG. 23 is executed, and after step S216 (fine adjustment) of FIG. 26, step S175 (log recording) and subsequent steps of FIG. 23 may be executed.

[0338] The other operation examples according to the first embodiment and the other operation examples according to the second embodiment can also be applied to the fifth embodiment.

[0339] [Other Embodiments] In the first embodiment described above, supervised learning has been mainly described, but the present invention is not limited to this. For example, unsupervised learning or reinforcement learning may be applied to the first embodiment.

[0340] The above-described operational flows are not limited to being implemented independently, but can also be implemented by combining two or more operational flows. For example, some steps of one operational flow may be added to another operational flow, or some steps of one operational flow may be replaced with some steps of another operational flow. In each flow, it is not necessary to execute all steps, and only some steps may be executed.

[0341] In the above-described embodiments and examples, an example in which the base station is an NR base station (gNB) has been described, but the base station may be an LTE base station (eNB) or a 6G base station. The base station may also be a relay node such as an IAB (Integrated Access and Backhaul) node. The base station may also be a DU of the IAB node. The UE 100 may also be an MT (Mobile Termination) of the IAB node.

[0342] That is, the UE 100 may be a terminal function unit (a type of communication module) for a base station to control a repeater that relays signals. Such a terminal function unit is referred to as an MT. Examples of the MT include, in addition to the IAB-MT, an NCR (Network Controlled Repeater)-MT and a RIS (Reconfigurable Intelligent Surface)-MT.

[0343] Also, the term "network node" primarily refers to a base station, but may also refer to a device in the core network or part of a base station (CU, DU, or RU).

[0344] A program may be provided that causes a computer to execute each process performed by the UE 100, the gNB 200, or the network device 400. The program may be recorded on a computer-readable medium. Using a computer-readable medium, the program can be installed on a computer. Here, the computer-readable medium on which the program is recorded may be a non-transitory recording medium. The non-transitory recording medium is not particularly limited, and may be, for example, a recording medium such as a CD-ROM and / or a DVD-ROM. Furthermore, circuits that execute each process performed by the UE 100, the gNB 200, or the network device 400 may be integrated, and at least a portion of the UE 100, the gNB 200, or the network device 400 may be configured as a semiconductor integrated circuit (chip set, SoC: System on a chip).

[0345] As used in this disclosure, the terms "based on" and "depending on / in response to" do not mean "based only on" or "depending only on," unless expressly stated otherwise. The term "based on" means both "based only on" and "based at least in part on." Similarly, the term "depending on" means both "depending only on" and "depending at least in part on." The terms "include," "comprise," and variations thereof do not mean including only the listed items, but may mean including only the listed items or may include additional items in addition to the listed items. Additionally, the term "or," as used in this disclosure, is not intended to mean an exclusive or. Furthermore, any reference to elements using designations such as "first," "second," etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used herein as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some way. In this disclosure, where articles are added by translation, such as a, an, and the in English, these articles shall include the plural unless the context clearly indicates otherwise.

[0346] The functions performed by the UE 100 or base station 200 (network node) may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and / or other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes a program stored in a memory.

[0347] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0348] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of hardware and software used to configure the hardware and / or processor.

[0349] Although one embodiment has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes can be made within the scope of the gist. Furthermore, the embodiments, operation examples, and processes can be appropriately combined within the scope of not being inconsistent.

[0350] This application claims priority from Japanese Patent Application No. 2024-018937 (filed February 9, 2024), the entire contents of which are incorporated herein by reference.

[0351] (Addendum) The above can be summarized as follows.

[0352] (Supplementary Note 1) A communication control method in a user device of a mobile communication system, comprising a step in which the user device performs the fine-tuning of the first trained AI / ML model based on a first time required to perform fine-tuning of the first trained AI / ML model, a second time required to perform a performance evaluation of the first trained AI / ML model, and an evaluation result of the performance evaluation, wherein the fine-tuning is to train the first trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0353] (Supplementary Note 2) The fine-tuning is to train the first trained AI / ML model using the training data, and further to perform the training on layers including the final layer that are equal to or less than a layer threshold, out of multiple layers up to the final layer that constitute the first trained AI / ML model. This is the communication control method described in Supplementary Note 1.

[0354] (Supplementary Note 3) The communication control method according to Supplementary Note 1 or Supplementary Note 2, further comprising the step of: the user device calculating the first time and the second time.

[0355] (Supplementary Note 4) The communication control method according to any one of Supplementary Notes 1 to 3, further comprising a step in which the user device receives the first trained AI / ML model, a first parameter, and a second parameter from a network device, and the calculating step includes a step in which the user device calculates the first time using the first parameter and calculates the second time using the second parameter.

[0356] (Supplementary Note 5) A communication control method according to any one of Supplementary Notes 1 to 4, comprising: a step in which the user equipment transmits the first time and the second time to a network node; and a step in which the user equipment receives a fine-tuning execution instruction from the network node, the fine-tuning execution instruction instructing the user equipment to execute the fine-tuning, wherein the executing step includes a step in which the user equipment executes the fine-tuning in response to receiving the fine-tuning execution instruction.

[0357] (Supplementary Note 6) The communication control method according to any one of Supplementary Notes 1 to 5, further comprising the steps of: receiving, by the user equipment, a reporting condition indicating a condition for reporting information on the fine-tuning and information on the performance evaluation from a network node; and transmitting, by the user equipment, the information on the fine-tuning and the information on the performance evaluation to the network node in accordance with the reporting condition.

[0358] (Supplementary Note 7) A communication control method in a network node of a mobile communication system, comprising a step in which the network node performs the fine-tuning of the second trained AI / ML model based on a third time taken to perform fine-tuning of the second trained AI / ML model, a fourth time taken to perform performance evaluation of the second trained AI / ML model, and an evaluation result of the performance evaluation, wherein the fine-tuning is to train the second trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

[0359] (Supplementary Note 8) The communication control method described in any one of Supplementary Note 1 to Supplementary Note 7, wherein the fine-tuning involves training the second trained AI / ML model using the training data, and further performing the training on layers below a layer threshold including the final layer among multiple layers up to the final layer that constitute the second trained AI / ML model.

[0360] (Supplementary Note 9) The communication control method according to any one of Supplementary Notes 1 to 8, further comprising the step of the network node calculating the third time and the fourth time.

[0361] (Supplementary Note 10) The communication control method according to any one of Supplementary Notes 1 to 9, further comprising a step in which the network node receives the second trained AI / ML model, a third parameter, and a fourth parameter from a network device other than the network node, and the calculating step includes a step in which the network node calculates the third time using the third parameter and calculates the fourth time using the fourth parameter.

[0362] (Supplementary Note 11) A communication control method described in any one of Supplementary Notes 1 to 10, further comprising the steps of: the network node receiving from a user device a first time required to perform fine-tuning of a first trained AI / ML model and a second time required to perform performance evaluation of the first trained AI / ML model; the network node deciding whether to perform fine-tuning of the first trained AI / ML model in the user device based on the first time and the second time; and the network node sending to the user device a fine-tuning execution instruction instructing the user device to perform fine-tuning of the first trained AI / ML model.

[0363] (Supplementary Note 12) The communication control method according to any one of Supplementary Notes 1 to 11, further comprising the step of transmitting, by the network node, reporting conditions indicating conditions for reporting information relating to the fine-tuning and information relating to the performance evaluation to the user equipment.

[0364] 1: Mobile communication system 20: 5GC (CN) 100: UE 110: Receiving unit 120: Transmitting unit 130: Control unit 200: gNB 210: Transmitting unit 220: Receiving unit 230: Control unit 400: Network device 500: OTT server

Claims

1. A communication control method in a user device of a mobile communication system, comprising: the user device performing fine-tuning of a first trained AI (Artificial Intelligence) / ML (Machine Learning) model based on a first time required to perform fine-tuning of the first trained AI / ML model, a second time required to perform performance evaluation of the first trained AI / ML model, and an evaluation result of the performance evaluation; and the fine-tuning comprises training the first trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

2. The communication control method according to claim 1, wherein the fine-tuning involves training the first trained AI / ML model using the training data, and further comprising performing the training on layers including the final layer and below a layer threshold, among multiple layers up to the final layer that constitute the first trained AI / ML model.

3. The communication control method according to claim 1, further comprising the user device calculating the first time and the second time.

4. The communication control method according to claim 3, further comprising the user device receiving the first trained AI / ML model, the first parameter, and the second parameter from a network device, and wherein the calculating includes the user device calculating the first time using the first parameter and calculating the second time using the second parameter.

5. A communication control method according to claim 3, comprising: the user equipment transmitting the first time and the second time to a network node; and the user equipment receiving a fine-tuning execution instruction from the network node instructing the user equipment to execute the fine-tuning, wherein the executing includes the user equipment executing the fine-tuning in response to receiving the fine-tuning execution instruction.

6. The communication control method according to claim 1, further comprising: the user equipment receiving, from a network node, reporting conditions indicating conditions for reporting information relating to the fine-tuning and information relating to the performance evaluation; and the user equipment transmitting, to the network node, information relating to the fine-tuning and information relating to the performance evaluation in accordance with the reporting conditions.

7. A communication control method in a network node of a mobile communication system, comprising: the network node performing fine-tuning on a second trained AI (Artificial Intelligence) / ML (Machine Learning) model based on a third time required to perform fine-tuning of the second trained AI / ML model, a fourth time required to perform performance evaluation of the second trained AI / ML model, and the evaluation results of the performance evaluation; and the fine-tuning comprises training the second trained AI / ML model using training data with a data volume equal to or less than a data volume threshold.

8. The communication control method according to claim 7, wherein the fine-tuning involves training the second trained AI / ML model using the training data, and further comprising performing the training on layers below a layer threshold including the final layer out of multiple layers up to the final layer that constitute the second trained AI / ML model.

9. The communication control method according to claim 6, further comprising the network node calculating the third time and the fourth time.

10. The communication control method of claim 8, further comprising the network node receiving the second trained AI / ML model, the third parameter, and the fourth parameter from a network device other than the network node, and wherein the calculating includes the network node calculating the third time using the third parameter and calculating the fourth time using the fourth parameter.

11. The communication control method of claim 7, further comprising: the network node receiving from the user equipment a first time required to perform fine-tuning of the first trained AI / ML model and a second time required to perform performance evaluation of the first trained AI / ML model; the network node determining whether to perform fine-tuning of the first trained AI / ML model in the user equipment based on the first time and the second time; and the network node transmitting to the user equipment a fine-tuning execution instruction instructing the user equipment to perform fine-tuning of the first trained AI / ML model.

12. The communication control method according to claim 7, further comprising the network node transmitting, to the user equipment, reporting conditions indicating conditions for reporting information relating to the fine-tuning and information relating to the performance evaluation.

Images