Model monitoring management method and device, storage medium and related system

Abstract

The invention discloses a model monitoring management method and device, a storage medium and a related system, and belongs to the technical field of communication. The method comprises: in a process of monitoring an AI model by a terminal device, determining whether a first condition is satisfied, the first condition comprising that the terminal device is in a low mobility state and a high beam quality state; and if the first condition is met, indicating that the terminal equipment is in a stable beam transceiving state, and entering a target state, so that model monitoring is not carried out or the model monitoring frequency is reduced within a preset duration to relax monitoring on the AI model. According to the invention, the terminal equipment can flexibly control the monitoring of the AI model according to the beam receiving and transmitting environment, so that the resource utilization of the terminal equipment can be optimized to a certain extent.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, and in particular to a model monitoring management method and device, a storage medium and a related system. BACKGROUND

[0002] In a wireless communication system, an artificial intelligence (AI) model can be used to enhance system performance. AI-based beam management can include an assisted decision mechanism based on a terminal-side AI model. In this assisted decision mechanism, both model inference and model monitoring functions can be set in a terminal device, and information generated by the two functions can be reported to a network device through a model inference report and a model monitoring report. SUMMARY

[0003] The present application provides a model monitoring management method, device, storage medium and related system, which can optimize resource utilization of a terminal device. The technical solution is as follows: In a first aspect, a model monitoring management method is provided. The method can be executed by a terminal device, or by a component (such as a circuit, a chip or a chip system, etc.) configured in the terminal device, or by a logic module or software that can implement all or part of the functions of the terminal device, and the present application does not limit this. Hereinafter, the terminal device is taken as an example for description.

[0004] In the method, the terminal device monitors an AI model used for beam management. The terminal device enters a target state when a first condition is met, the first condition including that the terminal device is in a low mobility state and a high beam quality state, and the terminal device does not perform model monitoring in the target state for a preset time length, or the terminal device reduces model monitoring frequency in the target state.

[0005] In the present application, the terminal device can determine whether the first condition is met during monitoring of the AI model. If the first condition is met, it indicates that the terminal device is in a stable beam transceiving state, and the terminal device can enter the target state to relax monitoring of the AI model. In this way, the terminal device can flexibly control monitoring of the AI model according to a beam transceiving environment, thereby optimizing resource utilization of the terminal device to a certain extent.

[0006] In one possible implementation, the terminal device determines that the terminal device is in a low mobility state when a difference between a reference received signal strength and a received signal strength of a serving cell is less than a first threshold value, and determines that the terminal device is not in a low mobility state when the difference between the reference received signal strength and the received signal strength of the serving cell is greater than or equal to the first threshold value.

[0007] If the difference between the reference received signal strength and the service cell received signal strength is less than the first threshold, it means that the current received signal is weaker than the reference point, but the degree of weakness is within an acceptable tolerance range. This indicates that the terminal device has not moved significantly over long distances and is still near the reference point. Therefore, the terminal device is determined to be in a low-mobility state. If the difference between the reference received signal strength and the service cell received signal strength is greater than or equal to the first threshold, it means that the current received signal is much weaker than the reference point, and the degree of weakness exceeds the acceptable tolerance range. This indicates that the terminal device may have moved to a farther place with a worse received signal. Therefore, the terminal device is determined not to be in a low-mobility state.

[0008] In one possible implementation, the terminal device determines that the terminal device is in a high beam quality state when the signal quality of the beam currently used by the terminal device is greater than a second threshold; and determines that the terminal device is not in a high beam quality state when the signal quality of the beam currently used by the terminal device is less than or equal to the second threshold.

[0009] If the signal quality of the beam currently used by the terminal device is greater than the second threshold, it means that the signal quality of the beam currently used by the terminal device is good, and therefore the terminal device is determined to be in a high beam quality state. If the signal quality of the beam currently used by the terminal device is less than or equal to the second threshold, it means that the signal quality of the beam currently used by the terminal device is poor, and therefore the terminal device is determined not to be in a high beam quality state.

[0010] In a possible implementation, the signal quality of the beam is the L1-RSRP of the beam.

[0011] L1-RSRP is the most important, fundamental, and direct beam quality information in beam management. BAI, a key metric used to quantitatively evaluate AI model performance, is implicitly calculated based on L1-RSRP. L1-RSRP is a real-time, unfiltered measurement of the physical layer, providing a faster and more reliable reference for beam management and BAI calculation. Therefore, using L1-RSRP as a beam quality metric is highly appropriate.

[0012] In a possible implementation, the first condition also includes that the terminal device is not located in an edge area of ​​the serving cell.

[0013] When a terminal device is in a low-mobility state with high beam quality and is not located at the edge of a serving cell, its downlink reception conditions are good and the channel quality is stable, resulting in a stable beam measured and used by the terminal device. In this case, the channel has low time-variability and high predictability, and interference and noise have little impact on beam prediction accuracy. Therefore, the monitoring intensity of the AI ​​model can be appropriately reduced to optimize resource utilization.

[0014] In one possible implementation, if the received signal strength of the service cell is greater than a third threshold, and / or if the received signal quality of the service cell is greater than a fourth threshold, the terminal device determines that the terminal device is not located in the edge area of ​​the service cell; otherwise, it is determined that the terminal device is located in the edge area of ​​the service cell.

[0015] If the received signal strength of the serving cell is greater than the third threshold, and / or if the received signal quality of the serving cell is greater than the fourth threshold, it means that the received signal of the terminal device is good, indicating that the terminal device is likely located in the center area of ​​the serving cell. Otherwise, it means that the received signal of the terminal device is poor, indicating that the terminal device is likely located in the edge area of ​​the serving cell.

[0016] In one possible implementation, when the terminal device satisfies the first condition, the operation of entering the target state may be: sending a relaxation monitoring application message to the network device when the first condition is met; and entering the target state when receiving the first indication message sent by the network device.

[0017] In this application, the terminal device can determine whether the first condition is met during the process of monitoring the AI ​​model. If the first condition is met, it means that the terminal device is in a stable beam transceiver state, and then it can apply to the network device to enter the target state. After receiving the first indication information sent by the network device, the terminal device can enter the target state to relax the monitoring of the AI ​​model. In this way, the terminal device and the network device can flexibly control the monitoring of the AI ​​model according to the beam transceiver environment, thereby optimizing the resource utilization of the terminal device to a certain extent.

[0018] In one possible implementation, after the terminal device sends a relaxation monitoring application message to the network device, it may not enter the target state and continue to determine whether the first condition is met when it receives a second indication message sent by the network device; or, it may not enter the target state and continue to determine whether the first condition is met within a second time period when it receives a third indication message sent by the network device.

[0019] In one possible implementation, after the terminal device enters the target state, it can also determine whether the second condition is met while in the target state, the second condition including that the terminal device is not in a high beam quality state; and exit the target state when the second condition is met.

[0020] In this application, when the terminal device is in the target state, it can determine whether the second condition is met. If the second condition is met, it indicates that the beam transceiver state is unstable, and the target state can be exited to resume normal monitoring of the AI ​​model. In this way, the terminal device can flexibly control the monitoring of the AI ​​model according to the beam transceiver environment, thereby optimizing the resource utilization of the terminal device to a certain extent.

[0021] In a second aspect, a communication apparatus is provided, which comprises a processing module and a communication module. The processing module is configured to monitor an AI model, the AI model being used for beam management; and enter a target state when a first condition is met, the first condition comprising that a terminal device is in a low mobility state and a high beam quality state, and the target state being a state in which no model monitoring is performed for a preset time length or a state in which model monitoring frequency is reduced.

[0022] The second aspect is a device-side implementation corresponding to the first aspect. The explanations, supplements and beneficial effects of the first aspect also apply to the second aspect, and thus will not be repeated.

[0023] In a third aspect, a communication apparatus is provided, which comprises a processor. The processor is coupled with a memory and is configured to execute instructions or data in the memory to implement the method in any possible implementation manner of any of the aspects. Optionally, the communication apparatus further comprises the memory. Optionally, the communication apparatus further comprises a communication interface, and the processor is coupled with the communication interface.

[0024] In an implementation manner, the communication interface can be a transceiver, or an input / output interface.

[0025] In another implementation manner, the communication apparatus is a chip configured in a terminal device. When the communication apparatus is a chip configured in a terminal device, the communication interface can be an input / output interface.

[0026] In a fourth aspect, a computer program product is provided, which comprises a computer program (also referred to as code or instructions), which, when executed, causes a computer to perform the method in any possible implementation manner of any of the aspects.

[0027] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program (also referred to as code or instructions), which, when executed on a computer, causes the computer to perform the method in any possible implementation manner of any of the aspects.

[0028] In a sixth aspect, a chip system is provided, which comprises one or more processors configured to invoke and execute instructions stored in a memory, so that the method in any possible implementation manner of any of the aspects is performed. The chip system can be composed of a chip, or can comprise a chip and other discrete devices.

[0029] In the chip system, the input circuit or interface for sending information or data, and the output circuit or interface for receiving information or data can be included.

[0030] In a seventh aspect, a communication system is provided, comprising the terminal device as described above. Optionally, the communication system can further comprise other devices in communication with the terminal device. BRIEF DESCRIPTION OF DRAWINGS

[0031] Figure 1 FIG. 1 is a schematic diagram of a communication system according to an embodiment of the present application; Figure 2 FIG. 2 is a flow chart of a model monitoring management method according to an embodiment of the present application; Figure 3 FIG. 3 is a flow chart of another model monitoring management method according to an embodiment of the present application; Figure 4 FIG. 4 is a flow chart of another model monitoring management method according to an embodiment of the present application; Figure 5 FIG. 5 is a flow chart of another model monitoring management method according to an embodiment of the present application; Figure 6 FIG. 6 is a schematic block diagram of a communication device according to an embodiment of the present application;

[0032] Figure 7 FIG. 7 is a schematic block diagram of another communication device according to an embodiment of the present application; DETAILED DESCRIPTION

[0033] In the following description, specific details are set forth, such as a particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. However, persons skilled in the art will understand that the present application can be practiced without these specific details.

[0034] It should be understood that, when used in the specification and the appended claims, the term "comprises" indicates the presence of the described features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. The terms "comprises", "comprising", "includes", "including", "has", "having" and their conjugates mean "including but not limited to", unless otherwise expressly stated.

[0035] It should be understood that, in the present application, "one or more" refers to one, two or more than two, and "multiple" refers to two or more than two. In the description of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B. In the present application, "and / or" is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone.

[0036] To facilitate the clear description of the technical solutions of this application, the words "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or order of execution, and the words "first" and "second" do not necessarily mean different.

[0037] The phrases "one embodiment" or "some embodiments" described in this application mean that the specific features, structures, or characteristics described in the embodiment are included in one or more embodiments of the application. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" that appear in different places in this application do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized.

[0038] The embodiments of the present application can be applied to various communication systems, such as the Global System for Mobile Communications (GSM) system, the General Packet Radio Service (GPRS) system, the Wireless Local Area Network (WLAN) system (such as the Wireless Fidelity (Wi-Fi) system), the Long Term Evolution (LTE) system, the LTE Frequency Division Duplex (FDD) system, the LTE Time Division Duplex (TDD) system, the Sidelink communication system, the Universal Mobile Telecommunication System (UMTS), the Worldwide Interoperability for Microwave Access (WiMAX) communication system, the Non-Terrestrial Network (NTN) communication system, the Fourth Generation (4G) mobile communication system, the Fifth Generation (5G) mobile communication system or the New Radio Access Technology (NR) system, the Sixth Generation (6G) mobile communication system, and the like. The 5G mobile communication system may include non-standalone (NSA) and / or standalone (SA) networking. It is understood that the embodiments of the present application may also be applied to future communication systems, and the embodiments of the present application are not limited thereto.

[0039] Figure 1 1 is a schematic diagram of a communication system 100 provided in an embodiment of the present application. The communication system 100 may include network (NW) devices, such as Figure 1 The communication system 100 may also include terminal devices, such as Figure 1 The terminal device 120 is shown. The network device and the terminal device can communicate via a wireless link. Figure 1 The example shows one network device 110 and one terminal device 120. Optionally, the communication system 100 may also include multiple network devices and / or multiple terminal devices.

[0040] The network device in the embodiments of the present application can be an access network device, a core network device, and the like.

[0041] The access network device is also sometimes referred to as an access node. The access network device has a wireless transceiving function and can communicate with the terminal device. For example, the access network device can be a base station, an evolved NodeB (eNodeB), a transmission reception point (TRP), a next generation radio access network (NG-RAN) device (such as a next generation NodeB (gNB) and the like) in a 5G mobile communication system, an access network device or a module of an access network device in an open RAN (ORAN) system, a satellite in an NTN communication system, a base station in a future mobile communication system, or an access point (AP) in a Wi-Fi system, and the like. The access network device can also be a module or unit capable of implementing part of the function of a base station, such as a macro base station, a micro base station, an indoor station, a relay node, a donor node, and the like. The plurality of access network devices in the communication system 100 can be the same type of device or different types of devices. The embodiments of the present application do not limit the specific technology and specific device form adopted by the access network device.

[0042] Core network equipment performs functions such as data processing, session management, network interconnection, operation administration and maintenance (OAM), and location management (LMF). Core network equipment can implement user access authentication, service bearer establishment, and data exchange with external networks. OAM functions also enable operational maintenance tasks such as network configuration monitoring, resource scheduling optimization, and fault resolution. LMF functions provide terminal location calculation, trajectory tracking, and spatial data analysis. For example, core network equipment can be network elements such as the mobility management entity (MME), serving gateway (SGW), and packet data network gateway (PGW) in a 4G mobile communication system. Alternatively, core network equipment can be network elements such as the access and mobility management function (AMF), session management function (SMF), user plane function (UPF), and LMF in a 5G mobile communication system. Alternatively, core network equipment can be a functional entity dedicated to providing operational maintenance services or location services, such as an independent server that closely collaborates with the core network. Alternatively, the core network device may be a virtualized network element in a network functions virtualization (NFV) architecture that integrates OAM or LMF capabilities. The core network device may also be a new type of core network entity in a future communication system. The multiple core network devices in communication system 100 may be deployed in a centralized or distributed architecture, and each core network device may perform the same or different types of network functions. The embodiments of this application do not limit the specific technologies and device forms used by the core network devices.

[0043] In the embodiments of the present application, the apparatus for implementing the functions of a network device may be a network device, or may be a device capable of supporting the network device in implementing the functions, such as a processor, circuit, chip, or chip system. The apparatus may be installed in the network device or connected to the network device for use. In the embodiments of the present application, the technical solution provided by the present application is described using the network device as an example.

[0044] The terminal device in the embodiments of the present application may be a wireless terminal device capable of receiving scheduling and instructions from a network device. A wireless terminal device may be a device that provides voice and / or data connectivity to a user, or a handheld device with wireless connection capabilities, or other processing devices connected to a wireless modem. For example, the terminal device may communicate with one or more core networks or the Internet via a radio access network (RAN). The terminal device may also be referred to as a terminal, user equipment (UE), mobile terminal (MT), mobile station (MS), mobile unit (MU), wireless unit, remote unit, user agent, mobile client, etc. Terminal devices can be widely used in various scenarios, such as device-to-device (D2D), vehicle-to-everything (V2X) communication, machine-type communication (MTC), the Internet of Things (IoT), ultra-reliable low-latency communication (URLLC), virtual reality (VR), augmented reality (AR), industrial control, self-driving, remote medical surgery, smart grid, smart transportation, smart home, smart city, or satellite communication. The terminal device can be a mobile phone, tablet computer, computer with wireless transceiver capabilities, wearable device, vehicle, aircraft (such as drones, helicopters, airplanes), hot air balloon, ship, robot, robotic arm, or smart home appliance. The embodiments of the present application do not limit the form of the terminal device.

[0045] In the embodiments of the present application, the apparatus for implementing the functions of a terminal device may be a terminal device, or may be a device capable of supporting the terminal device in implementing the functions, such as a processor, circuit, chip, or chip system. The apparatus may be installed in the terminal device or connected to the terminal device for use. In the embodiments of the present application, the technical solutions provided by the present application are described using the terminal device as an example.

[0046] To facilitate understanding of the embodiments of the present application, the technical terms involved in the embodiments of the present application are briefly explained. Optionally, the explanation of some terms can also refer to the explanation in the 3rd Generation Partnership Project (3GPP) standard protocol.

[0047] 1. Beam A beam is a pattern of energy radiation with a specific directionality formed when electromagnetic waves propagate through space. Its energy is concentrated in the target direction, with energy attenuated in non-target directions. The beam described in the embodiments of this application may also be referred to as a beam direction, and the two terms can be used interchangeably.

[0048] 2. Beamforming Beamforming is a technology that dynamically constructs and tracks the optimal beam pattern by optimizing the amplitude weights, phase offsets, and delay compensation parameters of a multi-antenna array. Its core goal is to achieve coherent signal superposition in the target direction and energy cancellation in the interfering direction, thereby overcoming path loss and improving spatial multiplexing capabilities.

[0049] Beamforming relies on decision-making information provided by beam management (BM). During beam management, network devices can send reference signals in multiple candidate beam directions. Terminal devices measure the signal quality of each reference signal and provide feedback to the network device. Based on this feedback, the network device can switch beams.

[0050] It should be noted that one reference signal corresponds to one beam. That is, when a reference signal is sent in a certain beam direction, the reference signal corresponds to the beam identifier of that beam direction. For example, the beam identifier can be a beam index or a channel state information-reference signal resource indicator (CRI), etc., but this embodiment of the application does not limit this.

[0051] The signal quality of the reference signal described in the embodiment of the present application can also be referred to as the signal quality of the beam corresponding to the reference signal. That is, the signal quality of a certain beam refers to the signal quality of the reference signal sent through the beam.

[0052] 3. Reference signal (RS) A reference signal is a known signal used in communication systems for channel estimation or channel sounding. Its core function is to provide the receiver with channel state information, assisting in efficient resource scheduling and data transmission.

[0053] Optionally, the reference signal described in the embodiment of the present application may include a channel state information-reference signal (CSI-RS), a synchronization signal / physical broadcast channel block (SSB) reference signal, etc., which is not limited to the embodiment of the present application.

[0054] It should be understood that the technical terms in the embodiments of the present application are only examples and not limitations. As technology evolves, technical terms will also change. In the case of the same technical meaning, other technical terms should also be applicable to the embodiments of the present application.

[0055] The application scenarios involved in the embodiments of the present application are described below.

[0056] Beam management involves selecting, maintaining, and optimizing directional beams between network devices and end devices to ensure reliable and high-quality communications. Its goal is to establish and maintain appropriate beam pairs, specifically selecting appropriate transmit beams on the transmitter side and appropriate receive beams on the receiver side. Embodiments of this application involve beam management based on AI (also known as machine learning (ML)).

[0057] AI-based beam management can include a decision-making support mechanism based on terminal-side AI models. This decision-making support mechanism can include two functions: model inference and model monitoring. The information generated by these two functions can be reported to the network device via model inference reports and model monitoring reports. Model inference refers to using a trained AI model to obtain signal quality predictions for a specific beam set. Model monitoring involves comparing the AI ​​model's predictions with actual measurements to obtain performance metrics (such as prediction error and accuracy). For example, a model inference report can include beam signal quality predictions or indicate beams with predicted good signal quality. The network device can use this information to make beam switching or scheduling decisions. For example, a model monitoring report can include model performance metrics, which the network device can use to evaluate model performance and determine whether to trigger a model update or adjustment.

[0058] The following is a brief example of the model reasoning process and the model monitoring process: For example, model inference mainly includes two application scenarios: spatial beam prediction and time beam prediction. The following describes the AI ​​use cases for these two application scenarios (i.e., BM-Case 1 and BM-Case 2). 1. BM-Case1: Based on the measurement results of the reference signal set Set B, the spatial domain downlink beam prediction of the reference signal set Set A is performed.

[0059] In BM-Case1, the network device transmits the reference signal set Set B, and the terminal device measures the signal quality of Set B. After that, the terminal device takes the measurement value of Set B as the input or part of the input of the AI model, and uses the AI model to predict the signal quality of the reference signal set Set A to obtain the predicted value of Set A. The terminal device reports the beam identifiers of the TopK reference signals in Set A to the network device according to the prediction result of the AI model. The TopK reference signals in Set A refer to the K reference signals with the best signal quality in Set A. Set B is a subset of Set A. For example, Set B includes CSI-RS#[2, 6], and Set A includes CSI-RS#[1, 2, 3, 4, 5, 6].

[0060] 2. BM-Case2: Based on the historical measurement results of Set B, the time domain downlink beam prediction of Set A is performed.

[0061] In BM-Case2, the terminal device can measure the signal quality of Set B at one or more past transmission occasions, take the historical measurement results of Set B as the input or part of the input of the AI model, and use the AI model to predict the signal quality of Set A at one or more future time points. The terminal device reports the beam identifiers of the TopK reference signals in Set A at the one or more future time points to the network device according to the prediction result of the AI model.

[0062] Optionally, the AI model described in the embodiments of the present application can be a long short-term memory (LSTM) model, a self-attention model (such as a transformer model), a convolutional neural network (CNN) model, a graph neural network (GNN) model, etc., which is not limited in the embodiments of the present application.

[0063] It should be noted that the above is only a simple example of the model inference process with BM-Case1 and BM-Case2 AI use cases. The AI use cases described above do not limit the embodiments of the present application. In actual applications, the terminal device can also use other AI use cases.

[0064] The model inference process described above demonstrates that the terminal device does not need to fully measure all reference signals (i.e., Set A). Instead, it only needs to measure a small subset of them (i.e., Set B). The terminal device uses the measured values ​​of Set B to obtain predicted values ​​for Set A through the AI ​​model. In this case, when performing model monitoring, the terminal device can obtain and report model performance indicators based on the actual measured values ​​of Set B and the predicted values ​​of Set B within the predicted values ​​of Set A.

[0065] Currently, terminal devices continuously monitor the model during model inference. In some cases, when the beam measured and used by the terminal device is stable, the channel has low time-variability, the probability of neighboring cell handoffs is low, and the serving cell beam can remain optimal. In this case, measurement error is low, the reliability of input feature extraction is high, and the impact of interference and noise on beam prediction accuracy is minimized. Therefore, the intensity of terminal device monitoring of the AI ​​model can be appropriately reduced. For example, performance indicator calculations can be suspended and the frequency of model monitoring reports can be reduced to conserve terminal device computing and communication resources.

[0066] To this end, an embodiment of the present application provides a model monitoring management method. During the monitoring of the AI ​​model, the terminal device can relax the monitoring of the AI ​​model when the terminal device is in a stable beam transceiver state. Afterwards, the terminal device can resume normal monitoring of the AI ​​model when the beam transceiver state is unstable. In this way, the terminal device can flexibly control the monitoring of the AI ​​model according to the beam transceiver environment, thereby optimizing the resource utilization of the terminal device to a certain extent.

[0067] The model monitoring and management method provided by the embodiment of the present application is described in detail below in conjunction with the corresponding flow chart. It can be understood that the schematic flow chart provided in the embodiment of the present application mainly uses different devices (such as network devices, terminal devices) as examples of the execution subjects of the interactive diagram to illustrate the model monitoring and management method, but the embodiment of the present application does not limit the execution subjects of the interactive diagram. For example, the device (such as network device, terminal device) in the schematic flow chart can also be a chip, chip system, or processor that supports the device to implement the model monitoring and management method, or it can be a logic module or software that can implement all or part of the functions of the device.

[0068] For a unified explanation here, in the interaction process of the embodiment of the present application, the messages or signaling involved can adopt the messages or signaling in the standard, or can be newly introduced messages or signaling, and the embodiment of the present application does not limit this.

[0069] Understandably, the following Figures 2 to 5 The network device described in the embodiment may be Figure 1 Any network device described in the embodiments may also be a device in the network device (such as a processor, chip, or chip system, etc.). Figures 2 to 5 The terminal device described in the embodiment may be Figure 1 Any terminal device described in the implementation manner may also be a device in the terminal device (such as a processor, a chip, or a chip system, etc.).

[0070] Figure 2 This is a flow chart of a model monitoring and management method provided by an embodiment of the present application. Figure 2 , the method may include the following steps: Step 201: The terminal device monitors the AI ​​model.

[0071] The AI ​​model is used for beam management. Optionally, the AI ​​model is used to predict the signal quality of the beam.

[0072] The terminal device may periodically obtain the performance indicator of the AI ​​model to monitor the AI ​​model. For example, the terminal device may obtain the performance indicator of the AI ​​model each time by: the terminal device obtains the performance indicator of the AI ​​model based on the measured value input to the AI ​​model and the predicted value output by the AI ​​model during the most recent model inference process.

[0073] Optionally, each time the terminal device obtains the performance indicators of the AI ​​model, it can send a model monitoring report message to the network device, and the model monitoring report message may include the performance indicators of the AI ​​model.

[0074] For example, the performance indicators of the AI ​​model may include beam accuracy indicator (BAI), etc., which is not limited in the embodiments of the present application.

[0075] Step 202: The terminal device determines whether a first condition is met.

[0076] The first condition can be pre-set. The first condition is a condition that can reduce the terminal device's monitoring intensity of the AI ​​model, that is, relax the condition for monitoring the AI ​​model. The first condition represents that the terminal device is in a stable beam transceiver state.

[0077] The terminal device may continue to perform step 202 during the process of performing step 201. That is, the terminal device may periodically determine whether the first condition is met during the model monitoring process to determine whether the model monitoring can be relaxed.

[0078] Optionally, the first condition may include: the terminal device is in a low mobility state and a high beam quality state. Low mobility means that the terminal device's location changes little. High beam quality means that the signal quality of the beam currently used by the terminal device is high. Furthermore, the first condition may optionally include: the terminal device is not located in an edge area of ​​a serving cell. Of course, the first condition may also include other conditions, which are not limited in this embodiment of the present application.

[0079] When the terminal device is in a low-mobility state and high-beam quality state (such as when it is near the TRP of the serving cell), its downlink reception conditions are relatively good and the channel quality is relatively stable. Therefore, the beam measured and used by the terminal device is relatively stable. In this case, the channel has low time-variability and is more predictable, and interference and noise have less impact on beam prediction accuracy. Therefore, the monitoring intensity of the AI ​​model can be appropriately reduced to optimize resource utilization.

[0080] When the terminal device is in a low-mobility state with high beam quality and is not located at the edge of the serving cell, its downlink reception conditions are good and the channel quality is stable, so the beam measured and used by the terminal device is stable. In this case, the channel has low time-variability and high predictability, and interference and noise have little impact on beam prediction accuracy. Therefore, the monitoring intensity of the AI ​​model can be appropriately reduced to optimize resource utilization.

[0081] In some embodiments, the operation for the terminal device to determine whether the terminal device is in a low mobility state may be: determining whether the difference obtained by subtracting the received signal strength of the serving cell from the reference received signal strength is less than a first threshold; if the difference obtained by subtracting the received signal strength of the serving cell from the reference received signal strength is less than the first threshold, determining that the terminal device is in a low mobility state; otherwise, determining that the terminal device is not in a low mobility state.

[0082] The above operation of determining whether the terminal device is in the low mobility state can be implemented based on the following formula 1. Specifically, if formula 1 is satisfied, it means that the terminal device is in the low mobility state, otherwise it means that the terminal device is not in the low mobility state.

[0083] Formula 1: (SrxlevRef–Srxlev)<SsearchDeltaP.

[0084] Wherein, Srxlev is the received signal strength of the serving cell, in decibels (dB). SrxlevRef is the reference received signal strength, which is the reference value of Srxlev. SsearchDeltaP is the first threshold.

[0085] For example, Srxlev=Qrxlevmeas–(Qrxlevmin+ Qrxlevminoffset)–Pcompensation. Qrxlevmeas is the reference signal receiving power (RSRP) value of the serving cell. Qrxlevmin is the minimum RSRP value of the serving cell, which is a preset threshold value. Qrxlevminoffset is the minimum RSRP offset of the serving cell, which is an optional parameter. Pcompensation is the RSRP compensation value. For example, its calculation formula is: MAX(Pmax–PpowerClass,0), ​​where PMax is the maximum allowed transmit power of the terminal device, and PpowerClass is the maximum transmit power supported by the terminal device capability. Of course, this is not limited to this, and Srxlev can also be determined by other means, which is not limited in the embodiments of the present application.

[0086] For example, the SrxlevRef setting rule is as follows: when a new cell is selected or reselected, or when (Srxlev−SrxlevRef)>0, or when Formula 1 is not satisfied for TsearchDeltaP time, SrxlevRef is updated to the latest determined Srxlev.

[0087] After selecting or reselecting a new cell, the current Srxlev of the serving cell is set to SrxlevRef. This is because when switching cells, the signal condition of the new cell is an important reference benchmark for subsequent measurement and judgment of the terminal device.

[0088] If (Srxlev – SrxlevRef) > 0, it means the current Srxlev is higher than the previously set reference value. In this case, SrxlevRef can be updated to the current Srxlev. This ensures that the reference value can keep pace with changes in signal strength, making the measurement more accurate.

[0089] If Formula 1 is not satisfied for a continuous period of TsearchDeltaP, that is, Formula 1 is always invalid, SrxlevRef can also be updated to the current Srxlev. TsearchDeltaP is a time parameter used to limit the update frequency of SrxlevRef to avoid too frequent adjustments. TsearchDeltaP specifies how long the terminal device needs to wait from the last SrxlevRef update. For example, TsearchDeltaP can be a time hysteresis value sent by a network device through a system message (such as system information block (SIB) 2 or SIB4 or measurement configuration message, etc.), such as 1 second.

[0090] For example, t-SearchDeltaP-r16 ENUMERATED {s5, s10, s20, s30, s60, s120, s180, s240, s300, spare7, spare6, spare5, spare4, spare3, spare2, spare1}. t-SearchDeltaP-r16 ENUMERATED refers to the enumeration type for TsearchDeltaP from the 3GPP R16 specification. s5, s10, s20, s30, s60, s120, s180, s240, and s300 represent durations in seconds. For example, s5 refers to 5 seconds, s10 refers to 10 seconds, and so on. spare7, spare6, spare5, spare4, spare3, spare2, and spare1 refer to additional enumeration values ​​reserved by the protocol and not defined in the 3GPP R16 specification.

[0091] SsearchDeltaP is a preset threshold value used to indicate the tolerance range of signal strength changes. For example, s-SearchDeltaP-r16 ENUMERATED{dB3, dB6, dB9, dB12, dB15, spare3, spare2, spare1}. s-SearchDeltaP-r16 ENUMERATED refers to the enumeration type for SsearchDeltaP from the 3GPP Release 16 specification. dB3, dB6, dB9, dB12, and dB15 indicate the tolerable signal attenuation. For example, dB3 means a maximum of 3dB below the reference point, dB6 means a maximum of 6dB below the reference point, and so on. spare3, spare2, and spare1 are additional enumeration values ​​reserved by the protocol and not defined in the 3GPP Release 16 specification.

[0092] If formula 1 is satisfied, that is, if (SrxlevRef–Srxlev) < SsearchDeltaP, it means that the current received signal is weaker than the reference point, but the degree of weakness is within an acceptable tolerance range. This indicates that the terminal device has not moved significantly over long distances and is still near the reference point. Therefore, the terminal device is determined to be in a low mobility state. If formula 1 is not satisfied, that is, if (SrxlevRef–Srxlev) ≥ SsearchDeltaP, it means that the current received signal is much weaker than the reference point, and the degree of weakness exceeds the acceptable tolerance range. This indicates that the terminal device may have moved to a farther location with a worse received signal. Therefore, the terminal device is determined not to be in a low mobility state.

[0093] For example, Formula 1 may be pre-set by a network device. For example, Formula 1 may be determined by low mobility evaluation configuration information sent by the network device to the terminal device. Of course, this is not limiting. The terminal device may also obtain Formula 1 through other means, such as pre-configuration within the terminal device or agreement through a standard protocol. This embodiment of the present application is not limited to this.

[0094] In some embodiments, the operation for the terminal device to determine whether the terminal device is in a high beam quality state may be: determining whether the signal quality of the beam currently used by the terminal device is greater than a second threshold; if the signal quality of the beam currently used by the terminal device is greater than the second threshold, determining that the terminal device is in a high beam quality state; otherwise, determining that the terminal device is not in a high beam quality state.

[0095] As an example, the signal quality of a beam can be determined based on one or more indicators of the beam's layer 1 reference signal received power (L1-RSRP), RSRP, reference signal receiving quality (RSRQ), received signal strength indicator (RSSI), and signal to interference plus noise ratio (SINR). In other words, the signal quality of the beam can be obtained by combining the one or more indicators.

[0096] As another example, the signal quality of the beam may include one or more indicators of the beam's L1-RSRP, RSRP, RSRQ, RSSI, SINR, etc. In this case, each indicator has its corresponding second threshold, and the second threshold corresponding to each indicator can be pre-set. Only when each indicator in the signal quality of the beam is greater than its corresponding second threshold, is it determined that the terminal device is in a high beam quality state, otherwise it is determined that the terminal device is not in a high beam quality state. For example, the signal quality of the beam includes the L1-RSRP and RSRQ of the beam, then the terminal device is determined to be in a high beam quality state only when the L1-RSRP of the beam is greater than a certain threshold and the RSRQ of the beam is also greater than a certain threshold.

[0097] The above operation of determining whether the terminal device is in a high beam quality state can be implemented based on the following formula 2. Specifically, if formula 2 is satisfied, it means that the terminal device is in a high beam quality state, otherwise it means that the terminal device is not in a high beam quality state.

[0098] Formula 2: Bqual>ThresholdPerformanceAI.

[0099] Bqual refers to the signal quality of the beam currently used by the terminal device. ThresholdPerformanceAI is the second threshold.

[0100] For example, Bqual can be the L1-RSRP of a beam. L1-RSRP is the most important, fundamental, and direct beam quality information in beam management. BAI, a key metric used to quantitatively evaluate AI model performance, is implicitly calculated based on L1-RSRP. L1-RSRP is a real-time, unfiltered measurement at the physical layer, providing a faster and more reliable reference for beam management and BAI calculation. Therefore, using L1-RSRP as a beam quality metric is highly appropriate. Of course, this is not a limitation; other metrics can also be used in practical applications.

[0101] ThresholdPerformanceAI is a preset threshold value, which is usually a value much greater than 0. For example, ThresholdPerformanceAI may be a threshold value set by a network device.

[0102] If Formula 2 is satisfied, that is, if Bqual>ThresholdPerformanceAI, it means that the signal quality of the beam currently used by the terminal device is good, and the terminal device is therefore determined to be in a high beam quality state. If Formula 2 is not satisfied, that is, if Bqual≤ThresholdPerformanceAI, it means that the signal quality of the beam currently used by the terminal device is poor, and the terminal device is therefore determined not to be in a high beam quality state.

[0103] For example, Formula 2 may be pre-set by a network device. For example, Formula 2 may be determined by beam quality assessment configuration information sent by the network device to the terminal device. Of course, this is not limited to this. The terminal device may also obtain Formula 2 through other means, such as pre-configuration within the terminal device or agreement through a standard protocol. This embodiment of the present application is not limited to this.

[0104] In some embodiments, the operation of the terminal device determining whether the terminal device is located in the edge area of ​​the service cell may be: if the received signal strength of the service cell is greater than a third threshold, and / or if the received signal quality of the service cell is greater than a fourth threshold, then it is determined that the terminal device is not located in the edge area of ​​the service cell; otherwise, it is determined that the terminal device is located in the edge area of ​​the service cell.

[0105] The above operation of determining whether the terminal device is located in the edge area of ​​the serving cell can be implemented based on the following formula 3 and formula 4. Specifically, if formula 3 and / or formula 4 are satisfied, it means that the terminal device is not located in the edge area of ​​the serving cell; otherwise, it means that the terminal device is located in the edge area of ​​the serving cell.

[0106] Formula 3: Srxlev>SSearchThresholdP.

[0107] Formula 4: Squal>SsearchThresholdQ.

[0108] Wherein, Srxlev is the received signal strength of the serving cell, in dB, and SSearchThresholdP is the third threshold.

[0109] SSearchThresholdP is a preset threshold value, which is usually a value much greater than 0. For example, SSearchThresholdP may be a threshold value sent by the network device through a system message (such as SIB2 or SIB4 or a measurement configuration message, etc.).

[0110] If formula 3 is satisfied, i.e., if Srxlev > SSearchThresholdP, it means that the terminal device has a high received signal strength, which indicates that the terminal device is likely to be located in the central area of the serving cell. If formula 3 is not satisfied, i.e., if Srxlev ≤ SSearchThresholdP, it means that the terminal device has a low received signal strength, which indicates that the terminal device is likely to be located in the edge area of the serving cell.

[0111] Squal is the received signal quality of the serving cell, and is in dB. SsearchThresholdQ is a fourth threshold value.

[0112] For example, Squal = Qqualmeas - (Qqualmin + Qqualminoffset). Qqualmeas is the RSRQ value of the serving cell. Qqualmin is the minimum RSRQ value of the serving cell, which is a pre-configured threshold value. Qqualminoffset is the minimum RSRQ offset of the serving cell, which is an optional parameter. Of course, Squal can also be determined in other manners, and the embodiments of the present application are not limited in this aspect.

[0113] SsearchThresholdQ is a pre-configured threshold value, which is usually a value much greater than 0. For example, SsearchThresholdQ can be a threshold value sent by the network device through a system message (such as SIB2 or SIB4 or a measurement configuration message, etc.).

[0114] If formula 4 is satisfied, i.e., if Srxlev > SSearchThresholdP, it means that the terminal device has a good received signal quality, which indicates that the terminal device is likely to be located in the central area of the serving cell. If formula 4 is not satisfied, i.e., if Srxlev ≤ SSearchThresholdP, it means that the terminal device has a poor received signal quality, which indicates that the terminal device is likely to be located in the edge area of the serving cell.

[0115] For example, formula 3 and formula 4 can be pre-configured by the network device. For example, formula 3 and formula 4 can be determined by the cellEdgeEvaluation configuration information sent by the network device to the terminal device. Of course, the terminal device can also obtain formula 3 and formula 4 in other manners, such as being pre-configured in the terminal device, or being agreed through a standard protocol, etc., and the embodiments of the present application are not limited in this respect.

[0116] It should be noted that the above formula 1 determines the mobility of the terminal device, and formulas 3 and 4 determine the location of the terminal device. Under normal circumstances, when the terminal device is in a state of low mobility and not at the edge of the service cell, it can be considered that the terminal device is in a stable beam transceiver state, and the monitoring of the AI ​​model can be relaxed. However, this does not judge the transmission performance of the beam currently used by the terminal device. If the signal quality of the beam does not meet certain requirements when formula 1, and formula 3 and / or formula 4 are satisfied, it means that the currently used beam does not meet or will not meet the communication requirements, the communication quality is unstable and the reliability of the AI ​​model prediction is questionable. This situation is not suitable for relaxing the monitoring of the AI ​​model. Therefore, formula 2 is introduced in the embodiment of the present application, that is, a high beam quality state is introduced as one of the conditions for relaxing model monitoring.

[0117] Generally, satisfying Formulas 1 and 2 indicates stable received power and low mobility for the terminal device. Formulas 3 and 4 can be flexibly configured as needed. For example, in scenarios with high co-channel interference, dense urban areas, and high signal quality requirements, Formulas 3 and 4 can be used.

[0118] In some embodiments, the first condition may be pre-configured by a network device and sent by the network device to the terminal device. For example, the network device may send dynamic performance monitoring configuration (DynPerfMonConfig) information to the terminal device. The dynamic performance monitoring configuration information is used to dynamically activate or deactivate (also referred to as deactivating) the performance monitoring configuration. The dynamic performance monitoring configuration information may include the first condition. For example, the network device may carry the dynamic performance monitoring configuration information in a media access control (MAC) control element (CE) message or downlink control information (DCI) and send it to the terminal device. Of course, the network device may also carry the dynamic performance monitoring configuration information in other messages and send them to the terminal device. This embodiment of the present application is not limited to this.

[0119] Of course, this is not limited to the above. The terminal device may also obtain the first condition in other ways, such as by pre-configuration in the terminal device or by agreement through a standard protocol. This embodiment of the present application does not limit this.

[0120] Step 203: The terminal device enters the target state when the first condition is met.

[0121] In some embodiments, the model monitoring is not performed in the target state. The target state can last for a preset time length, i.e., the target state is automatically exited after the preset time length. The preset time length can be preset. For example, the preset time length can be preset by the network device and sent to the terminal device. Of course, the preset time length can also be obtained by the terminal device in other manners, such as being preconfigured in the terminal device, or being agreed through a standard protocol, etc., which are not limited in the embodiments of the present application. The preset time length can be implemented by a timer.

[0122] In some other embodiments, the model monitoring frequency is reduced in the target state. That is, the model monitoring is still performed in the target state, but the period of obtaining the performance indicators of the AI model is longer than that in the non-target state. In this way, the resource consumption can be reduced.

[0123] In some embodiments, to avoid frequent state switching caused by signal fluctuation, the terminal device can re-enter the target state when the terminal device meets the first condition for more than a certain time. That is, if the terminal device meets the first condition for a first time length, the terminal device enters the target state, otherwise, the terminal device does not enter the target state. The first time length can be preset, for example, the first time length can be TSearchDeltaP, etc., which are not limited in the embodiments of the present application. The first time length can be implemented by a timer.

[0124] Step 204: The terminal device determines whether the second condition is met in the target state.

[0125] The second condition can be preset. The second condition is a condition for exiting the target state. The second condition is used to indicate that the beam transceiving state of the terminal device is unstable, such as a sudden abnormality in the beam transceiving environment.

[0126] Optionally, the second condition can include that the terminal device is not in a high beam quality state. The determination of the high beam quality state is simple and fast, and the resource consumption is extremely small, which can efficiently indicate the environmental mutation. Of course, the second condition can also include other conditions, such as a condition that the terminal device is not in a low mobility state, which can indicate unstable communication connection, etc., which are not limited in the embodiments of the present application.

[0127] The terminal device does not need to determine whether the first condition is met in the target state, but can periodically determine whether the second condition is met to determine whether the target state needs to be exited to restore the normal model monitoring. The terminal device does not need to determine whether the second condition is met after exiting the target state.

[0128] Step 205: The terminal device exits the target state when the second condition is met.

[0129] In some embodiments, the terminal device does not perform model monitoring in the target state, and the target state is automatically exited after a preset time period. In this case, if the second condition is not detected to be satisfied within the preset time period, the terminal device may automatically exit the target state after entering the target state for the preset time period. If the second condition is detected to be satisfied within the preset time period, the terminal device may immediately exit the target state to resume normal model monitoring.

[0130] In other embodiments, the terminal device performs low-frequency model monitoring in the target state. In this case, if the terminal device does not detect that the second condition is met while in the target state, it can maintain the target state and perform low-frequency model monitoring. If it detects that the second condition is met while in the target state, it can exit the target state and resume normal-frequency model monitoring.

[0131] In an embodiment of the present application, the terminal device can determine whether the first condition is met during the process of monitoring the AI ​​model. If the first condition is met, it means that the terminal device is in a stable beam transceiver state, and then it can enter the target state to relax the monitoring of the AI ​​model. When the terminal device is in the target state, it can determine whether the second condition is met. If the second condition is met, it means that the beam transceiver state is unstable, and then it can exit the target state to resume normal monitoring of the AI ​​model. In this way, the terminal device can flexibly control the monitoring of the AI ​​model according to the beam transceiver environment, thereby optimizing the resource utilization of the terminal device to a certain extent.

[0132] In the above Figure 2 In some embodiments, the terminal device can enter the target state according to the first condition. In other embodiments, if the terminal device wants to enter the target state, it needs to obtain the instruction of the network device. Figure 3 This will be described in detail in the embodiment.

[0133] Figure 3 This is a flow chart of a model monitoring and management method provided by an embodiment of the present application. Figure 3 , the method may include the following steps: Step 301: The terminal device monitors the AI ​​model.

[0134] The operation of step 301 is similar to that of the above-mentioned step 201, and will not be described in detail in the embodiment of the present application.

[0135] Step 302: The terminal device determines whether the first condition is met.

[0136] The operation of step 302 is similar to that of the above-mentioned step 202, and will not be described in detail in this embodiment of the present application.

[0137] Step 303: When the first condition is met, the terminal device sends a monitoring relaxation application message to the network device.

[0138] The monitoring relaxation request information is used to indicate that the first condition has been met and to request the relaxation of monitoring of the AI ​​model. That is, the monitoring relaxation request information is used to request entry into the target state. Optionally, the monitoring relaxation request information may carry an identifier (ID) of the AI ​​model. Of course, this is not limited to this, and the monitoring relaxation request information may also carry other information related to the AI ​​model, which is not limited in this embodiment of the present application.

[0139] For example, the terminal device may carry the monitoring relaxation request information in a MAC CE message or uplink control information (UCI) and send it to the network device. Of course, the terminal device may also carry the monitoring relaxation request information in other messages and send it to the network device.

[0140] In some embodiments, to avoid frequent state switching caused by signal fluctuations, the terminal device may send the monitoring relaxation request information to the network device only if the terminal device meets the first condition for a certain period of time. That is, if the terminal device meets the first condition for a first period of time, the monitoring relaxation request information is sent to the network device; otherwise, the monitoring relaxation request information is not sent to the network device.

[0141] Step 304: After receiving the monitoring relaxation application information, the network device sends first indication information to the terminal device.

[0142] The first indication information is used to indicate the relaxation of monitoring of the AI ​​model, that is, to indicate the entry into the target state. Optionally, when the target state is not to perform model monitoring within a preset time period, the first indication information may include the preset time period.

[0143] In some implementations, after receiving the monitoring relaxation application information, the network device may directly send the first indication information to the terminal device.

[0144] In other embodiments, after receiving the relaxation monitoring application information, the network device can determine whether to send the first indication information to the terminal device based on the historical performance of the AI ​​model and / or the cell beam environment.

[0145] The historical performance of an AI model can reflect the AI ​​model's recent performance. For example, the AI ​​model's historical performance can be determined based on the BAI sent by the terminal device to the network device. For example, if the AI ​​model's historical performance reflects good recent performance (e.g., high model prediction accuracy), the network device may allow the terminal device to relax monitoring of the AI ​​model. If the AI ​​model's historical performance reflects poor recent performance (e.g., low model prediction accuracy), the network device may not allow the terminal device to relax monitoring of the AI ​​model.

[0146] The cell beam environment is used to reflect the communication performance of the beam direction currently used by the terminal device. For example, the cell beam environment can be determined based on the beam transceiver conditions of other terminal devices in the beam direction. For example, if the cell beam environment reflects that the beam transceiver conditions in the beam direction are stable, the network device can allow the terminal device to relax the monitoring of the AI ​​model; if the cell beam environment reflects that the beam transceiver conditions in the beam direction are abnormal (such as a large number of terminal devices performing beam switching in a short period of time, or the beam quality suddenly deteriorates, etc.), the network device does not allow the terminal device to relax the monitoring of the AI ​​model.

[0147] When the network device allows the terminal device to relax monitoring of the AI ​​model, the network device may send first indication information to the terminal device. When the network device does not allow the terminal device to relax monitoring of the AI ​​model, the network device may send second indication information or third indication information to the terminal device.

[0148] The second indication information is used to indicate that the terminal device is not allowed to relax monitoring of the AI ​​model, but the terminal device is allowed to report the relaxation monitoring application information again within the second time period.

[0149] The third indication information is used to indicate that the terminal device is not allowed to relax monitoring of the AI ​​model, and is not allowed to report the relaxation monitoring application information again within the second duration. Optionally, the third indication information may include the second duration. The second duration may be pre-set. The second duration may be implemented by a timer.

[0150] For example, if the historical performance of an AI model shows that its recent performance, while somewhat poor, is very close to the required performance, such as if the difference between the model's prediction accuracy and the corresponding accuracy threshold is already very small, then the AI ​​model's performance is likely to reach the required performance within a short period of time. Therefore, although the network device does not allow the terminal device to relax its monitoring of the AI ​​model at this time, it may allow the terminal device to re-report a request to relax monitoring within a short period of time. In this case, the network device may send a second indication message to the terminal device. After receiving the second indication message, the terminal device does not enter the target state (i.e., continues normal model monitoring) and continues to determine whether the first condition is met. If the first condition is met, it may again send a request to relax monitoring to the network device.

[0151] For another example, a large number of terminal devices have recently switched beams in the beam direction currently used by the terminal device, indicating that the beam reception and transmission conditions in this beam direction are extremely unstable and are unlikely to improve in a short period of time. Therefore, the network device not only does not allow the terminal device to relax its monitoring of the AI ​​model this time, but also does not allow the terminal device to report relaxation of monitoring application information again in a short period of time. In this case, the network device can send a third indication message to the terminal device. After receiving the third indication message, the terminal device does not enter the target state (i.e., continues normal model monitoring), and does not need to determine whether the first condition is met within the second time period. It can determine whether the first condition is met after the second time period.

[0152] For example, the network device may send the first indication information, the second indication information, or the third indication information to the terminal device via a physical downlink control channel (PDCCH).

[0153] Step 305: After receiving the first indication information, the terminal device enters the target state.

[0154] In some embodiments, model monitoring is not performed in the target state. The target state can last for a preset time period, that is, the target state is automatically exited after the preset time period. The preset time period can be pre-set.

[0155] In other embodiments, the frequency of model monitoring is reduced in the target state. That is, model monitoring is still performed when in the target state, but the cycle for obtaining the performance indicators of the AI ​​model during model monitoring is longer than that in the non-target state. In this way, resource consumption can be reduced. Moreover, in this case, there is no need to frequently request model monitoring relaxation from the network device, which can reduce signaling interaction. In this way, it is more suitable for scenarios where the terminal device is at the edge of a non-serving cell and has low mobility.

[0156] In an embodiment of the present application, the terminal device can determine whether the first condition is met during the process of monitoring the AI ​​model. If the first condition is met, it means that the terminal device is in a stable beam transceiver state, and then the terminal device can apply to the network device to enter the target state. After receiving the first indication information sent by the network device, the terminal device can enter the target state to relax the monitoring of the AI ​​model. In this way, the terminal device and the network device can flexibly control the monitoring of the AI ​​model according to the beam transceiver environment, thereby optimizing the resource utilization of the terminal device to a certain extent.

[0157] In the above Figure 2 In some embodiments, the terminal device may exit the target state according to the second condition. In other embodiments, if the terminal device wants to exit the target state, it needs to obtain an instruction from the network device. Figure 4 This will be described in detail in the embodiment.

[0158] Figure 4 This is a flow chart of a model monitoring and management method provided by an embodiment of the present application. Figure 4 , the method may include the following steps: Step 401: When the terminal device is in the target state, it determines whether the second condition is met.

[0159] It should be noted that the terminal device can Figure 2 In the embodiment, the target state is entered by steps 201 to 203; or, the terminal device can enter the target state by the above steps. Figure 3 In the embodiment, the target state is entered through steps 301 to 305 .

[0160] The operation of step 401 is similar to that of the above-mentioned step 204 and will not be described in detail in this embodiment of the present application.

[0161] Step 402: When the second condition is met, the terminal device sends a resumption monitoring application message to the network device.

[0162] The restoration monitoring application information is used to indicate that the second condition has been met in the target state and to apply to resume monitoring of the AI ​​model. That is, the restoration monitoring application information is used to apply to exit the target state. Optionally, the restoration monitoring application information may carry the identifier of the AI ​​model. Of course, this is not limited to this, and the restoration monitoring application information may also carry other information related to the AI ​​model, which is not limited in this embodiment of the present application.

[0163] For example, the terminal device can send the resumption of monitoring application information to the network device in a MAC CE message or UCI. Of course, the terminal device can also send the resumption of monitoring application information to the network device in other messages.

[0164] Step 403: After receiving the resumption of monitoring application information, the network device sends fourth indication information to the terminal device.

[0165] After receiving the resumption of monitoring application information, the network device can choose to activate the original model monitoring configuration, or can choose to use a new model monitoring configuration.

[0166] In this case, the fourth indication information is used to instruct to continue model monitoring using the original model monitoring configuration, that is, to reactivate the original model monitoring configuration. Alternatively, the fourth indication information is used to instruct to perform model monitoring using a new model monitoring configuration, that is, to activate a new model monitoring configuration.

[0167] For example, the network device can send the fourth indication information to the terminal device through a PDCCH.

[0168] Step 404: After receiving the fourth indication information, the terminal device exits the target state.

[0169] In some embodiments, the terminal device does not perform model monitoring in the target state, and the target state is automatically exited after a preset time length. In this case, if the second condition is not detected at all within the preset time length, the terminal device can automatically exit the target state after the preset time length of entering the target state, at which time the normal model monitoring can be resumed without applying to the network device. If the second condition is detected within the preset time length, the terminal device can apply to the network device to exit the target state to resume the normal model monitoring.

[0170] In other embodiments, the terminal device performs low-frequency model monitoring in the target state. In this case, if the second condition is not detected at all while the terminal device is in the target state, the terminal device can remain in the target state and perform low-frequency model monitoring. If the second condition is detected while the terminal device is in the target state, the terminal device can apply to the network device to exit the target state to resume the normal-frequency model monitoring.

[0171] In some cases, in step 402, the terminal device can first maintain the target state or can first perform normal model monitoring using the original model monitoring configuration before sending the resumption of monitoring application information to the network device and before receiving a reply from the network device.

[0172] In an embodiment of the present application, the terminal device determines whether the second condition is satisfied when it is in the target state. If the second condition is satisfied, it can apply to the network device to exit the target state. After receiving the fourth indication information sent by the network device, the terminal device can exit the target state to resume normal model monitoring. In this way, when the terminal device is in the target state, it can exit the target state in a timely manner when a sudden abnormality occurs in the beam transceiver environment, thereby ensuring the performance of the AI ​​model to a certain extent.

[0173] It should be noted that the parameters involved in the model monitoring relaxation mechanism provided in the embodiment of the present application include the above-mentioned first condition, preset duration, first duration, and second duration. These parameters can be configured by the network device when the terminal device initially accesses the cell, or can also be configured by the network device during the communication process between the terminal device and the network device, and the embodiment of the present application does not limit this.

[0174] Optionally, the network device may carry one or more of the first condition, preset duration, first duration, and second duration in the same message and send it to the terminal device, or may carry one or more of the first condition, preset duration, first duration, and second duration in different messages and send them to the terminal device.

[0175] For example, the network device may carry one or more of the first condition, preset duration, first duration, and second duration in the model reasoning configuration information or the model monitoring configuration information and send it to the terminal device, or may carry one or more of the first condition, preset duration, first duration, and second duration and the model reasoning configuration information or the model monitoring configuration information in the same message and send it to the terminal device. Of course, one or more of the first condition, preset duration, first duration, and second duration may also be carried in other messages and sent to the terminal device, and this is not limited to the embodiments of the present application.

[0176] Of course, not limited to this, the terminal device can also obtain one or more of the first condition, preset duration, first duration, and second duration in other ways, such as pre-configuration in the terminal device, or agreement through a standard protocol, etc. The embodiments of the present application are not limited to this.

[0177] In some embodiments, the network device may determine whether to enable the model monitoring relaxation mechanism, that is, whether to send the model monitoring relaxation mechanism parameters to the terminal device, based on the cell beam environment and / or the cell geographical environment.

[0178] The cell beam environment is used to reflect the communication performance of the beam direction currently used by the terminal device.

[0179] The cell geographical environment is used to reflect the geographical situation of the beam direction currently used by the terminal device. For example, the cell geographical environment is used to reflect whether the geographical area corresponding to the beam direction is a densely built-up area, a park, or an area near a train.

[0180] For example, if the cell beam environment reflects that the recent beam switching frequency of other terminal devices in the beam direction is very high, the model monitoring relaxation mechanism is temporarily not enabled. If the cell beam environment reflects that the recent beam switching frequency of other terminal devices in the beam direction is very low, the model monitoring relaxation mechanism is enabled. If the cell geographical environment reflects that the geographical area corresponding to the beam direction is a densely built-up area or an area near a train, the model monitoring relaxation mechanism is temporarily not enabled. If the cell geographical environment reflects that the geographical area corresponding to the beam direction is a park, the model monitoring relaxation mechanism is enabled.

[0181] In some embodiments, when the parameters of the AI ​​model are modified, the AI ​​model is rolled back, or the AI ​​model is replaced, the network device can turn off the model monitoring relaxation mechanism, that is, it can instruct the terminal device to delete the corresponding model monitoring relaxation mechanism parameters and no longer perform the above-mentioned judgment on the first condition and the second condition. Alternatively, when the parameters of the AI ​​model are modified, the AI ​​model is rolled back, or the AI ​​model is replaced, the network device can reconfigure the model monitoring relaxation mechanism, that is, it can reset the model monitoring relaxation mechanism parameters and send them to the terminal device, and the terminal device can perform the above-mentioned judgment on the first condition and the second condition based on the new model monitoring relaxation mechanism parameters.

[0182] It should be noted that Formulas 1, 3, and 4 involved in the embodiments of this application are part of the 3GPP standard protocol and belong to the field of traditional radio resource management (RRM). The embodiments of this application utilize these existing formulas and introduce the new Formula 2 to implement the model monitoring relaxation mechanism provided in the embodiments of this application. In this way, flexible control of AI model monitoring in beam management is achieved with minimal standard impact and high reliability.

[0183] The following describes a possible implementation of the embodiment of the present application by taking the configuration of the model monitoring relaxation mechanism parameters in the initial configuration when the terminal device is initially connected as an example: Figure 5 This is a flow chart of a model monitoring and management method provided by an embodiment of the present application. Figure 5 , the method may include the following steps: Step 501: After a terminal device is connected, the network device determines whether to enable a model monitoring relaxation mechanism for the terminal device.

[0184] After the terminal device is connected, the network device can perform initial configuration of the AI ​​model in the terminal device. During the initial configuration, it can determine whether to enable the model monitoring relaxation mechanism for the terminal device.

[0185] If the network device determines that the model monitoring relaxation mechanism is not enabled for the terminal device, the model monitoring relaxation mechanism parameters are not sent to the terminal device. In this case, the terminal device activates the model reasoning configuration and the model monitoring configuration normally and performs normal model reasoning and model monitoring.

[0186] Step 502: If the network device determines to enable the model monitoring relaxation mechanism for the terminal device, the network device sends model monitoring relaxation mechanism parameters to the terminal device.

[0187] For example, the network device may send the model monitoring relaxation mechanism parameters to the terminal device via the PDCCH.

[0188] Step 503: The terminal device activates the model reasoning configuration, activates the model monitoring configuration, and determines whether the first condition is met.

[0189] The terminal device can activate the corresponding AI model configuration after initial access. For example, activate the model reasoning configuration to perform relevant reasoning through the AI ​​model, and send a model reasoning report to the network device. Activate the model monitoring configuration to monitor the AI ​​model and send a model monitoring report to the network device. In an embodiment of the present application, a model monitoring relaxation mechanism can also be executed, that is, it can be determined whether the first condition is met during the model monitoring process to determine whether it is necessary to relax the monitoring of the AI ​​model.

[0190] Step 504: If the terminal device determines that the first condition is met, it sends a monitoring relaxation application message to the network device.

[0191] Step 505: The network device sends the first indication information, the second indication information or the third indication information to the terminal device.

[0192] Step 506: If the terminal device receives the first indication information, it enters the target state, and when in the target state, determines whether the second condition is met, and exits the target state if the second condition is met.

[0193] Step 507: If the terminal device receives the second indication information, it does not enter the target state, and continues to determine whether the first condition is met.

[0194] Step 508: If the terminal device receives the third indication information, it does not enter the target state, and no longer determines whether the first condition is met within the second time period, and determines whether the first condition is met after the second time period.

[0195] It should be understood that Figures 2 to 5 The flowcharts or scenario diagrams shown are only for ease of understanding and are not intended to limit the embodiments of the present application to the examples shown in the diagrams. In fact, those skilled in the art will Figures 2 to 5 The examples in can be equivalently transformed to obtain more implementation methods.

[0196] Combined with the above Figures 2 to 5 , describes in detail the model monitoring management method provided by the embodiment of this application. Figures 6 and 7 It should be understood that the communication device of the present invention can execute the various model monitoring and management methods of the aforementioned embodiments of the present invention, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

[0197] In each of the above embodiments, the network device may perform some or all of the steps in each embodiment; the terminal device may perform some or all of the steps in each embodiment. These steps or operations are merely examples, and the embodiments of the present application may also perform other operations or variations of various operations. In addition, the various steps may be performed in a different order as presented in the embodiments, and it is possible that not all operations in the embodiments of the present application need to be performed. The size of the sequence number of each step does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0198] Figure 6 This is a schematic block diagram of a communication device provided in an embodiment of the present application. Figure 6 As shown, communication device 600 may include a communication module 620. Communication module 620 can implement corresponding communication functions, which may be internal communication functions of communication device 600 or communication functions between communication device 600 and other devices. Optionally, communication module 620 may also be referred to as a communication interface or a transceiver module. Optionally, communication device 600 also includes a processing module 610. Processing module 610 can implement corresponding processing functions.

[0199] Optionally, the communication device 600 further includes a storage module, which can be used to store instructions and / or data; the processing module 610 can read the instructions and / or data in the storage module to enable the communication device 600 to implement the aforementioned method embodiment.

[0200] In one possible design, the communication device 600 may correspond to the terminal device in the above method embodiments, or a component configured in the terminal device (such as a circuit, chip, or chip system). The communication device 600 can be used to execute the steps or processes performed by the terminal device in any of the above method embodiments.

[0201] The processing module 610 is configured to monitor an AI model, the AI model being used for beam management, and enter a target state when a first condition is met, the first condition including that the terminal device is in a low mobility state and a high beam quality state, and the target state being a state in which model monitoring is not performed for a preset time length or a state in which model monitoring frequency is reduced.

[0202] The processing module 610 is configured to determine that the terminal device is in the low mobility state when a difference between a reference received signal strength and a received signal strength of a serving cell is less than a first threshold value, and determine that the terminal device is not in the low mobility state when the difference between the reference received signal strength and the received signal strength of the serving cell is greater than or equal to the first threshold value.

[0203] The processing module 610 is configured to determine that the terminal device is in the high beam quality state when a signal quality of a beam currently used by the terminal device is greater than a second threshold value, and determine that the terminal device is not in the high beam quality state when the signal quality of the beam currently used by the terminal device is less than or equal to the second threshold value.

[0204] The signal quality of the beam is L1-RSRP of the beam.

[0205] The first condition further includes that the terminal device is not located at an edge area of the serving cell.

[0206] The processing module 610 is configured to determine that the terminal device is not located at the edge area of the serving cell if a received signal strength of the serving cell is greater than a third threshold value and / or if a received signal quality of the serving cell is greater than a fourth threshold value, and determine that the terminal device is located at the edge area of the serving cell otherwise.

[0207] The communication module 620 is configured to send, to a network device, relaxation monitoring application information when the first condition is met. The processing module 610 is configured to enter the target state when first indication information sent by the network device is received.

[0208] The processing module 610 is configured to not enter the target state and continue to determine whether the first condition is met when second indication information sent by the network device is received, or not enter the target state and not determine whether the first condition is met for a second time length when third indication information sent by the network device is received.

[0209] The processing module 610 is configured to determine whether a second condition is met when in the target state, the second condition including that the terminal device is not in the high beam quality state, and exit the target state when the second condition is met.

[0210] The above is only an example, and for detailed steps or processes, please refer to the description of the aforementioned embodiments.

[0211] Figure 7 7 is a schematic block diagram of a communication device 700 provided in an embodiment of the present application. Communication device 700 may be a network device or terminal device, or a circuit, chip, chip system, or processor for implementing the above method. Communication device 700 may be used to implement the method described in the above method embodiment. For details, please refer to the description of the above method embodiment.

[0212] like Figure 7 As shown, communication device 700 may include one or more processors 710, which may also be referred to as processing units or processing modules, and may implement certain control functions. Processor 710 may be a general-purpose processor or a dedicated processor, such as a baseband processor or a central processing unit. The baseband processor may be used to process communication protocols and communication data, while the central processing unit may be used to control communication device 700 (e.g., base station, baseband chip, user equipment, user chip), execute software programs, and process data in the software programs.

[0213] In an optional design, the processor 710 may also store instructions and / or data, which can be executed by the processor 710 to enable the communication device 700 to perform the method described in the above method embodiment.

[0214] In another optional design, the communication device 700 may include a communication interface 720 for implementing receiving and transmitting functions. For example, the communication interface 720 may be a transceiver circuit, an interface, an interface circuit, or a transceiver. The transceiver circuit, interface, interface circuit, or transceiver for implementing the receiving and transmitting functions may be separate or integrated. The transceiver circuit, interface, interface circuit, or transceiver may be used for reading and writing code / data, or the transceiver circuit, interface, interface circuit, or transceiver may be used for transmitting or delivering signals.

[0215] Optionally, the communication device 700 may include one or more memories 730, which may store instructions that can be executed on the processor 710, causing the communication device 700 to perform the methods described in the above method embodiments. Optionally, the memories 730 may also store data. Optionally, the processor 710 may also store instructions and / or data. The processor 710 and the memories 730 may be provided separately or integrated together.

[0216] It should be understood that, in a possible design, each step in the method embodiments provided in the present application can be completed by integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as execution completed by a hardware processor, or execution completed by a combination of hardware and software modules in the processor. The software modules can be located in storage media which are mature in the art, such as random storage, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, register, etc. The storage media are located in the storage, and the processor reads information in the storage, and combines the hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.

[0217] In an implementation, the communication apparatus 700 can correspond to the network device in the above method embodiments, and can be used to execute each step and / or process executed by the network device in the above method embodiments. The processor 710 can be used to execute the instructions stored in the memory 730, and when the processor 710 executes the instructions stored in the memory, the processor 710 is used to execute each step and / or process of the above method embodiments corresponding to the network device.

[0218] In another implementation, the communication apparatus 700 can correspond to the terminal device in the above method embodiments, and can be used to execute each step and / or process executed by the terminal device in the above method embodiments. The processor 710 can be used to execute the instructions stored in the memory 730, and when the processor 710 executes the instructions stored in the memory, the processor 710 is used to execute each step and / or process of the above method embodiments corresponding to the terminal device.

[0219] It should be understood that the above processing apparatus can be one or more chips. For example, the processing apparatus can be a field programmable gate array (FPGA), can be an application specific integrated circuit (ASIC), can also be a system on chip (SoC), can also be a central processor unit (CPU), can also be a network processor (NP), can also be a digital signal processor (DSP), can also be a micro controller unit (MCU), can also be a programmable logic device (PLD) or other integrated chip.

[0220] It is understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0221] Based on the methods provided in the embodiments of the present application, the present application also provides a chip system, which includes one or more processors configured to retrieve and execute instructions stored in a memory, thereby executing the methods of the embodiments of the present application. The chip system can be composed of a chip or can include a chip and other discrete devices.

[0222] Among them, the chip system may include an input circuit or interface for sending information or data, and an output circuit or interface for receiving information or data.

[0223] According to the method provided in the embodiment of the present application, the present application also provides a communication system, which includes the aforementioned network device and terminal device.

[0224] According to the method provided in the embodiments of the present application, the present application also provides a computer program product, which includes: computer program code, which, when running on a computer, enables the computer to execute the various steps or processes executed by the network device and terminal device in any of the aforementioned method embodiments.

[0225] According to the method provided in the embodiments of the present application, the present application also provides a computer-readable storage medium, which stores program code. When the program code runs on a computer, the computer executes the various steps or processes performed by the network device and terminal device in any of the aforementioned method embodiments.

[0226] The computer-readable storage medium may be the aforementioned volatile memory or non-volatile memory, or may include both volatile memory and non-volatile memory.

[0227] In the embodiments of this application, each term and English abbreviation is provided for convenience of description and shall not constitute any limitation to this application. This application does not exclude the possibility of defining other terms that can achieve the same or similar functions in existing or future agreements.

[0228] In the above embodiments, all or part of the embodiments may be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part.

[0229] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0230] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0231] In short, the above description is only an optional embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included in the scope of protection of this application.

Claims

1. A model monitoring and management method, characterized in that: Applied to a terminal device, the method includes: Monitoring of artificial intelligence (AI) models used for beam management; When the first condition is met, the target state is entered, and the first condition includes that the terminal device is in a low mobility state and a high beam quality state, and no model monitoring is performed within a preset time period in the target state, or the frequency of model monitoring is reduced in the target state.

2. The method according to claim 1, wherein The method further comprises: When a difference between the reference received signal strength and the serving cell received signal strength is less than a first threshold, determining that the terminal device is in a low mobility state; When a difference obtained by subtracting the received signal strength of the serving cell from the reference received signal strength is greater than or equal to a first threshold, it is determined that the terminal device is not in a low mobility state.

3. The method according to claim 1, wherein The method further comprises: When the signal quality of the beam currently used by the terminal device is greater than a second threshold, determining that the terminal device is in a high beam quality state; When the signal quality of the beam currently used by the terminal device is less than or equal to a second threshold, it is determined that the terminal device is not in a high beam quality state.

4. The method according to claim 3, wherein The signal quality of the beam is the layer 1 reference signal received power L1-RSRP of the beam.

5. The method according to claim 1, wherein The first condition also includes that the terminal device is not located in an edge area of ​​a serving cell.

6. The method according to claim 5, wherein The method further comprises: If the received signal strength of the service cell is greater than the third threshold, and / or if the received signal quality of the service cell is greater than the fourth threshold, it is determined that the terminal device is not located in the edge area of ​​the service cell; otherwise, it is determined that the terminal device is located in the edge area of ​​the service cell.

7. The method according to claim 1, wherein Entering the target state when the first condition is met includes: When the first condition is met, sending a monitoring relaxation request message to the network device; Entering the target state when first indication information sent by the network device is received.

8. The method according to claim 7, wherein After sending the monitoring relaxation request information to the network device, the method further includes: In the case of receiving the second indication information sent by the network device, not entering the target state, and continuing to determine whether the first condition is met; or When the third indication information sent by the network device is received, the target state is not entered, and whether the first condition is met is not determined within a second time period.

9. The method according to any one of claims 1 to 8, characterized in that: After entering the target state, the method further includes: When in the target state, determining whether a second condition is satisfied, the second condition including that the terminal device is not in a high beam quality state; The target state is exited when the second condition is satisfied.

10. A communication device, characterized in that: The communication device includes at least one processor coupled to a memory, wherein the memory stores a program or instruction. The processor executes the program or instruction so that the communication device is configured to perform the method according to any one of claims 1 to 9.

11. A communication system, characterized in that: The communication system includes the communication device according to claim 10.

12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program or instructions, which, when executed, causes a computer to perform the method according to any one of claims 1 to 9.

13. A chip system, characterized in that: The chip system includes one or more processors, and the one or more processors are used to call and execute instructions stored in the memory from the memory, so that the method according to any one of claims 1 to 9 is executed.

Images