Model test method, devices, and storage medium

By proposing a model testing method in the communication system, using the information exchange between terminal equipment and network equipment, we determine whether the prediction data of the prediction model meets the performance requirements, and solve the problem of difficulty in determining the reliability of the prediction data, and realize the online verification of the model and tests, improving the flexibility and reliability of model management.

WO2025000237A1PCT designated stage expired Publication Date: 2025-01-02BEIJING XIAOMI MOBILE SOFTWARE CO LTD

Patent Information

Application Number
PCT/CN2023/102924
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-27
Publication Date
2025-01-02

AI Technical Summary

Technical Problem

In communication systems, it is difficult for the prior art to effectively determine the predictive data reliability of the prediction model, which affects network performance.

Method used

A model testing method is proposed, by determining whether the predicted data output by the model meets the performance requirements, and using information exchange between terminal equipment and network equipment to conduct online verification and testing of the model to ensure the reliability and flexibility of the model.

Benefits of technology

The online verification and testing of the model is realized, which improves the flexibility and reliability of model management and ensures the reliable use of the model in different scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023102924_02012025_PF_FP_ABST
    Figure CN2023102924_02012025_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure relates to a model test method, devices, and a storage medium. The method comprises: determining whether predicted data output by a first model meets a first condition, wherein the first condition is a performance requirement for the predicted data, the predicted data is data obtained by means of the first model performing prediction according to first measured data, the first measured data is data obtained after a terminal device performs measurement on first information, and the first information is information sent by a network device to the terminal device. Thus, a first model can be tested or verified to determine whether the first model meets a first condition, thereby determining the performance and reliability of the model, achieving online verification and testing of the model, and improving the flexibility and reliability of model management.
Need to check novelty before this filing date? Find Prior Art

Description

Model testing method, equipment and storage medium Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to a model testing method, device, and storage medium. Background Art

[0002] With advances in communications technology, predictive models, such as artificial intelligence (AI) models, machine learning (ML) models, and other models, have been introduced into communication systems. These predictive models can generate forecast data for certain scenarios, thereby improving network performance. However, the reliability of this forecast data can significantly impact network performance. Therefore, determining the reliability of the forecast data from these models remains a pressing issue.

[0003] Summary of the Invention

[0004] The embodiments of the present disclosure provide a model testing method, device, and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a model testing method is proposed, the method comprising:

[0006] Determine whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement of the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

[0007] According to a second aspect of an embodiment of the present disclosure, a model testing method is proposed, the method comprising:

[0008] Using a first model, performing prediction based on first information to obtain the predicted data; wherein the first information is information sent by the network device to the terminal device;

[0009] Sending second information, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data.

[0010] According to a third aspect of the embodiments of the present disclosure, a model testing method is proposed, the method comprising:

[0011] The terminal device uses the first model to make a prediction based on the first information to obtain the predicted data; wherein the first information is information sent by the network device to the terminal device;

[0012] The terminal device sends second information to the network device, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data;

[0013] The network device determines whether the predicted data output by the first model meets the first condition; wherein, the predicted data is data obtained by the first model based on the first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

[0014] According to a fourth aspect of an embodiment of the present disclosure, a network device is provided, including:

[0015] The processing module is configured to determine whether the predicted data output by the first model meets a first condition; wherein the first condition is the performance requirement of the predicted data, the predicted data is the data predicted by the first model based on the first measurement data, the first measurement data is the data obtained after the terminal device measures the first information, and the first information is the information sent by the network device to the terminal device.

[0016] According to a fifth aspect of an embodiment of the present disclosure, a terminal device is provided, including:

[0017] a processing module configured to use a first model to make a prediction based on first information to obtain the prediction data; wherein the first information is information sent by the network device to the terminal device;

[0018] The transceiver module is configured to send second information, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data.

[0019] According to a sixth aspect of an embodiment of the present disclosure, a network device is proposed, comprising: one or more processors; wherein the network device can be used to execute an optional implementation of the first aspect.

[0020] According to a seventh aspect of an embodiment of the present disclosure, a terminal device is proposed, comprising: one or more processors; wherein the terminal device can be used to execute the optional implementation of the second aspect.

[0021] According to the eighth aspect of an embodiment of the present disclosure, a communication system is proposed, which may include: a network device and a terminal device; wherein, the network device is configured to execute the method described in the optional implementation manner of the first aspect, and the terminal device is configured to execute the method described in the optional implementation manner of the second aspect.

[0022] According to a ninth aspect of an embodiment of the present disclosure, a storage medium is proposed, which stores instructions. When the instructions are executed on a communication device, the communication device executes the method described in the optional implementation of the first aspect or the second aspect.

[0023] The technical solution provided by the embodiments of the present disclosure can include the following beneficial effects: determining whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement for the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after a terminal device measures first information, and the first information is information sent by a network device to the terminal device. In this way, the first model can be tested or verified to determine whether it meets the first condition, thereby determining the performance and reliability of the model, enabling online verification and testing of the model, and improving the flexibility and reliability of model management.

[0024] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following drawings required for describing the embodiments are introduced. The following drawings are merely some embodiments of the present disclosure and do not impose specific limitations on the protection scope of the present disclosure.

[0026] FIG1A is a schematic diagram showing the architecture of a communication system according to an embodiment of the present disclosure.

[0027] FIG1B is a schematic diagram showing a beam prediction scenario according to an embodiment of the present disclosure.

[0028] FIG2A is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0029] FIG2B is a flow chart of a model testing method according to an embodiment of the present disclosure.

[0030] FIG3A is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0031] FIG3B is a flow chart of a model testing method according to an embodiment of the present disclosure.

[0032] FIG3C is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0033] FIG3D is a flow chart of a model testing method according to an embodiment of the present disclosure.

[0034] FIG4A is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0035] FIG4B is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0036] FIG4C is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0037] FIG4D is a flow chart illustrating a model testing method according to an embodiment of the present disclosure.

[0038] FIG5 is a flow chart of a model testing method according to an embodiment of the present disclosure.

[0039] FIG6 is a flow chart showing a model testing method according to an embodiment of the present disclosure.

[0040] FIG7A is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure.

[0041] FIG7B is a schematic structural diagram of a network device according to an embodiment of the present disclosure.

[0042] FIG8A is a schematic structural diagram of a communication device according to an embodiment of the present disclosure.

[0043] FIG8B is a schematic structural diagram of a chip according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0044] The embodiments of the present disclosure provide a model testing method, device, and storage medium.

[0045] In a first aspect, an embodiment of the present disclosure provides a model testing method, the method comprising:

[0046] Determine whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement of the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

[0047] In the above embodiment, the first model can be tested or verified to determine whether the first model meets the first condition, thereby determining the performance and reliability of the model, realizing online verification and testing of the model, and improving the flexibility and reliability of model management.

[0048] In conjunction with some embodiments of the first aspect, in some embodiments, the method further includes:

[0049] Receive second information sent by the terminal device, where the second information includes the prediction data.

[0050] In the above embodiment, the first model can be tested or verified according to the prediction data or the first measurement data, so as to adapt to the model testing requirements in different scenarios.

[0051] In conjunction with some embodiments of the first aspect, in some embodiments, the method further includes:

[0052] Sending third information to the terminal device; the third information is used to indicate whether the first model can be used by the terminal device.

[0053] In the above embodiment, when the first model satisfies the first condition, the terminal device may be instructed to determine that the first model can be used, thereby ensuring the reliability of the model added or updated by the terminal device.

[0054] In conjunction with some embodiments of the first aspect, in some embodiments, the method further includes:

[0055] receiving fourth information; wherein the fourth information is used to trigger the network device to send the first information, and the fourth information includes a first model identifier of the first model;

[0056] Determine, based on the fourth information, that the first model meets the test start condition, and send the first information to the terminal device.

[0057] In the above embodiment, the terminal device can actively trigger the model test, thereby improving the flexibility of the model test.

[0058] In conjunction with some embodiments of the first aspect, in some embodiments, the test initiation condition includes at least one of the following:

[0059] The first model has not been tested;

[0060] The first model is not in the model management set; the model management set includes models that have been tested;

[0061] The fourth information is used to instruct execution of the test of the first model.

[0062] In the above embodiment, starting the model test when the test starting conditions are met can avoid invalid testing and improve test reliability.

[0063] In conjunction with some embodiments of the first aspect, in some embodiments, the fourth information includes at least one of the following:

[0064] Model update instruction information;

[0065] Add instruction information to the model;

[0066] Model testing instructions.

[0067] In the above embodiment, the model test may be triggered by at least one of the model update indication information, the model addition indication information, and the model test indication information.

[0068] In conjunction with some embodiments of the first aspect, in some embodiments, the first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device;

[0069] The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

[0070] In the above embodiment, the model performing beam prediction can be tested according to the difference in signal quality to improve the reliability of the model in the beam prediction scenario.

[0071] In conjunction with some embodiments of the first aspect, in some embodiments, the first model is a model for performing beam prediction, and the prediction data includes a second beam obtained by the beam prediction that satisfies a signal condition;

[0072] The signal condition includes at least one of the following:

[0073] The signal quality of the second beam is greater than or equal to a preset signal quality threshold;

[0074] The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

[0075] In the above embodiment, the model that performs beam prediction can be tested based on the accuracy of the predicted beam to improve the reliability of the model in the beam prediction scenario.

[0076] In conjunction with some embodiments of the first aspect, in some embodiments, the first condition is that the number of times a prediction success condition is satisfied in N beam predictions performed is greater than or equal to M; where N is a natural number, and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam obtained by performing beam prediction that satisfies a signal condition;

[0077] The third beam is a beam that meets the signal condition determined by the network device based on the beam configuration information; or, the third beam is a beam that meets the signal condition determined based on second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

[0078] In the above embodiment, the model performing beam prediction can be tested according to the prediction accuracy of multiple predictions to improve the reliability of the model in the beam prediction scenario.

[0079] In combination with some embodiments of the first aspect, in some embodiments, the signal quality includes at least one of the following: RSRP, SINR, RSSI, RSRQ.

[0080] In the above embodiment, the first model may be tested according to at least one of multiple signal qualities to improve the reliability of the model in the beam prediction scenario.

[0081] In conjunction with some embodiments of the first aspect, in some embodiments, the first information includes at least one of the following:

[0082] first data for testing the first model;

[0083] A first signal is used to test the first model.

[0084] In the above embodiments, the model can be tested through the first data and / or the first signal, thereby increasing the application scenarios of the model test.

[0085] In a second aspect, an embodiment of the present disclosure provides a model testing method, the method comprising:

[0086] Using a first model, performing prediction based on first information to obtain the predicted data; wherein the first information is information sent by the network device to the terminal device;

[0087] Sending second information, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data.

[0088] In the above embodiment, the first model can be tested or verified to determine whether the first model meets the first condition, thereby determining the performance and reliability of the model, realizing online verification and testing of the model, and improving the flexibility and reliability of model management.

[0089] In conjunction with some embodiments of the second aspect, in some embodiments, the method further includes:

[0090] receiving the first information;

[0091] The using the first model to perform prediction based on the first information to obtain the prediction data includes:

[0092] measuring the first information to obtain the first measurement data;

[0093] The first measurement data is input into the first model to obtain the predicted data output by the first model.

[0094] In conjunction with some embodiments of the second aspect, in some embodiments, the method further includes:

[0095] receiving third information; wherein the third information is used to indicate whether the first model can be used by the terminal device;

[0096] It is determined whether the first model can be used according to the third information.

[0097] In conjunction with some embodiments of the second aspect, in some embodiments, the method further includes:

[0098] Sending fourth information; wherein the fourth information is used to trigger the network device to send the first information, and the fourth information includes the first model identifier of the first model;

[0099] In conjunction with some embodiments of the second aspect, in some embodiments, the fourth information includes at least one of the following:

[0100] Model update instruction information;

[0101] Add instruction information to the model;

[0102] Model testing instructions.

[0103] In conjunction with some embodiments of the second aspect, in some embodiments, the first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device;

[0104] The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

[0105] In conjunction with some embodiments of the second aspect, in some embodiments, the first model is a model for performing beam prediction, and the prediction data includes a second beam obtained by the beam prediction that satisfies a signal condition;

[0106] The signal condition includes at least one of the following:

[0107] The signal quality of the second beam is greater than or equal to a preset signal quality threshold;

[0108] The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

[0109] In conjunction with some embodiments of the second aspect, in some embodiments, the first condition is that the number of times the prediction success condition is satisfied in N beam predictions performed is greater than or equal to M; where N is a natural number, and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam obtained by performing beam prediction that satisfies the signal condition;

[0110] The third beam is a beam that meets the signal condition determined by the network device based on the beam configuration information; or, the third beam is a beam that meets the signal condition determined based on second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

[0111] In combination with some embodiments of the second aspect, in some embodiments, the signal quality includes at least one of the following: RSRP, SINR, RSSI, RSRQ.

[0112] In conjunction with some embodiments of the second aspect, in some embodiments, the first information includes at least one of the following:

[0113] first data for testing the first model;

[0114] A first signal is used to test the first model.

[0115] In a third aspect, an embodiment of the present disclosure provides a model testing method, the method comprising:

[0116] The terminal device uses the first model to make a prediction based on the first information to obtain the predicted data; wherein the first information is information sent by the network device to the terminal device;

[0117] The terminal device sends second information to the network device, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data;

[0118] The network device determines whether the predicted data output by the first model meets the first condition; wherein, the predicted data is data obtained by the first model based on the first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

[0119] In the above embodiment, the first model can be tested or verified to determine whether the first model meets the first condition, thereby determining the performance and reliability of the model, realizing online verification and testing of the model, and improving the flexibility and reliability of model management.

[0120] In a fourth aspect, an embodiment of the present disclosure proposes a network device, which may include at least one of a transceiver module and a processing module; wherein the network device can be used to execute the optional implementation method of the first aspect.

[0121] In a fifth aspect, an embodiment of the present disclosure proposes a terminal device, which may include at least one of a transceiver module and a processing module; wherein the terminal device can be used to execute the optional implementation method of the second aspect.

[0122] In a sixth aspect, an embodiment of the present disclosure proposes a network device, which may include: one or more processors; wherein, the network device can be used to execute the optional implementation method of the first aspect.

[0123] In a seventh aspect, an embodiment of the present disclosure proposes a terminal device, which may include: one or more processors; wherein, the terminal device can be used to execute the optional implementation method of the second aspect.

[0124] In an eighth aspect, an embodiment of the present disclosure proposes a communication system, which may include: a terminal device and a network device; wherein the network device is configured to execute the method described in the optional implementation manner of the first aspect, and the terminal device is configured to execute the method described in the optional implementation manner of the second aspect.

[0125] In a ninth aspect, an embodiment of the present disclosure proposes a storage medium storing instructions, which, when executed on a communication device, enables the communication device to execute the method described in the optional implementation of the first or second aspect.

[0126] In a tenth aspect, an embodiment of the present disclosure proposes a program product, which, when executed by a communication device, enables the communication device to execute the method described in the optional implementation manner of the first aspect or the second aspect.

[0127] In an eleventh aspect, an embodiment of the present disclosure proposes a computer program, which, when executed on a computer, enables the computer to execute the method described in the optional implementation of the first or second aspect.

[0128] In a twelfth aspect, an embodiment of the present disclosure provides a chip or a chip system, wherein the chip or chip system includes a processing circuit configured to execute the method described in the optional implementation of the first aspect or the second aspect.

[0129] It is understandable that the above-mentioned terminal devices, network devices, communication devices, communication systems, storage media, program products, computer programs, chips, or chip systems can all be used to perform the methods proposed in the embodiments of the present disclosure. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods and will not be repeated here.

[0130] The present disclosure provides a model testing method, device, and storage medium. In some embodiments, the terms "model testing method" and "information processing method" and "communication method" are interchangeable; "model testing device" and "information processing device" and "communication device" are interchangeable; and "information processing system" and "communication system" are interchangeable.

[0131] The embodiments of the present disclosure are not exhaustive and are merely illustrative of some embodiments, and are not intended to be a specific limitation on the scope of protection of the present disclosure. In the absence of contradiction, each step in a certain embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a certain embodiment can also be implemented as an independent embodiment, and the order of the steps in a certain embodiment can be arbitrarily exchanged. In addition, the optional implementation methods in a certain embodiment can be arbitrarily combined; in addition, the embodiments can be arbitrarily combined. For example, some or all steps of different embodiments can be arbitrarily combined, and a certain embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0132] In each embodiment of the present disclosure, unless otherwise specified or provided for by logic, the terms and / or descriptions between the embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form a new embodiment based on their inherent logical relationships.

[0133] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure.

[0134] In the embodiments of the present disclosure, unless otherwise specified, elements expressed in the singular, such as "a", "an", "the", "above", "said", "the", "the", etc., may mean "one and only one", or "one or more", "at least one", etc. For example, when using articles such as "a", "an", "the" in English in translation, the noun following the article may be understood as a singular expression or a plural expression.

[0135] In the embodiments of the present disclosure, “plurality” refers to two or more.

[0136] In some embodiments, the terms "a plurality of," "multiple," "at least one of," "one or more," and the like can be used interchangeably.

[0137] In some embodiments, descriptions such as "at least one of A and B," "A and / or B," "A in one case, B in another case," or "in response to one case A, in response to another case B" may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed); and in some embodiments, A and B (both A and B are executed). The above is also applicable when there are more branches such as A, B, and C.

[0138] In some embodiments, "A or B" and other descriptions may include the following technical solutions depending on the situation: in some embodiments, A (A is executed independently of B); in some embodiments, B (B is executed independently of A); in some embodiments, execution is selected from A and B (A and B are selectively executed). The above is also applicable when there are more branches such as A, B, C, etc.

[0139] The prefixes such as "first" and "second" in the embodiments of the present disclosure are only used to distinguish different description objects and do not constitute any restriction on the position, order, priority, quantity or content of the description objects. For the statement of the description object, please refer to the description in the context of the claims or embodiments, and no unnecessary restriction should be constituted due to the use of prefixes. For example, if the description object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields". "First" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the description object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of description objects is not limited by the ordinal number and can be one or more. Taking "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the description object is "device", then the "first device" and the "second device" can be the same device or different devices, and their types can be the same or different; for another example, if the description object is "information", then the "first information" and the "second information" can be the same information or different information, and their contents can be the same or different.

[0140] In some embodiments, “including A,” “comprising A,” “used to indicate A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0141] In some embodiments, terms such as "in response to...", "in response to determining...", "in the case of...", "at the time of...", "when...", "if...", "if...", etc. can be used interchangeably.

[0142] In some embodiments, terms such as "greater than", "greater than or equal to", "not less than", "more than", "more than or equal to", "not less than", "higher than", "higher than or equal to", "not less than", and "above" can be replaced with each other, and terms such as "less than", "less than or equal to", "not greater than", "less than", "less than or equal to", "not more than", "lower than", "lower than or equal to", "not higher than", and "below" can be replaced with each other.

[0143] In some embodiments, devices and equipment can be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. In some cases, they can also be understood as "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", "subject", etc.

[0144] In some embodiments, "network" can be interpreted as devices included in the network, such as access network equipment, core network equipment, etc.

[0145] In some embodiments, "Access Network Device (AN Device)" may also be referred to as "Radio Access Network Device (RAN Device)", "Base Station (BS)", "Radio Base Station (Radio Base Station)", "Fixed Station (Fixed Station)", and in some embodiments may also be understood as "Node (Node)", "Access Point (Access Point)", "Transmission Point (TP)", "Reception Point (RP)", "Transmission and / or Reception Point (TRP))", "Panel (Panel)", "Antenna Panel (Antenna Panel)", "Antenna Array (Antenna Array)" "Cell (Cell)", "Macro Cell (Macro Cell)", "Small Cell (Small Cell)", "Femto Cell (Femto Cell)", "Pico Cell (Pico Cell)" "Sector (Sector)" "Cell Group (Cell Group)" "Serving Cell" "Carrier (Carrier)", "Component Carrier (Component Carrier)" "Bandwidth Part (BWP)" and the like.

[0146] In some embodiments, "terminal" or "terminal device" can be referred to as "user equipment (UE)", "user terminal (User Terminal)", "mobile station (MS)", "mobile terminal (MT)", subscriber station (Subscriber Station), mobile unit (Mobile Unit), subscriber unit (Subscriber Unit), wireless unit (Wireless Unit), remote unit (Remote Unit), mobile device (Mobile Device), wireless device (Wireless Device), wireless communication device (Wireless Communication Device), remote device (Remote Device), mobile subscriber station (Mobile Subscriber Station), access terminal (Access Terminal), mobile terminal (Mobile Terminal), wireless terminal (Wireless Terminal), remote terminal (Remote Terminal), handset (Handset), user agent (User Agent), mobile client (Mobile Client), client (Client), etc.

[0147] In some embodiments, obtaining data, information, etc. may comply with the laws and regulations of the country where the data is obtained.

[0148] In some embodiments, data, information, etc. may be obtained with the user's consent.

[0149] In addition, each element, each row, or each column in the table of the embodiment of the present disclosure can be implemented as an independent embodiment, and the combination of any elements, any rows, and any columns can also be implemented as an independent embodiment.

[0150] FIG1A is a schematic diagram illustrating an architecture of a communication system according to an embodiment of the present disclosure. As shown in FIG1A , the communication system 100 may include a terminal device 101 and a network device 102 .

[0151] In some embodiments, the terminal device 101 may include at least one of a mobile phone, a wearable device, an Internet of Things device, a car with communication capabilities, a smart car, a tablet computer, a computer with wireless transceiver capabilities, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in a smart grid, a wireless terminal device in transportation safety, a wireless terminal device in a smart city, and a wireless terminal device in a smart home, but is not limited thereto.

[0152] In some embodiments, the network device 102 may include at least one of an access network device and a core network device.

[0153] In some embodiments, the access network device may be a node or device that accesses the terminal to the wireless network. The access network device may include an evolved NodeB (eNB), a next generation evolved NodeB (ng-eNB), a next generation NodeB (gNB), a node B (NB), a home node B (HNB), a home evolved nodeB (HeNB), a wireless backhaul device, a radio network controller (RNC), a base station controller (BSC), a base transceiver station (BTS), a base band unit (BBU), a mobile switching center, a base station in a 6G communication system, an open base station (Open RAN), a cloud base station (Cloud RAN), a base station in other communication systems, and at least one of an access node in a Wi-Fi system, but is not limited thereto.

[0154] In some embodiments, the technical solution of the present disclosure can be applied to the Open RAN architecture. In this case, the interfaces between or within the access network devices involved in the embodiments of the present disclosure can be transformed into internal interfaces of the Open RAN, and the processes and information interactions between these internal interfaces can be implemented through software or programs.

[0155] In some embodiments, the access network device can be composed of a centralized unit (CU) and a distributed unit (DU), where the CU can also be called a control unit. The CU-DU structure can be used to split the protocol layer of the access network device, with the functions of some protocol layers centrally controlled by the CU, and the functions of the remaining part or all of the protocol layers distributed in the DU, which is centrally controlled by the CU, but is not limited to this.

[0156] In some embodiments, the core network device may be a single device, or may be multiple devices or a group of devices. The core network may include at least one of an Evolved Packet Core (EPC), a 5G Core Network (5GCN), and a Next Generation Core (NGC).

[0157] It can be understood that the communication system described in the embodiment of the present disclosure is for the purpose of more clearly illustrating the technical solution of the embodiment of the present disclosure, and does not constitute a limitation on the technical solution proposed in the embodiment of the present disclosure. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution proposed in the embodiment of the present disclosure is also applicable to similar technical problems.

[0158] The following embodiments of the present disclosure may be applied to the communication system 100 shown in FIG1A , or a portion thereof, but are not limited thereto. The entities shown in FIG1A are examples. The communication system may include all or part of the entities shown in FIG1A , or may include other entities outside of FIG1A . The number and form of the entities are arbitrary. The entities may be physical or virtual. The connection relationship between the entities is an example. The entities may be connected or disconnected. The connection may be in any manner, whether direct or indirect, and may be wired or wireless.

[0159] The embodiments of the present disclosure can be applied to Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), future radio access (FRA), new radio access technology (RAT), new radio (NR), new radio access (NX), future generation radio access (FX), Global System for Mobile communications (GSM (registered trademark)), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, Ultra-WideBand (UWB), Bluetooth (registered trademark), Public Land Mobile Network (PLMN) networks, Device-to-Device (D2D) systems, Machine-to-Machine (M2M) systems, Internet of Things (IoT) systems, Vehicle-to-Everything (V2X), systems utilizing other communication methods, and next-generation systems based on and extending these methods. Furthermore, multiple systems may be combined (for example, a combination of LTE or LTE-A with 5G).

[0160] In some embodiments of the present disclosure, the communication system may introduce a first model, which may be an AI model, an ML model, an AI / ML model, or other models for prediction. The first model may be one or more models.

[0161] In the communication system, the first model prediction can be used to simplify the process of certain typical scenarios and improve performance. For example, the typical scenarios may include CSI (Channel State Information) feedback scenarios, beam management scenarios, positioning scenarios, or other application scenarios.

[0162] In the CSI feedback scenario, the terminal device can obtain an accurate and effective CSI feedback value based on the first model prediction, so that the network device can select a suitable MCS (Modulation and Coding Scheme) for the transmission of downlink data according to the feedback CSI value, thereby reducing the BLER (Block Error Rate) of downlink data transmission. In the beam management scenario, the terminal device can predict the best beam / beam group based on the first model, such as the TOP1 strongest beam / beam group, so that the network device can select the best beam for subsequent transmission. In the positioning scenario, the terminal device can predict the positioning information based on the first model, thereby improving the positioning accuracy. The positioning information may include at least one of the following information: Reference Signal Time Difference (RSTD), Positioning Reference Signal-Reference Signal Receiving Power (PRS-RSRP), positioning accuracy, Line of Sight (LOS) indication, Non-Line of Sight (NLOS) indication, etc.

[0163] Figure 1B is a schematic diagram of a beam prediction scenario according to an embodiment of the present disclosure. As shown in Figure 1B, a terminal device can measure some beams to obtain first measurement data, which may include the measured channel quality of some beams. The first measurement data is input into a first model to obtain prediction data output by the first model. For example, the first model can perform inference to predict the channel quality of beams other than the measured beams. The prediction data may include at least one of the following information: the channel quality of some or all beams, the optimal beam, and the channel quality of the optimal beam.

[0164] The network device may determine, based on the first measurement data and / or prediction data, a beam with the best channel quality from all beams for communication.

[0165] In some embodiments, the first model may be deployed on a terminal device, the portion of the beam measured by the terminal device may be referred to as first information, and the predicted data obtained by the terminal device based on the first model may be referred to as second information. The terminal device may report the predicted data to a network device.

[0166] In some embodiments, the first model may be deployed on a network device, the partial beam measured by the terminal device may be referred to as first information, and the first measurement data obtained by the terminal device may be referred to as second information. The terminal device may report the first measurement data to the network device, and the network device may input the first measurement data into the first model to obtain predicted data.

[0167] In related technologies, if a terminal device updates a first model or adds a new model that is not in the model management monitoring list, the performance and reliability of the model's prediction results have not been tested, and the terminal device may not be able to directly use the model for prediction. Therefore, online model verification and testing is an urgent problem to be solved.

[0168] FIG2A is a flow chart of a model testing method according to an embodiment of the present disclosure. The method may be executed by the above-mentioned communication system. As shown in FIG2A , the method may include:

[0169] Step S2101: The terminal device sends fourth information to the network device.

[0170] In some embodiments, the network device may receive the fourth information. For example, the network device may receive the fourth information sent by the terminal device. For another example, the network device may also receive the fourth information sent by another entity.

[0171] In some embodiments, the fourth information may be used to trigger the network device to send the first information.

[0172] In some embodiments, the fourth information may be used to request or instruct the network device to send the first information.

[0173] In some embodiments, the fourth information may be used to indicate addition or update of the first model.

[0174] In some embodiments, the fourth information may be used to indicate a test of the first model.

[0175] In some embodiments, the name of the fourth information is not limited, for example, it can be "model addition or update indication information", "model addition indication information", "model update indication information", "model online test indication information", "model test indication information", "model test request information", etc.

[0176] In some embodiments, the terminal device may send the fourth information to the network device when the first model is newly added or updated, so as to trigger the network device to start testing the first model.

[0177] In some embodiments, the fourth information may include a first model identifier, and the first model identifier may be an ID identifier corresponding to the first model.

[0178] In some embodiments, the fourth information may include at least one of the following: model update indication information, model addition indication information, and model test indication information.

[0179] The model update indication information may be used to trigger, request or indicate an update (or rollback) of the first model.

[0180] The model addition indication information may be used to trigger, request or indicate the addition (increase) of the first model.

[0181] The model test instruction information can be used to trigger, request or instruct the test (training or verification) of the first model. The name of the model test instruction information is not limited, for example, it can be "model online test instruction information", "model test request information" and so on.

[0182] In some embodiments, the terminal device may send a fourth message, which may include the fourth information. For example, the terminal device may send the fourth message to the network device. Optionally, the network device may receive the fourth message. The fourth message may include at least one of a Radio Resource Control (RRC) message, a Medium Access Control (MAC) CE (Medium Access Control) Element, uplink control information (UCI), or other messages sent by the terminal device to the network device.

[0183] In some embodiments of the present disclosure, the first model may be an AI model, an ML model, an AI / ML model, or other models for prediction. The first model may be one or more models.

[0184] In some embodiments, the first model may be a model for performing beam prediction, and the first model may be applied to beam management scenarios. For example, the first model may be deployed on a terminal device, and the terminal device may predict the best beam / beam group (e.g., the TOP1 strongest beam / beam group) based on the first model and report it to the network device, which may select the best beam / beam group for subsequent transmission. Similarly, the first model may also be deployed on a network device, and the network device may also predict the best beam / beam group based on the first model.

[0185] In some embodiments, the first model may be a model for performing CSI feedback prediction, and the first model may be applied in CSI feedback scenarios. For example, the first model may be deployed in a terminal device, which may predict accurate and effective CSI feedback values ​​based on the first model. The network device may then select an appropriate MCS for downlink data transmission based on the CSI feedback values, thereby reducing the BLER of downlink data transmission. Similarly, the first model may also be deployed in a network device, which may also predict accurate and effective CSI feedback values ​​based on the first model.

[0186] In some embodiments, the first model may be a model for performing positioning prediction, and the first model may be applied in positioning scenarios. For example, the first model may be deployed on a terminal device, which may predict positioning information based on the first model to improve positioning accuracy. The positioning information may include at least one of RSTD, PRS-RSRP, positioning accuracy, LOS indication, and NLOS indication. Similarly, the first model may be deployed on a network device, which may also predict the above-mentioned positioning information based on the first model.

[0187] Step S2102: The network device sends first information to the terminal device.

[0188] In some embodiments, the terminal device may receive the first information. For example, the terminal device may receive the first information sent by the network device. For another example, the terminal device may also receive the first information sent by another entity.

[0189] In some embodiments, the first information may include information for testing the first model.

[0190] In some embodiments, the first information may include first data for testing the first model. The first data may include downlink data, which may be data sent by a network device to a terminal device via a downlink channel, and the downlink channel may include at least one of a physical downlink control channel (PDCCH), a physical downlink shared channel (PDSCH), or other channels specified by the protocol.

[0191] In some embodiments, the first information may include a first signal for testing the first model. The first signal may include at least one of a channel state information reference signal (CSI-RS), a synchronization signal block (SSB), a positioning reference signal (PRS), or other signals sent by the network device to the terminal device.

[0192] In some embodiments, the first information may include the first data and the first signal.

[0193] In some embodiments, the name of the first information is not limited, and may be, for example, "test reference information," "test information," "test data," "test signal," "model test information," "model test data," "model test signal," etc. Similarly, the name of the first signal is not limited, and may be, for example, "test reference signal," "test signal," "model test signal," etc.; the name of the first data is also not limited, and may be, for example, "test reference data," "test data," "model test data," etc.

[0194] In some embodiments, the test of the first model can be an online test. For example, the first model can be tested online during operation on a commercial network. The first data can include data from the commercial network, and similarly, the first signal can include a signal from the commercial network. In this way, online testing can be performed after the terminal device or network device is commercially available, allowing for timely verification, updates, or additions to the model.

[0195] In some embodiments, the test performed on the first model may also be an offline test. For example, the first model may be tested offline before being put into commercial use in a laboratory or on a network.

[0196] In some embodiments, the network device may send a first message, which may include the first information. For example, the network device may send the first message to the terminal device. Optionally, the terminal device may receive the first message. The first message may include at least one of an RRC message, a MAC CE, downlink control information (DCI), or other messages sent by the network device to the terminal device.

[0197] In some embodiments of the present disclosure, the network device may determine, based on the fourth information, that the first model meets the test start condition, and send the first information to the terminal device.

[0198] The start condition to be tested may include at least one of the following:

[0199] The first model has not been tested: illustratively, the first model has not been trained or performance verified.

[0200] The first model is not in a model management set: wherein the model management set includes models that have been tested (or trained, or performance verified). The model management set may also be referred to as a model management list, a model monitoring management list, a model monitoring list, etc.

[0201] The fourth information is used to instruct execution of a test of the first model. For example, the first information may be model test instruction information or model online test instruction information.

[0202] In some embodiments, the network device may determine whether it is necessary to send the first information to the terminal device, or whether to send data / signals for the first model online test to the terminal device, based on the received fourth information.

[0203] For example, if the first model is not in the model monitoring management list (has not been trained or performance verified), or after the network receives the online test indication information, the network sends online test data / signal to the UE, where the data / signal can be determined according to different scenarios, for example, data (PDSCH) is used for AI / ML-based CSI feedback; signal (CSI-RS / SSB) is used for AL / ML-based beam management (beam management) and signal (PRS) is used for AL / ML-based positioning (positioning).

[0204] Step S2103: The terminal device uses the first model to make predictions based on the first information to obtain prediction data.

[0205] In some embodiments, the terminal device may measure the received first information to obtain first measurement data; input the first measurement data into a first model to obtain prediction data output by the first model.

[0206] For example, the first information is a CSI-RS signal, the first measurement data may be an actual measurement result of the CSI-RS signal, and the predicted data may be data output by the first model after the first measurement data is input into the first model.

[0207] In one implementation, the first model is deployed on the terminal device side, and the second information may include prediction data, or the second information may include prediction data and first measurement data. The prediction data may be data predicted by the terminal device based on the first model and the first measurement data.

[0208] For example, the terminal device may receive first information, measure the first information to obtain first measurement data, input the first measurement data into a first model, and obtain prediction data output by the first model.

[0209] For example, the terminal device may perform prediction based on the configuration information. For example, the terminal device may perform prediction using the first model based on the configuration information to obtain a prediction result. The configuration information may be information predefined by a protocol, or may be information configured by the terminal device, or may be information received by the terminal device from a network device, for example, configuration information determined by the network device and sent to the terminal device.

[0210] Step S2104: The terminal device sends second information to the network device.

[0211] In some embodiments, the network device may receive the second information. For example, the network device may receive the second information sent by the terminal device. For another example, the network device may also receive the second information sent by another entity.

[0212] In some embodiments, the name of the second information is not limited, for example, it can be "prediction result", "prediction information", "measurement result", "measurement information", "test result", "test information", etc.

[0213] In some embodiments, the second information may include at least one of prediction data and first measurement data.

[0214] In some embodiments, the name of the predicted data is not limited, and may be, for example, "prediction result," "model output data," "model output result," etc. Similarly, the name of the first measurement data is also not limited, and may be, for example, "first measurement result," "actual measurement result," "actual measurement data," etc.

[0215] The predicted data may be data predicted by the first model based on the first measurement data, and the first measurement data may be data obtained after the terminal device measures the first information.

[0216] In some embodiments, the terminal device may send a second message, which may include the second information. For example, the terminal device may send the second message to the network device. Alternatively, the network device may receive the second message. The second message may include at least one of an RRC message, a MAC CE, a UCI, or other message sent by the terminal device to the network device.

[0217] In some embodiments of the present disclosure, the terminal device uses the first model to predict the result based on the configuration information of the first information configured by the network device, obtains the second information (prediction result), and reports the second information to the network device.

[0218] Step S2105: The network device determines whether the prediction data output by the first model meets the first condition.

[0219] In some embodiments, the network device may determine whether the prediction data output by the first model satisfies the first condition based on the second information. Alternatively, the network device may determine whether the first model satisfies the first condition based on the second information.

[0220] In some embodiments, the first condition may be a performance requirement of the prediction data, which may include at least one of an accuracy requirement, a precision requirement, and a reliability requirement.

[0221] In some embodiments, the first condition may be a condition for determining whether the first mode can be used. For example, if the first condition is met, the first model can be used by the terminal device or the network; if the first condition is not met, the first model cannot be used by the terminal device or the network.

[0222] In some embodiments, the first model may be a model for performing beam prediction, and the prediction data includes a predicted signal quality of a first beam, where the first beam is at least one beam configured by the network device for the terminal device.

[0223] It should be noted that the first beam can be a beam or a beam group, which is not limited in this disclosure.

[0224] The first beam may be any one or more beams configured by the network device for the terminal device, and the first beam may also be the beam with the strongest signal quality.

[0225] The first condition may include that the difference between the above-mentioned predicted signal quality and the first signal quality is within a first difference range; wherein, the predicted signal quality is the signal quality of the first beam predicted by the first model according to the first information; the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

[0226] In some embodiments, the first model may be a model for performing beam prediction, and the prediction data may include a second beam obtained by beam prediction that satisfies a signal condition;

[0227] The signal condition may include at least one of the following:

[0228] The signal quality of the second beam is greater than or equal to a preset signal quality threshold;

[0229] The second beam is the beam with the strongest signal quality among the multiple beams configured by the network device for the terminal device.

[0230] It should also be noted that the second beam can be a beam or a beam group.

[0231] The first condition may be that the number of times the prediction success condition is satisfied in N beam predictions performed is greater than or equal to M, where N is a natural number and M is a natural number less than or equal to N. The prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam obtained by performing the beam prediction.

[0232] The third beam is a beam that satisfies the signal condition and is determined by the network device according to the beam configuration information; or,

[0233] The third beam is a beam that satisfies the signal condition and is determined based on the second measurement data, where the second measurement data is data obtained after the terminal device measures multiple beams configured by the network device to the terminal device.

[0234] For example, the network device configures the first information for beam management to the terminal device (the first information may be a first signal), and the terminal device may infer and predict the first information based on the first model to obtain the predicted signal quality of the first beam. The first beam may be at least one beam or beam group configured by the network device for the terminal device. The first beam may also be the optimal beam or beam group with the strongest signal quality. The terminal device may report prediction data to the network device, and the prediction data may include the predicted signal quality of the first beam, or the second information may include the first beam and the predicted signal quality of the first beam. The network device may evaluate whether the performance requirements of the prediction data meet the first condition based on the prediction data reported by the terminal device. The first condition may include a predefined performance indicator requirement.

[0235] In one implementation, the performance indicator requirement may be a signal quality accuracy requirement, where the signal quality may include at least one of RSRP, SINR, RSSI, and RSRQ. The signal quality accuracy may be a difference between the predicted signal quality and the first signal quality.

[0236] Among them, the first signal quality can be the signal quality simulated by the network device according to the beam configuration information, or the first signal quality can be the signal quality of the first beam actually measured by the terminal device (for example, it can be the signal quality of the first beam obtained by the terminal device based on the traditional method to measure the first information).

[0237] If the signal quality accuracy meets the predefined performance indicator requirement, for example, the signal quality accuracy is within the first difference range, it can be determined that the predicted data output by the first model meets the first condition.

[0238] In another implementation, the performance indicator requirement may be a prediction reliability requirement. For example, the prediction reliability percentage must meet a predefined prediction reliability requirement. If the performance indicator is prediction reliability, the prediction reliability percentage must meet the predefined prediction reliability requirement. For example, if N beam predictions are performed, and the number of successful prediction conditions met is M, then the prediction reliability is (M / N)*100%.

[0239] Wherein, N is a natural number, and M is a natural number less than or equal to N.

[0240] The prediction success condition is that the second beam is identical to the third beam.

[0241] The second beam is a beam (eg, an optimal beam or beam group) that satisfies the signal condition and is obtained by the terminal device performing beam prediction.

[0242] The third beam may be a beam that satisfies the signal condition and is determined by the network device according to the beam configuration information. For example, it may be a beam that satisfies the signal condition and is simulated and generated by the network device (for example, an optimal beam or beam group). Or,

[0243] The third beam may be a beam that satisfies the signal condition and is determined based on second measurement data, where the second measurement data is data obtained after the terminal device measures multiple beams configured by the network device to the terminal device.

[0244] If the prediction reliability requirement meets the predefined performance indicator requirement, for example, the number of times the prediction success condition is met in the N beam predictions performed is greater than or equal to M, then it can be determined that the prediction data output by the first model meets the first condition.

[0245] It should be noted that the prediction data output by the first model meets the first condition, which can also be expressed as "the first model is reliable."

[0246] Step S2106: The network device sends third information to the terminal device.

[0247] In some embodiments, the terminal device may receive the third information. For example, the terminal device may receive the third information sent by the network device. For another example, the terminal device may also receive the third information sent by another entity.

[0248] In some embodiments, the third information may be used to indicate whether the first model can be used by the terminal device.

[0249] In some embodiments, the third information can be used to indicate whether the terminal device can use the first model.

[0250] For example, the network device may send the third information when it is determined that the prediction result of the first model meets the first condition, and the third information is used to indicate that the first model can be used by the terminal device.

[0251] For another example, the network device may not send the third information if it determines that the prediction result of the first model does not meet the first condition.

[0252] For another example, when the network device determines that the prediction result of the first model meets the first condition, the third information sent is a first specific value. The third information being the first specific value can be used to indicate that the first model can be used by the terminal device.

[0253] For another example, if the terminal network device determines that the prediction result of the first model does not meet the first condition, the third information sent may be a second specific value. The third information being the second specific value may be used to indicate that the first model cannot be used by the terminal device. The first specific value and the second specific value are different, for example, the first specific value is 1 and the second specific value is 0; or the first specific value is 0 and the second specific value is 1.

[0254] In some embodiments, the third information can be used to instruct the terminal device to add, update or delete the above-mentioned first model.

[0255] In some embodiments, the third information can be used to instruct the terminal device to add or update the above-mentioned first model.

[0256] In some embodiments, the third information may be used to indicate that the terminal device is capable of using the first model.

[0257] In some embodiments, the third information may be used to indicate that the terminal device is allowed to use the first model.

[0258] In some embodiments, the third information can be used to instruct the terminal device to delete the above-mentioned first model.

[0259] In some embodiments, the third information may be used to indicate that the terminal device cannot use the first model.

[0260] In some embodiments, the name of the third information is not limited, for example, it can be "add model indication information", "update model indication information", "delete model indication information", "can use model indication information", "allow use of model indication information", etc.

[0261] In some embodiments, the network device determines that the prediction data output by the first model meets the first condition, and sends third information to the terminal device, where the third information is used to instruct the terminal device to add or update the first model.

[0262] For example, the network evaluates whether the predicted data output by the first model meets the first condition (that is, the predefined performance requirements) based on the second information reported by the terminal device. If so, the network device can send third information to the terminal device, and the third information can be used to instruct the terminal device to add or update the first model.

[0263] Optionally, after receiving the third information, the terminal device may add or update the first model.

[0264] In other embodiments, the network device determines that the prediction data output by the first model does not meet the first condition, and sends third information to the terminal device, where the third information is used to instruct the terminal device to delete the first model.

[0265] Optionally, after receiving the third information, the terminal device may delete the first model.

[0266] In some embodiments, the network device may send a third message that may include the third information. For example, the network device may send the third message to the terminal device. Alternatively, the terminal device may receive the third message. The third message may include at least one of an RRC message, a MAC CE, a DCI, or other message sent by the network device to the terminal device.

[0267] Step S2107: The terminal device determines whether the first model can be used.

[0268] In some embodiments, the terminal device may determine whether the first model can be used based on the third information.

[0269] For example, the terminal device may determine that the first model can be used when receiving the third information. Similarly, the network device may send the third information when determining that the prediction result of the first model meets the first condition.

[0270] For another example, the terminal device may determine that the first model cannot be used if it does not receive the third information. Similarly, the network device may not send the third information if it determines that the prediction result of the first model does not meet the first condition.

[0271] For another example, the terminal device may determine that the first model can be used when the value of the third information is the first specific value. Similarly, the network device may send the third information as the first specific value when it determines that the prediction result of the first model meets the first condition.

[0272] For another example, the terminal device may determine that the first model cannot be used if the value of the third information is the second specific value. Similarly, the network device may send the third information as the second specific value if it determines that the prediction result of the first model does not meet the first condition. The first specific value and the second specific value are different, for example, the first specific value is 1 and the second specific value is 0; or the first specific value is 0 and the second specific value is 1.

[0273] In some embodiments, the terminal device determines that the first model can be used and can formally use the first model to perform predictions, thereby improving the performance and reliability of the predictions.

[0274] In some embodiments, the terminal device may add, update, or delete the first model according to the third information.

[0275] In some embodiments, the third information is used to instruct the terminal device to add the first model, and the terminal device can add the first model.

[0276] In some embodiments, the third information is used to instruct the terminal device to update the first model, and the terminal device can update the first model.

[0277] In some embodiments, the third information is used to instruct the terminal device to delete the first model, and the terminal device can delete the first model.

[0278] By using the above method, the first model can be tested or verified to determine whether the first model meets the first condition, thereby determining the performance and reliability of the model. This can realize online verification and testing of the model, thereby improving the flexibility and reliability of model management.

[0279] The method involved in the embodiments of the present disclosure may include at least one of the above steps S2101 to S2107. For example, step S2105 can be implemented as an independent embodiment, step S2104 can be implemented as an independent embodiment, steps S2102 + S2105 can be implemented as an independent embodiment, steps S2102 + S2104 can be implemented as an independent embodiment, steps S2105 + S2106 can be implemented as an independent embodiment, steps S2106 + S2107 can be implemented as an independent embodiment, steps S2102 + S2104 + S2105 can be implemented as an independent embodiment, steps S2102 + S2104 + S2105 + S2106 can be implemented as an independent embodiment, and steps S2101 + S2102 + S2104 + S2105 can be implemented as an independent embodiment, but are not limited thereto.

[0280] In some embodiments, the above steps S2101 to S2107 can be executed in a swapped order or simultaneously. For example, steps S2101 and S2104 can be executed in a swapped order or simultaneously.

[0281] In some embodiments, steps S2101 to S2107 are all optional. For example, steps S2101, S2102, S2104, S2106, and S2107 are optional, and one or more of these steps may be omitted or replaced in different embodiments. For another example, steps S2101, S2105, S2106, and S2107 are optional, and one or more of these steps may be omitted or replaced in different embodiments.

[0282] In some embodiments, reference may be made to other optional implementations described before or after the description corresponding to FIG. 2A .

[0283] In some embodiments, the names of information, etc. are not limited to the names described in the embodiments, and terms such as "information", "message", "signal", "signaling", "report", "configuration", "indication", "instruction", "command", "channel", "parameter", "domain", "field", "symbol", "symbol", "codeword", "codebook", "codeword", "codepoint", "bit", "data", "program", and "chip" can be used interchangeably.

[0284] In some embodiments, "obtain", "get", "get", "receive", "transmit", "bidirectional transmission", "send and / or receive" can be interchangeable, and can be interpreted as receiving from other entities, obtaining from protocols, obtaining from higher layers, obtaining by self-processing, autonomous implementation, etc.

[0285] In some embodiments, terms such as "send", "transmit", "report", "download", "transmit", "bidirectional transmission", "send and / or receive" can be used interchangeably.

[0286] FIG2B is a flow chart of a model testing method according to an embodiment of the present disclosure. The method can be executed by the above-mentioned communication system. As shown in FIG2B , the method may include:

[0287] Step S2201: The network device sends first information to the terminal device.

[0288] The optional implementation of step S2201 can refer to the optional implementation of step S2102 in FIG. 2A and other related parts in the embodiment involved in FIG. 2A , which will not be described in detail here.

[0289] In some embodiments, the terminal device may receive the first information. For example, the terminal device may receive the first information sent by the network device. For another example, the terminal device may also receive the first information sent by another entity.

[0290] In some embodiments, when a first model is newly added or updated, the network device may send first information to the terminal device to start testing the first model.

[0291] Step S2202: The terminal device sends second information to the network device.

[0292] The optional implementation of step S2202 can refer to the optional implementation of step S2104 in FIG. 2A and other related parts in the embodiment involved in FIG. 2A , which will not be described in detail here.

[0293] In some embodiments, the network device may receive the second information. For example, the network device may receive the second information sent by the terminal device. For another example, the network device may also receive the second information sent by another entity.

[0294] In some embodiments, the second information may include first measurement data. The terminal device may measure the received first information to obtain the first measurement data.

[0295] Step S2203: The network device uses the first model to make predictions based on the second information to obtain prediction data.

[0296] In one implementation, the first model may be deployed on a network device side, and the second information may include the first measurement data.

[0297] Optionally, the network device may obtain the predicted data by predicting the first measurement data based on the first model. For example, after receiving the first measurement data, the network device may input the first measurement data into the first model to obtain the predicted data output by the first model.

[0298] For example, the network device may perform prediction based on configuration information. For example, the network device may perform prediction based on the configuration information using a first model to obtain a prediction result. The configuration information may be information predefined by a protocol, or may be information configured by the network device, or may be information received by the network device from a terminal device, for example, configuration information determined by the terminal device and sent to the network device.

[0299] In another implementation, the first model can be deployed on both the terminal device and the network device. The second information may include predicted data, or the second information may include first measurement data, or the second information may include predicted data and first measurement data. If the network device receives the first measurement data, it may use the predicted data obtained by prediction based on the first measurement data based on the first model. If the network device receives the predicted data, it may directly use the predicted data without re-executing the prediction. There may be a first terminal with the first model deployed in the communication system, and there may also be a second terminal without the first model deployed, and the network device may be compatible with both the first terminal and the second terminal.

[0300] Step S2204: The network device determines whether the prediction data output by the first model meets the first condition.

[0301] The optional implementation of step S2204 can refer to the optional implementation of step S2105 in FIG2A and other related parts in the embodiment involved in FIG2A , which will not be described in detail here.

[0302] In some embodiments, when the network device determines that the prediction data output by the first model meets the first condition, the first model can be used for prediction to improve the performance and reliability of the prediction.

[0303] FIG3A is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG3A , the embodiment of the present disclosure relates to a model testing method, which can be executed by a network device. The method includes:

[0304] Step S3101: Obtain fourth information.

[0305] The optional implementation of step S3101 can refer to the optional implementation of step S2101 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0306] In some embodiments, the network device may receive the fourth information sent by the terminal device, but is not limited thereto. The network device may also receive the fourth information sent by other entities.

[0307] In some embodiments, the network device may obtain fourth information specified by the protocol.

[0308] In some embodiments, the network device may obtain the fourth information from upper layer(s).

[0309] In some embodiments, the network device may perform processing to obtain the fourth information.

[0310] In some embodiments, step S3101 may be omitted, and the network device may autonomously implement the function indicated by the fourth information, or the above function may be default or by default.

[0311] Step S3102: Send the first information.

[0312] The optional implementation of step S3102 can refer to the optional implementation of step S2102 in Figure 2A, the optional implementation of step S2201 in Figure 2B, and other related parts in the embodiments involved in Figures 2A and 2B, which will not be repeated here.

[0313] In some embodiments, the network device may send the first information to the terminal device, but is not limited thereto. The network device may also send the first information to other entities.

[0314] Optionally, the first information can be used by the terminal device to perform measurement to obtain first measurement data. For example, the terminal device can receive the first information and measure the first information to obtain the first measurement data. For optional implementations, see the optional implementations of steps S2102 or S2104 in FIG. 2A , and other related portions of the embodiment involved in FIG. 2A , which are not further described here.

[0315] Step S3103: Obtain second information.

[0316] The optional implementation of step S3103 can refer to the optional implementation of step S2104 in Figure 2A, the optional implementation of step S2202 in Figure 2B, and other related parts in the embodiments involved in Figures 2A and 2B, which will not be repeated here.

[0317] In some embodiments, the network device may receive the second information sent by the terminal device, but is not limited thereto. The network device may also receive the second information sent by other entities.

[0318] In some embodiments, the network device may obtain second information specified by the protocol.

[0319] In some embodiments, the network device may obtain the second information from upper layer(s).

[0320] In some embodiments, the network device may perform processing to obtain the second information.

[0321] In some embodiments, step S3103 may be omitted, and the network device may autonomously implement the function indicated by the second information, or the above function may be default or acquiescent.

[0322] Step S3104: Determine whether the predicted data output by the first model meets the first condition.

[0323] The optional implementation of step S3104 can refer to the optional implementation of step S2105 in Figure 2A, the optional implementation of step S2204 in Figure 2B, and other related parts in the embodiments involved in Figures 2A and 2B, which will not be repeated here.

[0324] Step S3105: Send the third information.

[0325] The optional implementation of step S3105 can refer to the optional implementation of step S2106 in FIG2A and other related parts in the embodiment involved in FIG2A , which will not be described in detail here.

[0326] In some embodiments, the network device may send the third information to the terminal device, but is not limited thereto. The network device may also send the third information to other entities.

[0327] Optionally, the third information can be used by the terminal device to perform measurement to obtain the first measurement data. For example, the terminal device can receive the third information and measure the third information to obtain the first measurement data. For optional implementations, see the optional implementations of steps S2102 or S2104 in FIG. 2A , and other related portions of the embodiment involved in FIG. 2A , which are not further described here.

[0328] Optionally, the third information can be used by the terminal device to determine whether the first model can be used. For optional implementations, see the optional implementation of step S2107 in FIG2A and other related parts of the embodiment involved in FIG2A, which will not be repeated here.

[0329] In some embodiments, the network device may use the first model to make predictions based on the second information to obtain prediction data. The specific implementation of this step can refer to the optional implementation of step S2203 in Figure 2B and other related parts of the embodiment involved in Figure 2B, which will not be repeated here.

[0330] The method according to the embodiments of the present disclosure may include at least one of steps S3101 to S3105. For example, step S3104 may be implemented as an independent embodiment, steps S3102+S3104 may be implemented as an independent embodiment, steps S3104+S3105 may be implemented as an independent embodiment, steps S3102+S3103+S3104 may be implemented as an independent embodiment, and steps S3102+S3103+S3104+S3105 may be implemented as an independent embodiment, but the present invention is not limited thereto.

[0331] In some embodiments, the above steps S3101 to S3105 can be executed in a swapped order or simultaneously. For example, steps S3101 and S3103 can be executed in a swapped order or simultaneously.

[0332] In some embodiments, steps S3101 to S3105 are all optional steps. For example, steps S3101, S3102, S3103, and S3105 are optional, and one or more of these steps may be omitted or replaced in different embodiments.

[0333] In some embodiments, reference may be made to other optional implementations described before or after the description corresponding to FIG. 3 .

[0334] FIG3B is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG3B , an embodiment of the present disclosure relates to a model testing method, which can be executed by a network device. The method may include:

[0335] Step S3201: Send the first information.

[0336] The optional implementation of step S3201 can be found in step S2102 of FIG. 2A , the optional implementation of step S3102 of FIG. 3A , and other related parts in the embodiments involved in FIG. 2A and FIG. 3A , which will not be repeated here.

[0337] Step S3202: Determine whether the predicted data output by the first model meets the first condition.

[0338] The optional implementation of step S3202 can be found in step S2105 of FIG. 2A , step S2204 of FIG. 2B , the optional implementation of step S3104 of FIG. 3A , and other related parts in the embodiments involved in FIG. 2A , FIG. 2B , and FIG. 3A , which will not be repeated here.

[0339] In some embodiments, the above steps are all optional steps.

[0340] In some embodiments, the embodiment shown in FIG. 3B may also be combined with step S3103 in the embodiment shown in FIG. 3A as a new embodiment.

[0341] In some embodiments, the embodiment shown in FIG. 3B may also be combined with step S3101 in the embodiment shown in FIG. 3A as a new embodiment.

[0342] In some embodiments, the embodiment shown in FIG. 3B may also be combined with step S3103 and step S3105 in the embodiment shown in FIG. 3A as a new embodiment.

[0343] In some embodiments, the embodiment shown in FIG. 3B can also be combined with step S3101 and step S3103 in the embodiment shown in FIG. 3A as a new embodiment.

[0344] In some embodiments, the embodiment shown in FIG. 3B may also be combined with step S3101 , step S3103 , and step S3105 in the embodiment shown in FIG. 3A as a new embodiment.

[0345] FIG3C is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG3C , an embodiment of the present disclosure relates to a model testing method, which can be performed by a network device. The method may include:

[0346] Step S3301: Determine whether the prediction data output by the first model meets the first condition.

[0347] The optional implementation of step S3301 can be found in step S2105 of FIG. 2A , step S2204 of FIG. 2B , the optional implementation of step S3104 of FIG. 3A , and other related parts in the embodiments involved in FIG. 2A , FIG. 2B , and FIG. 3A , which will not be repeated here.

[0348] Step S3302: Send the third information.

[0349] The optional implementation of step S3302 can be found in step S2106 of FIG. 2A , the optional implementation of step S3105 of FIG. 3A , and other related parts in the embodiments involved in FIG. 2A and FIG. 3A , which will not be described in detail here.

[0350] In some embodiments, the above steps are all optional steps.

[0351] In some embodiments, the embodiment shown in FIG. 3C may also be combined with step S3103 in the embodiment shown in FIG. 3A as a new embodiment.

[0352] In some embodiments, the embodiment shown in FIG. 3C may also be combined with step S3102 and step S3103 in the embodiment shown in FIG. 3A to form a new embodiment.

[0353] In some embodiments, the embodiment shown in FIG. 3C may also be combined with step S3102, step S3103 and step S3103 in the embodiment shown in FIG. 3A as a new embodiment.

[0354] FIG3D is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG3C , an embodiment of the present disclosure relates to a model testing method, which can be performed by a network device. The method may include:

[0355] Step S3401: Determine whether the prediction data output by the first model meets the first condition.

[0356] The optional implementation of step S3401 can be found in step S2105 of FIG. 2A , step S2204 of FIG. 2B , the optional implementation of step S3104 of FIG. 3A , and other related parts in the embodiments involved in FIG. 2A , FIG. 2B , and FIG. 3A , which will not be repeated here.

[0357] In some embodiments, the embodiment shown in FIG. 3C may also be combined with at least one of step S3101 , step S3102 , step S3103 , and step S3105 in the embodiment shown in FIG. 3A as a new embodiment.

[0358] In some embodiments, the first condition is a performance requirement of the predicted data, the predicted data is data predicted by the first model based on the first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

[0359] In some embodiments, the method further comprises:

[0360] Receive second information sent by the terminal device, where the second information includes the prediction data.

[0361] In some embodiments, the method further comprises:

[0362] Sending third information to the terminal device; the third information is used to indicate whether the first model can be used by the terminal device.

[0363] In some embodiments, the method further comprises:

[0364] receiving fourth information; wherein the fourth information is used to trigger the network device to send the first information, and the fourth information includes a first model identifier of the first model;

[0365] Determine, based on the fourth information, that the first model meets the test start condition, and send the first information to the terminal device.

[0366] In some embodiments, the test initiation condition includes at least one of the following:

[0367] The first model has not been tested;

[0368] The first model is not in the model management set; the model management set includes models that have been tested;

[0369] The fourth information is used to instruct execution of the test of the first model.

[0370] In some embodiments, the fourth information includes at least one of the following:

[0371] Model update instruction information;

[0372] Add instruction information to the model;

[0373] Model testing instructions.

[0374] In some embodiments, the first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device;

[0375] The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

[0376] In some embodiments, the first model is a model for performing beam prediction, and the prediction data includes a second beam satisfying a signal condition obtained by the beam prediction;

[0377] The signal condition includes at least one of the following:

[0378] The signal quality of the second beam is greater than or equal to a preset signal quality threshold;

[0379] The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

[0380] In some embodiments, the first condition is that the number of times the prediction success condition is satisfied in N beam predictions performed is greater than or equal to M; where N is a natural number and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam obtained by performing beam prediction that satisfies the signal condition;

[0381] The third beam is a beam that meets the signal condition determined by the network device based on the beam configuration information; or, the third beam is a beam that meets the signal condition determined based on second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

[0382] In some embodiments, the signal quality includes at least one of the following: RSRP, SINR, RSSI, RSRQ.

[0383] In some embodiments, the first information includes at least one of the following:

[0384] first data for testing the first model;

[0385] A first signal is used to test the first model.

[0386] FIG4A is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG4A , an embodiment of the present disclosure relates to a model testing method, which can be executed by a terminal device. The method may include:

[0387] Step S4101: Send the fourth information.

[0388] The optional implementation of step S4101 can refer to the optional implementation of step S2101 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0389] In some embodiments, the terminal device may send the fourth information to the network device, but is not limited thereto. The terminal device may also send the fourth information to other entities.

[0390] Step S4102: Obtain first information.

[0391] The optional implementation of step S4102 can refer to the optional implementation of step S2102 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0392] In some embodiments, the terminal device may receive the first information sent by the network device, but is not limited thereto. The terminal device may also receive the first information sent by other entities.

[0393] In some embodiments, the terminal device may obtain first information specified by the protocol.

[0394] In some embodiments, the terminal device may obtain the first information from an upper layer(s).

[0395] In some embodiments, the terminal device may perform processing to obtain the first information.

[0396] In some embodiments, step S4102 may be omitted, and the terminal device may autonomously implement the function indicated by the first information, or the above function may be default or by default.

[0397] Step S4103: Use the first model to make predictions based on the first information to obtain prediction data.

[0398] The optional implementation of step S4103 can refer to the optional implementation of step S2103 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0399] Step S4104: Send the second information.

[0400] The optional implementation of step S4104 can refer to the optional implementation of step S2104 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0401] In some embodiments, the terminal device may send the second information to the network device, but is not limited thereto. The terminal device may also send the second information to other entities.

[0402] Step S4105: Obtain third information.

[0403] The optional implementation of step S4105 can refer to the optional implementation of step S2106 in FIG2A and other related parts in the embodiment involved in FIG2A , which will not be described in detail here.

[0404] In some embodiments, the terminal device may receive the third information sent by the network device, but is not limited thereto. The terminal device may also receive the third information sent by other entities.

[0405] In some embodiments, the terminal device may obtain third information specified by the protocol.

[0406] In some embodiments, the terminal device may obtain the third information from upper layer(s).

[0407] In some embodiments, the terminal device may perform processing to obtain the third information.

[0408] In some embodiments, step S4102 may be omitted, and the terminal device may autonomously implement the function indicated by the third information, or the above function may be default or by default.

[0409] Step S4106: Determine whether the first model can be used.

[0410] The optional implementation of step S4106 can refer to the optional implementation of step S2107 in Figure 2A and other related parts in the embodiment involved in Figure 2A, which will not be repeated here.

[0411] The method involved in the embodiments of the present disclosure may include at least one of the above steps S4101 to S4106. For example, step S4104 can be implemented as an independent embodiment, steps S4103 + S4104 can be implemented as an independent embodiment, steps S4102 + S4104 can be implemented as an independent embodiment, steps S4105 + S4106 can be implemented as an independent embodiment, steps S4102 + S4103 + S4104 can be implemented as an independent embodiment, steps S4101 + S4102 + S4104 can be implemented as an independent embodiment, and steps S4101 + S4105 + S4106 can be implemented as an independent embodiment, but the present invention is not limited thereto.

[0412] In some embodiments, the above steps S4101 to S4106 can be executed in a swapped order or simultaneously. For example, steps S4101 and S4104 can be executed in a swapped order or simultaneously.

[0413] In some embodiments, steps S4101 to S4106 are all optional. For example, steps S4101, S4102, S4103, S4105, and S4106 are optional, and one or more of these steps may be omitted or replaced in different embodiments. For another example, steps S4101, S4102, and S4104 are optional, and one or more of these steps may be omitted or replaced in different embodiments.

[0414] In some embodiments, reference may be made to other optional implementations recorded before or after the description corresponding to FIG. 4 .

[0415] FIG4B is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG4B , an embodiment of the present disclosure relates to a model testing method, which can be executed by a terminal device. The method may include:

[0416] Step S4201: Obtain first information.

[0417] The optional implementation of step S4201 can be found in step S2102 of FIG. 2A , the optional implementation of step S4102 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be repeated here.

[0418] Step S4202: Send the second information.

[0419] The optional implementation of step S4202 can be found in step S2104 of FIG. 2A , the optional implementation of step S4104 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be described in detail here.

[0420] In some embodiments, the above steps are all optional steps.

[0421] In some embodiments, the embodiment shown in FIG. 4B may also be combined with at least one of steps S4101 , S4105 , and S4106 in the embodiment shown in FIG. 4A as a new embodiment.

[0422] FIG4C is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG4C , an embodiment of the present disclosure relates to a model testing method, which can be executed by a terminal device. The method may include:

[0423] Step S4301: Obtain third information.

[0424] The optional implementation of step S4301 can be found in step S2106 of FIG. 2A , the optional implementation of step S4105 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be described in detail here.

[0425] Step S4302: Determine whether the first model can be used.

[0426] The optional implementation of step S4302 can be found in step S2107 of FIG. 2A , the optional implementation of step S4106 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be described in detail here.

[0427] In some embodiments, the above steps are all optional steps.

[0428] In some embodiments, the embodiment shown in FIG. 4C may also be combined with at least one of steps S4101 , S4102 , and S4104 in the embodiment shown in FIG. 4A as a new embodiment.

[0429] FIG4D is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG4D , an embodiment of the present disclosure relates to a model testing method, which can be executed by a terminal device. The method may include:

[0430] Step S4401: Use the first model to make predictions based on the first information to obtain prediction data.

[0431] The optional implementation of step S4401 can be found in step S2103 of FIG. 2A , the optional implementation of step S4103 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be repeated here.

[0432] Step S4402: Send the second information.

[0433] The optional implementation of step S4402 can be found in step S2104 of FIG. 2A , the optional implementation of step S4104 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be described in detail here.

[0434] In some embodiments, the above steps are all optional steps.

[0435] In some embodiments, the embodiment shown in FIG. 4B may also be combined with at least one of steps S4101 , S4105 , and S4106 in the embodiment shown in FIG. 4A as a new embodiment.

[0436] In some embodiments, the first information is information sent by the network device to the terminal device.

[0437] In some embodiments, the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data.

[0438] In some embodiments, the method further comprises:

[0439] receiving the first information;

[0440] The using the first model to perform prediction based on the first information to obtain the prediction data includes:

[0441] measuring the first information to obtain the first measurement data;

[0442] The first measurement data is input into the first model to obtain the predicted data output by the first model.

[0443] In some embodiments, the method further comprises:

[0444] receiving third information; wherein the third information is used to indicate whether the first model can be used by the terminal device;

[0445] It is determined whether the first model can be used according to the third information.

[0446] In some embodiments, the method further comprises:

[0447] Sending fourth information; wherein the fourth information is used to trigger the network device to send the first information, and the fourth information includes the first model identifier of the first model;

[0448] In some embodiments, the fourth information includes at least one of the following:

[0449] Model update instruction information;

[0450] Add instruction information to the model;

[0451] Model testing instructions.

[0452] In some embodiments, the first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device;

[0453] The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

[0454] In some embodiments, the first model is a model for performing beam prediction, and the prediction data includes a second beam satisfying a signal condition obtained by the beam prediction;

[0455] The signal condition includes at least one of the following:

[0456] The signal quality of the second beam is greater than or equal to a preset signal quality threshold;

[0457] The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

[0458] In some embodiments, the first condition is that the number of times the prediction success condition is satisfied in N beam predictions performed is greater than or equal to M; where N is a natural number and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam obtained by performing beam prediction that satisfies the signal condition;

[0459] The third beam is a beam that meets the signal condition determined by the network device based on the beam configuration information; or, the third beam is a beam that meets the signal condition determined based on second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

[0460] In some embodiments, the signal quality includes at least one of the following: RSRP, SINR, RSSI, RSRQ.

[0461] In some embodiments, the first information includes at least one of the following:

[0462] first data for testing the first model;

[0463] A first signal is used to test the first model.

[0464] FIG5 is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in FIG5 , an embodiment of the present disclosure relates to a model testing method, which may include:

[0465] Step S5101: The terminal device uses the first model to make predictions based on the first information to obtain prediction data.

[0466] The first information is information sent from the network device to the terminal device.

[0467] The optional implementation of step S5101 can be found in step S2103 of FIG. 2A , the optional implementation of step S4103 of FIG. 4A , and other related parts in the embodiments involved in FIG. 2A and FIG. 4A , which will not be described in detail here.

[0468] Step S5102: The terminal device sends second information to the network device.

[0469] Optional implementations of step S5102 may be found in step S2104 of FIG. 2A , step S3103 of FIG. 3A , step S4104 of FIG. 4A , and other related parts of the embodiments involved in FIG. 2A , FIG. 3A , and FIG. 4A , which will not be described in detail here.

[0470] In some embodiments, the second information may include the above-mentioned prediction data.

[0471] Step S5103: The network device determines whether the prediction data output by the first model meets the first condition.

[0472] Optional implementations of step S5103 may be found in step S2105 of FIG. 2A , step S3104 of FIG. 3A , and other related parts of the embodiments involved in FIG. 2A and FIG. 3A , which will not be described in detail here.

[0473] In some embodiments, the above method may include the method described in the embodiments of the above communication system, terminal equipment, network equipment, etc., which will not be repeated here.

[0474] Figure 6 is a flow chart of a model testing method according to an embodiment of the present disclosure. As shown in Figure 6, an embodiment of the present disclosure relates to a model testing method, which can be executed by a communication system and may include:

[0475] Step S6101: The terminal device sends fourth information to the network device.

[0476] The fourth information may be AI / ML model addition instruction information, AI / ML model update instruction information, or AI / ML model online test instruction information. The fourth information includes at least a first model identifier of the first model.

[0477] For example, the terminal device may send an AI / ML model addition or update instruction information to the network device, or the terminal device may send an AI / ML model online test instruction information to the network device. The above instruction information includes at least the ID of the target model.

[0478] Step S6102: The network device sends second information to the terminal device according to the fourth information.

[0479] The second information may be data and / or signals used for online testing of the target model.

[0480] For example, the network device can determine whether it is necessary to send data and / or signals for online testing of the target model to the UE based on the received fourth information. If the target model is not in the model monitoring management list (that is, the model has not been trained or performance verified), or after the network device receives the above-mentioned AI / ML model online test indication information, the network device can send a second linear (online test data and / or signal) to the terminal device, where the data and / or signal can be determined according to different scenarios, for example, data (PDSCH) is used for CSI feedback based on the AL / ML model; signals (CSI-RS / SSB) are used for beam management based on the AL / ML model, and signals (PRS) are used for positioning based on the AL / ML model.

[0481] Step S6103: The terminal device performs prediction and reports the prediction data to the network device.

[0482] The prediction data may also be referred to as a prediction result.

[0483] For example, the terminal device may use the first model to predict results based on the configuration information of the test data / signal configured by the network, and report the prediction results to the network.

[0484] Step S6104: The network device determines whether the prediction data output by the first model meets the first condition.

[0485] The first condition may include a predefined performance requirement.

[0486] For example, the network device can evaluate whether the predefined performance requirements are met based on the reported prediction results. If so, the network device can send an indication message to the terminal device to allow the use of the target model. After receiving the indication message, the terminal device can add / update the first model.

[0487] In some embodiments, the network device configures a test reference signal for beam management to the terminal device. The terminal device infers and predicts the signal strength of the beam (L1-RSRP signal strength) based on the AI / ML model to obtain the strongest beam or beam group. The terminal device reports the predicted optimal beam or beam group and its signal strength to the network device. The network device evaluates whether the performance requirements of the predicted results meet the predefined performance indicator requirements based on the prediction results reported by the terminal device. For performance indicators such as RSRP signal strength accuracy, where signal strength accuracy = predicted result value – ideal value, where the ideal value is the signal strength value generated by TE based on the configuration parameters simulation, the signal strength accuracy requirement must meet the predefined performance indicator requirements, and the AI / ML model is considered reliable. If the performance indicator is prediction reliability, the prediction reliability percentage must meet the predefined prediction reliability requirements. For example, if N predictions are made and the number of successful predictions is M, the prediction reliability is (M / N)*100%. The successful prediction judgment condition is whether the optimal beam or beam group reported by the terminal device is consistent with the ideal optimal beam or beam group simulated and generated by the network device. If the network device determines and evaluates that the prediction result of the AI / ML model is reliable, it sends an indication message to the terminal device allowing the use / application of the model, and the terminal device adds / updates the target model according to the received indication message.

[0488] In some embodiments, the network device configures a test reference signal for beam management to the terminal device. The terminal device uses an AI / ML model to infer and predict the signal strength of the beam (L1-RSRP signal strength) to determine the strongest beam or beam group. The terminal device then reports the predicted optimal beam or beam group and its signal strength to the network device. Simultaneously, the terminal device uses traditional methods to measure the test reference signal and determine the strongest beam / beam group and its signal strength. The terminal device then reports the predicted optimal beam or beam group and its signal strength to the network device. Based on the prediction results reported by the terminal device, the network device evaluates whether the performance requirements of the prediction results meet predefined performance indicators. If the performance indicator is RSRP signal strength accuracy, where signal strength accuracy = predicted result value – traditional measurement value, the signal strength accuracy requirement must meet the predefined performance indicator requirement for the AI / ML model to be considered reliable. If the performance indicator is prediction reliability, the prediction reliability percentage must meet the predefined prediction reliability requirement. For example, if N predictions are performed and M predictions are successful, the prediction reliability is (M / N) * 100%. A successful prediction is determined by whether the optimal beam or beam group reported by the terminal device is consistent with the optimal beam or beam group measured by the terminal device using traditional methods. If the network device determines and evaluates the AI / ML model's prediction result as reliable, it sends an instruction to the terminal device to allow the use of the model. The terminal device then adds or updates the target model based on the received instruction.

[0489] In some embodiments of the present disclosure, a communication system is provided, which may include a terminal device and a network device, wherein the terminal device can execute the model testing method performed by the terminal device in the aforementioned embodiment of the present disclosure; the network device can execute the model testing method performed by the network device in the aforementioned embodiment of the present disclosure.

[0490] The embodiments of the present disclosure further provide an apparatus for implementing any of the above methods. For example, an apparatus is provided, comprising units or modules for implementing each step performed by a terminal device in any of the above methods. For another example, another apparatus is provided, comprising units or modules for implementing each step performed by a network device (e.g., an access network device, a core network function node, a core network device, etc.) in any of the above methods.

[0491] It should be understood that the division of the various units or modules in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a physical entity, or they may be physically separated. In addition, the units or modules in the device may be implemented in the form of a processor calling software: for example, the device includes a processor, the processor is connected to a memory, and the memory stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or implement the functions of the various units or modules of the above device, wherein the processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor, and the memory is a memory within the device or a memory outside the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units or modules can be realized by designing the hardware circuits. The above-mentioned hardware circuits can be understood as one or more processors; for example, in one implementation, the above-mentioned hardware circuit is an application-specific integrated circuit (ASIC), and the functions of some or all of the above units or modules are realized by designing the logical relationship of the components in the circuit; for example, in another implementation, the above-mentioned hardware circuit can be realized by a programmable logic device (PLD). Taking a field programmable gate array (FPGA) as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by configuring the configuration file, thereby realizing the functions of some or all of the above units or modules. All units or modules of the above devices can be realized in the form of software called by the processor, or in the form of hardware circuits, or in part by the form of software called by the processor, and the rest by hardware circuits.

[0492] In the embodiments of the present disclosure, the processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the above-mentioned hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.

[0493] Figure 7A is a structural diagram of a terminal device proposed in an embodiment of the present disclosure. As shown in Figure 7A, the terminal device 101 may include: at least one of a transceiver module 8101, a processing module 8102, etc. In some embodiments, the processing module 8102 is configured to use a first model to make a prediction based on the first information to obtain the predicted data; wherein the first information is information sent by the network device to the terminal device; the transceiver module 8101 is configured to send a second information, the second information includes the predicted data, and the predicted data is used to determine whether the first model meets the first condition, and the first condition is the performance requirement of the predicted data. Optionally, the transceiver module 8101 can be used to execute at least one of the communication steps such as sending and / or receiving performed by the terminal device 101 in any of the above methods (for example, step S2101, step S2102, step S2104, step S2106, but not limited to this), which will not be repeated here. Optionally, the processing module 8102 can be used to execute at least one of the other steps (such as step S2103, step S2105, step S2107, but not limited to these) performed by the terminal device 101 in any of the above methods, which will not be repeated here.

[0494] Figure 7B is a schematic diagram of the structure of a network device proposed in an embodiment of the present disclosure. As shown in Figure 7B, the network device 102 may include: at least one of a transceiver module 8201, a processing module 8202, etc. In some embodiments, the transceiver module 8201 is configured to send first information; wherein the first information is information for testing a first model; the processing module 8202 is configured to determine whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement of the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device. Optionally, the transceiver module 8201 can be used to perform at least one of the communication steps such as sending and / or receiving performed by the network device 102 in any of the above methods (for example, step S2101, step S2102, step S2104, step S2106, but not limited thereto), which will not be repeated here. Optionally, the processing module 8202 can be used to execute at least one of the other steps (such as step S2103, step S2105, step S2107, but not limited to these) performed by the network device 102 in any of the above methods, which will not be repeated here.

[0495] In some embodiments, the transceiver module may include a transmitting module and / or a receiving module, and the transmitting module and the receiving module may be separate or integrated. Optionally, the transceiver module may be interchangeable with the transceiver.

[0496] In some embodiments, the processing module can be a single module or can include multiple submodules. Optionally, the multiple submodules respectively execute all or part of the steps required to be executed by the processing module. Optionally, the processing module can be interchangeable with the processor.

[0497] Figure 8A is a schematic diagram of the structure of a communication device 9100 proposed in an embodiment of the present disclosure. Communication device 9100 can be a network device (e.g., an access network device, a core network device, etc.), or a terminal device (e.g., a user device, etc.), or a chip, chip system, or processor that supports a network device to implement any of the above methods, or a chip, chip system, or processor that supports a terminal device to implement any of the above methods. Communication device 9100 can be used to implement the methods described in the above method embodiments. For details, please refer to the description of the above method embodiments.

[0498] As shown in FIG8A , the communication device 9100 includes one or more processors 9101. The processor 9101 may be a general-purpose processor or a dedicated processor, for example, a baseband processor or a central processing unit. The baseband processor may be used to process communication protocols and communication data, and the central processing unit may be used to control a communication device (e.g., a base station, a baseband chip, a terminal device, a terminal device chip, a DU or a CU, etc.), execute programs, and process program data. The communication device 9100 is used to perform any of the above methods.

[0499] In some embodiments, the communication device 9100 further includes one or more memories 9102 for storing instructions. Optionally, all or part of the memories 9102 may be located outside the communication device 9100.

[0500] In some embodiments, the communication device 9100 further includes one or more transceivers 9103. When the communication device 9100 includes one or more transceivers 9103, the transceiver 9103 performs at least one of the communication steps such as sending and / or receiving in the above method (for example, step S2101, step S2102, step S2104, step S2106, but not limited thereto), and the processor 9101 performs at least one of the other steps (for example, step S2103, step S2105, step S2107, but not limited thereto).

[0501] In some embodiments, a transceiver may include a receiver and / or a transmitter. The receiver and transmitter may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, and transceiver circuit may be used interchangeably; the terms transmitter, transmitting unit, transmitter, and transmitting circuit may be used interchangeably; and the terms receiver, receiving unit, receiver, and receiving circuit may be used interchangeably.

[0502] In some embodiments, the communication device 9100 may include one or more interface circuits. Optionally, the interface circuits are connected to the memory 9102 and may be used to receive signals from the memory 9102 or other devices, or to send signals to the memory 9102 or other devices. For example, the interface circuits may read instructions stored in the memory 9102 and send the instructions to the processor 9101.

[0503] The communication device 9100 described in the above embodiments may be a network device or a terminal device, but the scope of the communication device 9100 described in the present disclosure is not limited thereto, and the structure of the communication device 9100 may not be limited by FIG. 8A. The communication device may be an independent device or may be part of a larger device. For example, the communication device may be: 1) an independent integrated circuit IC, or a chip, or a chip system or subsystem; (2) a collection of one or more ICs, optionally, the above IC collection may also include a storage component for storing data or programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, a terminal device, an intelligent terminal device, a cellular phone, a wireless device, a handheld device, a mobile unit, an in-vehicle device, a network device, a cloud device, an artificial intelligence device, etc.; (6) others, etc.

[0504] FIG8B is a schematic diagram of the structure of the chip 9200 proposed in an embodiment of the present disclosure. If the communication device 9100 can be a chip or a chip system, please refer to the schematic diagram of the structure of the chip 9200 shown in FIG8B, but the present disclosure is not limited thereto.

[0505] The chip 9200 includes one or more processors 9201 , and the chip 9200 is configured to execute any of the above methods.

[0506] In some embodiments, the chip 9200 further includes one or more interface circuits 9203. Optionally, the interface circuit 9203 is connected to the memory 9202. The interface circuit 9203 can be used to receive signals from the memory 9202 or other devices, and can be used to send signals to the memory 9202 or other devices. For example, the interface circuit 9203 can read instructions stored in the memory 9202 and send the instructions to the processor 9201.

[0507] In some embodiments, the interface circuit 9203 executes at least one of the communication steps such as sending and / or receiving in the above method (for example, step S2101, step S2102, step S2104, step S2106, but not limited to these), and the processor 9201 executes at least one of the other steps (for example, step S2103, step S2105, step S2107, but not limited to these).

[0508] In some embodiments, terms such as interface circuit, interface, transceiver pin, and transceiver may be used interchangeably.

[0509] In some embodiments, the chip 9200 further includes one or more memories 9202 for storing instructions. Alternatively, all or part of the memory 9202 may be located outside the chip 9200.

[0510] The embodiments of the present disclosure further provide a storage medium having instructions stored thereon. When the instructions are executed on the communication device 9100, the communication device 9100 executes any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but is not limited thereto and may also be a storage medium readable by other devices. Optionally, the storage medium may be a non-transitory storage medium, but is not limited thereto and may also be a temporary storage medium.

[0511] The embodiments of the present disclosure further provide a program product, which, when executed by the communication device 9100, enables the communication device 9100 to perform any of the above methods. Optionally, the program product may be a computer program product.

[0512] The embodiments of the present disclosure also provide a computer program, which, when executed on a computer, enables the computer to execute any one of the above methods.

Claims

1. A model testing method, characterized in that: The method comprises: Determine whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement for the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

2. The method according to claim 1, characterized in that The method further comprises: Receive second information sent by the terminal device, where the second information includes the prediction data.

3. The method according to claim 1, characterized in that The method further comprises: Sending third information to the terminal device; the third information is used to indicate whether the first model can be used by the terminal device.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: receiving fourth information; wherein the fourth information is used to trigger the network device to send first information, and the fourth information includes a first model identifier of the first model; Determine, according to the fourth information, that the first model meets the test start condition, and send the first information to the terminal device.

5. The method according to claim 4, characterized in that The test initiation condition includes at least one of the following: The first model has not been tested; The first model is not in the model management set; the model management set includes models that have been tested; The fourth information is used to instruct execution of the test of the first model.

6. The method according to claim 4 or 5, characterized in that: The fourth information includes at least one of the following: Model update indication information; Model adds instruction information; Model testing instructions.

7. The method according to any one of claims 1 to 6, characterized in that The first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device; The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

8. The method according to any one of claims 1 to 6, characterized in that The first model is a model for performing beam prediction, and the prediction data includes a second beam satisfying a signal condition obtained by the beam prediction; The signal condition includes at least one of the following: The signal quality of the second beam is greater than or equal to a preset signal quality threshold; The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

9. The method according to claim 8, characterized in that The first condition is that the number of times the prediction success condition is satisfied in the N beam predictions performed is greater than or equal to M; wherein N is a natural number, and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam that satisfies the signal condition obtained by performing beam prediction; The third beam is a beam that satisfies the signal condition and is determined by the network device according to the beam configuration information; or, the third beam is a beam that satisfies the signal condition and is determined according to second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

10. The method according to any one of claims 7 to 9, characterized in that The signal quality includes at least one of the following: RSRP, SINR, RSSI, and RSRQ.

11. The method according to any one of claims 1 to 12, characterized in that The first information includes at least one of the following: first data for testing the first model; A first signal is used to test the first model.

12. A model testing method, characterized in that: The method comprises: Using the first model, making predictions based on first information to obtain the prediction data; wherein the first information is information sent by the network device to the terminal device; Sending second information, wherein the second information includes the prediction data, and the prediction data is used to determine whether the first model satisfies a first condition, wherein the first condition is a performance requirement of the prediction data.

13. The method according to claim 12, characterized in that The method further comprises: receiving the first information; The using the first model to make a prediction based on the first information to obtain the prediction data includes: measuring the first information to obtain the first measurement data; The first measurement data is input into the first model to obtain the predicted data output by the first model.

14. The method according to claim 12 or 13, characterized in that The method further comprises: receiving third information; the third information is used to indicate whether the first model can be used by the terminal device; It is determined whether the first model can be used according to the third information.

15. The method according to any one of claims 12 to 14, characterized in that The method further comprises: Sending fourth information; wherein the fourth information is used to trigger the network device to send first information, and the fourth information includes a first model identifier of the first model.

16. The method according to claim 15, characterized in that The fourth information includes at least one of the following: Model update indication information; Model adds instruction information; Model testing instructions.

17. The method according to any one of claims 12 to 16, characterized in that The first model is a model for performing beam prediction, the prediction data includes a predicted signal quality of a first beam, and the first beam is at least one beam configured by the network device for the terminal device; The first condition includes that the difference between the predicted signal quality and the first signal quality is within a first difference range; wherein, the first signal quality is the signal quality of the first beam generated by the network device according to the beam configuration information, or the first signal quality is the signal quality of the first beam actually measured by the terminal device.

18. The method according to any one of claims 12 to 16, characterized in that The first model is a model for performing beam prediction, and the prediction data includes a second beam satisfying a signal condition obtained by the beam prediction; The signal condition includes at least one of the following: The signal quality of the second beam is greater than or equal to a preset signal quality threshold; The second beam is a beam with the strongest signal quality among multiple beams configured by the network device for the terminal device.

19. The method according to claim 18, characterized in that The first condition is that the number of times the prediction success condition is satisfied in the N beam predictions performed is greater than or equal to M; wherein N is a natural number, and M is a natural number less than or equal to N; the prediction success condition is that the second beam is the same as the third beam, and the second beam is a beam that satisfies the signal condition obtained by performing beam prediction; The third beam is a beam that satisfies the signal condition and is determined by the network device according to the beam configuration information; or, the third beam is a beam that satisfies the signal condition and is determined according to second measurement data, and the second measurement data is data obtained by the terminal device after measuring multiple beams configured by the network device to the terminal device.

20. The method according to any one of claims 17 to 19, characterized in that The signal quality includes at least one of the following: RSRP, SINR, RSSI, and RSRQ.

21. The method according to any one of claims 12 to 20, characterized in that The first information includes at least one of the following: first data for testing the first model; A first signal is used to test the first model.

22. A model testing method, characterized in that: The method comprises: The terminal device uses the first model to make predictions based on the first information to obtain the prediction data; wherein the first information is information sent by the network device to the terminal device; The terminal device sends second information to the network device, where the second information includes the prediction data, where the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data; The network device determines whether the predicted data output by the first model meets the first condition; wherein the predicted data is data obtained by the first model based on the first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

23. A network device, characterized in that: include: A processing module is configured to determine whether the predicted data output by the first model meets a first condition; wherein the first condition is a performance requirement for the predicted data, the predicted data is data predicted by the first model based on first measurement data, the first measurement data is data obtained after the terminal device measures the first information, and the first information is information sent by the network device to the terminal device.

24. A terminal device, characterized in that: include: A processing module is configured to use a first model to make a prediction based on first information to obtain the prediction data; wherein the first information is information sent by the network device to the terminal device; The transceiver module is configured to send second information, where the second information includes the prediction data, and the prediction data is used to determine whether the first model meets a first condition, where the first condition is a performance requirement of the prediction data.

25. A network device, characterized in that: include: one or more processors; Wherein, the terminal device is used to execute the model testing method described in any one of claims 1 to 11.

26. A terminal device, characterized in that: include: one or more processors; Wherein, the network device is used to execute the model testing method described in any one of claims 12 to 21.

27. A communication system, characterized in that: The communication system includes a terminal device and a network device, wherein the network device is configured to implement the model testing method described in any one of claims 1 to 11, and the terminal device is configured to implement the model testing method described in any one of claims 12 to 21.

28. A storage medium storing instructions, characterized in that: When the instruction is executed on a communication device, the communication device is caused to execute the model testing method according to any one of claims 1 to 11 or claims 12 to 21.

Citation Information

Patent Citations

  • Model testing method and device

    CN115827337A

  • Communication processing method and device, communication equipment and storage medium

    CN115836541A

  • Communication method and device

    CN116193585A

  • Method and system for free space optical communication performance prediction

    US20220085878A1

Cited By

  • Information processing method and apparatus, device, storage medium, and program product

    WO2026170573A1