Communication method, apparatus, and system

Abstract

Embodiments of the present application provide a communication method, apparatus, and system. The method comprises: a first network element sends first information, wherein the first information at least comprises a data distribution evaluation indicator, the first information is used for requesting to acquire data, and the data distribution evaluation indicator is used for evaluating the requested data; and the first network element further receives second information, wherein the second information comprises a target data set. In the example, the first network element (a data consumer) provides a sample distribution evaluation indicator of a required data set, so that the obtained target data set satisfies the data distribution evaluation indicator, thereby preventing the data consumer from obtaining a data set that does not satisfy an indicator distribution requirement.

Description

Communication method and device, system

[0001] The present application claims priority to the Chinese patent application No. 202411311105.9, filed on September 19, 2024, with the State Intellectual Property Office of China, and the Chinese patent application No. 202411311105.9 has the invention name of “Communication method and device, system”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the field of communication technology, in particular to a communication method and device, system. BACKGROUND

[0003] Data set bias refers to that the training data is different from the test data actually faced by the user in distribution. When the data set has bias, the trained model may show inclination to some categories or opinions and ignore other types or opinions, and such bias may lead to unfair or misleading results of model reasoning.

[0004] The current mobile communication network also has scenarios of data set bias. Taking the training of a service experience model supported by the network as an example, when the network data analytics function (NWDAF) trains the service experience model, the NWDAF cannot collect data in the entire network due to a large network coverage area and a large number of users. Therefore, the NWDAF can collect data of user equipment (UE) in a certain area, and train a service experience model applicable to the entire network based on the data collected in the area. When the NWDAF collects data from the selected area, if the data in the area has bias and cannot reflect the overall situation of the network, the service experience model will have performance bias. Therefore, when collecting data, how to avoid bias in the collected data set is a problem to be solved when training the model. SUMMARY

[0005] The present application discloses a communication method and device, system, which can avoid that the data consumer obtains a data set that does not meet the index distribution requirements.

[0006] In a first aspect, an embodiment of the present application provides a communication method. The method can be applied to a core network side, for example, a core network element or a module (such as a circuit, a chip or a chip system, etc.) in the core network element, or a logic node, a logic module or software capable of realizing all or part of the function of the core network element. Taking the case where the method is applied to a core network device, in the method, a core network element (which can be referred to as a first network element) sends first information, the first information at least including a data distribution evaluation index, and the first information is used to request to obtain data. The data distribution evaluation index is used to evaluate the requested data. The core network element also receives second information, the second information including a target data set.

[0007] In an embodiment of the present application, the core network element sends the first information, the first information at least including the data distribution evaluation index. In this way, by providing the sample distribution evaluation index of the required data set, the obtained target data set meets the data distribution evaluation index, and the data consumer avoids obtaining a data set that does not meet the index distribution requirement.

[0008] The data distribution evaluation index refers to an evaluation dimension corresponding to one or more evaluation indexes for evaluating the data set.

[0009] In a possible implementation, the data distribution evaluation index includes one or more of the following: data distribution evaluation based on a data network name (DNN), data distribution evaluation based on an application, data sample distribution evaluation based on a cell or a tracking area, data sample distribution evaluation based on a packet data unit (PDU) session type, data sample distribution evaluation based on a quality of service (QoS) level, data sample distribution evaluation based on a slice, and data sample distribution evaluation based on a service experience.

[0010] In a possible implementation, the core network element also receives third information, the third information including a data evaluation report.

[0011] In a possible implementation, based on the data evaluation report, the core network element sends fourth information, the fourth information indicating data obtaining strategy information.

[0012] In a possible implementation, the first information further includes one or more of the following: a data evaluation method, report indication information and data distribution requirement information, wherein the target data set is associated with the first information.

[0013] The data evaluation method refers to whether the data consumer needs the data collection network element to jointly evaluate multiple indexes or to evaluate each index respectively when the data distribution evaluation index includes multiple indexes.

[0014] In a possible implementation, the data evaluation method comprises one or more of the following: jointly evaluating a plurality of indicators in the data distribution evaluation indicators, respectively evaluating each of the indicators in the data distribution evaluation indicators.

[0015] The target data set is associated with the data evaluation method, that is, the target data set is obtained based on the data evaluation method.

[0016] In a possible implementation, the report indication information indicates a sending rule of the data evaluation report. For example, the report indication information indicates that a data collection network element such as a data collection coordination function (DCCF) sends the data evaluation report of the data set collected this time to a data consumer before sending data. Of course, it can also be defaulted that when the data distribution indication is included in the data collection request, the data collection network element sends the data evaluation report to the data consumer first.

[0017] The target data set is associated with the report indication information, that is, the target data set is obtained based on the report indication information.

[0018] The data distribution requirement information refers to the distribution requirement that needs to be met by each indicator for data evaluation. In a possible implementation, the data distribution requirement information comprises one or more of the following: the data distribution meets uniform distribution or normal distribution, a ratio threshold of a maximum sample number and a minimum sample number in the data distribution, a maximum sample number threshold in the data distribution, and a minimum sample number threshold in the data distribution.

[0019] The target data set is associated with the data distribution requirement information, that is, the target data set meets (complies with) the data distribution requirement information.

[0020] In a second aspect, an embodiment of the present application provides a communication method. The method can be applied to a data evaluation network element, and in the method, the data evaluation network element receives first information, the first information at least comprising data distribution evaluation indicators, the first information being used for requesting to obtain data, and the data distribution evaluation indicators being used for evaluating the requested data. The data evaluation network element obtains an initial data set, and obtains a target data set based on the first information and the initial data set. The data evaluation network element also sends second information, the second information comprising the target data set.

[0021] In this way, by providing the sample distribution evaluation indicators of the required data set, the target data set obtained by the data evaluation network element meets the data distribution evaluation indicators, and the data consumer avoids obtaining a data set that does not meet the distribution requirement of the indicators.

[0022] In a possible implementation, the data distribution evaluation index includes one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service (QoS) level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

[0023] In a possible implementation, the data evaluation network element further sends third information, where the third information includes a data evaluation report obtained by evaluating the initial data set based on one or more of the data distribution evaluation indexes.

[0024] In a possible implementation, the data evaluation network element further receives fourth information, where the fourth information indicates data acquisition strategy information.

[0025] In a possible implementation, the first information further includes one or more of the following: a data evaluation method, report indication information, and data distribution requirement information, where the target data set is associated with the first information.

[0026] In a possible implementation, the data evaluation method includes one or more of the following: joint evaluation of multiple indexes in the data distribution evaluation index and separate evaluation of each index in the data distribution evaluation index.

[0027] In a possible implementation, the report indication information indicates a sending rule of the data evaluation report.

[0028] In a possible implementation, the data distribution requirement information includes one or more of the following: that the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum number of samples to a minimum number of samples in the data distribution, a maximum threshold of the number of samples in the data distribution, and a minimum threshold of the number of samples in the data distribution.

[0029] In a third aspect, a communication apparatus is provided, which has the functions of the first aspect, for example, the communication apparatus includes modules or units or means corresponding to the operations of the first aspect, which can be implemented by software, or by hardware, or by a combination of software and hardware.

[0030] In one implementation, the communication apparatus includes a communication module, configured to send first information, where the first information at least includes a data distribution evaluation index, and the first information is used to request data acquisition, and the data distribution evaluation index is used to evaluate the requested data.

[0031] The communication module is further configured to receive second information, and the second information comprises a target data set.

[0032] In a possible implementation, the data distribution evaluation index comprises one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service (QoS) level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

[0033] In a possible implementation, the communication module is further configured to receive third information, and the third information comprises a data evaluation report.

[0034] In a possible implementation, the communication module is further configured to send fourth information based on the data evaluation report, and the fourth information indicates data acquisition strategy information.

[0035] In a possible implementation, the first information further comprises one or more of the following: a data evaluation method, report indication information, and data distribution requirement information, wherein the target data set is associated with the first information.

[0036] In a possible implementation, the data evaluation method comprises one or more of the following: joint evaluation of multiple indexes in the data distribution evaluation index, and separate evaluation of each index in the data distribution evaluation index.

[0037] In a possible implementation, the report indication information indicates a sending rule of the data evaluation report.

[0038] In a possible implementation, the data distribution requirement information comprises one or more of the following: the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum sample number and a minimum sample number in the data distribution, a maximum threshold of the sample number in the data distribution, and a minimum threshold of the sample number in the data distribution.

[0039] In a fourth aspect, the present application further provides a communication device, which has the functions of the second aspect, for example, the communication device comprises a module or unit or means corresponding to the operations of the second aspect, which can be implemented by software, or by hardware, or by a combination of software and hardware.

[0040] In one implementation, the communication device comprises a communication module configured to receive first information, and the first information at least comprises a data distribution evaluation index, and the first information is used to request data acquisition, and the data distribution evaluation index is used to evaluate the requested data;

[0041] The processing module is configured to obtain an initial data set, and obtain a target data set based on the first information and the initial data set.

[0042] The communication module is further configured to send second information, the second information comprising the target data set.

[0043] In a possible implementation, the data distribution evaluation indicators comprise one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service (QoS) level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

[0044] In a possible implementation, the communication module is further configured to send third information, the third information comprising a data evaluation report obtained by evaluating the initial data set based on one or more of the data distribution evaluation indicators.

[0045] In a possible implementation, the communication module is further configured to receive fourth information, the fourth information indicating data acquisition strategy information.

[0046] In a possible implementation, the first information further comprises one or more of the following: a data evaluation method, report indication information, and data distribution requirement information, wherein the target data set is associated with the first information.

[0047] In a possible implementation, the data evaluation method comprises one or more of the following: joint evaluation of multiple indicators in the data distribution evaluation indicators, and separate evaluation of each indicator in the data distribution evaluation indicators.

[0048] In a possible implementation, the report indication information indicates a sending rule of the data evaluation report.

[0049] In a possible implementation, the data distribution requirement information comprises one or more of the following: the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum number of samples to a minimum number of samples in the data distribution, a maximum threshold of the number of samples in the data distribution, and a minimum threshold of the number of samples in the data distribution.

[0050] In a fifth aspect, the present application provides a communication apparatus, comprising a processor configured to cause the apparatus to perform the method provided in any possible implementation of the first aspect to the second aspect by executing computer programs or computer executable instructions stored in a memory and / or by a logic circuit.

[0051] In a possible implementation, the apparatus further includes a memory. Optionally, the memory and the processor can be integrated together.

[0052] In a possible implementation, the apparatus further includes an interface circuit.

[0053] In a possible implementation, the apparatus is a chip or a chip system.

[0054] In a sixth aspect, the present application provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the method provided in any possible implementation of the first aspect or the second aspect.

[0055] In a seventh aspect, the present application provides a computer program product, which, when executed on a computer, causes the computer to perform the method provided in any possible implementation of the first aspect or the second aspect.

[0056] It can be understood that the apparatus provided in the third aspect, the apparatus provided in the fourth aspect, the apparatus provided in the fifth aspect, the computer readable storage medium provided in the sixth aspect, or the computer program product provided in the seventh aspect are all used to execute the method provided in any of the first aspect or the second aspect. Therefore, the beneficial effects that can be achieved are referred to the beneficial effects in the corresponding method, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0057] The drawings used by the embodiments of the present application are described below.

[0058] FIG. 1 is a schematic diagram of a communication system provided by an embodiment of the present application;

[0059] FIG. 2a is a schematic diagram of a non-roaming architecture based on a service interface of a fifth generation mobile communication network;

[0060] FIG. 2b is a schematic diagram of an architecture for supporting data collection coordination and data storage defined in a network data analytics standard in a 5G;

[0061] FIG. 2c is a schematic diagram of an architecture for data storage processing in a future communication system;

[0062] FIG. 3 is a schematic diagram of a communication method provided by an embodiment of the present application;

[0063] FIGS. 4-7 are schematic diagrams of a communication method provided by an embodiment of the present application;

[0064] FIGS. 8-9 are schematic diagrams of a structure of a communication apparatus provided by an embodiment of the present application;

[0065] FIG. 10 is a schematic diagram of another communication apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0066] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation manner part of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0067] Figure 1 shows a possible, non-limiting system schematic diagram. As shown in Figure 1, the communication system 1000 includes a radio access network (RAN) 100 and a core network (CN) 200. Optionally, it also includes the Internet 300. The RAN 100 includes at least one RAN node (such as 110a and 110b in Figure 1, collectively referred to as 110) and at least one terminal (such as 120a-120j in Figure 1, collectively referred to as 120). Other RAN nodes, such as wireless relay devices and / or wireless backhaul devices (not shown in Figure 1), etc., can also be included in the RAN 100. The terminal 120 is connected to the RAN node 110 in a wireless manner. The RAN node 110 is connected to the core network 200 in a wireless or wired manner. The core network device in the core network 200 and the RAN node 110 in the RAN 100 can be different physical devices respectively, or can be the same physical device integrated with the core network logical function and the radio access network logical function.

[0068] The RAN 100 can be a 3rd generation partnership project (3GPP) related cellular system, such as a 4G, 5G mobile communication system, or an evolved system after 5G (such as a 6th generation (6G) mobile communication system). The RAN 100 can also be an open radio access network (O-RAN or ORAN), a cloud radio access network (CRAN), or a wireless-fidelity (Wi-Fi) system based on IEEE 802.11 standards. The RAN 100 can also be a communication system in which two or more of the above systems are fused.

[0069] The RAN node 110, which can also be referred to as an access network device, a RAN entity, or an access node, etc., forms part of the communication system, and is configured to facilitate wireless access to the communication system for terminals. The RAN nodes 110 in the communication system 1000 can be of the same type or different types. In some scenarios, the roles of the RAN node 110 and the terminal 120 are relative, e.g., the network element 120i in Figure 1 can be a helicopter or a drone, which can be configured to move as a mobile base station, and for a terminal 120j accessing the RAN 100 via the network element 120i, the network element 120i is a base station; but for the base station 110a, the network element 120i is a terminal. Both the RAN node 110 and the terminal 120 are sometimes referred to as communication devices, e.g., the network elements 110a and 110b in Figure 1 can be understood as communication devices with base station functionalities, and the network elements 120a-120j can be understood as communication devices with terminal functionalities.

[0070] In a possible scenario, the RAN node can be a base station, an evolved NodeB (eNodeB), an access point (AP), a transmission reception point (TRP), a next generation NodeB (gNB), a next generation base station in a 6G mobile communication system, a base station in a future mobile communication system, or an access node in a WiFi system, etc. The RAN node can be a macro base station (e.g., 110a in Figure 1), a micro base station or an indoor station (e.g., 110b in Figure 1), a relay node or a donor node, or a wireless controller in a CRAN scenario. Optionally, the RAN node can also be a server, a wearable device, a vehicle or a vehicle-mounted device, etc. For example, the access network device in a vehicle to everything (V2X) technology can be a road side unit (RSU).

[0071] In another possible scenario, a terminal is assisted by multiple RAN nodes to implement wireless access, and different RAN nodes respectively implement part of functions of a base station. For example, a RAN node can be a central unit (CU), a distributed unit (DU), a CU-control plane (CP), a CU-user plane (UP), or a radio unit (RU), etc. The CU and the DU can be separately arranged, or can also be included in the same network element, for example, in a baseband unit (BBU). The RU can be included in a radio frequency device or a radio frequency unit, for example, included in a remote radio unit (RRU), an active antenna processing unit (AAU), or a remote radio head (RRH).

[0072] In different systems, the CU (or CU-CP and CU-UP), DU or RU can also have different names, but those skilled in the art can understand their meanings. For example, in an ORAN system, the CU can also be referred to as an O-CU (open CU), the DU can also be referred to as an O-DU, the CU-CP can also be referred to as an O-CU-CP, the CU-UP can also be referred to as an O-CU-UP, and the RU can also be referred to as an O-RU. For the convenience of description, the CU, CU-CP, CU-UP, DU and RU are taken as examples for description in this application. Any one of the CU (or CU-CP, CU-UP), DU and RU in this application can be implemented by a software module, a hardware module, or a combination of a software module and a hardware module.

[0073] The terminal can also be referred to as a terminal device, user equipment (UE), mobile station, mobile terminal, etc. The terminal can be widely applied to various scenarios, such as device-to-device (D2D), vehicle to everything (V2X) communication, machine-type communication (MTC), internet of things (IoT), virtual reality (VR) device, augmented reality (AR) device, industrial control, automatic driving, remote medical treatment, smart power grid, smart furniture, smart office, smart wear, smart transportation, smart city, etc. The terminal can be a mobile phone, tablet computer, computer with wireless transceiver function, wearable device, vehicle, unmanned aerial vehicle, helicopter, airplane, ship, robot, mechanical arm, smart home device, light terminal device (light UE), reduced capability user equipment (REDCAP UE), smart point of sale (POS) machine, customer-premises equipment (CPE), etc. The terminal can also be a vehicle device, such as a whole vehicle device, vehicle-mounted module, vehicle-mounted chip, on board unit (OBU), or telematics box (T-BOX), etc. Embodiments of the present application do not limit the device form of the terminal.

[0074] The communication between the access network device and the terminal device complies with a certain protocol layer structure. The protocol layer can include a control plane protocol layer and a user plane protocol layer. The control plane protocol layer can include at least one of a radio resource control (RRC) layer, a packet data convergence protocol (PDCP) layer, a radio link control (RLC) layer, a media access control (MAC) layer, or a physical (PHY) layer, etc. The user plane protocol layer can include at least one of a service data adaptation protocol (SDAP) layer, a PDCP layer, an RLC layer, a MAC layer, or a physical layer, etc.

[0075] For network elements in the ORAN system, the corresponding relationship of the protocol layer functions that can be implemented by the network elements is shown in Table 1:

[0076] Table 1

[0077] The base stations and terminals can be fixed in position or mobile. The base stations and terminals can be deployed on land, including indoors or outdoors, handheld or vehicle-mounted; can be deployed on water surface; can also be deployed on airplanes, balloons and artificial satellites. Embodiments of the present application do not limit the application scenarios of the base stations and terminals.

[0078] The roles of the base stations and terminals can be relative, for example, the helicopter or drone 120i in FIG. 1 can be configured as a mobile base station, and for those terminals 120j accessing the wireless access network 100 through 120i, the terminal 120i is a base station; but for the base station 110a, 120i is a terminal, that is, 110a and 120i communicate through a wireless air interface protocol. Of course, 110a and 120i can also communicate through a base station-to-base station interface protocol, at this time, relative to 110a, 120i is also a base station. Therefore, the base stations and terminals can be collectively referred to as communication devices, 110a and 110b in FIG. 1 can be referred to as communication devices with base station functions, and 120a-120j in FIG. 1 can be referred to as communication devices with terminal functions.

[0079] In embodiments of the present application, the base station is also referred to as an access network device, and the device for implementing the functions of the access network device can be an access network device; can also be a device capable of supporting the access network device to implement the functions, such as a chip system, a hardware circuit, a software module, or a hardware circuit plus a software module. The device can be installed in the access network device or used in conjunction with the access network device. In embodiments of the present application, only the device for implementing the functions of the access network device is taken as an example to illustrate the access network device, and the scheme of the embodiments of the present application is not limited.

[0080] It can be understood that the present application can be applied between the access network device and the terminal.

[0081] It should be understood that the number and type of devices in the communication system shown in FIG. 1 are only illustrative, and the present application is not limited thereto. In actual applications, more terminals, more access network devices, and other network elements, such as core network devices and / or network elements for implementing artificial intelligence functions, can also be included in the communication system.

[0082] It can be understood that all or part of the functions implemented by one or more of the terminal, the access network device, the core network device, or the network element for implementing the artificial intelligence function can be virtualized, that is, implemented by one or more of a special processor or a general processor and a corresponding software module. Among them, the terminal and the access network device involve the interface of air interface transmission, and the transceiving function of the interface can be implemented by hardware. The core network device, such as the operation administration and maintenance (OAM) network element, can be virtualized. Optionally, one or more functions of the virtualized terminal, access network device, core network device, or network element for implementing the artificial intelligence function can be implemented by a cloud device, such as a cloud device in an over the top (OTT) system.

[0083] In the present application, "sending information to (for example, a terminal)" or related illustrations in the drawings can be understood as that the destination of the information is the terminal. It can include direct or indirect sending of information to the terminal. "Receiving information from (for example, a terminal)" or "receiving information from (for example, a terminal)", or related illustrations in the drawings can be understood as that the source of the information is the terminal, and can include direct or indirect receiving of information from the terminal. The information can be processed as necessary between the source and the destination of the information, such as format change, etc., but the destination can understand the valid information from the source. Similar expressions in the present application can be similarly understood, and will not be repeated here.

[0084] The communication system to which the present application is applicable will be introduced below in detail taking the non-roaming architecture based on the service interface of the fifth generation mobile communication network shown in FIG. 2a as an example. The communication system mainly includes an access and mobility management function (AMF), a session management function (SMF), a user plane function (UPF), a network exposure function (NEF), and an application function (AF). It can also include a policy control function (PCF) entity, a unified data repository function (UDR) entity (not shown in the figure), and a unified data management (UDM) function entity.

[0085] Among them, the functions of each functional entity in FIG. 2a are as follows:

[0086] AMF: mainly responsible for processing of signaling, for example: access control, mobility management. Mainly includes the termination of Non-Acess-Stratum (NAS) signaling security, the registration of users, reachability, mobile signal management, N1 / N2 interface signaling transmission, access authentication and authorization, etc.

[0087] SMF: mainly responsible for session management, specifically responsible for selection of user plane function entities, redirection of user plane function entities, internet protocol (IP) address allocation, establishment, modification and release of bearers, and control of quality of service (QoS).

[0088] UPF: responsible for forwarding and receiving user data in the terminal. User data can be received from a data network and transmitted to a terminal through an access network device; it can also receive user data from a terminal through an access network device and forward it to a data network. The transmission resources and scheduling functions provided by the UPF entity for the terminal are managed and controlled by the SMF entity.

[0089] NEF: mainly supports secure interaction between 3GPP networks and third-party applications. NEF can securely expose network capabilities and events to third-party applications to enhance or improve application quality of service. 3GPP networks can also securely obtain relevant data from third-party applications to enhance network intelligent decision-making; at the same time, this functional entity supports the recovery of structured data from UDR or the storage of structured data in UDR.

[0090] AF: mainly supports interaction with 3GPP networks to provide services, such as influencing data routing decisions, policy control functions, or providing some business services to the network side (these services can be third-party (3rd party) or not).

[0091] PCF: mainly supports providing a unified policy framework to control network behavior, providing policy rules to control layer network functions, and being responsible for obtaining user subscription information related to policy decision.

[0092] UDR: mainly responsible for storing structured data, including subscription data and policy data, externally exposed structured data, and application-related data.

[0093] UDM: mainly used for managing user subscription information.

[0094] It should be noted that the above functional entities are only names, and the names themselves do not constitute a limitation on the entities. For example, the session management function entity can also be replaced by "session management function" or other names. Moreover, the session management function entity can also correspond to an entity that includes functions other than the session management function. The user plane function entity can also be replaced by "user plane function" or other names, and the user plane function entity can also correspond to an entity that includes functions other than the user plane function. A unified description is made here, and the following will not be repeated.

[0095] The user equipment accesses the network through the RAN node or the access network (AN) node. The RAN node is mainly a wireless network device in the 3GPP network, and the AN can be an access network device defined by non-3GPP.

[0096] As shown in FIG. 2b, it is a schematic diagram of a data collection coordination and data storage architecture defined in the network data analysis standard in 5G. In this architecture, the data consumer collects data through the DCCF and stores the data in the ADRF.

[0097] As shown in FIG. 2c, it is a schematic diagram of a data storage processing architecture in a future communication system. As shown in FIG. 2c, there can be network elements for data processing and data storage. The data processing is completed by one or more data processing network elements DCCF. The data storage is implemented by one or more ADRFs.

[0098] The network elements involved in the present application are introduced as follows.

[0099] NWDAF: a network element that provides data analysis functions for 5G core network (5GC) network functions (NFs) and OAM. The 5GC NF or OAM can request network data analysis results from the NWDAF, the NWDAF collects data from related network elements and trains AI models after receiving the request, and finally uses the AI model for data reasoning and feeds back the reasoning result to the corresponding 5GC NF or OAM. According to the different functions, the NWDAF can be divided into a NWDAF supporting training (i.e., a NWDAF model training logical function (MTLF)) and a NWDAF supporting reasoning (i.e., a NWDAF analytics logical function (AnLF)), and the NWDAF (AnLF) can request artificial intelligence (AI) model information from the NWDAF (MTLF) for data reasoning.

[0100] Data Collection Coordination Function, DCCF: A function for coordinating the collection and distribution of data requested by NF consumers, and also having the function of pre-processing the collected data according to the parameters specified by the data consumers, etc.

[0101] Analytics Data Repository Function, ADRF: A function for storing data and storing models.

[0102] NF: A general term for network element functions, including AMF, SMF, etc.

[0103] Data Management Function, DMF: A network element mainly used for centralized data management and authorization, responsible for centralized network data management and data service opening.

[0104] The architecture of the embodiments of the present application is described above, and the method of the embodiments of the present application is described in detail below.

[0105] Referring to FIG. 3, it is a flowchart of a communication method according to an embodiment of the present application. Optionally, the method can be applied to the communication system described above, such as the communication system shown in FIG. 1. The communication method shown in FIG. 3 can include steps 301-302. Steps 301-302 are as follows:

[0106] 301. The first network element sends first information to the second network element, the first information including at least a data distribution evaluation indicator, the first information being used to request data. Correspondingly, the second network element receives the first information.

[0107] In one possible implementation, the first network element can be a NWDAF (hereinafter referred to as a data consumer) network element. The second network element can be a data evaluation network element, such as a DCCF or an ADRF, etc.

[0108] The data distribution evaluation indicator refers to the evaluation dimension corresponding to one or more evaluation indicators for evaluating a data set. That is, the data distribution evaluation indicator is used to evaluate the requested data.

[0109] The data distribution evaluation indicators are introduced below. In a possible implementation, the data distribution evaluation indicators include one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

[0110] For example, DNN-based data distribution evaluation (DNN-based data distribution): The DNN-based data distribution evaluation indicates that the second network element (a data collection network element DCCF described below) is requested to evaluate the sample data in the collected data set according to the dimension of the DNN.

[0111] Application-based data distribution evaluation (application-based data distribution): The application-based data distribution evaluation indicates that the data collection network element is requested to evaluate the sample data in the collected data set according to the dimension of the application. When the data in the collected data set involves multiple applications, the data consumer considers that the data in the data set should meet the corresponding distribution on each application, and can request the data collection network element to evaluate the data in the data set according to the granularity of the application.

[0112] Cell or tracking area (TA)-based data sample distribution evaluation (cell / TA-based data distribution): The cell / TA-based data sample distribution evaluation indicates that the data collection network element is requested to evaluate the sample data in the collected data set according to the dimension of the cell / TA. When the data in the collected data set covers multiple cells or tracking areas, if the data consumer considers that the data in the data set needs to meet certain distribution requirements on different areas, the data collection network element can be requested to evaluate the data according to the dimension of the cell / TA.

[0113] PDU session type-based data sample distribution evaluation (PDU session type-based data distribution): The PDU session type-based data sample distribution evaluation indicates that the data collection network element is requested to evaluate the sample data in the collected data set according to the dimension of the PDU session type.

[0114] QoS-based data distribution: QoS-based data sample distribution evaluation. Indicating the request data collection network element to evaluate the sample data in the collected data set according to the dimension of the quality of service.

[0115] S-NSSAI-based data distribution: S-NSSAI-based data sample distribution evaluation. Indicating the request data collection network element to evaluate the sample data in the collected data set according to the dimension of the slice.

[0116] QoE (Mos)-based data distribution: Indicating the request data collection network element to evaluate the sample data in the collected data set according to the dimension of the service experience.

[0117] The above examples introduce the data distribution evaluation indicators. For example, the DNN-based data distribution evaluation in the request for collecting service experience related data is illustrated. The data consumer requests the data collection network element to collect the service experience of different UEs accessing the AF. Different UEs may use different DNNs to access the corresponding AF, that is, the samples in the data set are all associated with a certain DNN, and therefore the data consumer may request the data collection network element to evaluate the data in the data set according to the DNN dimension, so as to calculate the number distribution of the DNN-based data samples in the data set. Assuming that the data set involves 10 DNNs, the number of samples associated with each DNN can be calculated to obtain the number distribution of the samples based on the DNN.

[0118] In a possible implementation, the first information further includes one or more of the following: a data evaluation method, reporting indication information, data distribution requirement information. The target data set is associated with the first information.

[0119] The information in the first information is introduced below.

[0120] For example, the data evaluation method includes one or more of the following: joint evaluation of multiple indicators in the data distribution evaluation indicator, and separate evaluation of each indicator in the data distribution evaluation indicator.

[0121] The data assessment method refers to whether the data consumer needs the data collection network element to perform joint evaluation according to multiple indicators or separate evaluation according to a single indicator when the data consumer includes multiple indicators in the data distribution evaluation indicator. The data assessment method can be set to multiple-indicator joint evaluation (union) or single-indicator separate evaluation (single). Alternatively, TRUE or False can be used to identify, for example, when the data assessment method is set to True, multiple-indicator joint evaluation is indicated, and when the data assessment method is set to False, single-indicator separate evaluation is indicated. Optionally, the default can be single-indicator separate evaluation. The following describes the data assessment method by setting the corresponding string union / single.

[0122] The target data set is associated with the data assessment method, that is, the target data set is obtained based on the data assessment method.

[0123] Union (union indicator list): multiple indicators are jointly evaluated. When the data assessment method is set to union, the data consumer expects the data collection network element to perform joint evaluation on multiple indicators. Optionally, the indicator can provide an indicator union indicator list. Alternatively, when the union indicator list is not provided, all indicators in the data distribution evaluation indicator can be jointly evaluated by default. It can be understood that if the indicator joint evaluation list is provided, the list can be one or more. Optionally, at least one of the one or more lists includes at least two indicators.

[0124] Single: single-indicator separate evaluation. When the data assessment method is set to single, it indicates that the data collection network element needs to perform separate evaluation on each indicator in the data distribution evaluation indicator.

[0125] For example, the data distribution evaluation indicators include three evaluation indicators, which are

DNN-based, application-based, QoE (Mos)-based

DNN-based, QoE (Mos)-based

application-based, QoE (Mos)-based

[0126] In a possible implementation, the report indication information indicates a sending rule of the data evaluation report. The report indication information (report indication) indicates that the second network element (such as the data collection network element DCCF) sends the data evaluation report of the collected data set to the data consumer before sending the data. Of course, it can also be defaulted that when the data distribution indication is included in the data collection request, the data collection network element sends the data evaluation report to the data consumer first. The target data set is associated with the report indication information, that is, the target data set is obtained based on the report indication information.

[0127] In a possible implementation, the first information further indicates data distribution requirement information. The data distribution requirement information includes one or more of the following: the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum sample number and a minimum sample number in the data distribution, a maximum sample number threshold in the data distribution, and a minimum sample number threshold in the data distribution. The target data set is associated with the data distribution requirement information, that is, the target data set satisfies (meets) the data distribution requirement information.

[0128] The data distribution requirement information refers to distribution requirements that need to be met by each index for data evaluation. For example, specific parameters can be represented in the following two ways:

[0129] (1) Using a standard distribution representation. For example, the data distribution requirement information is set to a uniform distribution, a normal distribution, or other standard distributions. For example, it also includes the corresponding parameters of the distribution. Optionally, if the corresponding parameters are not provided, the default parameters of the data evaluation network element can be used, or the specific implementation of the data evaluation network element is based, which is not limited here.

[0130] For example, when set to a uniform distribution, the upper and lower fluctuation ranges of the uniform distribution, i.e. the offset from the mean, need to be provided. For example, the offset = 5. Optionally, when the offset is not provided, the offset = 0 can be used by default.

[0131] For example, when set to a normal distribution, the parameters of the normal distribution need to be provided. For example, the corresponding variance threshold.

[0132] Take the DNN-based data distribution evaluation in a data collection request related to service experience as an example. When the data volume of the data sample is calculated based on DNN, it is required to meet the uniform distribution, and the offset of the uniform distribution is 5. Assuming that the data set involves 10 DNNs, the number of samples associated with each DNN can be calculated to obtain the DNN-based sample quantity distribution. At this time, the data consumer requires that the sample data volume on the 10 DNNs be basically the same. The difference between the maximum value or the minimum value and the mean value does not exceed the value 5 of the offset.

[0133] (2) Using the following three specific parameters:

[0134] The ratio threshold of the maximum sample quantity to the minimum sample quantity in the distribution. For example, when the evaluation index of the sample quantity distribution evaluation of the data set is the joint evaluation based on DNN and QoE (Mos), the data distribution of the samples collected by the second network element is on 6 DNNs and 10 QoE (MOS). When the number of samples of the 60 DNN-QoE (Mos) does not meet the specified distribution requirement (exceeds the threshold set by the ratio threshold of max to min), for example, any of the following methods can be used:

[0135] (a) max threshold of sample number. For example, when the min value of sample number on DNN-QoE(Mos)1 is less than the threshold, the second network element continues to collect the data corresponding to DNN-QoE(Mos)1. When the data on DNN-QoE(Mos)1 exceeds the threshold, the second network element can take the undersampling method for the data on other DNNs based on the value of the DNN with the minimum sample number, to reduce the number of samples on other DNNs to meet the data set requirement. That is, oversampling is performed first and then undersampling.

[0136] (b) min threshold of sample number. For example, when the max value of sample number on DNN-QoE(Mos)6 is greater than the threshold, the second network element can take the undersampling method for the data exceeding the threshold, to reduce the number of samples on the DNN-QoE(Mos) exceeding the number, and then take the oversampling method for the data on the DNN-QoE(Mos) with the maximum number, to obtain the data amount of samples on the less DNN. That is, undersampling is performed first and then oversampling.

[0137] Optionally, if the data consumer does not set the max threshold and the min threshold, the second network element can determine whether to take the undersampling method or the oversampling method for processing.

[0138] 302. The second network element sends second information to the first network element, where the second information includes the target data set. Correspondingly, the first network element receives the second information.

[0139] The second network element processes the collected data set based on the first information to obtain the target data set.

[0140] In a possible implementation, before step 301, the second network element further sends third information to the first network element, where the third information includes a data evaluation report. The first network element sends fourth information to the second network element based on the data evaluation report, where the fourth information indicates data acquisition strategy information. In this way, the second network element sends the second information to the first network element based on the data acquisition strategy information.

[0141] For example, the second network element evaluates the data in the collected data set according to one or more indexes included in the data distribution index according to a data evaluation method, and generates a data evaluation report.

[0142] The data acquisition strategy information can include one or more of the following: 1, direct fetch: the second network element directly sends the collected data set to the data consumer. 2, sampling policy: under this policy, the data consumer specifies which data under which index the second network element samples, and gives the sampling ratio. For example, the second network element returns the number of DNN-based data samples, which contains 6 DNNs (DNN1-DNN6), the data consumer specifies that the sample data on DNN3 is sampled at a rate of 80%, that is, 80% of all data associated with this DNN is randomly taken, and the data associated with other DNNs remains unchanged, and the data set composed of these data is returned to the data consumer. 3, data collection policy: under this policy, the data consumer specifies which index the second network element collects data again. For example, the amount of sample data associated with DNN1 is insufficient, and the data consumer specifies that the second network element needs to continue data collection on DNN1 until the amount of sample data associated with DNN1 meets the corresponding value, and then stop data collection and send all collected data to the data consumer. 4, send and data collection policy: under this policy, the data consumer specifies to return existing data first and continue to collect data. The data consumer specifies that the second network element collects data again for the corresponding index. For example, the amount of sample data associated with DNN1 is insufficient, and the data consumer specifies to return these data first and continue data collection on DNN1 until the amount of sample data associated with DNN1 meets the corresponding value, and then return the newly collected data to the data consumer.

[0143] In the embodiment of the application, the first network element sends first information to the second network element, the first information at least including a data distribution evaluation index, the first information being used for requesting to acquire data, and the data distribution evaluation index being used for evaluating the requested data. Then, the second network element sends a target data set to the first network element. In this example, the first network element (data consumer) provides a sample distribution evaluation index of a required data set, so that the obtained target data set meets the data distribution evaluation index, and the data consumer avoids acquiring a data set that does not meet the index distribution requirement.

[0144] The communication method provided by the embodiment of the application will be described in detail below in combination with Examples 1-4.

[0145] Example 1

[0146] With reference to FIG. 4, a communication method provided by an embodiment of the present application is shown. In this example, data evaluation and the like are performed by the DCCF. The method can include steps 401-408, which are as follows:

[0147] 401. The data consumer sends a data collection request to the data collection network element (DCCF), which includes a service operation, a data specification, a processing instruction, a data distribution evaluation index, a data evaluation method, and report indication information.

[0148] The service operation refers to a specific service operation used by the data collection network element to collect data. For example, collecting data of the AMF requires using the event exposure service Namf_EventExposure_Subscribe provided by the AMF.

[0149] The data specification refers to the events and corresponding parameters used by the data network element to collect data using the corresponding operation.

[0150] The processing instruction refers to the method used by the DCCF to perform preliminary data processing on the collected data, such as the event to be processed, the processing interval, the processing method (average, maximum, minimum, variance), the duration, and the like. It also includes an indication of whether to aggregate data from multiple data sources, such as based on each UE, each area of interest (AOI), and time granularity.

[0151] The optional formatting instruction specifies the format or return method used when returning data to the data consumer.

[0152] The description of the data distribution evaluation index can be found in the description of step 301 in the embodiment shown in FIG. 3, which is not repeated here.

[0153] Optionally, the data collection request also includes the data evaluation method and the report indication information. The description of the data evaluation method and the report indication information can be found in the description of step 301 in the embodiment shown in FIG. 3, which is not repeated here.

[0154] 402. The DCCF collects data from each data source according to the service operation carried in the subscription request.

[0155] For example, the DCCF collects data from multiple NFs.

[0156] 403、DCCF aggregates the data collected from various data sources and processes the data according to the method provided in the data description, and generates a data evaluation report.

[0157] For example, the DCCF aggregates the data collected from various data sources and processes the data according to the method provided in the data description to obtain a data set. Then, the data in the data set is evaluated according to one or more indexes contained in the data distribution index according to the data evaluation method, and a data evaluation report is generated.

[0158] 404、DCCF sends the data evaluation report to the data consumer.

[0159] 405、The data consumer determines data acquisition strategy information based on the received data evaluation report.

[0160] For the introduction of the data acquisition strategy information, please refer to the description of step 302 in the embodiment shown in FIG. 3, which will not be repeated here.

[0161] 406、The data consumer sends the data acquisition strategy information to the DCCF.

[0162] 407、The DCCF continues to collect data according to the data acquisition strategy information.

[0163] 408、The DCCF sends the data set to the data consumer.

[0164] Alternatively, steps 407-408 can also be that the DCCF sends data that meets the requirements according to the data acquisition strategy information.

[0165] In this example, the data consumer provides sample distribution evaluation indexes and corresponding evaluation methods required for the data set, so that the target data set obtained meets the data distribution evaluation indexes, avoiding the data consumer obtaining a data set that does not meet the index distribution requirements.

[0166] Example 2

[0167] In combination with FIG. 5, another communication method provided by the embodiment of the application is shown. In this example, the ADRF performs data evaluation, etc. The method can include steps 501-510, as follows:

[0168] 501、The data consumer sends a data collection request to the DCCF, the data collection request including a service operation, a data description, and a processing description.

[0169] For the description of the above data collection request, please refer to the description of step 401 in the embodiment shown in FIG. 4, which will not be repeated here.

[0170] 502a, the DCCF collects data according to the data specification, or determines that the data to be collected has been stored in the ADRF.

[0171] Optionally, 502b, if the data is not stored in the ADRF, the DCCF collects data from each data source.

[0172] Optionally, 502c, the DCCF stores the data collected from each data source in the ADRF.

[0173] 503, the DCCF sends a data collection completion notification to the data consumer, and carries the corresponding ADRF ID, data transaction ID / dataset tag in the notification.

[0174] Among them, the ADRF ID refers to the identification of the ADRF storing the dataset. The data transaction ID / dataset tag refers to the identification of the data marked in the ADRF corresponding to the ADRF ID.

[0175] 504, the data consumer sends a data evaluation request to the corresponding ADRF, which includes data transaction ID and / or dataset tag, data distribution evaluation index list, and data evaluation method.

[0176] Among them, the data transaction ID and / or dataset tag is the dataset to be evaluated. For the introduction of data distribution evaluation index and data evaluation method, please refer to the description of step 301 in the embodiment shown in FIG. 3, which will not be repeated here.

[0177] 505, the ADRF performs data distribution evaluation on each index in the data distribution evaluation index according to the evaluation method specified by the data evaluation method, and generates a data evaluation report.

[0178] 506, the ADRF sends the data evaluation report to the data consumer.

[0179] 507, the data consumer determines data acquisition strategy information based on the received data evaluation report.

[0180] For the introduction of this data acquisition strategy information, please refer to the description of step 302 in the embodiment shown in FIG. 3, which will not be repeated here.

[0181] 508, the data consumer sends data acquisition strategy information to the ADRF.

[0182] 509, the ADRF determines the data to be sent according to the data acquisition strategy information.

[0183] 510, the ADRF sends data to the data consumer.

[0184] The example provides a sample distribution evaluation index of the required data set by the data consumer, and corresponding evaluation method, etc., so that the obtained target data set meets the data distribution evaluation index, and avoids that the data consumer obtains a data set that does not meet the index distribution requirement.

[0185] Example 3

[0186] In combination with FIG. 6, another communication method provided by the embodiment of the application is shown. In the example, the data evaluation is performed by the DCCF. The method can include steps 601-604, and the details are as follows:

[0187] 601. The data consumer sends a data collection request to a data collection network element (DCCF), and the data collection request includes a service operation, data description, processing description, data distribution evaluation index, data evaluation method, and data distribution requirement information.

[0188] The description of the data collection request can be referred to the description of step 301 in the embodiment shown in FIG. 3, and will not be repeated here.

[0189] The data distribution evaluation index and data distribution requirement information are included in the data collection request in the example. Optionally, the data evaluation method is also included.

[0190] 602. The DCCF collects data from each data source according to the service operation carried in the subscription request.

[0191] For example, the DCCF collects data from multiple NFs.

[0192] 603. The DCCF performs evaluation and screening on the collected data set according to the evaluation requirement corresponding to each evaluation index, and obtains UE / sample data that meets the data distribution requirement information.

[0193] For example, when the data distribution requirement information is set to uniform distribution, the collected data set is processed to obtain data that meets the requirement of uniform distribution.

[0194] 604. The DCCF sends data to the data consumer.

[0195] Optionally, the DCCF also sends a data evaluation report corresponding to the index to the data consumer.

[0196] In the example, the sample distribution evaluation index of the required data set is provided by the data consumer, and the corresponding evaluation method and sample distribution index requirement, etc., so that the obtained target data set meets the data distribution evaluation index, and avoids that the data consumer obtains a data set that does not meet the index distribution requirement.

[0197] Example 4

[0198] With reference to FIG. 7, another communication method provided by the embodiments of the present application is shown. In this example, data evaluation is performed by ADRF. The method can include steps 701-707, as follows:

[0199] 701. The data consumer sends a data collection request to the DCCF, the data collection request including a service operation, data description, processing description, data distribution evaluation index, and data distribution requirement information.

[0200] The description of the data collection request can refer to the description of step 601 in the embodiment shown in FIG. 6, and will not be repeated here.

[0201] 702a. The DCCF collects data according to the data description, or determines that the data to be collected is already stored in the ADRF.

[0202] Optionally, 702b. If the data is not stored in the ADRF, the DCCF collects data from each data source.

[0203] Optionally, 702c. The DCCF stores the data collected from each data source in the ADRF.

[0204] 703. The DCCF sends a data collection completion notification to the data consumer, and carries the corresponding ADRF ID, data identifier / data set label in the notification.

[0205] 704. The data consumer sends a request for data set evaluation to the ADRF, the request carrying the data identifier / data set label, data distribution evaluation index, data evaluation method, and data distribution requirement information.

[0206] The description of the request can refer to the description of step 301 in the embodiment shown in FIG. 3, and will not be repeated here.

[0207] Optionally, the request also includes the data evaluation method.

[0208] 705. The ADRF evaluates and filters the collected data set according to the evaluation requirement corresponding to each evaluation index, to obtain UE / sample data that meets the requirement.

[0209] Optionally, 706. When the ADRF evaluates the data in the data set and finds that some index data is too small, the ADRF sends a data collection request to the DCCF, requesting the DCCF to collect sample data corresponding to these indexes, so as to obtain a target data set that meets the data distribution requirement.

[0210] 707. The ADRF sends the data that meets the data distribution requirement to the data consumer.

[0211] The example provides a sample distribution evaluation index of a required data set by a data consumer, a corresponding evaluation method, and sample distribution index requirements, so that the obtained target data set meets the data distribution evaluation index, and the data consumer avoids obtaining a data set that does not meet the index distribution requirements.

[0212] It should be noted that in various embodiments of the present application, the data storage network element is ADRF. If the network element storing UE data is NWDAF, the data storage network element can be NWDAF. It can be understood that the data storage network element can also use other names such as (data storage function, DSF), and the present solution does not limit.

[0213] It should be noted that in various embodiments of the present application, the terms and / or descriptions of various embodiments are consistent and can be mutually referenced if there is no special description and logical conflict. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0214] The above describes the method of the embodiments of the present application in detail. The apparatus of the embodiments of the present application is provided below. It can be understood that the division of multiple units or modules in various apparatus embodiments of the present application is only a logical division according to functions, and does not limit the specific structure of the apparatus. In specific implementation, some of the function modules can be subdivided into more detailed function modules, and some of the function modules can be combined into one function module, but regardless of whether the function modules are subdivided or combined, the general flow performed by the apparatus is the same. For example, some apparatuses include a receiving unit and a sending unit. In some designs, the sending unit and the receiving unit can also be integrated into a communication unit, which can realize the functions realized by the receiving unit and the sending unit. Generally, each unit corresponds to its own program code (or program instructions), and the program code corresponding to each unit respectively running on the processor causes the unit to be controlled by the processing unit to execute the corresponding flow to realize the corresponding function.

[0215] The embodiments of the present application also provide an apparatus for implementing any one of the above methods, for example, a communication apparatus including a module (or means) for implementing each step performed by the first network element in any one of the above methods. For example, referring to FIG. 8, which is a structural schematic diagram of a communication apparatus provided by an embodiment of the present application. The communication apparatus is used to implement the communication method described above, such as the communication methods shown in FIGS. 3-7.

[0216] As shown in FIG. 8, the apparatus can include a communication module 801, specifically as follows:

[0217] The communication module 801 is configured to send first information, wherein the first information at least comprises a data distribution evaluation index, and the first information is used to request to acquire data, and the data distribution evaluation index is used to evaluate the requested data.

[0218] The communication module 801 is further configured to receive second information, wherein the second information comprises a target data set.

[0219] The above modules can refer to the description of the foregoing embodiments, and details are not described herein.

[0220] For another example, referring to FIG. 9, which is a structural schematic diagram of another communication device provided by the embodiments of the present application. The communication device is used to implement the foregoing communication method, for example, the modules (or means) of each step performed by the second network element in the communication method shown in FIGS. 3-7.

[0221] As shown in FIG. 9, the device can include a communication module 901 and a processing module 902, and the details are as follows.

[0222] The communication module 901 is configured to receive first information, wherein the first information at least comprises a data distribution evaluation index, and the first information is used to request to acquire data, and the data distribution evaluation index is used to evaluate the requested data.

[0223] The processing module 902 is configured to acquire an initial data set, and obtain a target data set based on the first information and the initial data set.

[0224] The communication module 901 is further configured to send second information, wherein the second information comprises the target data set.

[0225] The above modules can refer to the description of the foregoing embodiments, and details are not described herein.

[0226] It should be understood that the division of each module in each of the above devices is only a logical functional division, and all or part of the modules can be integrated into one physical entity or physically separated in actual implementation. In addition, the modules in the communication device can be implemented in the form of processor calling software; for example, the communication device includes a processor, the processor is connected with a memory, the memory stores instructions, and the processor calls the instructions stored in the memory to implement any one of the above methods or to realize the functions of the modules of the device, wherein the processor is, for example, a general processor such as a central processing unit (CPU) or a microprocessor, and the memory is an internal memory of the device or an external memory of the device. Alternatively, the modules in the device can be implemented in the form of hardware circuit, and the functions of part or all of the units can be realized through the design of the hardware circuit, which can be understood as one or more processors; for example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC), and the functions of part or all of the units are realized through the design of the logical relationship of elements in the circuit; for example, in another implementation, the hardware circuit is realized through a programmable logic device (PLD), and a field programmable gate array (FPGA) is taken as an example, which can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured through a configuration file, so as to realize the functions of part or all of the units. All the modules of the above device can be realized in the form of processor calling software, or all the modules can be realized in the form of hardware circuit, or part of the modules can be realized in the form of processor calling software, and the remaining part can be realized in the form of hardware circuit.

[0227] Referring to FIG. 10, a hardware structure schematic diagram of another communication device provided by the embodiment of the application is shown. As shown in FIG. 10, the communication device 1000 includes one or more processors 1001 (one processor is shown in the figure).

[0228] The processor 1001 is a circuit with a processing capability of signals. In one implementation, the processor 1001 can be a circuit with an instruction reading and running capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), a digital signal processor (DSP), or the like. In another implementation, the processor 1001 can implement certain functions through a logical relationship of a hardware circuit, which is fixed or reconfigurable. For example, the processor 1001 is an ASIC or a programmable logic device (PLD) such as an FPGA. In a reconfigurable hardware circuit, the processor loads a configuration document to implement hardware circuit configuration. It can be understood that the processor loads instructions to implement the functions of the above modules. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), or the like. The processor 1001 is configured to execute a related program to implement the functions required by the units in the communication device according to the embodiments of the present application, or execute the communication method according to the method embodiments of the present application.

[0229] Optionally, the communication device 1000 can further include a memory (for example, the memory 1003, the memory 1004, and the memory 1005) (indicated by a dashed line in the figure). The memory is configured to store instructions executed by the processor 1001, or store input data required by the processor 1001 for running instructions, or store data generated after the processor 1001 runs instructions.

[0230] Optionally, the memory can be located in the one or more processors (for example, the memory 1003), or located outside the one or more processors (for example, the memory 1004 and the memory 1005), or can include a memory part located in the one or more processors and a memory part located outside the one or more processors.

[0231] In the embodiments of the present application, the memory (for example, the memory 1003, the memory 1004, and the memory 1005) can include, but is not limited to, a cache, a read-only memory (ROM), a random access memory (RAM), a synchronous dynamic random access memory (SDRAM), a hard disk drive (HDD), or a solid-state drive (SSD), an erasable programmable ROM (EPROM), or a compact disc read-only memory (CD-ROM), and the like. The memory can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. The memory in the embodiments of the present application can also be a circuit or any other device capable of realizing a storage function, used for storing a computer program or instructions, and / or data.

[0232] Optionally, the communication device 1000 can further include a communication interface 1002 (indicated by a dashed line in the figure). The processor 1001 and the communication interface 1002 are coupled to each other. The communication interface 1002 can be a transceiver or an interface circuit, a bus, a module, or other types of communication interfaces.

[0233] The memory can store a program, and when the program stored in the memory is executed by the processor 1001, the processor 1001 and the communication interface 1002 are used to perform various steps of the communication method according to the embodiments of the present application.

[0234] It can be seen that each module in the above device can be one or more processors (or processing circuits) configured to implement the above method, for example: a CPU, a GPU, an NPU, a TPU, a DPU, a microprocessor, a DSP, an ASIC, an FPGA, or a combination of at least two of these processor forms or part of the processing circuits in these processors.

[0235] In addition, each module in the above device can be integrated together or can be independently implemented. In one implementation, the modules are integrated together to form a system-on-a-chip (SOC). The SOC can include at least one processor for implementing any of the above methods or the functions of the modules of the device, and the at least one processor can be different, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, and the like.

[0236] It should be noted that although the apparatus 1000 shown in FIG. 10 only shows the memory, the processor, the communication interface, in the specific implementation process, those skilled in the art should understand that the apparatus 1000 also includes other devices necessary for normal operation. At the same time, according to the specific needs, those skilled in the art should understand that the apparatus 1000 can also include hardware devices that realize other additional functions. In addition, those skilled in the art should understand that the apparatus 1000 can also only include devices necessary for the implementation of the embodiments of the present application, and does not have to include all the devices shown in FIG. 10.

[0237] The embodiments of the present application also provide a computer readable storage medium, which stores instructions, when the instructions run on a computer or a processor, make the computer or the processor execute one or more steps in any one of the above methods.

[0238] The embodiments of the present application also provide a computer program product containing instructions. When the computer program product runs on a computer or a processor, it makes the computer or the processor execute one or more steps in any one of the above methods.

[0239] It can be understood that in the present application, "indication" can include direct indication, indirect indication, display indication, and implicit indication. When describing that certain indication information is used to indicate A, it can be understood that the indication information carries A, directly indicates A, or indirectly indicates A. In the present application, the information indicated by the indication information is referred to as the to-be-indicated information. In the specific implementation process, there are many ways to indicate the to-be-indicated information, for example, but not limited to, the to-be-indicated information can be directly indicated, such as the to-be-indicated information itself or the index of the to-be-indicated information, or the to-be-indicated information can be indirectly indicated by indicating other information, wherein the other information and the to-be-indicated information have an association relationship. It can also only indicate a part of the to-be-indicated information, and the other part of the to-be-indicated information is known or agreed in advance. For example, the indication of a specific information can also be achieved by means of the arrangement order of each information agreed in advance (for example, the protocol stipulates), thereby reducing the indication overhead to a certain extent. The to-be-indicated information can be sent as a whole, or can be sent separately in multiple sub-information, and the sending period and / or sending time of these sub-information can be the same or different. The specific sending method is not limited in the present application. The sending period and / or sending time of these sub-information can be pre-defined, for example, pre-defined according to the protocol, or configured by the transmitting end device by sending configuration information to the receiving end device.

[0240] It should be understood that, in the description of the present application, unless otherwise specified, " / " represents that the objects before and after the " / " are in an "or" relationship, for example, A / B can represent A or B; wherein A, B can be singular or plural. And, in the description of the present application, unless otherwise specified, "multiple" means two or more than two. "At least one of the following" or the like means any combination of the items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the same items or similar items with basically the same function and role are distinguished by using "first", "second", etc. The skilled in the art can understand that "first", "second", etc. do not limit the quantity and execution order, and "first", "second", etc. do not necessarily mean different. At the same time, in the embodiments of the present application, "exemplary" or "for example" means to serve as an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, "exemplary" or "for example" is used to present the relevant concept in a specific manner, for understanding.

[0241] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the division of the unit is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. The coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0242] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0243] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions can be stored in or transmitted by a computer readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media sets. The available medium can be a read-only memory (ROM), or a random access memory (RAM), or a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape, a magnetic disk, or an optical medium, such as a digital versatile disc (DVD), or a semiconductor medium, such as a solid state disk (SSD), etc.

[0244] The above is only a specific implementation of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any change or replacement within the technical scope disclosed by the embodiments of the present application should be covered within the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims

1. A communication method characterized by comprising: The method applied to a first network element comprises: sending first information, the first information comprising data distribution evaluation indexes, the first information being used for requesting data, and the data distribution evaluation indexes being used for evaluating the requested data; receiving second information, the second information comprising a target data set.

2. The method of claim 1, wherein, The data distribution evaluation indexes comprise one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service (QoS) level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

3. The method according to claim 1 or 2, characterized in that, The method further comprises: receiving third information, the third information comprising a data evaluation report.

4. The method of claim 3, wherein, The method further comprises: based on the data evaluation report, sending fourth information, the fourth information indicating data acquisition strategy information.

5. The method according to any one of claims 1 to 4, characterized in that, The first information further comprises one or more of the following: a data evaluation method, report indication information, and data distribution requirement information, wherein the target data set is associated with the first information.

6. The method of claim 5, wherein, The data evaluation method comprises one or more of the following: joint evaluation of multiple indexes in the data distribution evaluation indexes, and separate evaluation of each index in the data distribution evaluation indexes.

7. The method according to claim 5 or 6, characterized in that, The report indication information indicates a sending rule of the data evaluation report.

8. The method according to any one of claims 5 to 7, characterized in that, The data distribution requirement information comprises one or more of the following: the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum sample number and a minimum sample number in the data distribution, a maximum threshold of the sample number in the data distribution, and a minimum threshold of the sample number in the data distribution.

9. A communication method characterized by comprising: The method applied to a second network element comprises: receiving first information, the first information comprising data distribution evaluation indexes, the first information being used for requesting data, and the data distribution evaluation indexes being used for evaluating the requested data; acquiring an initial data set, and based on the first information and the initial data set, obtaining a target data set; sending second information, the second information comprising the target data set.

10. The method of claim 9, wherein, The data distribution evaluation indexes comprise one or more of the following: data distribution evaluation based on a data network name (DNN), application-based data distribution evaluation, cell or tracking area-based data sample distribution evaluation, packet data unit (PDU) session type-based data sample distribution evaluation, quality of service (QoS) level-based data sample distribution evaluation, slice-based data sample distribution evaluation, and service experience-based data sample distribution evaluation.

11. The method according to claim 9 or 10, characterized in that, The method further comprises: sending third information, the third information comprising the data evaluation report, the data evaluation report being obtained by evaluating the initial data set based on one or more indexes in the data distribution evaluation indexes.

12. The method of claim 11, wherein, The method further comprises: receiving fourth information, the fourth information indicating data acquisition strategy information.

13. The method according to any one of claims 9 to 12, characterized in that, The first information further comprises one or more of the following: a data evaluation method, report indication information, data distribution requirement information, wherein the target data set is associated with the first information.

14. The method of claim 13, wherein, The data evaluation method comprises one or more of the following: joint evaluation of multiple indicators in the data distribution evaluation indicators, respectively evaluation of each indicator in the data distribution evaluation indicators.

15. The method according to claim 13 or 14, characterized in that, The report indication information indicates a sending rule of a data evaluation report.

16. The method according to any one of claims 13 to 15, characterized in that, The data distribution requirement information comprises one or more of the following: the data distribution satisfies uniform distribution or normal distribution, a ratio threshold of a maximum sample number and a minimum sample number in the data distribution, a maximum sample number threshold in the data distribution, a minimum sample number threshold in the data distribution.

17. A communications device, characterized by The apparatus comprises a module or unit for implementing the method of any one of claims 1-8, or a module or unit for implementing the method of any one of claims 9-16.

18. A communications device, characterized by The apparatus comprises a processor configured to cause the apparatus to perform the method of any one of claims 1-8 by executing computer programs or computer executable instructions stored in a memory, and / or by a logic circuit.

19. A communications device, characterized by The apparatus comprises a processor configured to cause the apparatus to perform the method of any one of claims 9-16 by executing computer programs or computer executable instructions stored in a memory, and / or by a logic circuit.

20. A communication system, characterized by The system comprises the apparatus of claim 18, and the apparatus of claim 19.

21. A computer-readable storage medium, characterized in that, A computer program is stored, and when executed by a processor, causes the method of any one of claims 1-8 to be implemented, or causes the method of any one of claims 9-16 to be implemented.

22. A computer program product comprising instructions which, when executed on a processor, cause the method of any one of claims 1-8 to be implemented, or cause the method of any one of claims 9-16 to be implemented.

Images