Data screening method and apparatus, storage medium, and program product

Abstract

A data screening method and apparatus, a storage medium, and a program product. The method comprises: a data consumer network element sends a first request to a data screening apparatus, wherein the first request is used for instructing to perform data screening on data in a collected data set, the first request comprises a method for screening the data in the data set, and the method for screening the data in the data set comprises a data type comprised in each piece of data constituting the data set in the data set; and the data screening apparatus sends a first response to the data consumer network element, wherein the first response comprises first data, and the first data is a data set consisting of data selected according to the method for screening the data in the data set. The data consumer network element instructs the data screening apparatus to perform data screening on the data in the collected data set, and provides the method for screening the data in the collected data set, so that the data screening apparatus screens the data in the data set according to the method and provides valid data satisfying the requirement of the data consumer network element.

Description

Data screening method and device, storage medium and program product

[0001] The present application claims priority to the Chinese patent application No. 202410954208.0, filed on July 16, 2024, and entitled "Data screening method and device, storage medium and program product", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the field of communication technology, in particular to a data screening method and device, a storage medium and a program product. BACKGROUND

[0003] With the development of future wireless communication technology, the data volume generated by future networks is growing continuously, and the demand for data collection and processing is increasing, and the requirement for data quality management is higher and higher. Moreover, future artificial intelligence (AI) technology will be further integrated into the network, and data meeting the quality requirements is the cornerstone of AI and the basis for model training and inference. It is necessary to collect high-quality data sets to assist AI model training to optimize network operation.

[0004] However, in the current data collection scheme, when the data consumer network element sends a data collection request to the data collection coordination network element, the data collection coordination network element is required to aggregate data from different data sources according to the aggregation granularity, and the data collection coordination network element only sends the aggregated data to the data consumer network element, which cannot guarantee that the aggregated data is effective for the data consumer network element.

[0005] Therefore, how to provide effective data to the data consumer network element is a problem to be solved. SUMMARY

[0006] The present application provides a data screening method and device, a storage medium and a program product to screen the collected data and provide effective data to the data consumer network element.

[0007] In a first aspect, a data screening method is provided. The method can be executed by a data screening device, or by a chip or circuit configured in the data screening device, or by a logic module or software capable of implementing all or part of the data screening device. The present application does not make any limitation in this regard.

[0008] The method comprises: receiving a first request indicating data filtering of data in a collected data set, the first request comprising a data filtering method of data in the data set, the data filtering method of data in the data set comprising data types contained in each piece of data constituting a data set in the data set; and sending a first response, the first response comprising first data, the first data being a data set composed of data satisfying the data filtering method of data in the data set.

[0009] By using the method, the data consumption network element instructs the data filtering device to perform data filtering on data in a collected data set, and provides a method for filtering data in the collected data set, so that the data filtering device filters data in the data set according to the method, and provides effective data satisfying the requirement of the data consumption network element.

[0010] In combination with the first aspect, in a possible design, the data filtering method of data in the data set further comprises at least one of the following: a number of data types in each piece of data in which there is a non-empty data value, and a data type in each piece of data in which there is a data value.

[0011] By using this design, effective data satisfying the requirement of the data consumption network element can be filtered out.

[0012] In combination with the first aspect, in another possible design, the method further comprises: collecting a plurality of pieces of data from a data source based on a requirement of data types included in each piece of data in the data set, each piece of data comprising data corresponding to one or more data types.

[0013] In combination with the first aspect, in yet another possible design, the method further comprises: determining data satisfying the data filtering method of data in the data set.

[0014] In combination with the first aspect, in yet another possible design, the determining of the data satisfying the data filtering method of data in the data set comprises: filtering each piece of data in the collected data set based on the number of data types in each piece of data in which there is a non-empty data value and / or the data type in each piece of data in which there is a data value, to determine the data satisfying the data filtering method of data in the data set.

[0015] In combination with the first aspect, in yet another possible design, the first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set.

[0016] In a second aspect, a data screening method is provided. The method can be executed by a data consumer network element, or a chip or circuit configured in the data consumer network element, or a logic module or software capable of implementing all or part of the data consumer network element. The present application does not limit this.

[0017] The method comprises: sending a first request, the first request indicating data screening on data in a collected data set, the first request comprising a data screening method on data in the data set, the data screening method on data in the data set comprising data types contained in each piece of data constituting the data set in the data set; and receiving a first response, the first response comprising first data, the first data being a data set constituted by data satisfying the data screening method on data in the data set.

[0018] With the method, the data consumer network element instructs the data screening device to screen data in a collected data set, and provides a method for screening data in the collected data set, so that the data screening device screens data in the data set according to the method, and provides effective data satisfying the requirements of the data consumer network element.

[0019] In combination with the second aspect, in a possible design, the data screening method on data in the data set further comprises at least one of the following: a number of data types in each piece of data in which there is a non-empty data value, and a data type in each piece of data in which there is a data value.

[0020] In combination with the second aspect, in another possible design, the first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis on the first data according to data types contained in each piece of data constituting the data set in the data set.

[0021] In a third aspect, a data screening device is provided for implementing the data screening method in the first aspect or any of the implementations of the first aspect. The device can be a data screening device, a module (such as a processor, a chip, or a chip system) applied to the data screening device, or a logic node, a logic module, or software capable of implementing all or part of the function of the data screening device.

[0022] In a fourth aspect, a data screening device is provided for implementing the data screening method in the second aspect or any of the implementations of the second aspect. The device can be a data consumer network element, a module (such as a processor, a chip, or a chip system) applied to the data consumer network element, or a logic node, a logic module, or software capable of implementing all or part of the function of the data consumer network element.

[0023] In a possible implementation, the data screening apparatus in the third aspect to the fourth aspect includes units, modules or means for performing the method in any one of the first aspect to the second aspect or any implementation of the first aspect to the second aspect. The units, modules or means can be implemented by software, or by hardware, or by a combination of software and hardware.

[0024] In the method, the data screening apparatus includes a communication unit and a processing unit, and can further include a storage unit. The communication unit is configured to receive a first request, the first request indicating data screening on data in a collected data set, the first request including a data screening method on the data in the data set, the data screening method including data types included in each piece of data constituting the data set in the data set. The processing unit is configured to generate a first response, the first response including first data, the first data being a data set constituted by data satisfying the data screening method on the data in the data set. The communication unit is further configured to send the first response.

[0025] Optionally, the data screening method on the data in the data set further includes at least one of the following: a number of data types in each piece of data having non-empty data values, and data types in each piece of data having data values.

[0026] Optionally, the processing unit is further configured to collect a plurality of pieces of data from a data source based on requirements of the data types included in each piece of data in the data set, each piece of data including data corresponding to one or more data types.

[0027] Optionally, the processing unit is further configured to determine data satisfying the data screening method on the data in the data set.

[0028] Optionally, the processing unit is further configured to screen each piece of data in the collected data set based on the number of data types in each piece of data having non-empty data values and / or the data types in each piece of data having data values, and determine data satisfying the data screening method on the data in the data set.

[0029] Optionally, the first response further includes a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis on the first data according to the data types included in each piece of data constituting the data set in the data set.

[0030] The data screening device is used for executing the method in the second aspect or any one of the implementations of the second aspect. The data screening device comprises a communication unit and a processing unit, and can further comprise a storage unit. The processing unit is configured to generate a first request, the first request indicating data screening on data in a collected data set, the first request comprising a data screening method on data in the data set, the data screening method on data in the data set comprising data types contained in each piece of data constituting the data set in the data set. The communication unit is configured to send the first request. The communication unit is further configured to receive a first response, the first response comprising first data, the first data being a data set composed of data satisfying the data screening method on data in the data set.

[0031] Optionally, the data screening method on data in the data set further comprises at least one of the following: a number of data types in each piece of data in which there is a non-empty data value, and a data type in each piece of data in which there is a data value.

[0032] Optionally, the first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of complete analysis on the first data according to the data types contained in each piece of data constituting the data set in the data set.

[0033] In another possible implementation, the data screening device in the third aspect to the fourth aspect comprises a processor. The processor is configured to implement the functions of the device in the data screening method.

[0034] Optionally, the processor can be coupled with a memory for storing programs (instructions) and / or data necessary for the device. Optionally, the data screening device can further comprise a communication interface for realizing communication between the device and other network elements. Optionally, the memory can be located inside the data screening device or outside the data screening device.

[0035] Optionally, the data screening device can further comprise a transceiver, the processor being coupled with the transceiver, the processor being configured to execute computer programs or instructions to control the transceiver to receive and send information; when the processor executes the computer programs or instructions, the processor is further configured to realize the above method through a logic circuit or an execution code instruction. The transceiver can be a transceiver, a transceiver circuit or an input / output interface, and is configured to receive a signal from another data screening device outside the data screening device and transmit the signal to the processor or send a signal from the processor to another data screening device outside the data screening device. When the data screening device is a chip, the transceiver is a transceiver circuit or an input / output interface.

[0036] When the data filtering device in the third aspect to the fourth aspect is a chip, the sending unit can be an output unit, such as an output circuit or a communication interface; the receiving unit can be an input unit, such as an input circuit or a communication interface. When the data filtering device is a terminal device, the sending unit can be a transmitter or a transmitter; the receiving unit can be a receiver or a receiver.

[0037] In a fifth aspect, a data filtering system is provided, which includes the data filtering device in the third aspect or any design of the third aspect, the data filtering device in the fourth aspect or any design of the fourth aspect, and a data source.

[0038] In a sixth aspect, a computer readable storage medium is provided, which stores a computer program or instructions, when the computer program or instructions are executed, the method in the above aspects is implemented.

[0039] In a seventh aspect, a computer program product is provided, which includes instructions, when the instructions are executed on the data filtering device, the data filtering device executes the method in the above aspects. BRIEF DESCRIPTION OF DRAWINGS

[0040] FIG. 1 is a schematic diagram of a possible, non-limiting communication system;

[0041] FIG. 2 is a schematic diagram of the full life cycle of internal data of a mobile network;

[0042] FIG. 3 is a schematic diagram of a data collection coordination framework based on a data collection coordination function;

[0043] FIG. 4 is a schematic diagram of an architecture of a data filtering system provided by an embodiment of the present application;

[0044] FIG. 5 is a schematic diagram of a data filtering system in a future mobile network according to an embodiment of the present application;

[0045] FIGS. 6-10 are schematic diagrams of a data filtering method provided by an embodiment of the present application;

[0046] FIGS. 11-12 are schematic diagrams of a structure of a data filtering device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0047] The scheme of the present application will be further described below with reference to the accompanying drawings.

[0048] The technical scheme provided by the present application can be applied to various communication systems, for example, can be applied to a fifth generation (5 thThe technical solutions provided in the present application can be applied to a 5th-Generation (5G) mobile communication system, a future evolution system or a plurality of communication fusion systems, and can also be applied to an existing communication system. The application scenarios of the technical solutions provided in the present application can include a plurality of scenarios, such as machine to machine (M2M), macro micro communication, enhanced mobile broadband (eMBB), ultra reliable & low latency communication (uRLLC), and massive machine type communication (mMTC). These scenarios can include, but are not limited to, a communication scenario between terminal devices, a communication scenario between network devices, a communication scenario between a network device and a terminal device, and the like. The network device includes an access network device and a core network device. The following is described by taking the scenario of the communication between the network device and the terminal device as an example.

[0049] FIG. 1 shows a schematic diagram of a possible, non-limiting communication system. As shown in FIG. 1, the communication system 1000 includes a radio access network (RAN) 100 and a core network (CN) 200. The communication system 1000 can also include the Internet 300. The RAN 100 includes at least one RAN node (e.g., 110a and 110b in FIG. 1, collectively referred to as 110) and at least one terminal device (e.g., 120a-120j in FIG. 1, collectively referred to as 120). The RAN 100 can also include other RAN nodes, such as a wireless relay device and / or a wireless backhaul device (not shown in FIG. 1), and the like. The terminal devices 120 are connected to the RAN nodes 110 in a wireless manner. The RAN nodes 110 are connected to the core network 200 in a wireless or wired manner. The core network devices in the core network 200 and the RAN nodes 110 in the RAN 100 can be different physical devices, respectively, or can be the same physical device integrated with the logical functions of the core network and the logical functions of the radio access network.

[0050] The RAN 100 can be a 3rd generation partnership project (3GPP) -related cellular system, e.g., a 4G, 5G mobile communication system, or a future-oriented evolved system, e.g., a 6G mobile communication system. The RAN 100 can also be an open radio access network (O-RAN or ORAN), a cloud radio access network (CRAN), or a wireless fidelity (WiFi) system. The RAN 100 can also be a communication system that combines two or more of the above systems.

[0051] The RAN node 110 can also be referred to as a network device, an access network device, a RAN entity, or an access node, etc., which constitutes a part of the communication system, and is configured to help the terminal device to implement wireless access. The plurality of RAN nodes 110 in the communication system 1000 can be nodes of the same type or nodes of different types. In some scenarios, the roles of the RAN node 110 and the terminal device 120 are relative, for example, the network element 120i in FIG. 1 can be a helicopter or a drone, which can be configured as a mobile base station, and for those terminal devices 120j that access the RAN 100 through the network element 120i, the network element 120i is a base station; but for the base station 110a, the network element 120i is a terminal device. The RAN node 110 and the terminal device 120 are sometimes collectively referred to as data screening apparatuses, for example, the network elements 110a and 110b in FIG. 1 can be understood as data screening apparatuses with base station functions, and the network elements 120a-120j can be understood as data screening apparatuses with terminal device functions.

[0052] In a possible scenario, the RAN node can be a base station, an evolved NodeB (eNodeB), an access point (AP), a transmission reception point (TRP), a next generation NodeB (gNB), a next generation base station in a 6th generation (6G) mobile communication system, a base station in a future mobile communication system, or an access node in a WiFi system, etc. The RAN node can be a macro base station (such as 110a in FIG. 1), a micro base station or an indoor station (such as 110b in FIG. 1), a relay node or a donor node, or a wireless controller in a CRAN scenario. Optionally, the RAN node can also be a server, a wearable device, a vehicle or a vehicle-mounted device, etc. For example, the network device in a vehicle to everything (V2X) technology can be a road side unit (RSU).

[0053] In another possible scenario, a terminal device is assisted by multiple RAN nodes to implement wireless access, and different RAN nodes respectively implement part of the functions of a base station. For example, the RAN node can be a central unit (CU), a distributed unit (DU), a central unit-control plane (CU-CP), a central unit-user plane (CU-UP), or a radio unit (RU), etc. The CU and the DU can be separately arranged, or can be included in the same network element, such as a baseband unit (BBU). The RU can be included in a radio frequency device or a radio frequency unit, such as a radio frequency remote unit (RRU), an active antenna processing unit (AAU), or a remote radio head (RRH).

[0054] The CU (or CU-CP and CU-UP), DU or RU can also have different names in different systems, but those skilled in the art can understand their meanings. For example, in an ORAN system, the CU can also be referred to as an open-central unit (O-CU), the DU can also be referred to as an open-distributed unit (O-DU), the CU-CP can also be referred to as an open-central unit-control plane (O-CU-CP), the CU-UP can also be referred to as an open-central unit-user plane (O-CU-UP), and the RU can also be referred to as an open-radio unit (O-RU). For the sake of convenience, the CU, CU-CP, CU-UP, DU and RU are taken as examples for description in this application. Any of the CU (or CU-CP, CU-UP), DU and RU in this application can be implemented by a software module, a hardware module, or a combination of a software module and a hardware module.

[0055] The terminal device can also be referred to as a terminal, a user equipment (UE), a mobile station, a mobile terminal device, etc. The terminal device can be widely applied to various scenarios, such as device-to-device (D2D) communication, vehicle to everything (V2X) communication, machine-type communication (MTC), internet of things (IOT), virtual reality, augmented reality, industrial control, automatic driving, remote medical treatment, smart power grid, smart furniture, smart office, smart wear, smart transportation, smart city, etc. The terminal device can be a mobile phone, a tablet computer, a computer with wireless transceiver function, a wearable device, a vehicle, a drone, a helicopter, an airplane, a ship, a robot, a mechanical arm, a smart home device, etc. Embodiments of the present application do not limit the device form of the terminal device.

[0056] The communication between the network device and the terminal device follows a certain protocol layer structure. The protocol layer can include a control plane protocol layer and a user plane protocol layer. The control plane protocol layer can include at least one of a radio resource control (RRC) layer, a packet data convergence protocol (PDCP) layer, a radio link control (RLC) layer, a media access control (MAC) layer, or a physical (PHY) layer, etc. The user plane protocol layer can include at least one of a service data adaptation protocol (SDAP) layer, a PDCP layer, an RLC layer, a MAC layer, or a physical layer, etc.

[0057] The base station and the terminal device can be fixed in position or movable. The base station and the terminal device can be deployed on land, including indoors or outdoors, handheld or vehicle-mounted; can also be deployed on water; can also be deployed on an airplane, a balloon, and a man-made satellite. The embodiments of the present application do not limit the application scenarios of the base station and the terminal device.

[0058] The roles of the base station and the terminal device can be relative, for example, the helicopter or the unmanned aerial vehicle 120i in FIG. 1 can be configured as a mobile base station, and for the terminal device 120j that accesses the wireless access network 100 through 120i, the terminal device 120i is a base station; but for the base station 110a, 120i is a terminal device, that is, 110a and 120i communicate through a wireless air interface protocol. Of course, 110a and 120i can also communicate through a base station-to-base station interface protocol, at this time, relative to 110a, 120i is also a base station. Therefore, the base station and the terminal device can be collectively referred to as a data screening device, 110a and 110b in FIG. 1 can be referred to as a data screening device with a base station function, and 120a-120j in FIG. 1 can be referred to as a data screening device with a terminal device function.

[0059] In the embodiments of the present application, the base station is also referred to as a network device, and the device for implementing the function of the network device can be a network device; can also be a device capable of supporting the network device to implement the function, such as a chip system, a hardware circuit, a software module, or a hardware circuit plus a software module. The device can be installed in the network device or used in combination with the network device. In the embodiments of the present application, only the device for implementing the function of the network device is taken as an example for description, and the scheme of the embodiments of the present application is not limited.

[0060] Furthermore, in this embodiment, the UE is also referred to as a terminal device. The apparatus for implementing the functions of the terminal device can be the terminal device itself; it can also be an apparatus capable of supporting the terminal device in implementing those functions, such as a chip system, hardware circuit, software module, or a hardware circuit plus a software module. This apparatus can be installed in the terminal device or used in conjunction with the terminal device. In this embodiment, only the apparatus for implementing the functions of the terminal device is described as a terminal device, and this does not constitute a limitation on the solutions of this embodiment.

[0061] It should be understood that the number and type of each device in the communication system shown in Figure 1 are for illustrative purposes only, and this application is not limited thereto. In actual applications, the communication system may include more terminal devices, more access network devices, and other network elements, such as core network devices and / or network elements used to implement artificial intelligence functions.

[0062] It is understandable that all or part of the functions implemented by one or more of the terminal devices, access network devices, core network devices, or network elements used to implement artificial intelligence functions can be virtualized, that is, implemented through one or more of dedicated or general-purpose processors and corresponding software modules. Among these, the terminal devices and access network devices involve air interface transmission, and the transmit and receive functions of this interface can be implemented in hardware. Core network devices, such as operation administration and maintenance (OAM) network elements, can also be virtualized. Optionally, one or more of the functions of the virtualized terminal devices, access network devices, core network devices, or network elements used to implement artificial intelligence functions can be implemented by cloud devices, such as cloud devices in over-the-top (OTT) systems.

[0063] Figure 2 shows a schematic diagram of the entire lifecycle of data within a mobile network, specifically the sixth generation (6G). th A white paper on the addition of a data plane in 6G, released at the Global Technology Conference for 6G Mobile Communication Systems, points out that with the continuous growth of data volume generated by future networks, the demand for data collection and processing is becoming increasingly prominent. Current data collection and processing methods in 5G cannot meet the increased data demands, and the 5G data collection and processing framework does not consider data quality management requirements. Therefore, it proposes establishing a unified data governance framework for future 6G. This framework introduces a data quality management function, which requires that, based on data requirements, the data plane should provide function selection and data processing to meet data service quality requirements such as accuracy, quantification precision, response time, validity period, completeness, redundancy, correctness, and consistency.

[0064] Meanwhile in 6G, artificial intelligence (AI) technology will be further integrated into the network, and the network will further use AI technology to optimize the running state of the network. In AI, data is the cornerstone of AI, and is the technology for model training and inference, and the quality of data determines the upper limit of the performance of the algorithm model. The design of the model itself has an upper limit, especially in the current era of large models, and a high-quality data set is particularly important, so the introduction of large models for endogenous AI intelligence of the network in future 6G, and the collection of high-quality data sets to assist the training of AI models to optimize the operation of the network are important problems to be solved at present.

[0065] Currently, the dimensions of AI data quality evaluation are provided. In the evaluation of AI data quality, the basic attributes and extended attributes of data are mainly considered, as shown in Table 1 below:

[0066] Table 1 AI data quality evaluation attributes

[0067] Among them, the data integrity in the basic attributes refers to the degree to which the data associated with the entity can reflect all the attribute characteristics of the entity. In the data integrity evaluation, the data integrity evaluation is mainly completed through the evaluation dimensions as shown in Table 2.

[0068] Table 2 AI data integrity evaluation dimensions

[0069] As can be seen from Table 2, when evaluating the integrity of the data, it is necessary to check whether the data is duplicated, whether the data is complete, and whether there is a missing, including the missing of time series and the missing of data features in the data.

[0070] However, the above description is mainly a general method for evaluating AI data integrity, and based on this method, the evaluation result of the data can be obtained. However, in the mobile network, the data consumption network element does not want to obtain the evaluation result of the data set, but wants to obtain a data set that meets the requirements, and then is used for model training, or model inference, etc., so this technology cannot meet the requirements of the data consumption network element in the mobile network.

[0071] A data collection coordination framework based on a data collection coordination function (DCCF) is also defined as shown in FIG. 3. In this framework, the DCCF receives a data collection request of a data consumer, which includes the requested data type and the processing method after data collection. The data processing method includes a method of aggregating data from different data sources according to a specific aggregation granularity (per UE, per AOI, per minute, per hour), etc.

[0072] However, when the DCCF receives the data request of the data consumer, the data consumer only requires the DCCF to aggregate data from different data sources, without considering whether the aggregated data of the DCCF meets the data requirements of the data consumer.

[0073] Therefore, how to provide effective data to the data consumer is a problem to be solved.

[0074] Therefore, how to provide effective data to the data consumer is a problem to be solved.

[0075] The above scheme can be applied to a data screening system. As shown in FIG. 4, an architecture diagram of a data screening system provided by an embodiment of the present application is shown, which includes a data consumer 41, a data screening device 42 and a data source 43. The data consumer 41 instructs the data screening device 42 to screen data in a collected data set, and provides a method of screening data in the collected data set. The data screening device 42 collects data from the data source 43, and screens data in the collected data set according to the screening method, and returns data meeting the requirements of the data consumer 41 to the data consumer 41.

[0076] As shown in FIG. 5, it is a schematic diagram of a data screening system in a future mobile network according to an embodiment of the present application. The data screening device can be located in the core network, and can include a data collection and processing function (DHF), a data management function (DMF), and a data storage function (DSF). The data consumer network element can be an application function (AF) network element or a network data analytics function (NWDAF), which obtains data for model training and inference. The data source can be a UE or a RAN or a core network NF.

[0077] The system can be a unified data collection framework that can be defined in a future sixth generation (6 th generation,6G) mobile communication network, which is an AI-friendly data base framework. In this framework, there is still a data collection and processing function, which is responsible for collecting data from various data sources and uniformly processing the collected data, and opening the processed data or original data to the NWDAF in the network, and also storing the processed data or original data in multiple data storage functions. Meanwhile, the network function also performs quality assessment on the processed data, for opening the data with quality assurance to the NWDAF or AF.

[0078] In this framework, there can also be a data management function, which is mainly responsible for unified authorization and management when the UE or AF accesses the data in the network, that is, responsible for centralized network data management and control and opening of data services.

[0079] In this framework, there can also be a data storage function, which is mainly responsible for distributed storage of data and retrieval, reading and writing of data.

[0080] As shown in FIG. 6, it is a flowchart of a data screening method according to an embodiment of the present application. The method can include the following steps:

[0081] S601. The data consumer network element sends a first request to the data screening device.

[0082] Correspondingly, the data screening device receives the first request.

[0083] In the embodiment, the data consumption network element sends a first request to the data filtering device when deciding to collect data. Different from the data collection mentioned in the background art, in the embodiment, the data consumption network element instructs the data filtering device to perform data filtering on the data in the collected data set. Exemplarily, the first request instructs to perform data filtering on the data in the collected data set.

[0084] The first request includes a data filtering method in the data set, i.e., the data filtering device is instructed to filter the collected data according to the data filtering method in the data set.

[0085] The data filtering method in the data set includes a data type contained in each piece of data constituting the data set in the data set. Based on the data type contained in each piece of data constituting the data set in the data set, the filtered data can be determined, and the filtered data only contains data conforming to the data type and does not contain data other than the data type.

[0086] S602. The data filtering device sends a first response to the data consumption network element.

[0087] Correspondingly, the data consumption network element receives the first response.

[0088] After receiving the first request, the data filtering device collects data from one or more data sources according to the first request, filters the collected data according to the data filtering method in the data set indicated by the first request, and then sends a first response to the data consumption network element. The first response contains first data, which is a data set composed of data satisfying the data filtering method in the data set.

[0089] According to the data filtering method provided by the embodiment, the data consumption network element instructs the data filtering device to perform data filtering on the data in the collected data set, and provides a method for filtering the data in the collected data set, so that the data filtering device filters the data in the data set according to the method, and provides effective data satisfying the requirements of the data consumption network element.

[0090] Further, the data filtering device can avoid sending data that does not satisfy the requirements to the data consumption network element, reduce the amount of data sent, and ensure the integrity of the data.

[0091] The above embodiment describes a data filtering method. The above data filtering method is further described below with reference to the architecture shown in FIG. 5:

[0092] As shown in FIG. 7, a flowchart of another data filtering method provided by an embodiment of the present application is shown. The method can be applied to the architecture shown in FIG. 5, and in this embodiment, the data filtering device is a DHF. The data filtering device can also include data processing functions, data storage functions, etc. By way of example, the method can include the following steps:

[0093] S701. The data consumer network element decides to collect data.

[0094] For example, the data consumer network element decides to perform model training, determines the data that needs to be collected, and determines the key indicators in the collected data that have different impacts on model training.

[0095] S702. The data consumer network element sends a first request to the DHF.

[0096] Correspondingly, the DHF receives the first request.

[0097] For example, the first request can be a data management subscription (DataManagement_subscibe) request.

[0098] The first request indicates data filtering on the data in the collected data set. The first request includes a data filtering method for the data in the data set. The data filtering method for the data in the data set can also be referred to as a requirement for performing data filtering (e.g., integrity evaluation) on the data set composed of the collected data.

[0099] The data filtering method for the data in the data set includes the data types included in each piece of data that constitutes the data set in the data set. For example, the data filtering method for the data in the data set includes a data type list. The data type list refers to list information of the data types corresponding to the data elements included in each piece of data that constitutes the data set in the data set.

[0100] Further, the method for data screening in the data set further comprises at least one of the following: the number of data types in each piece of data that has non-empty data values, and the data types in each piece of data that have data values. The number of data types in each piece of data that has non-empty data values can be determined by a data type number threshold or a data type valid data entry proportion threshold. The data type number threshold refers to the number of data types with valid data values in each piece of data that the data consumer network element expects to obtain satisfying the threshold requirement. The data type valid data entry proportion threshold refers to the proportion of the number of data entries that are not empty or valid in each data type to the total number of data entries in the data set containing n pieces of data. The valid data entry proportion threshold for each data type can be the same or different. The data types in each piece of data that have data values refer to necessary data types, i.e., each piece of data that the data consumer network element expects to obtain must have valid data values in the data type.

[0101] For example, the data consumer network element requests to collect data related to service experience. The data related to service experience is a data set composed of data entry groups formed by the DHF according to timestamps by associating multiple data related to UEs collected from application functions (AFs) / network functions (NFs).

[0102] The data consumer network element expects the DHF to aggregate per UE data collected from various data sources according to the time dimension and perform integrity checking. The data consumer network element provides the data types that should be included in each piece of aggregated data and the requirements for integrity checking of the overall aggregated data when aggregating per minute per UE.

[0103] For example, the data type list = [service experience / UE location (AMF) / finer UE location (GMLC) / QFI / QoS flow Bit Rate / packet delay / retransmission / RSRP / RSRQ], i.e., the data consumer network element expects each piece of data for each UE after aggregation per minute to include the data given in the data type list containing these data types.

[0104] The data type number threshold = 5, i.e., there are at least 5 data types in each piece of data that have non-empty data.

[0105] Necessary data type = service experience. It means that each data in the data set must have data in the data type of service experience. This necessary data type can be one or more.

[0106] Data type valid data entry proportion threshold = 90%. It means that if there are 100 data in the data set, at least 90 data in each data type have data.

[0107] When the data collected by the data collection network element does not meet the requirement after the data aggregated according to the timestamp, the data is considered invalid. The data does not need to be sent to the data consumption network element.

[0108] Further, the first request also indicates how to collect data and how to preliminarily preprocess the collected data. Exemplarily, the first request further includes a service operation and a data specification. The service operation is the name of the service operation that needs to be used when collecting data, such as using event exposure subscription (Namf_EventExposure_Subscribe) when collecting data from an access and mobility management function (AMF) network element, or using a subscription operation of an OAM when collecting data from the OAM. The data specification is a method for preliminarily preprocessing the collected data, such as aggregating multiple notifications together and returning according to a period when returning data to a data consumption network element, and further including aggregation and other processing of data collected from multiple data sources.

[0109] S703. The DHF sends identification information (Subscription Correlation ID) of the data subscription correlation to the data consumption network element.

[0110] Correspondingly, the data consumption network element receives the identification information of the data subscription correlation.

[0111] For example, the DHF sends a data management notification (DataManagement_Notify) to the data consumption network element. The data management notification includes the identification information of the data subscription correlation. The identification information is used to identify the data request / data subscription process.

[0112] S704. The DHF collects multiple data from the data source based on the requirement of the data type included in each data in the data set.

[0113] After receiving the first request, the DHF collects multiple pieces of data from the data source based on the data screening method included in the first request, i.e., based on the requirement of the data type included in each piece of data in the data set. Each piece of data includes data corresponding to one or more data types.

[0114] S705. The DHF screens each piece of data in the collected data set based on the number of data types with non-empty data values in each piece of data and / or the data types with data values in each piece of data, and determines the data that meets the data screening method in the data set.

[0115] After the DHF aggregates the collected data, the data set is obtained, and the data that meets the data screening method in the data set is determined. For example, the DHF screens each piece of data in the collected data set based on the number of data types with non-empty data values in each piece of data and / or the data types with data values in each piece of data, and determines the data that meets the data screening method in the data set.

[0116] Further, the DHF generates an integrity evaluation report of the data set. The integrity evaluation report is the result of evaluation according to the data element list provided by the data consumption network element.

[0117] The integrity evaluation report includes:

[0118] (1) Number of repeated data entries: X = A / B, A is the number of data entries in the data set that are exactly the same under the element list; B is the total number of data entries in the data set.

[0119] (2) Number of repetitions of each data element: Xi = Ai / B, Ai is the number of data entries with the same data value under the data element i; B is the total number of data entries in the data set.

[0120] (3) Data integrity: X = A / B, A is the total number of data entries with data under each data element; B is the total number of data entries in the data set.

[0121] (4) Integrity of each data element: Xi = Ai / B, Ai is the data entry of the data value of the data under the data element i; B is the total number of data entries in the data set.

[0122] For example, the data consumption network element provides a data type list = [service experience / UE location(AMF) / finer UE location(GMLC) / QFI / QoS flow Bit Rate / packet delay / retransmission / RSRP / RSRQ].

[0123] The data set collected by the DHF is shown in Table 3 below:

[0124] Table 3

[0125] As can be seen from Table 3, the number of identical data entries = 2;

[0126] The number of repeated data entries = 2 / 25;

[0127] The number of repeated data elements = [[service experience: 4.5 (18 / 25), 3.5 (5 / 25)], [UE location (AMF): TA1 (18 / 25)], [finer UE location (GMLC): value1 (13 / 25), value2 (5 / 25)], [QFI: 6 (18 / 25)], [QoS flow Bit Rate: 50mbps (15 / 25), 35mbps (2 / 25)], [packet delay: 1ms (5 / 25), 2ms (14 / 25)], [retransmission: 0.5% (14 / 25)], [RSRP: -90 (20 / 25)], [RSRQ: -3.5 (18 / 25), -3 (2 / 25)]].

[0128] Data integrity = (10 / 25) / 40%;

[0129] Data element integrity: [[service experience: (25 / 25) / 100%], [UE location (AMF): (18 / 25) / (72%)], [finer UE location (GMLC): (18 / 25) / (72%)], [QFI: (18 / 25) / (72%)], [QoS flow Bit Rate: (20 / 25) / 80%], [packet delay: (21 / 25) / 84%], [retransmission: (17 / 25) / 68%], [RSRP: (23 / 25) / [92%]], [RSRQ: (23 / 25) / (92%)]].

[0130] The above is only an example of the integrity assessment report, and the integrity assessment report can also include other parameters, or be determined according to the implementation of the DHF, which is not limited in the present application.

[0131] S706. The DHF sends a first response to the data consumption network element.

[0132] Correspondingly, the data consumption network element receives the first response.

[0133] The first response includes first data, and the first data is a data set composed of data satisfying a data filtering method of the data set.

[0134] Further, the first response can further include a completeness evaluation report of the data set.

[0135] Exemplarily, the first response can be a data management fetch message.

[0136] According to the data filtering method provided in the embodiment of the present application, the data consumption network element instructs the DHF to perform data filtering on the data in the collected data set, and provides a method for filtering the data in the collected data set, so that the DHF filters the data in the data set according to the method, and provides effective data satisfying the requirements of the data consumption network element.

[0137] Further, the DHF can be prevented from sending data not satisfying the requirements to the data consumption network element, the amount of data to be sent is reduced, and the completeness of the data is ensured.

[0138] The above data filtering method will be further described below by taking the architecture shown in FIG. 3 as an example:

[0139] As shown in FIG. 8, it is a flowchart of another data filtering method provided in the embodiment of the present application. The method can be applied to the architecture shown in FIG. 3, and in the embodiment, the data filtering device is the DCCF. In the embodiment, the DCCF has a data collection coordination function for coordinating the collection and distribution of data requested by the data consumption network element, and also has a function of performing data filtering according to the method for filtering the data in the data set indicated by the data consumption network element. Exemplarily, the method can include the following steps:

[0140] S801. The data consumption network element decides to collect data.

[0141] The specific implementation of the step can refer to step S701 of the embodiment shown in FIG. 7, and will not be described here again.

[0142] S802. The data consumption network element sends a first request to the DCCF.

[0143] Correspondingly, the DCCF receives the first request.

[0144] The first request instructs to perform data filtering on the data in the collected data set. The first request includes a data filtering method of the data set, and the data filtering method of the data set includes a data type included in each piece of data constituting the data set.

[0145] The specific implementation of this step can refer to step S702 of the embodiment shown in FIG. 7, which will not be repeated here. The difference is that, in the present embodiment, the data filtering device is DCCF. The present embodiment is a data set integrity evaluation scheme based on the current data collection processing framework of 5G, and is an enhancement of DCCF under the 5G framework.

[0146] S803. The DCCF sends the identification information of the data subscription association to the data consumption network element.

[0147] Correspondingly, the data consumption network element receives the identification information of the data subscription association.

[0148] The specific implementation of this step can refer to step S703 of the embodiment shown in FIG. 7, which will not be repeated here.

[0149] S804. The DCCF collects multiple pieces of data from the data source based on the requirement of the data type included in each piece of data in the data set.

[0150] The specific implementation of this step can refer to step S704 of the embodiment shown in FIG. 7, which will not be repeated here.

[0151] S805. The DCCF filters each piece of data in the collected data set based on the number of data types with non-empty data values in each piece of data and / or the data types with data values in each piece of data, and determines the data that meets the data filtering method in the data set.

[0152] The specific implementation of this step can refer to step S705 of the embodiment shown in FIG. 7, which will not be repeated here.

[0153] S806. The DCCF sends a first response to the data consumption network element.

[0154] Correspondingly, the data consumption network element receives the first response.

[0155] The first data in the first response is a data set composed of data that meets the data filtering method in the data set.

[0156] The specific implementation of this step can refer to step S706 of the embodiment shown in FIG. 7, which will not be repeated here.

[0157] According to the data filtering method provided in the embodiments of the present application, the data consumption network element instructs the DCCF to filter the data in the collected data set, and provides a method for filtering the data in the collected data set, so that the DCCF filters the data in the data set according to the method, and provides effective data that meets the requirements of the data consumption network element.

[0158] As shown in FIG. 9, a flowchart of another data filtering method provided by the embodiments of the present application is shown. In this embodiment, the data filtering device is NWDAF, and the NWDAF is combined with the data evaluation / filtering function. The method can include the following steps:

[0159] S901. The data consuming network element decides to collect data.

[0160] The specific implementation of this step can refer to step S701 of the embodiment shown in FIG. 7, which will not be repeated here.

[0161] S902. The data consuming network element sends a first request to the NWDAF.

[0162] Correspondingly, the NWDAF receives the first request.

[0163] The first request indicates that the data filtering is performed on the data in the collected data set. The first request includes the data filtering method of the data in the data set, and the data filtering method of the data in the data set includes the data type contained in each piece of data constituting the data set.

[0164] The specific implementation of this step can refer to step S702 of the embodiment shown in FIG. 7, which will not be repeated here. The difference is that, in this embodiment, the NWDAF is combined with the data evaluation / filtering function, and the NWDAF has the data evaluation / filtering function, which is an enhancement of the function of the NWDAF.

[0165] S903. The NWDAF sends the identification information of the data subscription association to the data consuming network element.

[0166] Correspondingly, the data consuming network element receives the identification information of the data subscription association.

[0167] The specific implementation of this step can refer to step S703 of the embodiment shown in FIG. 7, which will not be repeated here.

[0168] S904. The NWDAF collects multiple pieces of data from the data source based on the requirement of the data type included in each piece of data in the data set.

[0169] The specific implementation of this step can refer to step S704 of the embodiment shown in FIG. 7, which will not be repeated here.

[0170] S905. The NWDAF filters each piece of data in the collected data set based on the number of data types with non-empty data values in each piece of data and / or the data types with data values in each piece of data, and determines the data satisfying the data filtering method of the data set.

[0171] The specific implementation of this step can refer to step S705 of the embodiment shown in FIG. 7, which will not be repeated here.

[0172] S906. The NWDAF sends a first response to the data consuming network element.

[0173] Correspondingly, the data consuming network element receives the first response.

[0174] The first response contains first data, and the first data is a data set composed of data satisfying the data filtering method in the data set.

[0175] The specific implementation of this step can refer to step S706 of the embodiment shown in FIG. 7, which will not be described here.

[0176] According to the data filtering method provided in the embodiment of the application, the data consuming network element instructs the NWDAF to perform data filtering on the data in the collected data set, and provides a method for filtering the data in the collected data set, so that the NWDAF filters the data in the data set according to the method, and provides effective data that meets the requirements of the data consuming network element.

[0177] In the above embodiment, the data collection and filtering functions are integrated. In the following embodiment, the process in the case where the data collection and filtering functions are independent of each other will be described:

[0178] As shown in FIG. 10, it is a flowchart of another data filtering method provided in the embodiment of the application. The method may, for example, include the following steps:

[0179] S1001. The data consuming network element decides to collect data.

[0180] The specific implementation of this step can refer to step S701 of the embodiment shown in FIG. 7, which will not be described here.

[0181] S1002. The data consuming network element sends a first request to the data collection network element.

[0182] Correspondingly, the data collection network element receives the first request.

[0183] The first request instructs to perform data filtering on the data in the collected data set. The first request includes a data filtering method in the data set, and the data filtering method in the data set includes the data type contained in each piece of data constituting the data set in the data set.

[0184] The specific implementation of this step can refer to step S702 of the embodiment shown in FIG. 7, which will not be described here. The difference is that, in the embodiment, the data collection network element only has a data collection function, and does not have a data filtering / evaluation function.

[0185] S1003. The data collection network element sends identification information of the data subscription association to the data consuming network element.

[0186] Correspondingly, the data consumption network element receives the identification information associated with the data subscription.

[0187] The specific implementation of this step can refer to step S703 of the embodiment shown in FIG. 7, which will not be described here again.

[0188] S1004. The data collection network element collects a plurality of data from the data source based on the requirement of the data type included in each piece of data in the data set.

[0189] The specific implementation of this step can refer to step S704 of the embodiment shown in FIG. 7, which will not be described here again.

[0190] S1005. The data collection network element sends a second request to the data filtering network element.

[0191] Correspondingly, the data filtering network element receives the second request.

[0192] After the data collection network element collects a plurality of data from the data source, the data collection network element sends the collected data and the data filtering method of the data in the data set sent by the data consumption network element to the data filtering network element. Illustratively, the data collection network element sends a second request to the data filtering network element. The second request indicates that the data filtering is performed on the data in the collected data set. The second request includes the data filtering method of the data in the data set, and the data filtering method of the data in the data set includes the data type contained in each piece of data constituting the data set.

[0193] S1006. The data filtering network element filters each piece of data in the collected data set based on the number of data types with non-empty data values in each piece of data and / or the data types with data values in each piece of data, and determines the data satisfying the data filtering method of the data set.

[0194] After the data filtering network element evaluates and filters the received data according to the data filtering method of the data set, the data filtering network element obtains the data satisfying the data filtering method of the data set. Further, the data filtering network element generates a data set integrity evaluation report. The specific implementation of this step can refer to step S705 of the embodiment shown in FIG. 7, which will not be described here again.

[0195] After the data filtering network element determines the data satisfying the data filtering method of the data set, the data filtering network element performs the following processes alternatively:

[0196] Process one:

[0197] S1007a-1. The data filtering network element sends a second response to the data collection network element.

[0198] Correspondingly, the data collection network element receives the second response.

[0199] The first data in the second response is a data set composed of data satisfying the data filtering method of the data set.

[0200] The data collection network element sends a first response to the data consumption network element.

[0201] The data consumption network element receives the first response.

[0202] The first data in the second response is a data set composed of data satisfying the data filtering method of the data set.

[0203] In the first flow, the data filtering network element sends the filtered data and the data set integrity evaluation report to the data collection network element, and the data collection network element sends the data to the data consumption network element.

[0204] The second flow is as follows.

[0205] The data filtering network element sends a third response to the data consumption network element.

[0206] The data consumption network element receives the third response.

[0207] The first data in the second response is a data set composed of data satisfying the data filtering method of the data set.

[0208] In the second flow, the data filtering network element sends the filtered data and the data set integrity evaluation report directly to the data consumption network element.

[0209] According to the data filtering method provided by the embodiment of the present application, the data consumption network element instructs the data filtering network element to filter the data in the collected data set, and provides a method for filtering the data in the collected data set, so that the data filtering network element filters the data in the data set according to the method, and provides effective data satisfying the requirement of the data consumption network element.

[0210] It can be understood that the method and / or steps realized by the data filtering device in each of the above embodiments can also be realized by a component (for example, a chip or a circuit) that can be used for the data filtering device, and the method and / or steps realized by the data consumption network element can also be realized by a component (for example, a chip or a circuit) that can be used for the data consumption network element.

[0211] The above describes the scheme provided by the embodiments of the present application from the perspective of interaction between the data consumption network element and the data filtering device. Accordingly, the embodiments of the present application also provide a data filtering device, which is configured to implement the above-mentioned various methods. The data filtering device can be the data filtering device in the above-mentioned method embodiments, or a component applicable to the data filtering device; or the data filtering device can be the data consumption network element in the above-mentioned method embodiments, or a component applicable to the data consumption network element. It can be understood that, in order to implement the above-mentioned functions, the data filtering device comprises corresponding hardware structures and / or software modules for performing various functions. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0212] The embodiments of the present application can divide the data filtering device into functional modules according to the above-mentioned method embodiments, for example, each functional module can be divided according to each function, or two or more functions can be integrated in one processing unit. The above-mentioned integrated module can be implemented in the form of hardware or software functional module. It should be noted that the division of modules in the embodiments of the present application is illustrative, and is only a logical functional division. Actual implementation can have another division manner.

[0213] Based on the same concept of the above-mentioned data filtering method, the present application also provides a data filtering device as follows:

[0214] As shown in FIG. 11, it is a structural schematic diagram of a data filtering device provided by the embodiments of the present application. The data filtering device 1100 comprises a communication unit 1101 and a processing unit 1102, and can further comprise a storage unit 1103 (indicated by a dashed line in the figure). Wherein:

[0215] Exemplarily, the above-mentioned communication unit 1101 can comprise a receiving unit and a sending unit, which can be an integral whole or independent units.

[0216] When the data filtering device 1100 is configured to implement the functions of the data consumption network element, the communication unit 1101 is configured to perform one or more operations of the data consumption network element in steps S601 and S602 of the embodiment shown in FIG. 6.

[0217] The communication unit 1101 is configured to perform one or more operations of the data screening device in steps S601 and S602 of the embodiment shown in FIG. 6 when the data screening device 1100 is used to implement the functions of the data screening device.

[0218] For the specific implementation of the communication unit 1101 and the processing unit 1102, refer to the related description in the embodiment shown in FIG. 6.

[0219] The division of the modules in the present application is illustrative, and is only a logical functional division. In actual implementation, another division manner can be used. In addition, each functional module in each example in the present application can be integrated in one processor, or can be physically separated, or two or more modules can be integrated in one module. The integrated module can be implemented in the form of hardware or in the form of a software functional module.

[0220] As shown in FIG. 12, FIG. 12 is a structural schematic diagram of another data screening device provided by an embodiment of the present application. The data screening device 1200 includes a processor 1201. Optionally, the data screening device 1200 can further include an interface circuit 1202 (indicated by a dashed line in the figure), and the processor 1201 and the interface circuit 1202 are coupled to each other. It can be understood that the interface circuit 1202 can be a transceiver or an input / output interface. Optionally, the data screening device 1200 can further include a memory 1203 (indicated by a dashed line in the figure), which is used to store instructions executed by the processor 1201, or to store input data required by the processor 1201 to run instructions, or to store data generated after the processor 1201 runs instructions.

[0221] The interface circuit 1202 is configured to perform one or more operations of the data consumption network element in steps S601 and S602 of the embodiment shown in FIG. 6 when the data screening device 1200 is used to implement the functions of the data consumption network element.

[0222] The interface circuit 1202 is configured to perform one or more operations of the data screening device in steps S601 and S602 of the embodiment shown in FIG. 6 when the data screening device 1200 is used to implement the functions of the data screening device.

[0223] For the specific implementation of the processor 1201, the interface circuit 1202 and the memory 1203, refer to the related description in the embodiment shown in FIG. 6.

[0224] When the data screening device is a chip applied to the data screening device, the chip implements the function of the data screening device in the method embodiments. The chip receives information from other modules (such as a radio frequency module or an antenna) in the data screening device, and the information is sent by the data consumption network element to the data screening device; or the chip sends information to other modules (such as a radio frequency module or an antenna) in the data screening device, and the information is sent by the data screening device to the data consumption network element.

[0225] When the data screening device is a chip applied to the data consumption network element, the chip implements the function of the data consumption network element in the method embodiments. The chip receives information from other modules (such as a radio frequency module or an antenna) in the data consumption network element, and the information is sent by the data screening device to the data consumption network element; or the chip sends information to other modules (such as a radio frequency module or an antenna) in the data consumption network element, and the information is sent by the data consumption network element to the data screening device.

[0226] In addition, it should be noted that the aforementioned transceiver unit and / or processing unit can be implemented by a virtual module, for example, the processing unit can be implemented by a software function unit or a virtual device, and the transceiver unit can be implemented by a software function or a virtual device. Alternatively, the processing unit or the transceiver unit can also be implemented by an entity device, for example, if the device is implemented by a chip / chip circuit, the transceiver unit can be an input / output circuit and / or a communication interface, which performs an input operation (corresponding to the aforementioned receiving operation) and an output operation (corresponding to the aforementioned sending operation); and the processing unit is an integrated processor or a microprocessor or an integrated circuit.

[0227] It can be understood that the processor in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor can be a microprocessor or any conventional processor.

[0228] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program or instructions, when the computer program or instructions are executed, the method in the above embodiments is implemented.

[0229] The embodiment of the present application further provides a computer program product containing instructions, which, when executed on a computer, cause the computer to perform the method in the above embodiment.

[0230] The embodiment of the present application further provides a communication system, comprising the data screening device.

[0231] The embodiment of the present application further provides a circuit, which is coupled with the memory and is used for executing the method shown in the above embodiment. The circuit can comprise a chip circuit.

[0232] The embodiment of the present application further provides a chip device, comprising a processor, which is used for calling computer degree or computer instructions stored in the memory, so as to make the processor execute the method provided in any of the above method embodiments.

[0233] In a possible implementation manner, the input of the chip device corresponds to the receiving operation in any of the above method embodiments, and the output of the chip device corresponds to the sending operation in any of the above method embodiments.

[0234] Optionally, the processor is coupled with the memory through an interface.

[0235] Optionally, the chip device further comprises a memory, and the memory stores computer degree or computer instructions.

[0236] When the data screening device is a module applied to a network device, the network device module implements the function of the network device in the above method embodiments. The network device module receives information from other modules (such as a radio frequency module or an antenna) in the network device, and the information is sent by a UE to the network device; or the network device module sends information to other modules (such as a radio frequency module or an antenna) in the network device, and the information is sent by the network device to the UE. The network device module can be a baseband chip of the network device, or a CU, a DU or other modules, or an apparatus under the O-RAN architecture, such as an open CU, an open DU and the like.

[0237] It should be noted that the above unit or one or more of the units can be realized by software, hardware or combination of both. When any of the above units is realized by software, the software exists in the form of computer program instructions and is stored in the memory, and the processor can be used to execute the program instructions and realize the above method flow.

[0238] In this application, the processor can be a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, which can implement or perform the methods, steps and logical block diagrams disclosed in this application. The general purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in this application can be directly embodied as hardware processor execution, or executed by a combination of hardware and software modules in the processor.

[0239] When the above units or units are implemented in hardware, the hardware can be any one or a combination of a CPU, a microprocessor, a digital signal processing (DSP) chip, a microcontroller unit (MCU), an artificial intelligence processor, an ASIC, a SoC, a FPGA, a programmable logic device (PLD), a dedicated digital circuit, a hardware accelerator or a non-integrated discrete device, which can run necessary software or not rely on software to perform the above method flows.

[0240] Optionally, the embodiments of the present application further provide a chip system, comprising: at least one processor and an interface, the at least one processor is coupled with a memory through the interface, when the at least one processor runs a computer program or instructions in the memory, the chip system executes the method in any of the above method embodiments. Optionally, the chip system can be composed of a chip, or can contain a chip and other discrete devices, the embodiments of the present application do not make specific limitations hereon.

[0241] The memory in this application can also be a circuit or other any device capable of realizing the storage function, used for storing program instructions and / or data. The memory can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited to this. For example, the memory can be a non-volatile memory such as a digital versatile disc (DVD), a hard disk drive (HDD) or a solid-state drive (SSD), etc., and can also be a volatile memory such as a random-access memory (RAM).

[0242] It should be understood that, in the present application, "indication" can include direct indication, indirect indication, display indication, and implicit indication. When it is described that certain indication information is used to indicate A, it can be understood that the indication information carries A, directly indicates A, or indirectly indicates A. In the present application, the information indicated by the indication information is referred to as to-be-indicated information. In the specific implementation process, there are many ways to indicate the to-be-indicated information, for example, but not limited to, the to-be-indicated information can be directly indicated, such as the to-be-indicated information itself or an index of the to-be-indicated information, or the to-be-indicated information can be indirectly indicated by indicating other information, where the other information and the to-be-indicated information have an association relationship. It can also be indicated only a part of the to-be-indicated information, and the other part of the to-be-indicated information is known or agreed in advance. For example, the indication of a specific information can also be achieved by means of the arrangement order of each information agreed in advance (for example, specified by a protocol), thereby reducing the indication overhead to a certain extent. The to-be-indicated information can be sent together as a whole, or can be sent separately into multiple sub-information, and the sending period and / or sending occasion of the sub-information can be the same or different. The specific sending method is not limited in the present application. The sending period and / or sending occasion of the sub-information can be predefined, for example, predefined according to a protocol, or configured by a transmitting end device through sending configuration information to a receiving end device.

[0243] At least one (item) referred to in the present application indicates one (item) or multiple (items). Multiple (items) refers to two (items) or more than two (items). "And / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the front and rear associated objects. In addition, it should be understood that although the terms first, second, etc. can be used to describe various objects in the present application, these objects should not be limited by these terms. These terms are only used to distinguish the objects from each other.

[0244] The terms "include" and "have" mentioned above and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include other steps or units not listed, or can optionally include other steps or units inherent to the process, method, product, or device. It should be noted that in the present application, the words "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any method or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other methods or design schemes. Rather, the use of "exemplary" or "for example" is intended to present the relevant concept in a specific manner.

[0245] A network element in a communication system can send a signal to another network element or receive a signal from another network element. The signal can include information, signaling, data, and the like. The network element can also be replaced by an entity, a network entity, a device, a UE, a communication module, a node, a communication node, and the like. For example, the communication system can include at least one UE and at least one network device. The network device can send a downlink signal to the UE, and / or the UE can send an uplink signal to the network device. In addition, it can be understood that if the communication system includes multiple UEs, the multiple UEs can also send signals to each other, that is, the sending network element of the signal and the receiving network element of the signal can both be UEs.

[0246] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode.

[0247] Although the present application is described herein in conjunction with various embodiments, other variations of the disclosed embodiments can be understood and implemented by those skilled in the art through viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude a plurality. A single processor or other unit can implement several functions listed in the claims. Some measures described in mutually different dependent claims can be combined and produce a good result.

[0248] It can be understood that various numerical numbers involved in the embodiments of the present application are only for convenient differentiation and do not limit the scope of the embodiments of the present application. The size of the serial numbers of the above processes does not mean the execution order, and the execution order of the processes should be determined by its function and inherent logic.

[0249] In the above embodiments, the description of each embodiment is focused on, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0250] The components in the device embodiments of the present application can be combined, divided, and deleted according to actual needs. Those skilled in the art can combine or combine the features of different embodiments and different embodiments described in the specification.

[0251] In the present application, there is no logical contradiction between examples, for example, the methods and / or terms between method embodiments can be mutually quoted, for example, the functions and / or terms between device embodiments can be mutually quoted, for example, the functions and / or terms between device examples and method examples can be mutually quoted.

Claims

1. A method of data screening, characterized by, The method comprises: receiving a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; sending a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set.

2. The method of claim 1, wherein, The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values.

3. The method of claim 2, wherein, The method further comprises: collecting a plurality of pieces of data from a data source based on the requirements of the data types contained in each piece of data in the data set, each piece of data comprising data corresponding to one or more data types.

4. The method of any one of claims 2-3, wherein, The method further comprises: determining data satisfying the data filtering method in the data set.

5. The method of claim 4, wherein, The determination of data satisfying the data filtering method in the data set comprises: filtering each piece of data in the collected data set based on the number of data types in each piece of data having non-empty data values and / or the data types in each piece of data having data values, to determine data satisfying the data filtering method in the data set.

6. The method of any one of claims 1-5, wherein, The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set.

7. A method of data screening, characterized by, The method comprises: sending a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; receiving a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set.

8. The method of claim 7, wherein, The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values.

9. The method of claim 7 or 8, wherein, The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set.

10. A data screening device characterized by comprising: The method comprises:

11. A data screening device characterized by comprising: receiving a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; 12. A computer-readable storage medium, characterized in that, receiving a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set. The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values. The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set. The method comprises: receiving a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; receiving a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set. The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values. The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set. The method comprises: receiving a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; receiving a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set. The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values. The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set. The method comprises: receiving a first request, the first request indicating data filtering on data in a collected data set, the first request comprising a data filtering method in the data set, the data filtering method in the data set comprising data types contained in each piece of data constituting a data set in the data set; receiving a first response, the first response containing first data, the first data being a data set consisting of data satisfying the data filtering method in the data set. The data filtering method in the data set further comprises at least one of the following: the number of data types in each piece of data having non-empty data values, and the data types in each piece of data having data values. The first response further comprises a data set integrity evaluation report, the data set integrity evaluation report being a result of a complete analysis of the first data according to the data types contained in each piece of data constituting a data set in the data set.

13. A computer program product, characterised in that, The computer program product comprises program instructions involved, which, when executed, cause the method as claimed in any one of claims 1-6 to be implemented, or cause the method as claimed in any one of claims 7-9 to be implemented.

Images