Data collection processing method and device, nonvolatile storage medium and electronic equipment
By assigning data levels to indicate priority and using data collection rules, the method addresses low processing efficiency in user plane functional entities, improving data handling efficiency.
Patent Information
- Application Number
- CN202411304479.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-18
- Publication Date
- 2024-12-24
AI Technical Summary
Existing communication technologies face low data processing efficiency due to user plane functional entities with limited resources or reduced processing capabilities, failing to determine optimal processing methods based on data characteristics.
Implementing a data collection and processing method that includes determining data levels to indicate collection priority, using data collection rules to process data sets, and sending them to storage servers, with data levels indicating higher priority for processing.
Improves data processing efficiency by enabling user plane functional entities to determine appropriate processing methods based on data characteristics, enhancing data handling capabilities.
Smart Images
Figure CN119183097A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular, to a data collection and processing method, device, non-volatile storage medium and electronic device. Background Art
[0002] Currently, in the field of communications, it is usually necessary to collect and process various communication data through user plane functional entities. However, when the user plane functional entity itself has limited resources or reduced processing capabilities so that it cannot process all data with high precision, the relevant technology cannot achieve the determination of the data processing method based on the characteristics of various types of data without affecting the basic business. As a result, the data processing efficiency in the relevant technology is low when the user plane functional entity itself has limited resources or reduced processing capabilities.
[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention
[0004] The embodiments of the present application provide a data collection and processing method, device, non-volatile storage medium and electronic device to at least solve the technical problem of low data processing efficiency caused by the inability of relevant technicians to determine the required processing method according to the characteristics of different data.
[0005] According to one aspect of an embodiment of the present application, a data collection and processing method is provided, including: a user plane functional entity receives a first data collection rule; receives a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; according to the first data collection rule and the data levels marked with various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server.
[0006] Optionally, the first data collection rule is a data collection rule determined by the policy control function entity based on data collection configuration information sent by the data service function entity or the target application, and the first data collection rule includes the data level and its corresponding data collection requirements and data processing requirements; the second data collection rule is a data collection rule determined by the policy control function entity based on the data collection configuration information sent by the data service function entity or the target application, and the second data collection rule includes the data level.
[0007] Optionally, the data processing requirements include: a preset data processing method and a data storage address corresponding to the data level; the data collection requirements include: the type of data that needs to be collected or not collected under a preset network resource state or a preset user plane resource state.
[0008] Optionally, the second data collection rule also includes data level judgment conditions, wherein the data level judgment conditions include at least one of the following: access technology, terminal resources, network rate, service type, program ID, terminal ID, terminal IP address, target IP address, time information, and area information.
[0009] Optionally, after obtaining the second data set, the data collection and processing method also includes: generating data collection information based on the first data set, and generating data processing information based on the processing process of processing the first data set; sending the data collection information and data processing information to the policy control function entity.
[0010] Optionally, the data collection information includes the levels at which each type of data in the first data set is marked, and the distribution of the data levels in the first data set; the data processing information includes the data processing methods used for each type of data in the first data set.
[0011] Optionally, the data processing method includes at least one of the following: data cleaning, data encryption, and data feature extraction.
[0012] Optionally, based on data processing requirements and the data levels at which each type of data in the first data set is marked, processing the first data set includes: determining the resource utilization rate of the user plane functional entity; and determining the data to be retained in the first data set based on the resource utilization rate and the data levels at which each type of data in the first data set is marked.
[0013] According to another aspect of an embodiment of the present application, a data processing method is also provided, including: a terminal device receives a second data collection rule, wherein the second data collection rule includes a data level and its corresponding data collection requirement, and the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; determining a first data set according to the second data collection rule, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels; sending the first data set to a user plane functional entity, wherein the user plane functional entity is used to process the first data set according to the first data collection rule and the data levels marked with various types of data in the first data set, to obtain a second data set, and send the second data set to a data storage server.
[0014] According to another aspect of an embodiment of the present application, a data collection and processing device is also provided, which is applicable to a user plane functional entity, including: a first receiving module, used to receive a first data collection rule; a second receiving module, used to receive a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, the higher the data level, the higher the collection priority; a processing module, used to process the first data set according to the first data collection rule and the data levels marked with various types of data in the first data set, to obtain a second data set, and send the second data set to a data storage server.
[0015] According to another aspect of an embodiment of the present application, a non-volatile storage medium is provided, in which a program is stored, wherein when the program is running, a device where the non-volatile storage medium is located is controlled to execute a data collection and processing method.
[0016] According to another aspect of an embodiment of the present application, there is further provided an electronic device, including: a memory and a processor, wherein the processor is used to run a program stored in the memory, wherein the data collection and processing method is executed when the program is run.
[0017] According to another aspect of an embodiment of the present application, a computer program product is also provided, including a computer program, and the computer program implements the data collection and processing method when executed by a processor.
[0018] In an embodiment of the present application, a user plane functional entity is used to receive a first data collection rule; a first data set sent by a terminal device is received, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with data levels, and the data levels are used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; according to the first data collection rule and the data levels marked by various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server. By determining the first data collection rule and the second data collection rule by the policy control functional entity, and assisting the user plane functional entity in collecting various types of data according to the second data collection rule, and determining the data level of various types of data, the user plane functional entity processes the various types of data according to the first data collection rule and the data level of various types of data, thereby achieving the purpose of determining the required data processing method according to the characteristics of different data and performing data processing, thereby achieving the technical effect of improving the data processing efficiency of the user plane functional entity, and further solving the technical problem of low data processing efficiency caused by the inability of relevant technicians to determine the required processing method according to the characteristics of different data. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0020] Figure 1 It is a flowchart of a data collection and processing method provided according to an embodiment of the present application;
[0021] Figure 2 It is a flowchart of a data collection and processing process provided according to an embodiment of the present application;
[0022] Figure 3 It is a flowchart of another data collection and processing process provided according to an embodiment of the present application;
[0023] Figure 4 It is a flowchart of another data collection and processing method provided according to an embodiment of the present application;
[0024] Figure 5 It is a structural schematic diagram of a data collection and processing device provided according to an embodiment of the present application;
[0025] Figure 6 It is a structural schematic diagram of a computer terminal (mobile terminal) provided according to an embodiment of the present application. DETAILED DESCRIPTION
[0026] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0028] At present, communication networks need to collect user data from user plane functions or devices (UPF, etc.) for user, business and other related analysis. When the user plane function or device (UPF on satellite, edge UPF, etc.) itself has limited resources or reduced processing power (for example, high CPU and memory usage), or when network idle resources are dynamically reduced or limited (for example, network congestion between UPF and data collection equipment), it is necessary to consider how to obtain and transmit high-quality valid data in priority without affecting basic services. Such scenarios or situations are not considered when the network in the related technology collects and processes data.
[0029] In order to solve this problem, a relevant solution is provided in the embodiments of the present application, which is described in detail below.
[0030] According to an embodiment of the present application, a method embodiment of a data collection and processing method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0031] The data collection and processing method provided in the embodiment of the present application is applicable to service scenarios in which user data is collected from resource-constrained user plane functional devices such as onboard UPF, edge UPF, or in a state where network resources are limited.
[0032] In the above service scenario, the embodiment of the present application provides a data collection and processing method, which is applicable to a user plane functional entity, such as Figure 1 As shown, the method comprises the following steps:
[0033] Step S102, the user plane function entity receives a first data collection rule;
[0034] In the technical solution provided in step S102, the first data collection rule includes a data level, and the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority. The data level can be set to an integer value greater than or equal to zero. For data that does not need to be collected, its data level can be configured by default, or the terminal device can be directly notified not to transmit the data. In addition, the data mentioned in the embodiment of the present application can be user data.
[0035] Step S104, receiving a first data set sent by the terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority;
[0036] In some embodiments of the present application, the first data collection rule is a data collection rule determined by the policy control function entity according to data collection configuration information sent by the data service function entity or the target application, and the first data collection rule includes a data level and its corresponding data collection requirements and data processing requirements;
[0037] The second data collection rule is a data collection rule determined by the policy control function entity according to data collection configuration information sent by the data service function entity or the target application, and the second data collection rule includes a data level.
[0038] As an optional implementation, the data processing requirements include: a preset data processing method and data storage address corresponding to the data level; the data collection requirements include: the type of data that needs to be collected or not collected under a preset network resource state or a preset user plane resource state.
[0039] In the technical solution provided in step S104, the second data collection rule may further include a data level judgment condition, wherein the data level judgment condition includes at least one of the following: access technology, terminal resources, network rate, service type, program ID, terminal ID, terminal IP address, target IP address, time information, and regional information. In addition, the above-mentioned data level judgment condition may also include whether the access technology of the terminal device is satellite access or terrestrial access.
[0040] Specifically, the data levels in the first data collection rule and the second data collection rule may be in the form of a mapping table to reflect the correspondence between different data types and different data levels, and the data levels in the second data collection rule may also be in the form of a judgment rule to reflect the correspondence. When the correspondence is reflected in the form of a judgment rule, the judgment rule includes the values of various data level judgment conditions corresponding to each data level.
[0041] Optionally, the first data collection rule is a data collection rule determined by the policy control function entity based on data collection configuration information sent by the data service function entity or the target application, and the first data collection rule includes the data level and its corresponding data collection requirements and data processing requirements; the second data collection rule is a data collection rule determined by the policy control function entity based on the data collection configuration information sent by the data service function entity or the target application, and the second data collection rule includes the data level and / or data level judgment condition.
[0042] As an optional implementation, the first data collection rule also includes data collection requirements, such as under what circumstances data is collected and under what circumstances data is not collected. Generally, whether to collect data can be determined based on the resource utilization of the user plane function entity or the communication network as a whole. In addition, resource utilization information can be obtained by subscribing to the network resource function entity.
[0043] It should be noted that the data level and data processing requirements in the first data collection rule and the second data collection rule can be determined by integrating external configuration information and the requirements or actual conditions of the communication network and the equipment.
[0044] Step S106, processing the first data set according to the first data collection rule and the data levels marked for each type of data in the first data set to obtain a second data set, and sending the second data set to a data storage server.
[0045] In the technical solution provided in step S106, the step of processing the first data set according to the data processing requirements and the data levels marked by each type of data in the first data set includes: determining the resource utilization rate of the user plane functional entity; determining the data to be retained in the first data set according to the resource utilization rate and the data levels marked by each type of data in the first data set.
[0046] When sending the second data set to the data storage server, a pre-allocated data storage address may be determined first, and then the second data set may be sent to the storage space indicated by the data storage address.
[0047] Specifically, in the data collection and processing method provided in the embodiment of the present application, the terminal device will add corresponding level labels to various types of data generated during the communication process according to the second data collection rule, thereby obtaining a first data set. After receiving the data, the user plane functional entity will filter and process the first data set according to the level label of the data and the data processing method and collection method corresponding to each level, thereby obtaining a second data set. After that, the user plane functional entity can send the second data set to the storage space corresponding to the storage address according to the preset storage address.
[0048] As an optional implementation, after obtaining the second data set, the data collection and processing method also includes: generating data collection information based on the first data set, and generating data processing information based on the processing process of processing the first data set; sending the data collection information and data processing information to the policy control function entity.
[0049] In some embodiments of the present application, the data collection information includes the levels at which each type of data in the first data set is marked, and the distribution of the data levels in the first data set; the data processing information includes the data processing methods used for each type of data in the first data set.
[0050] In some embodiments of the present application, the data processing method includes at least one of the following: data cleaning, data encryption, and data feature extraction.
[0051] In some embodiments of the present application, there is also provided a Figure 2 The data collection process shown includes the following steps:
[0052] Step S202, the data service function entity or the external application sends data collection configuration information to the policy control function entity;
[0053] Step S202, the data service function entity sends a first data collection rule to the user plane function entity;
[0054] Step S206, the data service function entity sends a second data collection rule to the terminal device;
[0055] Step S208, the terminal device sends the data marked with the data level according to the second data collection rule to the user plane function entity through the base station;
[0056] Step S210: The user plane function entity processes the data sent by the terminal device according to the first data collection rule and stores the data in the data storage node.
[0057] In some embodiments of the present application, when the data collection and processing method provided in the embodiments of the present application is used to collect and process various types of data, the overall execution process of each module in the communication system is as follows: Figure 3 As shown, the following steps are included:
[0058] Step S302, the internal network function module such as the data service function entity or the external application sends data collection configuration information to the policy control function entity, wherein the data collection configuration information includes the data level or data level setting conditions of various types of data, data processing requirements, etc.
[0059] Step S304: The policy control function entity determines a user plane data collection rule according to network and device resources and other conditions, and uses the rule as a newly added PCC rule.
[0060] In the technical solution provided in step S304, the policy control function entity can determine the user plane data collection rules according to the preset configuration scheme based on network and device resources, etc. For example, different data collection ranges can be determined according to different resource usage rates.
[0061] Step S306, the policy control function entity sends the user plane data collection rule to the session management function entity, wherein the user plane data collection rule includes data level, data collection requirement and data processing requirement;
[0062] Step S308, the session management function entity forwards the user plane data collection rule to the user plane function entity;
[0063] Step S310, the policy control function entity informs the terminal device of the user plane data collection auxiliary policy through terminal policy or other means, including the data collection level or data collection level setting conditions, and data collection requirements;
[0064] Step S312, the terminal device may determine whether to establish a new session before sending user data;
[0065] Step S314, the terminal device collects data according to the user plane data collection auxiliary strategy and marks the data level;
[0066] Step S316, the user plane function entity filters and processes the data sent by the terminal device according to the data collection rules and information such as resource utilization, and sends the processed data to the data storage server;
[0067] Step S318: The user plane function entity reports the data collection and processing status to the policy control function entity.
[0068] A user plane function entity is used to receive a first data collection rule sent by a policy control function entity, wherein the first data collection rule is a data collection rule determined by the policy control function entity according to data collection configuration information sent by a data service function entity or a target application, and the first data collection rule includes data levels and corresponding data collection requirements and data processing requirements; a first data set is received from a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with data levels, the second data collection rule includes data levels and corresponding data collection requirements, and the second data collection rule is a data collection rule determined by the policy control function entity according to data collection configuration information sent by the data service function entity or the target application; according to the data processing requirements and the first data set, According to the data level marked by each type of data in the set, the first data set is processed to obtain the second data set, and the second data set is sent to the data storage server. The policy control function entity determines the first data collection rule and the second data collection rule, and the terminal device assists the user plane function entity in collecting various types of data according to the second data collection rule, and determines the data level of each type of data. Then, the user plane function entity processes the various types of data according to the first data collection rule and the data level of each type of data, thereby achieving the purpose of determining the required data processing method according to the characteristics of different data and performing data processing, thereby realizing the technical effect of improving the data processing efficiency of the user plane function entity, and further solving the technical problem of low data processing efficiency caused by the inability of relevant technicians to determine the required processing method according to the characteristics of different data.
[0069] The present application embodiment provides another data collection and processing method applicable to a terminal device. Figure 4 is a flow chart of the method. Figure 4 It can be seen that the method includes the following steps:
[0070] Step S402: The terminal device receives a second data collection rule, wherein the second data collection rule includes a data level and a corresponding data collection requirement, and the data level is used to indicate a collection priority of the corresponding data, and the higher the data level, the higher the collection priority;
[0071] Step S404, determining a first data set according to the second data collection rule, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels;
[0072] Step S406, sending the first data set to the user plane functional entity, wherein the user plane functional entity is used to process the first data set according to the first data collection rule and the data level marked by each type of data in the first data set, obtain the second data set, and send the second data set to the data storage server.
[0073] The present application embodiment provides a data collection and processing device, Figure 5 is a schematic diagram of the structure of the device. Figure 5 It can be seen that the device includes: a first receiving module 50, used to receive a first data collection rule; a second receiving module 52, used to receive a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, the higher the data level, the higher the collection priority; a processing module 54, used to process the first data set according to the first data collection rule and the data levels marked for various types of data in the first data set, to obtain a second data set, and send the second data set to the data storage server.
[0074] In some embodiments of the present application, the first data collection rule is a data collection rule determined by the policy control function entity based on the data collection configuration information sent by the data service function entity or the target application, and the first data collection rule includes the level and its corresponding data collection requirements and data processing requirements; the second data collection rule is a data collection rule determined by the policy control function entity based on the data collection configuration information sent by the data service function entity or the target application, and the second data collection rule includes the data level.
[0075] In some embodiments of the present application, data processing requirements include: preset data processing methods and data storage addresses corresponding to data levels; data collection requirements include: types of data that need to be collected or not collected under preset network resource states or preset user plane resource states.
[0076] In some embodiments of the present application, the first data collection rule and the second data collection rule also include data level judgment conditions, wherein the data level judgment conditions include at least one of the following: access technology, terminal resources, network rate, service type, program ID, terminal ID, terminal IP address, target IP address, time information, and area information.
[0077] In some embodiments of the present application, the processing module 54 processes the first data set according to data processing requirements and the data levels marked by each type of data in the first data set, and the steps include: determining the resource utilization rate of the user plane functional entity; determining the data to be retained in the first data set according to the resource utilization rate and the data levels marked by each type of data in the first data set.
[0078] In some embodiments of the present application, after obtaining the second data set, the processing module 54 is also used to: generate data collection information based on the first data set, and generate data processing information based on the processing process when processing the first data set; send the data collection information and data processing information to the policy control function entity.
[0079] In some embodiments of the present application, the data collection information includes the levels at which each type of data in the first data set is marked, and the distribution of the data levels in the first data set; the data processing information includes the data processing methods used for each type of data in the first data set.
[0080] In some embodiments of the present application, the data processing method includes at least one of the following: data cleaning, data encryption, and data feature extraction.
[0081] It should be noted that the various modules in the above-mentioned data collection and processing device can be program modules (for example, a set of program instructions that implement a certain specific function) or hardware modules. For the latter, it can be expressed in the following forms, but is not limited to this: the expression form of each of the above-mentioned modules is a processor, or the functions of each of the above-mentioned modules are implemented by a processor.
[0082] According to an embodiment of the present application, a non-volatile storage medium is also provided, in which a program is stored, wherein when the program is running, the device where the non-volatile storage medium is located is controlled to execute the following data collection and processing method applicable to the user plane functional entity: the user plane functional entity receives a first data collection rule sent by a policy control functional entity; receives a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with data levels, and the second data collection rule is a data collection rule determined by the policy control functional entity, the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; according to the data processing requirements and the data levels marked for various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server.
[0083] In some embodiments of the present application, the program in the above-mentioned non-volatile storage medium can also control the device where the non-volatile storage medium is located to execute the following data collection and processing method applicable to the terminal device when it is running: the user plane function entity receives the first data collection rule sent by the policy control function entity; receives the first data set sent by the terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, the first data set includes various types of data marked with data levels, and the second data collection rule is a data collection rule determined by the policy control function entity, the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; according to the data processing requirements and the data levels marked for various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to the data storage server.
[0084] According to an embodiment of the present application, an electronic device is also provided, including: a memory and a processor, the processor being used to run a program stored in the memory, wherein the program executes the following data collection and processing method applicable to a user plane functional entity when it is running: the user plane functional entity receives a first data collection rule sent by a policy control functional entity; receives a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with a data level, and the second data collection rule is a data collection rule determined by the policy control functional entity, the data level is used to indicate the collection priority of the corresponding data, and the higher the data level, the higher the collection priority; according to the data processing requirements and the data levels marked for various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server.
[0085] In some embodiments of the present application, when the electronic device is as follows Figure 6 The mobile terminal, computer terminal or similar computing device shown can be used to execute a data collection and processing method applicable to a terminal device. Figure 6 The hardware structure block diagram of a computer terminal (or mobile device) for implementing a data collection and processing method applicable to a terminal device is shown. Figure 6As shown, the computer terminal 60 (or mobile device 60) may include one or more (602a, 602b, ..., 602n are used to illustrate) processors 602 (the processor 602 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 604 for storing data, and a transmission device 606 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 6 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 6 More or fewer components as shown, or with Figure 6 Different configurations are shown.
[0086] It should be noted that the one or more processors 602 and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 60 (or mobile device). As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).
[0087] The memory 604 can be used to store software programs and modules of application software, such as program instructions / data storage devices corresponding to the data collection and processing method in the embodiment of the present application. The processor 602 executes various functional applications and data processing by running the software programs and modules stored in the memory 604, that is, the above-mentioned data collection and processing method applicable to the terminal device is realized. The memory 604 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 604 may further include a memory remotely arranged relative to the processor 602, and these remote memories may be connected to the computer terminal 60 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0088] The transmission device 606 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 60. In one example, the transmission device 606 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 606 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0089] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 60 (or mobile device).
[0090] According to an embodiment of the present application, a computer program product is also provided, including a computer program, which implements a data collection and processing method applicable to a user plane functional entity when executed by a processor: the user plane functional entity receives a first data collection rule; receives a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, the higher the data level, the higher the collection priority; according to the first data collection rule and the data levels marked for various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server.
[0091] In some embodiments of the present application, the above-mentioned computer program can also implement a data collection and processing method suitable for a terminal device when executed by a processor: a user plane functional entity receives a first data collection rule; receives a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, and the first data set includes various types of data marked with data levels, and the data level is used to indicate the collection priority of the corresponding data, the higher the data level, the higher the collection priority; according to the first data collection rule and the data levels marked for various types of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to a data storage server.
[0092] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0093] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0094] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0095] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0096] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), mobile hard disk, disk or optical disk, etc. Various media that can store program codes.
[0097] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A data collection and processing method, characterized in that: include: The user plane function entity receives a first data collection rule; Receiving a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with a data level, and the data level is used to indicate a collection priority of the corresponding data, and the higher the data level, the higher the collection priority; According to the first data collection rule and the data levels marked by each type of data in the first data set, the first data set is processed to obtain a second data set, and the second data set is sent to the data storage server.
2. The data collection and processing method according to claim 1, characterized in that: The first data collection rule is a data collection rule determined by the policy control function entity according to the data collection configuration information sent by the data service function entity or the target application, and the first data collection rule includes a data level and its corresponding data collection requirements and data processing requirements; The second data collection rule is a data collection rule determined by the policy control function entity according to data collection configuration information sent by the data service function entity or the target application, and the second data collection rule includes a data level and its corresponding data collection requirement.
3. The data collection and processing method according to claim 2, characterized in that: The data processing requirements include: a preset data processing method and a data storage address corresponding to the data level; the data collection requirements include: the type of data that needs to be collected or not collected under a preset network resource state or a preset user plane resource state.
4. The data collection and processing method according to claim 1, characterized in that: The second data collection rule also includes a data level judgment condition, wherein the data level judgment condition includes at least one of the following: Access technology, terminal resources, network rate, service type, program ID, terminal ID, terminal IP address, target IP address, time information, and area information.
5. The data collection and processing method according to claim 1, characterized in that: After obtaining the second data set, the data collection and processing method further includes: generating data collection information according to the first data set, and generating data processing information according to a processing process when processing the first data set; The data collection information and the data processing information are sent to a policy control function entity.
6. The data collection and processing method according to claim 5, characterized in that: The data collection information includes the levels of the data in the first data set, and the distribution of the data levels in the first data set; The data processing information includes a data processing method used for each type of data in the first data set.
7. The data collection and processing method according to claim 5, characterized in that: The data processing method includes at least one of the following: data cleaning, data encryption, and data feature extraction.
8. The data collection and processing method according to claim 1, characterized in that: According to the data processing requirements and the data levels of the various types of data in the first data set, processing the first data set includes: Determining a resource usage rate of the user plane functional entity; The data to be retained in the first data set is determined according to the resource usage rate and the data level marked for each type of data in the first data set.
9. A data collection and processing method, characterized in that: include: The terminal device receives a second data collection rule, wherein the second data collection rule includes a data level and a corresponding data collection requirement, and the data level is used to indicate a collection priority of the corresponding data, and the higher the data level, the higher the collection priority; Determine a first data set according to the second data collection rule, wherein the first data set is a set of various types of data collected by the terminal device according to the second data collection rule, and the first data set includes various types of data marked with data levels; The first data set is sent to a user plane functional entity, wherein the user plane functional entity is used to process the first data set according to a first data collection rule and a data level marked with each type of data in the first data set, to obtain a second data set, and send the second data set to a data storage server.
10. A data collection and processing device, applicable to a user plane functional entity, characterized in that: include: A first receiving module, used for receiving a first data collection rule; a second receiving module, configured to receive a first data set sent by a terminal device, wherein the first data set is a set of various types of data collected by the terminal device according to a second data collection rule, the first data set includes various types of data marked with a data level, and the data level is used to indicate a collection priority of the corresponding data, and the higher the data level, the higher the collection priority; The processing module is used to process the first data set according to the first data collection rule and the data level marked by each type of data in the first data set to obtain a second data set, and send the second data set to the data storage server.
11. A non-volatile storage medium, characterized in that: The non-volatile storage medium stores a program, wherein when the program is running, the device where the non-volatile storage medium is located is controlled to execute the data collection and processing method described in any one of claims 1 to 8 or claim 9.
12. An electronic device, characterized in that: include: A memory and a processor, wherein the processor is used to run a program stored in the memory, wherein the program, when running, executes the data collection and processing method described in any one of claims 1 to 8 or claim 9.
13. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the data collection and processing method according to any one of claims 1 to 8 or claim 9.