Data processing method and device, electronic equipment and computer readable storage medium
The data processing method generates data rules based on attribute information to enhance adaptability and efficiency in data collection and storage, addressing poor adaptability and efficiency in existing methods.
Patent Information
- Application Number
- CN202310707179.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-14
- Publication Date
- 2024-12-17
AI Technical Summary
Existing data collection and storage methods in wireless communication technology suffer from poor adaptability and low data processing efficiency.
A data processing method involving a first data service network element that generates data rules based on data processing auxiliary information, guiding data collection, processing, and storage by marking attribute information in data subscription requests, allowing for flexible adaptation to different data requirements.
Improves data collection, processing, and storage efficiency by enabling flexible data handling according to specific rules, enhancing adaptability and efficiency.
Smart Images

Figure CN119155659A_ABST
Abstract
Description
Background Art
[0002] In the field of wireless communication technology, how to collect, perceive, store and use data processing is one of the main research directions of the core network.
[0003] In the related art, a data consumer device sends a data subscription request to a data service network element, where the data subscription request includes multiple data types. The data service network element then collects and stores data based on the data types, so that the data consumer device can obtain data from the network element storing the data.
[0004] However, simple data collection and storage have problems of poor adaptability and low data processing efficiency.
[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0006] The present disclosure provides a data processing method, device, electronic device and computer-readable storage medium, which at least to some extent overcome the problems of poor adaptability and low data processing efficiency in the related art.
[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.
[0008] According to one aspect of the present disclosure, there is provided a data processing method, which is applied to a first data service network element, and includes: receiving a first data subscription request, the first data subscription request including subscription content and data processing auxiliary information, the subscription content including multiple data types, the data processing auxiliary information being used to mark attribute information of at least one data type among the multiple data types; generating a first data rule corresponding to each data type among the multiple data types according to the data processing auxiliary information, the first data rule being used to indicate a data processing method; and collecting, processing and storing data according to the first data rule and the subscription content.
[0009] In one embodiment of the present disclosure, the data collection, processing and storage according to the first data rule and the subscription content includes: sending the subscription content and the first data rule to a first data perception device, so that the first data perception device collects the subscription content according to the first data rule for data collection, processing and storage; or, sending the subscription content and the first data rule to a second data service network element, and the second data service network element filters the first data rule, and sends the filtered second data rule and the subscription content to the second data perception device, so that the second data perception device collects and processes data according to the second data rule and the subscription content, and sends the processed first processed data to the second data service network element, and the second data service network element processes the first processed data according to a third data rule, and stores the processed second processed data; wherein the third data rule is a data rule in the first data rule except the second data rule.
[0010] In one embodiment of the present disclosure, the receiving of the first data subscription request includes: receiving a second data subscription request sent by a first data consumer device, and using the second data subscription request as the first data subscription request; or, receiving a third data subscription request sent by a first artificial intelligence / machine learning AI / ML analysis network element, and using the third data subscription request as the first data subscription request; wherein, the data processing auxiliary information included in the third data subscription request is obtained by the first AI / ML analysis network element by supplementing and / or modifying the data processing auxiliary information included in the data analysis request, and the data analysis request is sent by the second data consumer device to the first AI / ML analysis network element.
[0011] In one embodiment of the present disclosure, the attribute information corresponding to the data processing auxiliary information included in the second data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data reliability level, data privacy level, and real-time level; the attribute information corresponding to the data processing auxiliary information included in the third data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data commonness level, data reliability level, data privacy level, and real-time level.
[0012] In one embodiment of the present disclosure, the first data service network element stores historical rule analysis information; the first data rule corresponding to each data type in the multiple data types is generated according to the data processing auxiliary information, and the first data rule is used to indicate the data processing method, including: obtaining rule analysis information from a second AI / ML analysis network element; updating the data processing auxiliary information according to the analysis information to obtain updated data processing auxiliary information, the analysis information includes the rule analysis information, or the analysis information includes the rule analysis information and the historical rule analysis information; generating the first data rule according to a rule generation message, the rule generation message includes the updated data processing auxiliary information, or the rule generation message includes the updated data processing auxiliary information and the analysis information.
[0013] In one embodiment of the present disclosure, the first data rule includes at least one of a data perception rule, a data processing rule and a data storage rule for each data type of the multiple data types; the first data perception device collects the subscription content according to the first data rule for data collection, processing and storage, including: the first data perception device collects the data corresponding to the subscription content according to the data perception rule, and processes the collected data according to the data processing rule, and sends the processed third processed data and the data storage rule to the data storage network element, so that the data storage network element stores the third processed data based on the data storage rule.
[0014] In one embodiment of the present disclosure, before sending the subscription content and the first data rule to the first data sensing device, it also includes: determining the network element identification ID and / or network element address of the data storage network element according to the data processing auxiliary information; sending the subscription content and the first data rule to the first data sensing device includes: sending the subscription content, the first data rule and the network element ID and / or network element address to the first data sensing device; sending the processed third processed data and the data storage rule to the data storage network element includes: the first data sensing device sends the third processed data and the data storage rule to the data storage network element according to the network element ID and / or network element address.
[0015] In one embodiment of the present disclosure, it also includes: sending the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0016] In one embodiment of the present disclosure, the sending of the processed third processed data and the data storage rules to the data storage network element includes: the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rules; the first data sensing device sends the third processed data and the data storage rules to the data storage network element according to the network element ID and / or network element address.
[0017] In one embodiment of the present disclosure, after the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rule, it also includes: the first data sensing device sends the network element ID and / or network element address to the first data service network element, and the first data service network element sends the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0018] In one embodiment of the present disclosure, the data perception rules include at least one of perception content, perception time and perception frequency; the data processing rules include at least one of processing priority, desensitization processing and encryption processing; the data storage rules include at least one of storage period, storage location, storage processing requirements, data deletion priority and exception processing indication.
[0019] In one embodiment of the present disclosure, it also includes: sending a data context carrying the data processing auxiliary information and / or the first data rule to a third data service network element, so that the third data service network element assists the first data service network element in data collection, or the third data service network element provides device services corresponding to the first data subscription request.
[0020] According to another aspect of the present disclosure, there is provided a data processing method, which is applied to a first data service network element, and includes: a receiving module, which is used to receive a first data subscription request, the first data subscription request includes subscription content and data processing auxiliary information, the subscription content includes multiple data types, and the data processing auxiliary information is used to mark attribute information of at least one data type among the multiple data types; a generating module, which is used to generate a first data rule corresponding to each data type among the multiple data types according to the data processing auxiliary information, the first data rule is used to indicate a data processing method; a processing module, which is used to collect, process and store data according to the first data rule and the subscription content.
[0021] In one embodiment of the present disclosure, the processing module is used to send the subscription content and the first data rule to a first data perception device, so that the first data perception device collects the subscription content according to the first data rule for data collection, processing and storage; or, send the subscription content and the first data rule to a second data service network element, and the second data service network element filters the first data rule, and sends the filtered second data rule and the subscription content to the second data perception device, so that the second data perception device collects and processes data according to the second data rule and the subscription content, and sends the processed first processed data to the second data service network element, and the second data service network element processes the first processed data according to a third data rule, and stores the processed second processed data; wherein the third data rule is a data rule in the first data rule except the second data rule.
[0022] In one embodiment of the present disclosure, the receiving module is used to receive a second data subscription request sent by a first data consumer device, and use the second data subscription request as the first data subscription request; or, receive a third data subscription request sent by a first artificial intelligence / machine learning AI / ML analysis network element, and use the third data subscription request as the first data subscription request; wherein, the data processing auxiliary information included in the third data subscription request is obtained by the first AI / ML analysis network element by supplementing and / or modifying the data processing auxiliary information included in the data analysis request, and the data analysis request is sent by the second data consumer device to the first AI / ML analysis network element.
[0023] In one embodiment of the present disclosure, the attribute information corresponding to the data processing auxiliary information included in the second data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data reliability level, data privacy level, and real-time level; the attribute information corresponding to the data processing auxiliary information included in the third data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data commonness level, data reliability level, data privacy level, and real-time level.
[0024] In one embodiment of the present disclosure, the first data service network element stores historical rule analysis information; the generation module is used to obtain rule analysis information from the second AI / ML analysis network element; the data processing auxiliary information is updated according to the analysis information to obtain updated data processing auxiliary information, the analysis information includes the rule analysis information, or the analysis information includes the rule analysis information and the historical rule analysis information; according to the rule generation message, the first data rule is generated, the rule generation message includes the updated data processing auxiliary information, or the rule generation message includes the updated data processing auxiliary information and the analysis information.
[0025] In one embodiment of the present disclosure, the first data rule includes at least one of a data perception rule, a data processing rule and a data storage rule for each data type of the multiple data types; the first data perception device collects the subscription content according to the first data rule for data collection, processing and storage, including: the first data perception device collects the data corresponding to the subscription content according to the data perception rule, and processes the collected data according to the data processing rule, and sends the processed third processed data and the data storage rule to the data storage network element, so that the data storage network element stores the third processed data based on the data storage rule.
[0026] In one embodiment of the present disclosure, the device also includes: a determination module, used to determine the network element identification ID and / or network element address of the data storage network element based on the data processing auxiliary information; the processing module, used to send the subscription content, the first data rule and the network element ID and / or network element address to the first data perception device; the sending of the processed third processed data and the data storage rules to the data storage network element includes: the first data perception device sends the third processed data and the data storage rules to the data storage network element according to the network element ID and / or network element address.
[0027] In one embodiment of the present disclosure, the device also includes: a first sending module, used to send the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0028] In one embodiment of the present disclosure, the sending of the processed third processed data and the data storage rules to the data storage network element includes: the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rules; the first data sensing device sends the third processed data and the data storage rules to the data storage network element according to the network element ID and / or network element address.
[0029] In one embodiment of the present disclosure, after the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rule, it also includes: the first data sensing device sends the network element ID and / or network element address to the first data service network element, and the first data service network element sends the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0030] In one embodiment of the present disclosure, the data perception rules include at least one of perception content, perception time and perception frequency; the data processing rules include at least one of processing priority, desensitization processing and encryption processing; the data storage rules include at least one of storage period, storage location, storage processing requirements, data deletion priority and exception processing indication.
[0031] In one embodiment of the present disclosure, the device also includes: a second sending module, used to send a data context carrying the data processing auxiliary information and / or the first data rule to a third data service network element, so that the third data service network element assists the first data service network element in data collection, or the third data service network element provides device services corresponding to the first data subscription request.
[0032] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any of the above-mentioned data processing methods by executing the executable instructions.
[0033] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, any of the above-mentioned data processing methods is implemented.
[0034] According to another aspect of the present disclosure, a computer program product is provided, wherein the computer program product comprises a computer program or computer instructions, wherein the computer program or the computer instructions are loaded and executed by a processor so that a computer implements any of the above-mentioned data processing methods.
[0035] The technical solution provided by the embodiments of the present disclosure includes at least the following beneficial effects:
[0036] The technical solution provided by the embodiments of the present disclosure can enable the first data service network element to generate data rules for guiding the data processing method according to the data processing auxiliary information, by carrying data processing auxiliary information for marking attribute information of the data type in the first data subscription request. After obtaining the data rules, the first data service network element can collect, process and store data according to the data rules and the subscription content. Compared with simply collecting and storing data using subscription content, the collection, processing and storage of data adjusted by data rules can be implemented more flexibly to adapt to the collection, processing and storage requirements of different data. In addition, the data rules generated according to the data processing auxiliary information corresponding to the data can better guide the processing of the data, thereby improving the efficiency of data collection, processing and storage.
[0037] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0039] Figure 1 A schematic diagram showing a data processing system in one embodiment of the present disclosure;
[0040] Figure 2 A schematic diagram showing a data processing system in another embodiment of the present disclosure;
[0041] Figure 3 A schematic diagram showing a data processing system in yet another embodiment of the present disclosure;
[0042] Figure 4 A schematic diagram showing a data processing system in yet another embodiment of the present disclosure;
[0043] Figure 5 A schematic diagram showing a data processing system in yet another embodiment of the present disclosure;
[0044] Figure 6 A flow chart of a data processing method in one embodiment of the present disclosure is shown;
[0045] Figure 7A schematic diagram of a data processing device in one embodiment of the present disclosure is shown;
[0046] Figure 8 A structural block diagram of an electronic device in one embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0047] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0048] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0049] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0050] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0051] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0052] Figure 1 A schematic diagram of a data processing system in an embodiment of the present disclosure is shown, and the system can apply the data processing method or data processing device in various embodiments of the present disclosure.
[0053] like Figure 1 As shown, the data processing system may include: a first data consumer device 101, a first data service network element 102, a first data perception device 103, and a data storage network element 104.
[0054] Among them, the data consumer network element 101 can initiate a data subscription request to the first data service network element 102, and the data subscription request includes subscription content and data processing auxiliary information. The subscription content includes multiple data types, and the data processing auxiliary information is used to mark the attribute information of at least one data type among the multiple data types.
[0055] For example, the subscription content includes 5 types of data that need to be subscribed, and accordingly, the multiple data types are 5 data types. The data processing auxiliary information may be attribute information that marks any one or more data types among the 5 data types.
[0056] In one embodiment, the number of attribute information annotated on two different data types may be the same or different. For example, the data processing auxiliary information annotates one data information with four types of attribute information and annotates another data information with one type of attribute information.
[0057] In one embodiment, when different data types are annotated with the same attribute information, the specific content corresponding to the attribute information may be the same or different. For example, one data type is annotated with the attribute information of importance level, and the importance level is the first predetermined level; another data type is also annotated with the attribute information of importance level, and the importance level is the second predetermined level, or the importance level is the first predetermined level. The first predetermined level and the second predetermined level are used to distinguish that the two levels are different.
[0058] In one embodiment, the attribute information corresponding to the data processing auxiliary information included in the data subscription request initiated by the data consumer network element 101 to the first data service network element 102 may include: one or more of: data importance level, data isolation level, data usage location, data storage time, data reliability level, data privacy level, and real-time level.
[0059] Among them, the data importance level is used to measure the importance of the data. The data isolation level is used to indicate what specific isolation measures need to be taken for the data. For example, the data isolation level of the data indicates that the data needs to be processed using a separate GPU (Graphics Processing Unit), or that the data needs to be processed using a separate thread, etc. The data usage location is used to indicate the location of the device that uses the data; the data storage duration is used to indicate the minimum storage duration of the data in the data storage network element. The data reliability level is used to indicate the degree to which the data needs to be backed up. The higher the reliability, the more the data needs to be stored in a service with strong backup capabilities. The data privacy level is used to indicate that the data needs to be processed to avoid privacy leakage. For example, a certain data privacy level is used to indicate that the data needs to be encrypted or desensitized. Real-time is used to indicate the real-time requirements of the data. The higher the real-time, the more the data needs to be processed in real time.
[0060] The embodiments of the present disclosure do not limit how to specifically classify the data importance level, data isolation level, data reliability level, data privacy level, and real-time level. The classification of the levels of two different attribute information can be the same or different, and the embodiments of the present disclosure do not limit this. Taking the importance level as an example, it can be divided into: level one, level two, level three, etc.
[0061] Taking a data type as an example, the data processing auxiliary information may label the data type as having an importance level of 1 and a data isolation level of 1; or it may label the data type as having an importance level of 3, a data isolation level of 2, a data storage duration of 1 minute, and a data privacy level of 2.
[0062] In one embodiment, after the first data service network element 102 receives the data subscription request sent by the data consumer network element 101, it can directly generate corresponding data rules based on the data processing auxiliary information in the data subscription request, and when the first data perception device 103 has the ability to implement the data rules, it can send the data rules and subscription content to the first data perception device 103.
[0063] Afterwards, the first data perception device 103 may collect, process and store data according to the data rules and subscription content.
[0064] In one embodiment, the data rules may include one or more of data awareness rules, data processing rules, and data storage rules for each data type in a plurality of data types corresponding to the subscription content.
[0065] In one embodiment, when the data processing auxiliary information does not mark attribute information for a data type, the data type can also have one or more of the corresponding data perception rules, data processing rules, and data storage rules. In this case, the attribute information can affect the specific content of the data perception rules, data processing rules, and data storage rules, but will not directly determine whether there are data perception rules, data processing rules, and data storage rules.
[0066] In one embodiment, when the data processing auxiliary information does not mark attribute information for a data type, the data type has one or more of a data perception rule, a data processing rule, and a data storage rule, and the data perception rule, data processing rule, and data storage rule of the data type are all empty. At this time, a predetermined collection, processing, and storage method is used when collecting, processing, and storing data corresponding to the data type.
[0067] In one embodiment, the data sensing rule may include at least one of sensing content, sensing time, and sensing frequency. The sensing content is used to indicate the specific data that needs to be sensed (collected). The sensing time is used to indicate the start time and end time of a sensing. For example, the sensing time indicates that data sensing starts at a first moment and ends at a second moment. The sensing frequency is used to indicate the frequency of sensing. For example, the sensing frequency indicates that data sensing is performed every 5 minutes.
[0068] The embodiments of the present disclosure do not limit the attribute information included in the data processing auxiliary information according to which the data perception rules are generated. For example, the perception content can be determined based on the data type, and the perception time and perception frequency can be determined using the importance level, real-time level and / or commonness level of the data type. For example, for data types with higher commonness, higher real-time level and higher importance level, a higher perception frequency and a longer perception time can be configured. Among them, the more scenarios and the more frequently the data corresponding to the data type is used, the higher the commonness level of the data type.
[0069] The data processing rules are used to indicate what processing needs to be done after data collection is completed and before being stored in the data storage network element. In one embodiment, the data processing rules may include: at least one of processing priority, desensitization processing and encryption processing.
[0070] The processing priority is used to indicate the priority of the data when it is processed. The higher the processing priority of the data, the higher the priority of the data. For example, if the priority of the data is the highest among all the data to be processed, the data will be processed first. Desensitization processing means that the data needs to be desensitized. Encryption processing means that the data needs to be encrypted.
[0071] The embodiments of the present disclosure do not limit the attribute information included in the data processing auxiliary information according to which the data processing rules are generated. For example, it can be determined whether the data corresponding to the data type needs to be encrypted and / or desensitized according to the data privacy level. For another example, the processing priority corresponding to the data type can be determined according to the importance level and real-time level of the data.
[0072] The data storage rule is used to instruct the data storage network element how to store data corresponding to the data type. The embodiments of the present disclosure do not limit which rules the data storage rule specifically includes. For example, the data storage rule includes: at least one of a storage period, a storage location, a storage processing requirement, a data deletion priority, and an exception processing indication.
[0073] Among them, the storage period is used to indicate the time period in which the data corresponding to the data type is stored. The storage location is used to indicate in which service of the data storage network element, or in which storage, or in which memory the data corresponding to the data type should be stored. Storage processing needs to indicate what processing is required for the data corresponding to the data type when it is stored. Data deletion priority is used to indicate the level at which data is deleted first when it needs to be deleted. Exception handling can indicate how to handle exceptions in the data corresponding to the data type.
[0074] The embodiments of the present disclosure do not limit the attribute information included in the data processing auxiliary information according to which the data storage rules are generated. For example, the storage processing requirements can be determined according to the data privacy level and / or the data isolation level. For another example, the storage location can be determined according to the data usage location, the data reliability level, and the data storage duration.
[0075] The first data sensing device 103 can collect data corresponding to the subscribed content according to the data sensing rules, and then process the collected data according to the data processing rules, and then send the processed data and the data storage rules to the data storage network element 104.
[0076] In one embodiment, the first data sensing device 103 can determine the network element ID (Identity) and / or network element address of the data storage network element 104 based on the data storage rules, and then send the processed data and data storage rules to the data storage network element 104 based on the network element ID and / or network element address.
[0077] In one embodiment, the first data perception device 103 may also send the network element ID and / or network element address to the first data service network element 102, and the first data service network element 102 may forward the network element ID and / or network element address to the first data consumer device 101, so that the first data consumer device 101 may obtain data from the data storage network element 104 according to the network element ID and / or network element address.
[0078] In another embodiment, the first data service network element 102 may determine the network element ID and / or network element address of the data storage network element 104 according to the data processing auxiliary information included in the data subscription request, and send the network element ID and / or network element address to the first data perception device 103. Afterwards, the first data perception device 103 may send the processed data and data storage rules to the data storage network element 104 according to the network element ID and / or network element address.
[0079] In one embodiment, after the first data service network element 102 determines the network element ID and / or the network element address, it can send the network element ID and / or the network element address to the first data consumer device 101, so that the first data consumer device 101 can obtain data from the data storage network element 104 according to the network element ID and / or the network element address.
[0080] The data processing system in another embodiment of the present disclosure may be as follows Figure 2 As shown, the system includes: a first data consumer device 101, a first data service network element 102, a first data perception device 103, a data storage network element 104, a first AI / ML network element 105 (Artificial Intelligence / Machine Learning), and a second data consumer device 106.
[0081] Among them, the first data consumer device 101, the first data service network element 102, the first data perception device 103, and the data storage network element 104 have Figure 1 Corresponding functions and capabilities in corresponding embodiments.
[0082] In addition, the second data consumer device 106 may initiate a data analysis request to the first AI / ML network element 105, the data analysis request carrying analysis content and data processing auxiliary information. The analysis content corresponds to multiple data types, and the data processing auxiliary information is used to identify attribute information of at least one data type among the multiple data types.
[0083] The first AI / ML network element 105 may modify and / or supplement the data auxiliary information based on the analysis content. For example, the data processing auxiliary information includes an importance level of level 2 for a data type. The first AI / ML network element 105 may, based on the data analysis content, believe that the importance of the data type needs to be higher, and may modify the importance level to level 3. For another example, the data processing auxiliary information does not include a data privacy level in the annotation of a data type, but the first AI / ML network element 105 believes that the data needs to be encrypted and / or desensitized based on the analysis content, and then adds content to the data processing auxiliary information to mark the data privacy level for the data type.
[0084] In one embodiment, the attribute information corresponding to the data processing auxiliary information modified or supplemented by the first AI / ML network element 105 may include one or more of data importance level, data isolation level, data usage location, data storage time, data commonness level, data reliability level, data privacy level, and real-time level.
[0085] The first AI / ML network element 105 can also determine the data that needs to be subscribed based on the analysis content, thereby determining the subscription content. After that, the first AI / ML network element 105 can send the subscription content and the modified and / or supplemented data processing auxiliary information to the first data service network element 102. After that, the first data service network element 102 generates corresponding data rules based on the data processing auxiliary information, and when the first data perception device 103 has the ability to implement the processing corresponding to the data rule, the subscription content and the data rule are sent to the first data perception device 103, and the first data perception device 103 collects, processes and stores data based on the subscription content and the data rule. For example, the data is stored in the data storage network element 104. For another example, the first data perception device 103 sends the processed data and the data storage rules included in the data rule to the data storage network element 104.
[0086] After the data storage is completed, the first AI / ML network element 105 can obtain the data from the data storage network element. For example, the network element ID and / or network element address of the data storage network element is determined by the first data sensing device 103, and the first data sensing device 103 sends the network element ID and / or network element address to the first data service network element 102, and the first data service network element 102 forwards the network element ID and / or network element address to the first AI / ML network element 105, so that the first AI / ML network element 105 can obtain data from the data storage network element according to the network element ID and / or network element address.
[0087] For another example, if the network element ID and / or network element address of the data storage network element is determined by the first data service network element 102, the first data service network element 102 directly sends the network element ID and / or network element address to the first AI / ML network element 105, so that the first AI / ML network element 105 can obtain data from the data storage network element according to the network element ID and / or network element address.
[0088] In one embodiment, the second data consumer device 106 and the first data consumer device 101 may be the same data consumer device or different data consumer devices.
[0089] In another embodiment of the present disclosure, the data processing system may be as follows: Figure 3 As shown, the system includes: a first data consumer device 101, a first data service network element 102, a first data perception device 103, a data storage network element 104, a first AI / ML network element 105, a second data consumer device 106, a second data service network element 107 and a second data perception device 108.
[0090] Among them, the first data service network element 102 can also send the data rules and subscription content to the second data service network element 107 after generating data rules according to the data processing auxiliary information in the data subscription request. The second data service network element 107 can select the rules that the second data perception device 108 cannot implement from the data rules according to the capabilities of the second data perception device 108. For example, the data rules include data perception perception rules, data processing rules and data storage rules. Taking the second data perception device 108 as an example that it cannot implement some rules in the data processing rules, the part of the rules and the data storage rules can be selected from the data rules, and the remaining rules and subscription content are sent to the second data perception device 108. After the second data perception device 108 completes the acquisition and processing of the data, it sends the processed data to the second data service network element 107, and the second data service network element 107 continues to process the data according to the first selected part of the data processing rules, and sends the data and the data storage rules to the data storage network element after the processing is completed.
[0091] Among them, the second data service network element 107 can determine the network element ID and / or network element address of the data storage network element according to the data storage rule, and send the data and the data storage rule to the data storage network element indicated by the network element ID and / or network element address according to the network element ID and / or network element address. Taking the data storage network element indicated by the network element ID and / or network element address as the data storage network element 104 as an example, the second data service network element 107 sends the data and the data storage rule to the data storage network element 104 according to the network element ID and / or network element address.
[0092] In another embodiment, when the second data sensing device 108 is capable of determining the network element ID and / or network element address according to the data storage rules, only some data processing rules that cannot be implemented by the second data sensing device 108 can be selected, and then the second data sensing device 108 collects data according to the data sensing rules, processes the data according to the remaining data processing rules, and sends the processed data and the network element ID and / or network element address determined according to the data storage rules to the second data service network element 107. Afterwards, the second data service network element 107 further processes the data according to the selected partial data processing rules, and sends the data and the data storage rules to the data storage network element according to the network element ID and / or network element address.
[0093] In another embodiment, the network element ID and / or network element address of the data storage network element can be determined by the first data service network element 102 based on the data processing auxiliary information, and then the network element ID and / or network element address is sent to the second data service network element 107, and the second data service network element 107 sends the data and data storage rules to the data storage network element based on the network element ID and / or network element address.
[0094] In one embodiment, when the network element ID and / or network element address is determined by the first data service network element 102, the first data service network element 102 sends the network element ID and / or network element address to the device that initiates the data subscription request; when the network element ID and / or network element address is determined by the second data service network element 107, the second data service network element 107 may forward the network element ID and / or network element address to the first data service network element 102, and the first data service network element 102 sends the network element ID and / or network element address to the device that initiates the data subscription request; when the network element ID and / or network element address is determined by the second data sensing device 108, the second data sensing device 108 forwards the network element ID and / or network element address to the first data service network element 102 via the second data service network element 107, and the first data service network element 102 sends the network element ID and / or network element address to the device that initiates the data subscription request.
[0095] This enables the device that initiates the data subscription request to obtain data according to the network element ID and / or the network element address.
[0096] In another embodiment of the present disclosure, the data processing system may be as follows: Figure 4 As shown, the system includes: a first data consumer device 101, a first data service network element 102, a first data perception device 103, a data storage network element 104, a first AI / ML network element 105, a second data consumer device 106, a second data service network element 107, a second data perception device 108 and a second AI / ML network element 109.
[0097] In one embodiment, after receiving the data subscription request, the first data service network element 102 may request the second AI / ML network element 109 for rule analysis information according to the subscription content, and after receiving the rule analysis information fed back by the second AI / ML network element 109, the data processing auxiliary information included in the data subscription request may be modified and / or supplemented according to the rule analysis information and historical rule analysis information. The data subscription request may be sent by the AI / ML network element or by the data consumer device. The first data service network element 102 stores the historical rule analysis information.
[0098] In one embodiment, the historical rule analysis information is historical rule analysis information in a data usage scenario corresponding to the data subscription request.
[0099] In one embodiment, the rule analysis information may include: network element load analysis, DN (Data Network) performance analysis, UE (User Equipment) behavior, and the like.
[0100] In another embodiment, after receiving the rule analysis information fed back by the second AI / ML network element 109, the first data service network element 102 may modify and / or supplement the data processing auxiliary information included in the data subscription request according to the rule analysis information.
[0101] In one embodiment, the modified and / or supplemented data processing auxiliary information corresponds to new information which may include: one or more of data importance level, data isolation level, data usage location, data storage duration, data usage level, data reliability level, data privacy level, and real-time level.
[0102] Afterwards, the first data service network element 102 can collect, process and store data according to the modified and / or supplemented data processing auxiliary information and subscription content. The implementation of the data collection, processing and storage can refer to Figure 1-Figure 3 The corresponding embodiments will not be described in detail here.
[0103] Forward the network element ID and / or network element address to the device that initiates the data subscription request so that the device can obtain the data. For details on the implementation, see Figure 1-Figure 3 The corresponding embodiments will not be described in detail here.
[0104] In one embodiment, the second AI / ML network element 109 and the first AI / ML network element 105 may be the same AI / ML network element or different AI / ML network elements.
[0105] In another embodiment of the present disclosure, the data processing system may be as follows: Figure 5As shown, the system includes: a first data consumer device 101, a first data service network element 102, a first data perception device 103, a data storage network element 104, a first AI / ML network element 105, a second data consumer device 106, a second data service network element 107, a second data perception device 108, a second AI / ML network element 109 and a third data service network element 110.
[0106] In one embodiment, the first data service network element 102 may send a data context carrying data processing auxiliary information and / or data rules to the third data service network element 110, so that the third data service network element 110 assists the first data service network element 102 in data collection, or the third data service network element 110 provides services for the device corresponding to the data subscription request. For a specific implementation of the third data service network element 110 providing services for the device corresponding to the data subscription request, please refer to Figure 1-Figure 4 The corresponding embodiments will not be described in detail here.
[0107] The technical solution provided by the embodiments of the present disclosure can enable the first data service network element to generate data rules for guiding the data processing method according to the data processing auxiliary information, by carrying data processing auxiliary information for marking attribute information of the data type in the first data subscription request. After obtaining the data rules, the first data service network element can collect, process and store data according to the data rules and the subscription content. Compared with simply collecting and storing data using subscription content, the collection, processing and storage of data adjusted by data rules can be implemented more flexibly to adapt to the collection, processing and storage requirements of different data. In addition, the data rules generated according to the data processing auxiliary information corresponding to the data can better guide the processing of the data, thereby improving the efficiency of data collection, processing and storage.
[0108] The first data consumer device 101, the first data service network element 102, the first data perception device 103, the data storage network element 104, the first AI / ML network element 105, the second data consumer device 106, the second data service network element 107, the second data perception device 108, the second AI / ML network element 109 and the third data service network element 110 are connected to each other through a network, which can be a wired network or a wireless network.
[0109] Optionally, the wireless network or wired network described above uses standard communication technology and / or protocol. The network is usually the Internet, but it can also be any network, including but not limited to a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired or wireless network, a dedicated network or any combination of a virtual private network). In some embodiments, technologies and / or formats including Hyper Text Mark-up Language (HTML), Extensible Markup Language (XML), etc. are used to represent data exchanged through the network. In addition, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec) can also be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies can also be used to replace or supplement the above data communication technologies.
[0110] The first data consumer device 101, the first data aware device 103, the second data consumer device 106 and the second data aware device 108 may be various electronic devices, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers.
[0111] The first data consumer device 101, the first data perception device 103, the second data consumer device 106, and the second data perception device 108 may also be servers that provide various services. Optionally, the server may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.
[0112] It should be noted that each network element in the embodiments of the present disclosure refers to a node unit in network management, which can independently complete certain information processing and transmission functions. The network element can be a device specifically deployed in the network, or a service that provides certain functions in the network.
[0113] The present exemplary implementation is described in detail below with reference to the accompanying drawings and embodiments.
[0114] The present disclosure provides a data processing method, which can be executed by any electronic device with computing and processing capabilities. For example, the electronic device is a first data service network element.
[0115] Figure 6 A flow chart of a data processing method in one embodiment of the present disclosure is shown as follows: Figure 6 As shown, the data processing method provided in the embodiment of the present disclosure includes the following S601 to S603. Figure 6 The time and meaning of each step can be found in Figure 1-Figure 5 The corresponding embodiments will not be described in detail here.
[0116] S601, receiving a first data subscription request, the first data subscription request including subscription content and data processing auxiliary information, the subscription content including multiple data types, the data processing auxiliary information being used to mark attribute information of at least one data type among the multiple data types.
[0117] In one embodiment, receiving a first data subscription request may include: receiving a second data subscription request sent by a first data consumer device, and using the second data subscription request as the first data subscription request; or, receiving a third data subscription request sent by a first AI / ML analysis network element, and using the third data subscription request as the first data subscription request; wherein the data processing auxiliary information included in the third data subscription request is obtained by the first AI / ML analysis network element by supplementing and / or modifying the data processing auxiliary information included in the data analysis request, and the data analysis request is sent by the second data consumer device to the first AI / ML analysis network element.
[0118] In one embodiment, the attribute information corresponding to the data processing auxiliary information included in the second data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data reliability level, data privacy level, and real-time level; the attribute information corresponding to the data processing auxiliary information included in the third data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data usage level, data reliability level, data privacy level, and real-time level.
[0119] S602: Generate a first data rule corresponding to each data type in a plurality of data types according to the data processing auxiliary information.
[0120] The first data rule is used to indicate the data processing method.
[0121] In one embodiment, a first data service network element stores historical rule analysis information; based on the data processing auxiliary information, a first data rule corresponding to each data type in a plurality of data types is generated, and the first data rule is used to indicate a data processing method, including: obtaining rule analysis information from a second AI / ML analysis network element; updating the data processing auxiliary information based on the analysis information to obtain updated data processing auxiliary information, the analysis information including the rule analysis information, or the analysis information including the rule analysis information and historical rule analysis information; generating a first data rule based on a rule generation message, the rule generation message including the updated data processing auxiliary information, or the rule generation message including the updated data processing auxiliary information and the analysis information.
[0122] S603: Collect, process and store data according to the first data rule and subscription content.
[0123] In one embodiment, data collection, processing and storage are performed according to the first data rule and subscription content, which may include: sending the subscription content and the first data rule to the first data sensing device, so that the first data sensing device collects the subscription content according to the first data rule for data collection, processing and storage; or, sending the subscription content and the first data rule to the second data service network element, and the second data service network element filters the first data rule, and sends the filtered second data rule and subscription content to the second data sensing device, so that the second data sensing device collects and processes data according to the second data rule and subscription content, and sends the processed first processed data to the second data service network element, and the second data service network element processes the first processed data according to the third data rule, and stores the processed second processed data; wherein the third data rule is the data rule in the first data rule except the second data rule.
[0124] In one embodiment, the first data rule includes at least one of data perception rules, data processing rules and data storage rules for each data type in multiple data types; the first data perception device collects subscribed content according to the first data rule for data collection, processing and storage, including: the first data perception device collects data corresponding to the subscribed content according to the data perception rule, and processes the collected data according to the data processing rule, and sends the processed third processed data and data storage rules to the data storage network element, so that the data storage network element stores the third processed data based on the data storage rule.
[0125] In one embodiment, before sending the subscription content and the first data rule to the first data sensing device, it may also include: determining the network element ID and / or network element address of the data storage network element based on the data processing auxiliary information; sending the subscription content and the first data rule to the first data sensing device may include: sending the subscription content, the first data rule and the network element ID and / or the network element address to the first data sensing device; sending the processed third processed data and the data storage rule to the data storage network element may include: the first data sensing device sends the third processed data and the data storage rule to the data storage network element according to the network element ID and / or the network element address.
[0126] In one embodiment, after determining the network element ID and / or network element address, the first data service network element may send the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request can obtain the third processed data from the data storage network element according to the network element ID and / or network element address.
[0127] In one embodiment, the first data sensing device sends the processed third processing data and data storage rules to the data storage network element, which may include: the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rules; the first data sensing device sends the third processing data and data storage rules to the data storage network element according to the network element ID and / or network element address.
[0128] In one embodiment, after the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rules, it also includes: the first data sensing device sends the network element ID and / or network element address to the first data service network element, and the first data service network element sends the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0129] In one embodiment, the data perception rules include at least one of perception content, perception time and perception frequency; the data processing rules include at least one of processing priority, desensitization processing and encryption processing; the data storage rules include at least one of storage period, storage location, storage processing requirements, data deletion priority and exception processing indication.
[0130] In one embodiment, the first data service network element may also send a data context carrying data processing auxiliary information and / or the first data rule to the third data service network element, so that the third data service network element assists the first data service network element in data collection, or the third data service network element provides device services corresponding to the first data subscription request.
[0131] The technical solution provided by the embodiments of the present disclosure can enable the first data service network element to generate data rules for guiding the data processing method according to the data processing auxiliary information, by carrying data processing auxiliary information for marking attribute information of the data type in the first data subscription request. After obtaining the data rules, the first data service network element can collect, process and store data according to the data rules and the subscription content. Compared with simply collecting and storing data using subscription content, the collection, processing and storage of data adjusted by data rules can be implemented more flexibly to adapt to the collection, processing and storage requirements of different data. In addition, the data rules generated according to the data processing auxiliary information corresponding to the data can better guide the processing of the data, thereby improving the efficiency of data collection, processing and storage.
[0132] Based on the same inventive concept, the present disclosure also provides a data processing device in the following embodiments. Since the principle of solving the problem in the device embodiment is similar to that in the above method embodiment, the implementation of the device embodiment can refer to the implementation of the above method embodiment, and the repeated parts will not be repeated.
[0133] Figure 7 A schematic diagram of a data processing device in one embodiment of the present disclosure is shown. Figure 7 As shown, the device is applied to a first data service network element, including: a receiving module 701, used to receive a first data subscription request, the first data subscription request includes subscription content and data processing auxiliary information, the subscription content includes multiple data types, and the data processing auxiliary information is used to mark the attribute information of at least one data type in the multiple data types; a generating module 702, used to generate a first data rule corresponding to each data type in the multiple data types according to the data processing auxiliary information, the first data rule is used to indicate the processing method of the data; a processing module 703, used to collect, process and store data according to the first data rule and the subscription content.
[0134] In one embodiment of the present disclosure, the processing module 703 is used to send subscription content and a first data rule to a first data sensing device, so that the first data sensing device collects the subscription content according to the first data rule for data collection, processing and storage; or, send the subscription content and the first data rule to a second data service network element, and the second data service network element filters the first data rule, and sends the filtered second data rule and subscription content to the second data sensing device, so that the second data sensing device collects and processes data according to the second data rule and subscription content, and sends the processed first processed data to the second data service network element, and the second data service network element processes the first processed data according to a third data rule, and stores the processed second processed data; wherein the third data rule is a data rule in the first data rule except the second data rule.
[0135] In one embodiment of the present disclosure, the receiving module 701 is used to receive a second data subscription request sent by a first data consumer device, and use the second data subscription request as the first data subscription request; or, receive a third data subscription request sent by a first AI / ML analysis network element, and use the third data subscription request as the first data subscription request; wherein the data processing auxiliary information included in the third data subscription request is obtained by the first AI / ML analysis network element by supplementing and / or modifying the data processing auxiliary information included in the data analysis request, and the data analysis request is sent by the second data consumer device to the first AI / ML analysis network element.
[0136] In one embodiment of the present disclosure, the attribute information corresponding to the data processing auxiliary information included in the second data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data reliability level, data privacy level, and real-time level; the attribute information corresponding to the data processing auxiliary information included in the third data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data commonness level, data reliability level, data privacy level, and real-time level.
[0137] In one embodiment of the present disclosure, a first data service network element stores historical rule analysis information; a generation module 702 is used to obtain rule analysis information from a second AI / ML analysis network element; data processing auxiliary information is updated according to the analysis information to obtain updated data processing auxiliary information, the analysis information includes rule analysis information, or the analysis information includes rule analysis information and historical rule analysis information; a first data rule is generated according to a rule generation message, the rule generation message includes the updated data processing auxiliary information, or the rule generation message includes the updated data processing auxiliary information and the analysis information.
[0138] In one embodiment of the present disclosure, the first data rule includes at least one of a data perception rule, a data processing rule and a data storage rule for each data type in a plurality of data types; the first data perception device collects the subscribed content according to the first data rule for data collection, processing and storage, including: the first data perception device collects the data corresponding to the subscribed content according to the data perception rule, and processes the collected data according to the data processing rule, and sends the processed third processed data and the data storage rule to the data storage network element, so that the data storage network element stores the third processed data based on the data storage rule.
[0139] In one embodiment of the present disclosure, the device also includes: a determination module 704, used to determine the network element ID and / or network element address of the data storage network element based on the data processing auxiliary information; a processing module 703, used to send the subscription content, the first data rule and the network element ID and / or the network element address to the first data perception device; sending the processed third processing data and the data storage rules to the data storage network element, including: the first data perception device sends the third processing data and the data storage rules to the data storage network element according to the network element ID and / or the network element address.
[0140] In one embodiment of the present disclosure, the device also includes: a first sending module 705, which is used to send a network element ID and / or a network element address to a device that issues a first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or the network element address.
[0141] In one embodiment of the present disclosure, the processed third processed data and the data storage rules are sent to the data storage network element, including: the first data sensing device determines the network element ID and / or the network element address of the data storage network element according to the data storage rules; the first data sensing device sends the third processed data and the data storage rules to the data storage network element according to the network element ID and / or the network element address.
[0142] In one embodiment of the present disclosure, after the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rule, it also includes: the first data sensing device sends the network element ID and / or network element address to the first data service network element, and the first data service network element sends the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
[0143] In one embodiment of the present disclosure, the data perception rules include at least one of perception content, perception time and perception frequency; the data processing rules include at least one of processing priority, desensitization processing and encryption processing; the data storage rules include at least one of storage period, storage location, storage processing requirements, data deletion priority and exception processing indication.
[0144] In one embodiment of the present disclosure, the device also includes: a second sending module 706, which is used to send a data context carrying data processing auxiliary information and / or a first data rule to a third data service network element, so that the third data service network element assists the first data service network element in data collection, or the third data service network element provides device services corresponding to the first data subscription request.
[0145] The technical solution provided by the embodiments of the present disclosure can enable the first data service network element to generate data rules for guiding the data processing method according to the data processing auxiliary information, by carrying data processing auxiliary information for marking attribute information of the data type in the first data subscription request. After obtaining the data rules, the first data service network element can collect, process and store data according to the data rules and the subscription content. Compared with simply collecting and storing data using subscription content, the collection, processing and storage of data adjusted by data rules can be implemented more flexibly to adapt to the collection, processing and storage requirements of different data. In addition, the data rules generated according to the data processing auxiliary information corresponding to the data can better guide the processing of the data, thereby improving the efficiency of data collection, processing and storage.
[0146] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0147] Refer to the following Figure 8 The electronic device 800 according to this embodiment of the present disclosure is described. Figure 8 The electronic device 800 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0148] like Figure 8 As shown, the electronic device 800 is in the form of a general computing device. The components of the electronic device 800 may include but are not limited to: at least one processing unit 810, at least one storage unit 820, and a bus 830 connecting different system components (including the storage unit 820 and the processing unit 810).
[0149] The storage unit stores program codes, which can be executed by the processing unit 810, so that the processing unit 810 executes the steps according to various exemplary embodiments of the present disclosure described in the above “Specific Implementation Methods” section of this specification.
[0150] The storage unit 820 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 8201 and / or a cache memory unit 8202 , and may further include a read-only memory unit (ROM) 8203 .
[0151] The storage unit 820 may also include a program / utility 8204 having a set (at least one) of program modules 8205, such program modules 8205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0152] Bus 830 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0153] The electronic device 800 may also communicate with one or more external devices 840 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 800, and / or any device that enables the electronic device 800 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 850. Furthermore, the electronic device 800 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 860. Figure 8 As shown, the network adapter 860 communicates with other modules of the electronic device 800 via the bus 830. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 800, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0154] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.
[0155] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, which may be a readable signal medium or a readable storage medium. A program product capable of implementing the above-mentioned method of the present disclosure is stored thereon. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above “Specific Implementation Methods” section of this specification.
[0156] More specific examples of computer-readable storage media in the present disclosure may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0157] In the present disclosure, a computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A readable signal medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0158] Alternatively, the program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0159] In a specific implementation, the program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).
[0160] In an exemplary embodiment of the present disclosure, a computer program product is also provided, which includes a computer program or computer instructions, and the computer program or computer instructions are loaded and executed by a processor to enable a computer to implement the steps of various exemplary embodiments of the present disclosure described in the above "Specific Implementation" section of this specification.
[0161] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.
[0162] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.
[0163] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.
[0164] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The description and examples are to be regarded as exemplary only, and the true scope of the present disclosure is indicated by the appended claims.
Claims
1. A data processing method, characterized in that: Applied to a first data service network element, comprising: receiving a first data subscription request, the first data subscription request including subscription content and data processing auxiliary information, the subscription content including multiple data types, the data processing auxiliary information being used to mark attribute information of at least one data type among the multiple data types; generating, according to the data processing auxiliary information, a first data rule corresponding to each data type of the plurality of data types, wherein the first data rule is used to indicate a data processing method; Data collection, processing and storage are performed according to the first data rule and the subscription content.
2. The method according to claim 1, characterized in that The collecting, processing and storing data according to the first data rule and the subscription content includes: Sending the subscription content and the first data rule to a first data-aware device, so that the first data-aware device collects the subscription content according to the first data rule for data collection, processing and storage; Alternatively, the subscription content and the first data rule are sent to a second data service network element, and the second data service network element filters the first data rule, and sends the filtered second data rule and the subscription content to a second data perception device, so that the second data perception device collects and processes data according to the second data rule and the subscription content, and sends the processed first processed data to the second data service network element, and the second data service network element processes the first processed data according to a third data rule, and stores the processed second processed data; The third data rule is a data rule in the first data rule except the second data rule.
3. The method according to claim 1, characterized in that The receiving a first data subscription request comprises: receiving a second data subscription request sent by a first data consumer device, and using the second data subscription request as the first data subscription request; Alternatively, receiving a third data subscription request sent by a first artificial intelligence / machine learning AI / ML analysis network element, and using the third data subscription request as the first data subscription request; The data processing auxiliary information included in the third data subscription request is obtained by the first AI / ML analysis network element by supplementing and / or modifying the data processing auxiliary information included in the data analysis request, and the data analysis request is sent by the second data consumer device to the first AI / ML analysis network element.
4. The method according to claim 3, characterized in that The attribute information corresponding to the data processing auxiliary information included in the second data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data reliability level, data privacy level, and real-time level; The attribute information corresponding to the data processing auxiliary information included in the third data subscription request includes: one or more of data importance level, data isolation level, data usage location, data storage duration, data usage level, data reliability level, data privacy level, and real-time level.
5. The method according to claim 1, characterized in that The first data service network element stores historical rule analysis information; the generating, according to the data processing auxiliary information, a first data rule corresponding to each data type of the multiple data types, wherein the first data rule is used to indicate a data processing method, includes: Obtain rule analysis information from the second AI / ML analysis network element; updating the data processing auxiliary information according to the analysis information to obtain updated data processing auxiliary information, wherein the analysis information includes the rule analysis information, or the analysis information includes the rule analysis information and the historical rule analysis information; The first data rule is generated according to a rule generation message, wherein the rule generation message includes the updated data processing auxiliary information, or the rule generation message includes the updated data processing auxiliary information and the analysis information.
6. The method according to claim 2, characterized in that The first data rule comprises at least one of a data perception rule, a data processing rule, and a data storage rule for each data type of the plurality of data types; The first data sensing device collects the subscription content according to the first data rule to perform data collection, processing and storage, including: The first data sensing device collects data corresponding to the subscribed content according to the data sensing rules, processes the collected data according to the data processing rules, and sends the processed third processed data and the data storage rules to the data storage network element, so that the data storage network element can store the third processed data based on the data storage rules.
7. The method according to claim 6, characterized in that Before sending the subscription content and the first data rule to the first data perception device, the method further includes: Determine, according to the data processing auxiliary information, a network element identification ID and / or a network element address of the data storage network element; The sending the subscription content and the first data rule to the first data sensing device includes: Sending the subscription content, the first data rule and the network element ID and / or the network element address to the first data perception device; The sending the processed third processed data and the data storage rule to the data storage network element includes: The first data perception device sends the third processed data and the data storage rule to the data storage network element according to the network element ID and / or the network element address.
8. The method according to claim 7, characterized in that Also includes: The network element ID and / or network element address is sent to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
9. The method according to claim 6, characterized in that The sending the processed third processed data and the data storage rule to the data storage network element includes: The first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rule; The first data perception device sends the third processed data and the data storage rule to the data storage network element according to the network element ID and / or the network element address.
10. The method according to claim 9, characterized in that After the first data sensing device determines the network element ID and / or network element address of the data storage network element according to the data storage rule, the method further includes: The first data perception device sends the network element ID and / or network element address to the first data service network element, and the first data service network element sends the network element ID and / or network element address to the device that issues the first data subscription request, so that the device that issues the first data subscription request obtains the third processed data from the data storage network element according to the network element ID and / or network element address.
11. The method according to any one of claims 6 to 10, characterized in that: The data sensing rule includes at least one of sensing content, sensing time and sensing frequency; The data processing rules include at least one of processing priority, desensitization processing and encryption processing; The data storage rules include at least one of a storage period, a storage location, a storage processing requirement, a data deletion priority, and an exception processing indication.
12. The method according to claim 1, characterized in that Also includes: A data context carrying the data processing auxiliary information and / or the first data rule is sent to a third data service network element, so that the third data service network element assists the first data service network element in data collection, or the third data service network element provides device services corresponding to the first data subscription request.
13. A data processing method, characterized in that: Applied to a first data service network element, comprising: A receiving module, configured to receive a first data subscription request, wherein the first data subscription request includes subscription content and data processing auxiliary information, wherein the subscription content includes multiple data types, and the data processing auxiliary information is used to mark attribute information of at least one data type among the multiple data types; A generating module, configured to generate a first data rule corresponding to each of the plurality of data types according to the data processing auxiliary information, wherein the first data rule is used to indicate a data processing method; A processing module is used to collect, process and store data according to the first data rule and the subscription content.
14. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the data processing method according to any one of claims 1 to 12 by executing the executable instructions.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 12 is implemented.
Citation Information
Patent Citations
Transaction subscribing method, filtering rule configuring method and related equipment
CN101364952A
Semiconductor device for managing user data according to security level and method of operating the same
US20160337322A1
Systems and methods for blockchain rule synchronization
US20180039667A1
Bearer processing method and system and related apparatus
WO2017070859A1
