Audit method, system and equipment adaptive to dynamic metadata model

Abstract

The invention discloses an auditing method, system and device adaptive to a dynamic metadata model, and the method comprises the steps: dividing historical configuration data collected by a network management system according to resource classes, and distributing a unique identifier for each piece of configuration data; auditing rules of the historical configuration data are collected, and the auditing rules are in one-to-one correspondence with the configuration data; establishing a metadata model according to metadata of the configuration data, and matching the metadata model with the auditing rule according to the unique identifier; and matching to-be-audited configuration data with the unique identifier, writing metadata of the to-be-audited configuration data into the metadata model, and matching a corresponding auditing rule for auditing. According to the method, the unified metadata model is constructed by checking the configuration data in the network management system, the key field in the configuration data is extracted, and the key field is audited, so that whether the configuration data is abnormal or not can be quickly judged, redundant checking of irrelevant data is avoided, and the inspection efficiency and accuracy are improved.

Description

Technical Field

[0001] The present invention relates to the field of data auditing technology, and in particular to an auditing method, system, storage medium and device adapted to a dynamic metadata model. Background Art

[0002] Data auditing refers to the inspection of data quality standards such as data integrity, consistency, and accuracy during the process of collecting configuration data and integrating resource data, in order to improve data quality and avoid abnormal data such as information loss, duplication, and contradiction.

[0003] In the scenario where network objects are complex and frequently added, the network management system collects configuration data and integrates the middle-layer data. Due to the continuous addition and change of management objects in the network, there are resource model diversity and low data quality that needs to be audited. The audit work after traditional modeling, if relying on manual configuration of audit rules, will produce the disadvantages of lag and poor scalability, affecting the accuracy and timeliness of data auditing. Summary of the invention

[0004] In response to the problems existing in the prior art, the present invention provides an audit method, system and device adapted to a dynamic metadata model. By constructing a dynamic metadata model, the audit rules are automatically matched, the efficiency and accuracy of data auditing are improved, and the possibility of manual intervention and misjudgment is reduced.

[0005] To achieve the above technical objectives, the present invention adopts the following technical solution: an audit method adapted to a dynamic metadata model, specifically comprising the following steps:

[0006] Step S1: divide the historical configuration data collected by the network management system according to resource categories, and assign a unique identifier to each configuration data;

[0007] Step S2: Collect audit rules for historical configuration data and match the audit rules with the configuration data one by one;

[0008] Step S3: Establish a metadata model based on the metadata of the configuration data, and match the metadata model with the audit rules based on the unique identifier;

[0009] Step S4: Match the configuration data to be audited with a unique identifier, write the metadata of the configuration data to be audited into a metadata model, and match the corresponding audit rules for auditing.

[0010] Furthermore, the resource categories in step S1 include: equipment, physical link, logical link, area, address, networking and code number.

[0011] Furthermore, the metadata model established in step S3 includes: a storage type field, a required attribute field, and a dictionary attribute field.

[0012] Furthermore, the storage type field, the required attribute field and the dictionary attribute field all need to be audited for required items, uniqueness, association and number length.

[0013] Furthermore, the rules for the mandatory item audit are specifically as follows: traverse the fields in the metadata model, identify the mandatory item fields, and if all the mandatory item fields exist, the audit passes; otherwise, the audit fails.

[0014] Furthermore, the uniqueness audit rules are specifically as follows: according to the business logic and data table design corresponding to the metadata model, the fields that need to ensure uniqueness are identified. If the uniqueness verification of the field passes, the audit passes; otherwise, the audit fails.

[0015] Furthermore, the rules of the relevance audit are specifically as follows: identifying the associated fields that need to be kept consistent from the metadata model, and if the associated fields are consistent, the audit passes; otherwise, the audit fails.

[0016] Furthermore, the rules for the digital length audit are specifically as follows: identifying the fields that need to control the digital length from the metadata model, if the data length meets the requirements, the audit passes; otherwise, the audit fails.

[0017] Furthermore, the present invention also provides an audit system of the audit method adapted to the dynamic metadata model, comprising: an audit rule module, a metadata model construction module and an audit module, wherein the audit rule module is used to store the audit rules of historical configuration data, and to correspond the audit rules to the configuration data collected by the network management system one by one; the metadata model construction module establishes a metadata model according to the metadata of the configuration data, and matches the metadata model with the audit rules in the audit rule module; the audit module is used to audit the configuration data to be audited according to the audit rule module and the metadata model construction module.

[0018] Furthermore, the present invention also provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the audit method adapted to the dynamic metadata model is implemented.

[0019] Compared with the prior art, the present invention has the following beneficial effects: the audit method, system and device adapted to the dynamic metadata model of the present invention construct a unified metadata model by checking the configuration data in the network management system, extract the key fields in the configuration data, and by auditing the key fields, it is possible to quickly determine whether there are any abnormalities in the configuration data, and avoid redundant checks on irrelevant data, thereby improving the audit efficiency and accuracy; and, through the metadata model, a number of newly collected configuration data can be quickly audited according to the corresponding audit rules, thereby avoiding the time lag and poor scalability problems caused by manual auditing. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A flowchart of the audit method adapted to the dynamic metadata model of the present invention;

[0021] Figure 2 The diagram is an architectural diagram of the audit system adapted to the dynamic metadata model of the present invention. DETAILED DESCRIPTION

[0022] The technical solution of the present invention is further explained below in conjunction with the accompanying drawings.

[0023] like Figure 1 The flowchart of the audit method adapted to the dynamic metadata model of the present invention includes the following steps:

[0024] Step S1, divide the historical configuration data collected by the network management system according to resource classes, and assign a unique identifier to each configuration data; specifically, the resource classes include: equipment, physical link, logical link, area, address, networking and code number, each resource class uses a three-digit number as an identifier, and for the configuration data belonging to a certain resource class, a four-digit number is configured after the three-digit identifier to form a unique identifier for the configuration data, for example: the equipment category identifier is 102, and the router identifier under it is 1020001.

[0025] Step S2: Collect audit rules of historical configuration data and match the audit rules with configuration data one by one.

[0026] Step S3, establish a metadata model according to the metadata of the configuration data, and match the metadata model with the audit rule according to the unique identifier; specifically, the metadata model includes: storage type field, required attribute field and dictionary attribute field, and the storage type field, required attribute field and dictionary attribute field all need to be audited for required items, uniqueness, relevance and digital length. The present invention constructs a unified metadata model based on the abstract features of metadata, extracts key fields in the configuration data, and can quickly determine whether there are abnormalities in the configuration data by auditing the key fields, and avoids redundant checks on irrelevant data, thereby improving audit efficiency and accuracy.

[0027] The specific rules for mandatory auditing are: traverse the fields in the metadata model, identify the mandatory fields, and if all mandatory fields exist, the audit passes; otherwise, the audit fails. Mandatory auditing can ensure that each configuration data contains all key information, prevent data loss, and thus maintain data integrity. In addition, through mandatory auditing, all configuration data will have a valid value in the same field, which helps to maintain data consistency.

[0028] The specific rules for uniqueness auditing are: Based on the business logic and data table design corresponding to the metadata model, identify the fields that need to ensure uniqueness, usually including: name, IP, SN number. If the uniqueness verification of the field passes, the audit passes; otherwise, the audit fails. Uniqueness auditing ensures that there are no duplicate records of configuration data in the data table, thereby improving the accuracy of the data. Through uniqueness auditing, it can be ensured that the identification of the same entity in different systems or data tables is consistent, avoiding data conflicts and errors; at the same time, uniqueness auditing can reduce data redundancy and improve the efficiency of data storage and processing.

[0029] The specific rules of association audit are: identify the associated fields that need to be kept consistent from the metadata model, including foreign keys and reference fields. If the associated fields are consistent, the audit passes; otherwise, the audit fails. Association audit ensures that the association relationship between configuration data is correct, thereby maintaining data integrity and improving data credibility.

[0030] The specific rules for digital length audit are: identify the fields that need to control the length of numbers from the metadata model, such as IP address, telephone number, ID number, date. If the data length meets the requirements, the audit passes; otherwise, the audit fails. Through digital length audit, data that does not meet the expected format and length requirements can be identified and corrected, thereby improving data quality, helping to reduce data errors and anomalies, and reducing the risk of illegal data tampering.

[0031] The present invention can realize the audit of the integrity, consistency and accuracy of the configuration data by performing mandatory item audit, uniqueness audit, correlation audit and digital length audit on the metadata model.

[0032] Step S4: Match the configuration data to be audited with a unique identifier, write the metadata of the configuration data to be audited into the metadata model, and match the corresponding audit rules for auditing. The metadata model constructed by the present invention calls the corresponding audit rules to implement the audit of the configuration data to be audited, avoids artificial configuration of audit rules, and improves data audit efficiency.

[0033] The audit method adapted to the dynamic metadata model of the present invention constructs a unified metadata model by checking the configuration data in the network management system, extracts the key fields in the configuration data, and can quickly determine whether there are any abnormalities in the configuration data by auditing the key fields, and avoid redundant checks on irrelevant data, thereby improving audit efficiency and accuracy; and, through the metadata model, a number of newly collected configuration data can be quickly audited according to corresponding audit rules, avoiding the time lag and poor scalability problems caused by manual auditing.

[0034] like Figure 2 In a technical solution of the present invention, an audit system adapted to an audit method of a dynamic metadata model is also provided, comprising: an audit rule module, a metadata model construction module and an audit module, the audit rule module is used to store the audit rules of historical configuration data, and to correspond the audit rules to the configuration data collected by the network management system one by one; the metadata model construction module establishes a metadata model according to the metadata of the configuration data, and matches the metadata model with the audit rules in the audit rule module; the audit module is used to audit the configuration data to be audited according to the audit rule module and the metadata model construction module.

[0035] In a technical solution of the present invention, an electronic device is also provided, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the audit method adapted to the dynamic metadata model is implemented.

[0036] In the embodiments disclosed in the present application, the computer storage medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. The computer storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. More specific examples of computer storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0037] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0038] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. An audit method adapted to a dynamic metadata model, characterized in that: The specific steps include: Step S1: divide the historical configuration data collected by the network management system according to resource categories, and assign a unique identifier to each configuration data; Step S2: Collect audit rules for historical configuration data and match the audit rules with the configuration data one by one; Step S3: Establish a metadata model based on the metadata of the configuration data, and match the metadata model with the audit rules based on the unique identifier; Step S4: Match the configuration data to be audited with a unique identifier, write the metadata of the configuration data to be audited into a metadata model, and match the corresponding audit rules for auditing.

2. According to claim 1, an audit method adapted to a dynamic metadata model is characterized in that: The resource categories in step S1 include: equipment, physical link, logical link, area, address, networking and code number.

3. The audit method adapted to the dynamic metadata model according to claim 1, characterized in that: The metadata model established in step S3 includes: a storage type field, a required attribute field, and a dictionary attribute field.

4. The audit method adapted to the dynamic metadata model according to claim 3, characterized in that: For storage type fields, required attribute fields and dictionary attribute fields, required item audits, uniqueness audits, association audits and number length audits are required.

5. The audit method adapted to the dynamic metadata model according to claim 4, characterized in that: The specific rules for the mandatory item audit are: traverse the fields in the metadata model, identify the mandatory fields, and if all the mandatory fields exist, the audit passes; otherwise, the audit fails.

6. The audit method adapted to the dynamic metadata model according to claim 4, characterized in that: The specific rules of the uniqueness audit are: according to the business logic and data table design corresponding to the metadata model, identify the fields that need to ensure uniqueness. If the uniqueness verification of the field passes, the audit passes; otherwise, the audit fails.

7. The audit method adapted to the dynamic metadata model according to claim 4, characterized in that: The rules of the relevance audit are specifically: identifying the associated fields that need to be kept consistent from the metadata model, and if the associated fields are consistent, the audit passes; otherwise, the audit fails.

8. The audit method adapted to the dynamic metadata model according to claim 4, characterized in that: The specific rules for the digital length audit are: identify the fields that need to control the digital length from the metadata model. If the data length meets the requirements, the audit passes; otherwise, the audit fails.

9. An audit system for the audit method adapted to the dynamic metadata model as claimed in any one of claims 1 to 8, characterized in that: include: An audit rule module, a metadata model construction module and an audit module, wherein the audit rule module is used to store the audit rules of historical configuration data, and to correspond the audit rules to the configuration data collected by the network management system one by one; the metadata model construction module establishes a metadata model according to the metadata of the configuration data, and matches the metadata model with the audit rules in the audit rule module; the audit module is used to audit the configuration data to be audited according to the audit rule module and the metadata model construction module.

10. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the audit method adapted to the dynamic metadata model as described in any one of claims 1 to 8 is implemented.

Images