An online verification method for configuration files based on SCL model

Abstract

The present invention relates to the technical field of substation operation and maintenance, and specifically to an online verification method for configuration files based on an SCL model, the method comprising: obtaining a configuration file of a secondary device; performing an integrity check on the configuration file, and if the check is consistent, executing a consistency comparison step, and if the check is inconsistent, issuing an alarm; parsing the configuration file of the secondary device, and calculating the parsing accuracy of the parsed configuration file; and performing a consistency comparison of the parsed configuration file of the secondary device to obtain a current verification result; obtaining a comprehensive confidence of the current verification result; taking the product of the parsing accuracy and the comprehensive confidence as a credible verification accuracy of the current verification result; in response to the credible verification accuracy being greater than or equal to a set threshold, the current verification result is accurate; in response to the credible verification accuracy being less than a set threshold, the current verification result is inaccurate. That is, the scheme of the present invention can improve the accuracy of verifying the entire station model.

Description

Technical Field

[0001] The present invention relates to the technical field of substation operation and maintenance, and more specifically, to an online verification method for a configuration file based on an SCL model. Background Art

[0002] The IEC61850 standard uses SCL (Substation Configuration Language) to describe the secondary equipment model, so the secondary equipment model is also called the SCL model. The SCL model includes the SSD file describing the substation specification, the ICD file describing the IED capability, the SCD file describing the complete configuration of the entire station, and the CID file describing the configuration of a single IED.

[0003] At present, China is conducting research on related majors such as models and configuration files of smart substations, and has realized the development and application of a series of management software such as version control of SCD files, text comparison, and downloading of configuration files.

[0004] Among them, for the direction of comparing the differences in the configuration files of the secondary equipment of the smart substation, in the related technologies, such as the patent application document with the publication number CN116089157A and the name of a method and system for online verification of the configuration files of the process layer equipment, it discloses the calculation of the CRC check code of the configuration file, and obtains the final verification result by verifying the CRC check code obtained.

[0005] However, the above-mentioned verification of the process layer device configuration file is only for the integrity of the configuration file, that is, to verify the errors that may occur after data transmission or storage. Since it only verifies the integrity of the configuration file, it does not verify the specific content in the configuration file. Therefore, the existing technology will further perform consistency verification, but its verification scope is only the configuration information with greater relevance, and ignores the potential dangers caused by the remaining information. Therefore, there may be false alarms, missed alarms, etc., causing substation operation and maintenance accidents, and excessive safety risks. Summary of the invention

[0006] The purpose of the present invention is to propose an online verification method of a configuration file based on an SCL model, so as to solve the problem of inaccuracy in the verification of the configuration file in the prior art; to this end, the present invention provides a solution in the following aspect.

[0007] The present invention provides an online verification method for a configuration file based on an SCL model, comprising:

[0008] Step 1, obtain the configuration file of the secondary device;

[0009] Step 2, perform integrity check on the configuration file, if the check is consistent, execute step 3, if the check is inconsistent, issue an alarm;

[0010] Step 3, parse the configuration file of the secondary device, calculate the parsing accuracy of the parsed configuration file; and perform consistency comparison of the parsed configuration file of the secondary device to obtain the current verification result; obtain the comprehensive confidence of the current verification result; and use the product of the parsing accuracy and the comprehensive confidence as the credible verification accuracy of the current verification result;

[0011] Step 4: In response to the credible verification accuracy being greater than or equal to a set threshold, the current verification result is accurate; in response to the credible verification accuracy being less than the set threshold, the current verification result is inaccurate.

[0012] The above scheme parses the configuration file on the basis of integrity verification to compare the consistency of the parsed content, thereby obtaining the current verification result, and introduces the parsing accuracy of the parsed content and the comprehensive confidence of the current verification result to further evaluate the credible verification accuracy of the current verification result, so as to finally determine the accuracy of the current verification result. That is, through multiple judgment mechanisms, the accuracy of the verification result of the configuration file of the smart substation is improved, and the safety of the substation operation is ensured.

[0013] Optionally, before calculating the credible verification accuracy, a step of normalizing the comprehensive confidence is also included. Optionally, the analysis accuracy is:

[0014] ACC p =e -δ ·(1-P FPR,FNR )

[0015] Among them, ACC p is the parsing accuracy, P FPR,FNR is the probability of false positive and false negative of analysis result error information and warning information, δ is the analysis dissimilarity, and e is a natural constant; the analysis dissimilarity is the difference between the proportion of analysis errors and the proportion of warning information.

[0016] The above scheme provides a method for accurately calculating the accuracy of parsing the configuration file.

[0017] Optionally, the method for obtaining the comprehensive confidence is:

[0018] Acquire various configuration information in the parsed configuration file; the various configuration information includes but is not limited to communication configuration information and virtual circuit connection information;

[0019] Calculate the matching degree score of each configuration information, where the matching degree score is positively correlated with the similarity between the attribute in the corresponding configuration information and the standard attribute and the weight of each attribute; take the average of all matching degree scores as the matching degree score; the weight is the Pearson correlation coefficient between the similarity and the substation fault degree under the corresponding attribute;

[0020] Calculating a coverage score, wherein the coverage score is positively correlated with the weight of the attribute in each configuration information;

[0021] The sum of the matching degree score and the coverage score is taken as the comprehensive confidence.

[0022] The above scheme quantifies the degree of consistency from the perspective of consistency comparison, and can accurately determine the degree of consistency of the current verification result after the consistency comparison.

[0023] Optionally, when the current verification result is accurate, the current verification result is visualized in the form of a scalable vector image SVG.

[0024] Optionally, the integrity check uses CRC check, Kappa consistency check or ICC intra-group correlation coefficient.

[0025] Optionally, the configuration file includes the virtual connection CRC of the device MMS, the virtual connection CRC program version information of the entire site, the CID configuration file, and the CCD configuration file.

[0026] Optionally, the process of parsing the configuration file of the secondary device is: decomposing the manufacturer and file type according to the name of the directory where the configuration file is located, and then calling the parsing interface provided by the corresponding manufacturer according to the manufacturer and file type to parse the configuration file.

[0027] The beneficial effects of the present invention are:

[0028] The solution of the present invention first performs an integrity check on the configuration file, and based on the result of the integrity check, performs a consistency comparison on the parsed configuration information content. When performing the consistency comparison, the accuracy of the consistency comparison result is further evaluated from the comprehensive confidence of the comparison result and the accuracy rate during parsing, which can improve the accuracy of the configuration file consistency check and ensure the reliable operation of the smart substation. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] By reading the following detailed description with reference to the accompanying drawings, the above and other objects, features and advantages of the exemplary embodiments of the present invention will become readily understood. In the accompanying drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, and the same or corresponding reference numerals represent the same or corresponding parts, wherein:

[0030] Figure 1The flowchart schematically shows a method for online checking of a configuration file based on an SCL model in this embodiment. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0032] Taking a certain intelligent substation as an example, an online verification method of a configuration file based on an SCL model of the present invention is introduced.

[0033] Specifically, Figure 1 As shown, an online verification method for a configuration file based on an SCL model in this embodiment includes the following steps:

[0034] Step 1: Obtain the configuration file of the secondary device.

[0035] Obtain the current running configuration information (SCD file) from the real-time monitoring system of the smart substation, access the station control layer switch, and call the configuration file of the secondary equipment online through MMS. The configuration file includes the virtual connection CRC of the device MMS, the version information of the virtual connection CRC program of the entire station, the CID configuration file, and the CCD configuration file.

[0036] Step 2, perform integrity check on the configuration file. If the check is consistent, execute step 3. If the check is inconsistent, issue an alarm.

[0037] The integrity check in this embodiment adopts CRC check technology; specifically, the SCD configuration file in the actual operation process is checked by checking whether the CRC check codes of the SCD configuration file in the actual operation process and the SCD configuration file stored in the design phase are consistent, thereby realizing the verification of the SCD configuration file in the actual operation process.

[0038] For example, taking the generation of CRC check code from the virtual terminal of the process layer as an example, it is first necessary to extract the process layer configuration information related to the device based on the IED device, including the published or subscribed control block configuration information, the basic parameters and data structure of the GOOSE and SV protocols, the private address information mapped between the control block and the internal variables, and the configuration information between the control block and the physical port.

[0039] Step 3, parse the configuration file of the secondary device, calculate the parsing accuracy of the parsed configuration file; and perform consistency comparison of the parsed configuration file of the secondary device to obtain the current verification result; obtain the comprehensive confidence of the current verification result; and calculate the credible verification accuracy of the current verification result based on the parsing accuracy and the comprehensive confidence.

[0040] In this embodiment, the manufacturer and file type are decomposed according to the name of the directory where the configuration file is located, and then the parsing interface provided by the corresponding manufacturer is called according to the manufacturer and file type to parse the configuration file.

[0041] The configuration information parsed in this embodiment includes: communication configuration information and virtual circuit connection information. Specifically, the configuration information is accurately parsed by using the annotated SCL parsing library configuration file and multi-mode matching to parse and correct them respectively.

[0042] In one embodiment, the SCL model itself is very complex and contains a large number of tags and attributes. When parsing the SCD file, all the attributes of the configuration file will be parsed out. However, a large amount of parsing will cause the parsing process to incorrectly report configuration problems or omit specific information of some configurations, and in the face of the manufacturer's private extensions, the configuration files between different devices cannot be interoperable.

[0043] Therefore, in the embodiment, SCL parsing library and multi-mode matching are used for parsing respectively, and the parsing results are cross-recorded as error information, and the configuration information missing from the parsing is recorded as warning information. The difference between the ratio of parsing errors to parsing results and the ratio of warning information to parsing results is taken as the parsing dissimilarity. If the parsing dissimilarity is less than the threshold, the parsing accuracy is calculated according to the parsing dissimilarity and the ratio of false positives and false negatives, and the abnormal information (error and warning information) is corrected; if it is greater than the threshold, SCL and multi-mode matching are performed on the error information and the warning information for mutual parsing (multi-mode matching is used for secondary parsing of the abnormal information of SCL, and the same applies to multi-mode matching), and the parsing correction is repeatedly iterated according to the parsing results until the parsing dissimilarity remains unchanged, and the parsing accuracy is calculated.

[0044] The parsing accuracy is:

[0045] ACC p =e -δ ·(1-P FPR,FNR )

[0046] Among them, ACC p is the parsing accuracy, ACC p The larger the value, the more accurate the analysis, which is beneficial for the consistency check of the secondary device configuration file. FPR,FNRis the probability of false positives and false negatives in the error and warning information of the parsing results (the probability of parsing missing configuration information as not missing and parsing missing information when the configuration information is not missing, and the same applies to the cross-parsing results), P FPR,FNR The smaller it is, the more accurate the error and warning information recorded in the analysis results are. δ is the analysis difference. The smaller δ is, the more accurate the analysis is.

[0047] Furthermore, the consistency comparison of the configuration files of the secondary devices after parsing in this embodiment specifically refers to calling the GOOSE and SV message models from the process layer network, and comparing the called configuration file information (i.e., the upper computer configuration information) in real time with the SCD configuration file stored on the engineering workstation or server of the substation automation system to achieve configuration consistency verification.

[0048] When performing consistency comparison, the consistency check of the parsed configuration file includes two parts: communication configuration information comparison and virtual circuit connection comparison, that is, checking whether the IP address, MAC address, port number, etc. are consistent with the corresponding parameters in the stored standard model, whether the configuration of the GOOSE and SV control blocks are consistent with the corresponding parameters in the stored standard model, checking whether the data flow connection between the logical nodes is consistent with the corresponding parameters in the stored standard model, and finally checking whether the physical connection relationship between the IEDs is consistent with the corresponding parameters in the stored standard model to obtain the verification results.

[0049] In this embodiment, CRC check is performed to confirm that the data is not damaged during transmission or storage. Failure of CRC check indicates that the file may be damaged and a damage signal is fed back to the monitoring system. Otherwise, after the data integrity is confirmed to be correct, a consistency check is performed to check the consistency of the configuration file between different devices or versions to further confirm whether the configuration file is consistent.

[0050] Among them, in order to improve the efficiency of verification, usually only key configuration information is selected for verification during consistency comparison, which includes key parameters, function configuration, communication settings, etc. The specific selection principle is to select according to the degree of impact on the equipment function and system security when these information changes. However, in the actual configuration file consistency verification requirements of substation secondary equipment, some ignored configuration information changes will indirectly cause equipment function problems or affect the response speed of fault identification, affecting the confidence of the consistency verification results of the configuration file.

[0051] Exemplary problems caused by ignored minor configuration information include, but are not limited to: inconsistent timestamps in system logs affect the accuracy of troubleshooting and time records, resulting in the inability to promptly resolve security issues; inconsistent alarm settings of equipment, resulting in untimely alarm response when the equipment is in an abnormal state; inconsistent control logic parameter settings of equipment, resulting in uncoordinated system response or abnormal equipment control; different configurations of service ports, resulting in port conflicts or service access issues.

[0052] Therefore, it is necessary to start with the secondary configuration information to further confirm the accuracy of the configuration file verification results. Specifically, the matching degree score and coverage score of the configuration information are calculated, and the matching degree score and coverage score of the configuration information are calculated according to the different attributes (n attributes b1, b2, ..., b n ) is used to divide the weights of the Pearson correlation coefficient of the impact on the operation safety of the smart substation to obtain the final comprehensive confidence.

[0053] Among them, the comprehensive confidence is expressed as: D=M+C; among them, D is the comprehensive confidence, M is the matching degree score, the larger the value of D is, the more reliable the consistency check result is. If the comprehensive confidence is lower than the threshold, the consistency check range is continuously increased to calculate the comprehensive confidence until it exceeds the threshold and there is no obvious increasing trend.

[0054] The matching degree score is: the average of the communication configuration information matching degree score and the virtual circuit connection information matching degree score. The larger the matching degree score M is, the more similar the configuration information of the secondary devices is.

[0055] The communication configuration information matching degree score s1 is: Where k is the number of attributes selected for consistency check of communication configuration information, α j is the weight of the jth attribute when verifying the communication configuration information, θ j is the similarity between the jth attribute and the corresponding standard attribute during communication configuration verification, α j The larger the value is, the greater the impact of the checked jth attribute on the safe operation of the substation. j The larger it is, the greater the consistency of the j-th attribute being checked.

[0056] The weight α j is the Pearson correlation coefficient between the similarity and the substation fault degree under the corresponding attributes.

[0057] Among them, the inverse of the unit time operation efficiency A when the substation has different degrees of faults is used as the substation operation status measurement indicator, and the substation unit time operation efficiency is normalized. 0-1 represents the degree of fault in the substation operation, specifically:

[0058] The standard attributes mentioned above are multiple attributes in the corresponding communication configuration information obtained by parsing the SCD configuration file stored in the design phase.

[0059] Take any attribute as an example and calculate the string similarity of the attribute. Commonly used string similarity measurement methods include: edit distance, Jaccard similarity, Cosine similarity, Jaro-Winkler distance and other methods.

[0060] The virtual circuit connection information matching degree score s2 is: k′ is the number of attributes selected for consistency check of virtual circuit connection information, α j′ is the weight of the j′th attribute when checking virtual circuit connection information, θ j′ It is the similarity of the j′th attribute when checking the virtual circuit connection information.

[0061] Among them, the coverage score is: in is the coverage score of the communication configuration information, is the coverage score of the virtual circuit connection information; where α j , α j′ are the weight of the jth attribute and the weight of the j′th attribute when checking the communication configuration information and the virtual circuit connection information, respectively. i 、b i′ are the weight of the ith attribute and the weight of the ith′ attribute when checking the communication configuration information and virtual circuit connection information respectively; n and n′ are the total number of attributes in the communication configuration information and virtual circuit connection information respectively.

[0062] Among them, α j and α j′ The larger the value is, the greater the impact of the checked j-th attribute on the safe operation of the substation.

[0063] The above b i With weight α j The calculation method is the same and will not be elaborated here.

[0064] The credible verification accuracy is:

[0065] ACC q =D×ACC p

[0066] Among them, ACC q is the credible calibration accuracy, ACC q The larger the value, the more accurate the online consistency verification result is. D is the comprehensive confidence level, ACC p is the parsing accuracy.

[0067] In one embodiment, the introduction of secondary configuration information to improve the comprehensive confidence of consistency check is based on the following: secondary configuration information usually covers the details of device operation and auxiliary functions, that is, it represents the potential consistency check of the file. The introduction of consistency check of secondary configuration information can explain potential configuration errors or inconsistencies, reduce system failures or anomalies caused by minor configuration inconsistencies, and improve the response speed of identifying faults.

[0068] The above attributes may include voltage level, bay name, device type, set number, device model, version number, checksum and manufacturer.

[0069] The trusted verification accuracy in this embodiment is composed of the parsing accuracy and the comprehensive confidence. In the consistency verification process of the configuration file, adding a certain amount of secondary configuration information for consistency verification has a higher comprehensive confidence than only performing consistency verification of key configuration information. The comprehensive confidence specifically refers to the degree to which the verification result is trustworthy.

[0070] In this embodiment, the value of the comprehensive confidence used when calculating the credibility check accuracy is a normalized value.

[0071] Step 4: In response to the credible verification accuracy being greater than or equal to a set threshold, the current verification result is accurate; in response to the credible verification accuracy being less than the set threshold, the current verification result is inaccurate.

[0072] In this embodiment, when the trusted verification accuracy is lower than the set threshold, the file parsing is returned for verification, the trusted verification accuracy is recalculated, and it is determined whether the trusted verification accuracy is lower than the set threshold. If it is lower than the set threshold, a verification inconsistency warning signal is output; when the trusted verification accuracy is greater than or equal to the set threshold, a configuration file verification consistency signal is directly output to the monitoring system.

[0073] The threshold for the credible verification accuracy is set by the staff based on expert experience.

[0074] In this embodiment, after obtaining the final verification result, the verification result is also visualized in the form of a scalable vector image SVG, where unchanged information is displayed in a black solid line, modified information is displayed in a dotted line, added information is displayed in a "short line" line type, and deleted information is displayed in a solid line with a circle in the middle. The verification technology of this embodiment is safe, convenient, and efficient, and can achieve consistency verification of the configuration model of all devices in the entire station in a very short time, ensuring the consistency between the actual operation configuration of the device and the stored SCD configuration file.

[0075] The solution of the present invention can verify the whole station model in an online manner, which is more efficient and convenient than the previous offline verification, and avoids verification anomalies caused by incorrect version information.

[0076] In the description of this specification, “plurality” means at least two, such as two, three or more, etc., unless otherwise clearly and specifically defined.

[0077] Although this specification has shown and described a number of embodiments of the present invention, it will be apparent to those skilled in the art that such embodiments are provided by way of example only. Those skilled in the art will conceive of many modifications, changes and alternatives without departing from the ideas and spirit of the present invention. It should be understood that in the practice of the present invention, various alternatives to the embodiments of the present invention described herein may be employed.

Claims

1. A configuration file online verification method based on SCL model, characterized in that: include: Step 1, obtain the configuration file of the secondary device; Step 2, perform integrity check on the configuration file, if the check is consistent, execute step 3, if the check is inconsistent, issue an alarm; Step 3, parsing the configuration file of the secondary device, calculating the parsing accuracy of the parsed configuration file; and performing consistency comparison of the parsed configuration file of the secondary device to obtain the current verification result; Obtaining the comprehensive confidence of the current verification result, the method is: obtaining multiple configuration information in the parsed configuration file; the multiple configuration information includes but is not limited to communication configuration information and virtual circuit connection information; calculating the matching degree score of each configuration information, wherein the matching degree score is positively correlated with the similarity between the attribute in the corresponding configuration information and the standard attribute and the weight of each attribute; taking the average of all matching degree scores as the matching degree score; the weight is the Pearson correlation coefficient between the similarity and the substation fault degree under the corresponding attribute; calculating the coverage score, the coverage score is positively correlated with the weight of the attribute in each configuration information; taking the sum of the matching degree score and the coverage score as the comprehensive confidence; The product of the analytical accuracy and the comprehensive confidence is taken as the credible calibration accuracy of the current calibration result; Step 4, in response to the credible verification accuracy being greater than or equal to the set threshold, the current verification result is accurate; In response to the credible verification accuracy being less than a set threshold, the current verification result is inaccurate.

2. According to the SCL model-based configuration file online verification method of claim 1, it is characterized in that: The analysis accuracy is: ACC p =e -δ ·(1-P FPR,FNR ) Among them, ACC p is the parsing accuracy, P FPR,FNR is the probability of false positive and false negative of analysis result error information and warning information, δ is the analysis dissimilarity, and e is a natural constant; the analysis dissimilarity is the difference between the proportion of analysis errors and the proportion of warning information.

3. The online verification method of configuration files based on the SCL model according to claim 1 is characterized in that: Before calculating the credible verification accuracy, a step of normalizing the comprehensive confidence is also included.

4. The online verification method of configuration files based on the SCL model according to claim 1 is characterized in that: When the current verification result is accurate, the current verification result is visualized in the form of a scalable vector image SVG.

5. The online verification method of configuration files based on the SCL model according to claim 1 is characterized in that: The integrity check adopts CRC check, Kappa consistency check or ICC intragroup correlation coefficient.

6. The online verification method of configuration files based on the SCL model according to claim 1 is characterized in that: The configuration file includes the virtual connection CRC of the device MMS, the virtual connection CRC program version information of the whole site, the CID configuration file, and the CCD configuration file.

7. The online verification method of configuration files based on the SCL model according to claim 1 is characterized in that: The process of parsing the configuration file of the secondary device is: decomposing the manufacturer and file type according to the name of the directory where the configuration file is located, and then calling the parsing interface provided by the corresponding manufacturer according to the manufacturer and file type to parse the configuration file.

Images