Electric power automation equipment test method and system, electronic equipment and storage medium

Abstract

The invention provides an electric power automation equipment test method and system, electronic equipment and a storage medium, and the test method comprises the following steps: collecting defect information of electric power automation equipment, and inputting the defect information into a defect database; inputting the defect information into a defect analysis system, analyzing the defect information by using the defect analysis system, and generating a test scheme and a test case corresponding to the defect information; and inputting the defect information and the corresponding test scheme and the test case into an automatic test system, importing the whole substation SCD configuration file, the test scheme and the test case according to a preset automatic test strategy, and generating the automatic test case to test the power automation equipment. Quality improvement measures and test schemes are generated by combining historical data with expert experience, an automatic test system is used for testing, the test efficiency and product quality of electric power automatic equipment are effectively improved, and then safe and stable operation of an electric power system is guaranteed.

Description

Technical Field

[0001] The present invention relates to the technical field of power equipment testing, and particularly to a testing method, system, electronic device and storage medium for power automation equipment. Background Art

[0002] With the continuous expansion of the scale of the power system and the continuous improvement of the complexity of the power system, power automation equipment plays an increasingly important role in the operation of the power system. Typical power automation equipment includes relay protection devices, automation control systems, monitoring and data acquisition systems (SCADA), etc. The performance of these devices is directly related to the safety and stability of the power grid. Therefore, testing power automation equipment to ensure its performance is the key to ensuring the normal operation of the power grid.

[0003] Currently, the testing means of power automation equipment are developing diversely: Laboratory testing conducts function, performance and reliability tests in a controlled environment to ensure that the equipment meets the design requirements during the R & D stage; Field testing verifies the performance of the equipment in the actual operating environment to ensure that the equipment can cope with complex on-site conditions; Simulation testing simulates various power grid operation scenarios through digital simulation to test the performance of the equipment under different working conditions. With the development and progress of testing technology, some new testing means have emerged: Using an automated testing platform to test power automation equipment can greatly improve testing efficiency and accuracy and reduce human errors; Using big data analysis technology to analyze equipment operation data to discover potential problems of power automation equipment and then optimize equipment performance; Using artificial intelligence technology to predict and diagnose equipment faults to improve the intelligence level of the equipment.

[0004] In the prior art, although there are already rich testing means for power automation equipment, many challenges are still faced: As the functions of the equipment increase, the complexity and workload of testing increase significantly; The actual application site environment of power automation equipment is complex, and it is difficult to fully simulate all working conditions; The cost of high-precision testing equipment and simulation platforms is relatively high. Summary of the Invention

[0005] Object of the Invention: The first object of the present invention is to provide a testing method for power automation equipment that uses defect information for automated testing; The second object is to provide a testing system, electronic device and storage medium for power automation equipment.

[0006] Technical Solution: A testing method for power automation equipment includes the following steps:

[0007] S1. Collect defect information of power automation equipment and enter the defect information into the defect database;

[0008] S2. Input the defect information in the defect database into the defect analysis system, analyze the defect information using the defect analysis system, and generate a test plan and test cases corresponding to the defect information.

[0009] S3. Input the defect information and the corresponding test plan and test cases into the automated test system. The automated test system imports the substation-wide SCD configuration file, test plan, and test cases according to the preset automated test strategy, and generates automated test cases to test the power automation equipment.

[0010] Preferably, step S1 further includes:

[0011] After collecting the defect information of the power automation equipment, enter the defect information into the defect collection system, review the defect information based on expert experience, and enter the reviewed defect information into the defect database.

[0012] Specifically, step S2 includes:

[0013] S21. Use the historical power system defect information, defect analysis cases, quality improvement measure cases, and power equipment technical standards and specifications as input data to train the defect analysis algorithm.

[0014] S22. Set the defect analysis configuration strategy according to expert experience, and read the defect information according to the defect analysis configuration strategy.

[0015] S23. Use the trained defect analysis algorithm to analyze and process the defect information in the defect database, and output a test plan and test cases corresponding to the defect information.

[0016] Specifically, step S3 includes:

[0017] S31. Configure the automated test case generation algorithm, and use the test cases screened by expert experience and the power equipment technical standards and specifications to train the automated test case generation algorithm.

[0018] S32. Configure the automated test strategy, import the substation-wide SCD configuration file, extract the configuration information of the power automation equipment according to the automated test strategy, generate the configuration CID file of the object under test, and load the test plan and test cases generated by the defect analysis system.

[0019] S33. Preprocess the substation-wide SCD configuration file, test plan, and test cases according to the automated test strategy to obtain the preprocessed test information.

[0020] S34. Use the trained automated test case generation algorithm to process the preprocessed test information, generate automated test cases, send them to the automated test execution system, and automatically test the power automation equipment.

[0021] Specifically, the automated test strategy includes: test object type, test scope, and test granularity;

[0022] The test object type includes single-device testing and multi-device system testing; the test scope includes single-function testing, multi-function testing, full-function testing, and function and impact scope testing; the test granularity includes basic function testing, basic performance testing, and full boundary coverage testing.

[0023] Specifically, in step S34, the automated test execution system includes:

[0024] A system management unit, which is used to provide a human-machine interaction interface and the management function of the automated test execution system;

[0025] A use case execution processing unit, which is used to provide a hardware virtualization platform and send configuration information to control the automated test process;

[0026] A programmable interface unit, which consists of several distributed programmable interface boards. The programmable interface board includes a processor module and a programmable hardware interface module. The processor module is used to execute the configuration information sent by the use case execution processing unit and configure the programmable hardware interface program. The programmable hardware interface module is used to perform interface adaptation according to the test case and the information of the power automation device under test.

[0027] Specifically, in step S1, the defect information of the power automation device includes the information of product defects, management defects, configuration anomalies, and operation errors found in the production process, factory inspection, equipment detection, system integration commissioning, acceptance inspection, and system operation and maintenance management of the power automation device.

[0028] The present invention also provides a power automation device test system, including the following modules:

[0029] A defect information collection module: which is used to collect the defect information of the power automation device and enter the defect information into the defect database;

[0030] A defect information analysis module: which is used to input the defect information in the defect database into the defect analysis system, analyze the defect information by using the defect analysis system, and generate a test plan and test cases corresponding to the defect information;

[0031] An automated test module: which is used to input the defect information, the corresponding test plan and test cases into the automated test system. The automated test system imports the substation full-station SCD configuration file, test plan, and test cases according to the preset automated test strategy, and generates automated test cases to test the power automation device.

[0032] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of the above-mentioned power automation equipment testing method are implemented.

[0033] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned power automation equipment testing method are implemented.

[0034] Beneficial effects: Compared with the prior art, the remarkable effect of the present invention is that, aiming at the complex characteristics of power automation equipment testing, the present invention designs an automated testing scheme. By collecting and analyzing the defect information of power automation equipment, and then training the defect analysis algorithm with historical defect information, the testing scheme and test cases corresponding to the defect information are automatically generated by the defect analysis algorithm, avoiding a large amount of labor generated by manual design of the testing scheme. Then, the automated testing system generates automated test cases, and the virtualization technology is used to execute the automated test cases to test the power automation equipment, effectively improving the testing efficiency of the power automation equipment. In multiple key links such as defect information collection, defect analysis configuration strategy, and automated use case algorithm training, the expert experience review method is adopted, increasing the information credibility, greatly reducing the introduction probability of error information, and thus increasing the accuracy of power automation equipment testing. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is the method flow chart of the present invention.

[0036] Figure 2 is the structural schematic diagram of the automated testing execution system of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0037] The following further illustrates a preferred solution of the present invention with reference to the drawings.

[0038] Embodiment 1

[0039] Please refer to Figure 1 shown. This embodiment provides a power automation equipment testing method, including the following steps:

[0040] S1. Collect the defect information of the power automation equipment, enter the defect information into the defect collection system, and based on expert experience, review the defect information, and enter the reviewed defect information into the defect database.

[0041] The defect information of the power automation equipment includes information on product defects, management defects, configuration anomalies, and operation errors found in the production process, factory inspection, equipment detection, system integration and commissioning, acceptance inspection, and system operation and maintenance management of the power automation equipment.

[0042] In a typical application scenario, a defect collection system is deployed on distributed servers and databases to automatically collect defect information of power automation devices, which is then entered by test engineers from authorized inspection agencies, operation and maintenance management teams, system integrators, and manufacturers of power automation devices; the review of defect information is the responsibility of inspection agencies or safety and quality departments at all levels. The defect information that passes the review will be entered into the defect database for storage.

[0043] In this embodiment, taking the example of a 750 kV substation where a network storm causes the automation device to restart or freeze, the defect information is as follows:

[0044] Defect generation link: The system in operation.

[0045] Fault phenomenon: In a 750 kV substation, the L manufacturer's measurement and control device, model number: LDD2X62U, was used. On February 25, 2018, the measurement and control devices of circuit breakers 7512, 7511, and the measurement and control device on the 66 kV side of the No. 1 main transformer restarted irregularly and issued alarms at different times.

[0046] Defect information number: 2018031500290750XX0043

[0047] Fault analysis: Technical personnel inspected the operation information of the measurement and control device on-site and found only the self-record of the measurement and control device, without seeing other abnormal alarms. Further inspection found that there were a large number of broadcast messages on the network, resulting in a network storm.

[0048] Fault cause:

[0049] 1. The background sent a large number of unknown multicast messages for network-wide broadcast.

[0050] 2. The switch did not enable storm suppression.

[0051] 3. The measurement and control device lacks network storm protection function.

[0052] Fault type:

[0053] 1. Application exception.

[0054] 2. The function is not configured according to the specification requirements.

[0055] 3. Device reliability.

[0056] Fault-related product:

[0057] 1. Substation management background.

[0058] 2. Switch.

[0059] 3. Measurement and control device.

[0060] Product manufacturer:

[0061] 1. ZSX

[0062] 2. All manufacturers

[0063] 3. Manufacturer L

[0064] Product model:

[0065] 1. XXXYD

[0066] 2. PS3821

[0067] 3. LDD2X62U

[0068] Solution:

[0069] 1. Upgrade the background application software to reduce unnecessary multicast information transmission.

[0070] 2. Add storm suppression configuration to the switch.

[0071] 3. Upgrade the version of the measurement and control device of manufacturer L to solve the problem of being unable to resist storm messages.

[0072] Improvement measures:

[0073] 1. Organize to eliminate the multicast message sending situation of the background systems of each manufacturer, and give rectification measures and rectification plans.

[0074] 2. Clarify the switch configuration requirements, and each manufacturer conducts configuration problem troubleshooting; notify each unit to optimize the on-site acceptance inspection items and operation and maintenance inspection items of the switch, and add the inspection of the switch storm suppression configuration.

[0075] 3. The testing agency adds the test of the device's resistance to network storms; each manufacturer conducts device problem troubleshooting and gives rectification measures and rectification plans.

[0076] The defect information is input into the defect management system by the operation and maintenance team of the 750 kV substation, and the safety and quality department of the branch to which the substation belongs organizes experts to conduct information review and evaluation.

[0077] S2. Input the defect information in the defect database into the defect analysis system, use the defect analysis system to analyze the defect information, and generate a test plan and test cases corresponding to the defect information.

[0078] In a typical application scenario, the defect analysis system is deployed on the server side, and the server side should meet the performance requirements for processing artificial intelligence algorithms and machine learning algorithms. After selecting an appropriate defect analysis algorithm, use the historical power system defect information, defect analysis cases, quality improvement measure cases, and power equipment technical standards and specifications as input data to train the defect analysis algorithm.

[0079] In this embodiment, the original text information of historical power system defect information, defect analysis cases, quality improvement measure cases, and power equipment technical standards and specifications is used as input data. Using a Chinese pre-trained model, such as the RoBERTa-wwm-ext model, the feature information of the input data is extracted, and feature enhancement and key feature extraction are performed. Then, the features are structurally encoded. For example, when encoding device parameters, the numerical features are first binned, and then the categorical features are embedded; for spatio-temporal features, a Transformer spatio-temporal encoder is used for encoding to save time information, device location information, and corresponding device parameter information (temperature, humidity, etc.).

[0080] After completing the feature encoding, a knowledge graph is constructed. The specific process is as follows: original text → entity recognition → relation extraction → graph storage; or technical standards → clause parsing → graph storage → Neo4j graph database. Then, an entity-relation joint extraction model, such as the GlobalPointer model, is used to complete the recognition of named entities by customizing entity types; after that, the knowledge graph is vectorized. For example, using TransR knowledge representation learning, by embedding entities and relations into different spaces, TransR can better capture the multiple attributes of entities under different relations, thereby improving the effect of knowledge graph completion.

[0081] After completing the construction of the knowledge graph, a multi-task learning model is constructed. This model has three main parts: a shared feature encoding layer, a test plan generation branch, and a standard matching branch. The model combines multi-modal inputs, including text, structured data, spatio-temporal information, etc. When training the multi-task learning model, a mixed loss function is used. The mixed loss function combines the generation loss, the similarity loss between different modalities, and regularization, sets the weights of the loss terms, and then the multi-task learning model is trained in stages.

[0082] Taking the test plan as an example, using the above multi-task learning model, the specific process of generating the test plan is as follows: the user inputs a fault description and environmental parameters, and feature extraction is performed on the input text; knowledge retrieval is performed using the knowledge graph of the model to automatically obtain relevant cases and standards, and a preliminary plan is generated after providing constraint conditions, such as adding mandatory reference standards, the test items need to comply with a specific standard, and adding keyword constraints, such as adding key test items; then, standard verification is performed, that is, the final plan after compliance checking is obtained.

[0083] In this embodiment, the test engineer or the dedicated quality management personnel sets the defect analysis configuration strategy and reads the defect information stored in the defect database according to the defect analysis configuration strategy.

[0084] Based on the defect information message of a 750 kV substation in the newly added S1 step, the test engineer performs the reliability detection of the measurement and control device against network storms according to the supervision and detection tasks required by the competent department, and sets the defect analysis configuration strategy. The defect analysis configuration strategy is as follows:

[0085] Scope of equipment and systems involved: Measurement and control device

[0086] Scope of manufacturers involved: All manufacturers

[0087] Scope of analysis involved: Reliability

[0088] Whether to conduct root cause analysis by analogy: Yes

[0089] Using the above trained defect analysis algorithm and defect analysis configuration strategy, analyze and process the defect information in the defect database, and output the analysis results, including the test plan and test cases corresponding to the defect information, suggestions for product quality improvement measures, and defect analysis reports.

[0090] Defect analysis report: It includes contents such as problem phenomenon, analysis process, root cause of the problem, solution measures, and quality improvement measures, which will not be elaborated in this embodiment.

[0091] Test plan:

[0092] Test objectives: (1) Verify that the functions of the measurement and control device should be normal under network storm conditions. (2) Verify the normal working flow size of the measurement and control device under different information and operation instructions of large-flow normal service messages. When the flow exceeds the normal working flow, the device should not crash or restart, and the functions should be normal after the flow decreases.

[0093] Test environment: Automated test case execution system, the measurement and control device under test.

[0094] Test cases: Use case 1, perform basic function tests under the background flow of network storms. Use case 2, construct a large number of SV / GOOSE messages subscribed by the device for testing. Use case 3, construct a large number of MMS client read measurement and control device information instructions according to the CID model of the measurement and control device.

[0095] S3. Input the defect information and the corresponding test plan and test cases into the automated test system. The automated test system imports the substation-wide SCD configuration file, test plan, and test cases according to the preset automated test strategy, and generates automated test cases to test the power automation equipment.

[0096] In a typical application scenario, the automated test case generation algorithms configured on the automated test system include artificial intelligence algorithms, machine learning algorithms, and code generation algorithms, and the automated test case generation algorithms are trained using the test cases screened by expert experience and the technical standards and specifications of power equipment. In this embodiment, the same general artificial intelligence (AGI) model as in step S2 is used for defect analysis training.

[0097] The tester is responsible for configuring the automated test strategy, and the automated test strategy includes: test object type, test scope, and test granularity; the test object type includes single-device testing and multi-device system testing; the test scope includes single-function testing, multi-function testing, full-function testing, function and impact scope testing; the test granularity includes basic function testing, basic performance testing, and full boundary coverage testing. After the automated test strategy is configured, the substation's full-station SCD configuration file is imported, and the configuration information of the power automation equipment is extracted according to the automated test strategy to generate the configuration CID file of the object under test, and the test plan and test cases generated by the defect analysis system are loaded.

[0098] According to the automated test strategy, preprocess the substation's full-station SCD configuration file, test plan, and test cases, extract the test information in the above inputs, and output the preprocessed test information;

[0099] Use the trained automated test case generation algorithm to process the preprocessed test information, generate automated test cases, and send them to the automated test execution system to perform automatic testing on the power automation equipment.

[0100] The tester of the testing agency configures the test strategy according to the defect supervision and detection task of a certain 750 kV substation in step S1, and the content is as follows:

[0101] Test object type: Single-device testing.

[0102] Test scope: Full-function testing.

[0103] Test granularity: Full boundary coverage testing.

[0104] The automated test system generates corresponding test cases according to the configured test strategy and the test SCD configuration file. Taking the first test case as an example, the test case information is as follows:

[0105] Test case 1, perform basic function testing under the background of network storm.

[0106] The device under test subscribes to the information device configuration file.

[0107] Network storm background message flow generation configuration file.

[0108] The output check configuration file of the device under test.

[0109] Step 1: Send the configuration file to the automatic and test execution system.

[0110] Step 2: Test the basic functions of the test device, control the test virtual device 1 to send the messages subscribed by the device under test. The test virtual device 2 collects the information of the device under test and judges the test result.

[0111] Step 3: Test the basic functions of the test device during network storm, control the test virtual device 3 to send storm messages, and repeat Step 2.

[0112] Please refer to Figure 2 As shown, a typical automatic test execution system includes: a system management unit, an algorithm processing unit, and a test case execution processing unit. The system management unit and the test case execution processing unit are composed of a high-performance multi-core ARM processor and other peripheral devices; the system management unit is used to provide a human-computer interaction interface and the management function of the automatic test execution system, that is, an integrated test management system, and receives automatic test cases through the test system control interface; the test case execution processing unit is used to send configuration information to control the automatic test process. The high-performance multi-core ARM processor runs a hardware virtualization platform, virtualizes the processor cores into functional devices, including a test system management system and test virtual devices. The test system management system is responsible for receiving automatic test case information, dynamically generating test virtual devices according to the automatic test case information. The test virtual devices are used to execute test cases and judge test results; the test virtual devices, according to the virtual device configuration, send configuration programs to the programmable hardware interface through the underlying driver interface.

[0113] The programmable interface unit is composed of several distributed programmable interface boards. The programmable interface boards include a high-performance processor module and a programmable hardware interface module. In this embodiment, the high-performance processor uses a multi-core ARM processor. The programmable hardware interface module is implemented through an FPGA device and peripheral circuits. The high-performance processor module is used to execute the configuration information sent by the test case execution processing unit, configure the FPGA device, and configure the programmable hardware interface program. The programmable hardware interface module performs interface adaptation according to the test case and the information of the power automation device under test, such as IO interfaces, Ethernet interfaces, and serial interfaces.

[0114] Embodiment 2

[0115] This embodiment provides a power automation device test system corresponding to the power automation device test method described in Embodiment 1, including the following modules:

[0116] Defect information collection module: used to collect the defect information of the power automation device and enter the defect information into the defect database;

[0117] Defect information analysis module: used to input the defect information in the defect database into the defect analysis system, analyze the defect information using the defect analysis system, and generate a test plan and test cases corresponding to the defect information;

[0118] Automated testing module: used to input the defect information and the corresponding test plan and test cases into the automated testing system. The automated testing system imports the substation-wide SCD configuration file, test plan, and test cases according to the preset automated testing strategy, and generates automated test cases to test the power automation equipment.

[0119] This embodiment also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of the power automation equipment testing method described in Embodiment 1 are implemented.

[0120] This embodiment also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the power automation equipment testing method described in Embodiment 1 are implemented.

Claims

1. A method for testing power automation equipment, characterized in that It includes the following steps: S1. Collect the defect information of power automation equipment and enter the defect information into the defect database; S2. Input the defect information in the defect database into the defect analysis system, analyze the defect information by using the defect analysis system, and generate a test plan and test cases corresponding to the defect information; S3. Input the defect information and the corresponding test plan and test cases into the automated test system. The automated test system imports the substation full-station SCD configuration file, test plan and test cases according to the preset automated test strategy, and generates automated test cases to test the power automation equipment.

2. The power automation equipment testing method according to claim 1, characterized in that: The step S1 further includes: After collecting the defect information of power automation equipment, enter the defect information into the defect collection system, and based on expert experience, review the defect information and enter the reviewed defect information into the defect database.

3. The power automation equipment testing method according to claim 1, characterized in that: The step S2 includes: S21. Use the historical power system defect information, defect analysis cases, quality improvement measure cases, and power equipment technical standards and specifications as input data to train the defect analysis algorithm; S22. Set the defect analysis configuration strategy according to expert experience and read the defect information according to the defect analysis configuration strategy; S23. Analyze and process the defect information in the defect database by using the trained defect analysis algorithm, and output a test plan and test cases corresponding to the defect information.

4. The power automation equipment testing method according to claim 1, characterized in that: The step S3 includes: S31. Configure the automated test case generation algorithm, and use the test cases screened by expert experience and the power equipment technical standards and specifications to train the automated test case generation algorithm; S32. Configure the automated test strategy, import the substation full-station SCD configuration file, extract the configuration information of the power automation equipment according to the automated test strategy, generate the configuration CID file of the object under test, and load the test plan and test cases generated by the defect analysis system; S33. Preprocess the substation full-station SCD configuration file, test plan and test cases according to the automated test strategy to obtain the preprocessed test information; S34. Use the trained automated test case generation algorithm to process the preprocessed test information, generate automated test cases, and send them to the automated test execution system to automatically test the power automation equipment.

5. The power automation equipment testing method according to claim 1, wherein: In the step S3, the automated test strategy includes: test object type, test scope and test granularity; The test object type includes single-device test and multi-device system test; the test scope includes single-function test, multi-function test, full-function test, function and influence scope test; the test granularity includes basic function test, basic performance test, and boundary full-coverage test.

6. The power automation equipment testing method according to claim 4, characterized in that: In the step S34, the automated test execution system includes: The system management unit is used to provide a human-computer interaction interface and the management function of the automated test execution system; The test case execution processing unit is used to provide a hardware virtualization platform and send the configuration information to control the automated test process; A programmable interface unit, which is composed of a number of distributed programmable interface boards. The programmable interface board includes a processor module and a programmable hardware interface module. The processor module is used to execute the configuration information issued by the use case execution processing unit and configure the programmable hardware interface program. The programmable hardware interface module is used to perform interface adaptation according to the test case and the information of the power automation device under test.

7. The power automation equipment testing method according to claim 1, wherein: In the step S1, the defect information of the power automation device includes information on product defects, management defects, configuration anomalies, and operation errors found during the production process, factory inspection, equipment detection, system integration testing, acceptance inspection, and system operation and maintenance management of the power automation device.

8. A power automation equipment testing system, characterized in that Including: Defect information collection module: used to collect the defect information of the power automation device and enter the defect information into the defect database; Defect information analysis module: used to input the defect information in the defect database into the defect analysis system, analyze the defect information using the defect analysis system, and generate a test plan and test cases corresponding to the defect information; Automated testing module: used to input the defect information, corresponding test plan and test cases into the automated testing system. The automated testing system imports the substation-wide SCD configuration file, test plan, and test cases according to the preset automated testing strategy, and generates automated test cases to test the power automation device.

9. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 7.

Images