Method and device for evaluating state of substation automation system in novel power system

Abstract

The invention provides a method and a device for evaluating the state of a substation automation system in a novel power system. The method comprises the following steps: establishing a fault instance library according to acquired fault data; performing accuracy evaluation on a model of the substation automation system to be tested based on the fault instance library, loading the evaluated model, and generating a model grading result; simulating and generating a fault scene based on the fault instance library, and injecting the fault scene into a to-be-tested substation automation system; generating a system representation evaluation result according to data output by the to-be-tested substation automation system; determining a comprehensive judgment result according to the representation evaluation result and the model grading result; and generating a state evaluation result according to the comprehensive judgment result in combination with manual check analysis. According to the method and the device, accurate evaluation, defect identification, fault diagnosis alarm and defect intelligent early warning of the equipment state are realized, and the automation and intelligence level of operation and maintenance of the transformer substation is improved.

Description

Technical Field

[0001] This invention relates to the field of power system condition assessment, and more specifically, to a method and apparatus for assessing the condition of substation automation systems in a novel power system. Background Technology

[0002] With the further development of smart grid infrastructure and the promotion of new power system technologies, substation automation systems, as a crucial link in smart grid monitoring, control, and regulation, and the source of various grid data, are fundamental to the safe and stable operation of the grid. Their operational status directly affects the grid's real-time monitoring, fault isolation, and recovery capabilities, making them a vital component of grid operation. As the new production system of smart grids continues to evolve, smart substations can now meet the operational needs of unmanned operation and centralized equipment monitoring. Simultaneously, substation automation systems have achieved protection and control of equipment within the substation, measurement and monitoring, remote monitoring, and network security functions. Smart substation systems can also meet the needs of grid operation monitoring and control, centralized monitoring and management of primary, secondary, and auxiliary equipment, as well as substation maintenance, equipment management, and emergency duty.

[0003] In addition to meeting the above requirements, intelligent substation automation systems have also grown exponentially in scale and size. Traditional "measurement-observation" assessment methods are no longer sufficient to evaluate the condition of intelligent substations. Therefore, how to quantitatively assess potential substation faults and system health indices, and to formulate strategies for equipment procurement, selection, and maintenance, has become a pressing technical problem that needs to be solved. Summary of the Invention

[0004] To address the technical problem of difficulty in quantitatively assessing the health status of substations as the data scale of substation automation systems continues to expand in existing technologies, this invention provides a method and apparatus for assessing the status of substation automation systems in new power systems.

[0005] According to one aspect of the present invention, a method for evaluating the status of a substation automation system in a novel power system is provided, comprising:

[0006] A fault instance library is established based on the acquired fault data;

[0007] Based on the fault instance library, the accuracy of the model of the substation automation system under test is evaluated, and the evaluated model is loaded into the substation automation system under test to generate the model rating result.

[0008] Based on the fault instance library, fault scenarios are simulated and generated and injected into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios.

[0009] Based on the data output by the automation system of the substation under test, generate system appearance evaluation results;

[0010] Based on the aforementioned appearance evaluation results and model rating results, a comprehensive judgment result is determined;

[0011] Based on the comprehensive judgment results and combined with manual verification and analysis, a status assessment result is generated.

[0012] According to another aspect of the present invention, an apparatus for evaluating the status of a substation automation system in a novel power system is provided, the apparatus comprising:

[0013] The instance library module is used to build a fault instance library based on the acquired fault data;

[0014] The first evaluation module is used to evaluate the accuracy of the model of the substation automation system under test based on the fault instance library, load the evaluated model into the substation automation system under test, and generate the model rating result.

[0015] The fault injection module is used to simulate and generate fault scenarios based on the fault instance library and inject them into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios.

[0016] The second evaluation module is used to generate system appearance evaluation results based on the data output by the automation system of the substation under test.

[0017] The third evaluation module is used to determine the comprehensive judgment result based on the appearance evaluation results and the model rating results;

[0018] The results output module is used to generate a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, the storage medium storing a computer program for performing the methods described in any of the above aspects of the present invention.

[0020] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: a processor; a memory for storing executable instructions of the processor; the processor being configured to read the executable instructions from the memory and execute the instructions to implement the method described in any of the preceding aspects of the present invention.

[0021] The present invention discloses a method and apparatus for evaluating the status of substation automation systems in a novel power system. The method includes: establishing a fault instance library based on acquired fault data; performing an accuracy assessment on a model of the substation automation system under test based on the fault instance library, loading the assessed model into the substation automation system under test, and generating a model rating result; simulating and generating fault scenarios based on the fault instance library and injecting them into the substation automation system under test; generating a system appearance assessment result based on the data output by the substation automation system under test; determining a comprehensive judgment result based on the appearance assessment result and the model rating result; and generating a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis. The method and apparatus comprehensively extract multi-dimensional information data from the substation automation system and employ algorithms such as combined prediction and fault diagnosis to achieve accurate assessment of equipment status, defect identification, fault diagnosis alarms, and intelligent defect early warning, thereby improving the automation and intelligence level of substation operation and maintenance, and enhancing the intelligent assessment and control capabilities of equipment status. Attached Figure Description

[0022] Exemplary embodiments of the present invention can be more fully understood by referring to the following figures:

[0023] Figure 1 A flowchart illustrating a method for evaluating the status of a substation automation system in a novel power system according to a preferred embodiment of the present invention;

[0024] Figure 2 A schematic diagram illustrating the assessment of fault levels in a substation automation system within a novel power system according to a preferred embodiment of the present invention;

[0025] Figure 3 This is a schematic diagram illustrating the post-fault injection assessment of the defect tolerance capability of the substation automation system under test according to a preferred embodiment of the present invention.

[0026] Figure 4 A logic block diagram of a method for evaluating the status of a substation automation system in a novel power system, as preferred by the present invention;

[0027] Figure 5 A schematic diagram of a device for evaluating the status of a substation automation system in a novel power system according to a preferred embodiment of the present invention.

[0028] Figure 6 This is a schematic diagram of the structure of an electronic device according to a preferred embodiment of the present invention. Detailed Implementation

[0029] Exemplary embodiments of the invention will now be described with reference to the accompanying drawings. However, the invention may be embodied in many different forms and is not limited to the embodiments described herein. These embodiments are provided to fully and completely disclose the invention and to fully convey its scope to those skilled in the art. The terminology used in the exemplary embodiments illustrated in the drawings is not intended to limit the invention. In the drawings, the same units / elements are referred to by the same reference numerals.

[0030] Unless otherwise stated, the terms used herein (including technical terms) have their common meaning as understood by one of ordinary skill in the art. Furthermore, it is understood that terms defined in commonly used dictionaries should be understood to have a meaning consistent with the context of their relevant field, and not to be interpreted as having an idealized or overly formal meaning.

[0031] Exemplary methods

[0032] Figure 1 This is a flowchart illustrating a method for evaluating the status of a substation automation system in a novel power system according to a preferred embodiment of the present invention. Figure 1 As shown, the method for evaluating the status of a substation automation system in a novel power system according to this preferred embodiment begins with step 101.

[0033] In step 101, a fault instance library is established based on the acquired fault data.

[0034] Preferably, the step of establishing a fault instance library based on the acquired fault data includes:

[0035] Acquire fault data, wherein the fault data includes historical operational fault data, test verification fault data, and simulation fault data;

[0036] A basic fault is generated based on the first data in the fault data, wherein the first data includes untime-stamped data, out-of-tolerance measurement data, and illegal logic control commands;

[0037] A complex fault scenario is generated based on the second data in the fault data, wherein the second data includes time signal anomaly data, non-uniform cross-section data, and reverse logic control sequence control data;

[0038] A fault instance library is established based on the basic faults and fault scenarios. The fault instance library, combined with the basic faults and complex fault scenarios, can simulate and generate mixed fault scenarios.

[0039] In this preferred embodiment, the fault instance library designs faults such as data without time stamp, out-of-tolerance measurement data, and illegal logic control commands as basic faults, and designs faults such as abnormal time synchronization signals, non-uniform cross-section data, and reverse logic control sequence control as complex fault scenarios. The combination of the two types of faults constitutes a mixed fault scenario. After injecting at least one of the above faults into the substation automation system under test, the fault tolerance capability of the substation automation system under test can be evaluated through dimensions such as system output failure data, functional loss, system operating status, and reliability index calculation and verification.

[0040] The method for evaluating the status of substation automation systems in a new power system according to this preferred embodiment relies on the intelligent substation automation reliability analysis and evaluation system. It constructs an index system based on the system structure characteristics and business characteristics, and explores the system's reliability operation boundary by simulating various fault scenarios and designing fault injection strategies for reliability testing. Figure 2 This is a schematic diagram illustrating the assessment of fault levels in a substation automation system within a novel power system according to a preferred embodiment of the present invention. Figure 2 As shown, based on the system structure and business characteristics of the substation automation system, and the reliability concerns of the substation automation system model, measurement, control, and advanced application functions, typical fault scenarios are arranged to construct an indicator system related to the substation. Then, based on historical operational faults, faults are tested and verified, and faults are simulated to establish a fault instance library. Finally, the fault level is determined based on the impact of the fault on the system, the hazard of the fault on the system, and the evaluation given by the expert experience system.

[0041] In step 102, the accuracy of the model of the substation automation system under test is evaluated based on the fault instance library, and the evaluated model is loaded into the substation automation system under test to generate the model rating result.

[0042] Preferably, the accuracy assessment of the model of the substation automation system under test based on the fault instance library, and the loading of the assessed model into the substation automation system under test to generate model rating results, includes:

[0043] The fault instance library is matched with the model of the substation automation system under test, and the accuracy of the model is evaluated according to the set matching dimensions to generate an accuracy evaluation result. The matching dimensions include naming rules, format rules, data rules, logic rules and security rules.

[0044] The model, after accuracy assessment, is loaded into the substation automation system under test. The model quality level is evaluated based on the system characteristics after loading and the accuracy assessment results, and a model rating result is generated. The system characteristics include system downtime, system freeze, resource consumption, and no impact.

[0045] In step 103, fault scenarios are simulated and generated based on the fault instance library and injected into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios.

[0046] Figure 3 This is a schematic diagram illustrating the post-fault injection assessment of the defect tolerance capability of a substation automation system under test according to a preferred embodiment of the present invention. Figure 3 As shown, in this preferred embodiment, the basic faults and (complex) fault scenarios in the fault instance library are simulated and generated by mixing faults (scenarios). After being injected into the substation automation system under test, the system's fault tolerance capability is evaluated through dimensions such as system output failure data, functional deficiencies, system operating status, and reliability index calculation and verification.

[0047] In step 104, a system appearance evaluation result is generated based on the data output by the automation system of the substation under test.

[0048] Preferably, generating system appearance evaluation results based on the data output by the substation automation system under test includes:

[0049] After receiving the injected fault scenario, the substation automation system under test outputs graphical data, which includes the substation automation system under test operation control diagram, sequence control diagram, intelligent alarm diagram, and human-machine interface operation diagram.

[0050] Based on the established impact degree-evaluation result correspondence table, a system appearance evaluation result is generated according to the impact degree of the graphical data. The impact degree-evaluation result correspondence table reflects the correspondence between the impact degree of the graphical data output by the intelligent substation automation system after receiving the injected fault scenario and different evaluation results.

[0051] In step 105, a comprehensive judgment result is determined based on the appearance evaluation result and the model rating result.

[0052] Preferably, determining the comprehensive judgment result based on the appearance evaluation result and the model rating result includes:

[0053] Based on the appearance evaluation results and model rating results, a comprehensive judgment result is generated by analyzing the internal data flow, control flow, application modules and API interfaces of the substation automation system under test, combined with rule checking, logic analysis and source tracing analysis.

[0054] In step 106, based on the comprehensive judgment result and combined with manual verification and analysis, a status assessment result is generated.

[0055] Preferably, the step of generating a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis includes:

[0056] Based on the comprehensive judgment results and manual verification analysis, verification analysis results are generated. The verification analysis results include accuracy analysis of defects, investigation of the destructiveness of defects and prediction of the impact of defects, and predictive mining of existing defects, predicting the direct and secondary impacts of defects on the substation automation system under test.

[0057] To locate, assess, and classify faults in the intelligent substation automation system, and determine the fault level;

[0058] Based on the verification and analysis results and the fault level, output status assessment results.

[0059] Figure 4 This is a logic block diagram of a method for evaluating the status of a substation automation system in a novel power system, as preferred by the present invention. Figure 4 As shown in the preferred embodiment, the method for evaluating the status of substation automation systems in a new power system is based on the system characteristics of substation automation systems. Targeting the operational characteristics and application features of substation automation systems, it starts with system models and fault examples to evaluate the substation automation system under test. Using system appearance evaluation and model evaluation and grading as entry points, it conducts accurate defect analysis and defect discovery and prediction through data flow, control flow, and logical structure analysis. After fault location and subsequent evaluation and classification, it generates a comprehensive decision-making evaluation report applicable to substation testing, manufacturing, operation, research, and development—that is, the status evaluation result. This achieves accurate evaluation of equipment status, defect identification, fault diagnosis and alarm, and intelligent defect early warning, improving the automation and intelligence level of substation operation and maintenance, and enhancing the intelligent evaluation and control capabilities of equipment status.

[0060] Exemplary device

[0061] Figure 5 This is a schematic diagram of a device for evaluating the status of a substation automation system in a novel power system according to a preferred embodiment of the present invention. Figure 5 As shown, the apparatus 500 for evaluating the status of a substation automation system in a novel power system according to this preferred embodiment includes:

[0062] The instance library module 501 is used to build a fault instance library based on the acquired fault data.

[0063] The first evaluation module 502 is used to evaluate the accuracy of the model of the substation automation system under test based on the fault instance library, load the evaluated model into the substation automation system under test, and generate the model rating result.

[0064] The fault injection module 503 is used to simulate and generate fault scenarios based on the fault instance library and inject them into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios.

[0065] The second evaluation module 504 is used to generate system appearance evaluation results based on the data output by the automation system of the substation under test.

[0066] The third evaluation module 505 is used to determine the comprehensive judgment result based on the appearance evaluation result and the model rating result;

[0067] The result output module 506 is used to generate a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis.

[0068] Preferably, the instance library module 501 establishes a fault instance library based on the acquired fault data, including:

[0069] Acquire fault data, wherein the fault data includes historical operational fault data, test verification fault data, and simulation fault data;

[0070] A basic fault is generated based on the first data in the fault data, wherein the first data includes untime-stamped data, out-of-tolerance measurement data, and illegal logic control commands;

[0071] A complex fault scenario is generated based on the second data in the fault data, wherein the second data includes time signal anomaly data, non-uniform cross-section data, and reverse logic control sequence control data;

[0072] A fault instance library is established based on the basic faults and fault scenarios. The fault instance library, combined with the basic faults and complex fault scenarios, can simulate and generate mixed fault scenarios.

[0073] Preferably, the first evaluation module 502 performs an accuracy evaluation on the model of the substation automation system under test based on the fault instance library, and loads the evaluated model into the substation automation system under test to generate a model rating result, including:

[0074] The fault instance library is matched with the model of the substation automation system under test, and the accuracy of the model is evaluated according to the set matching dimensions to generate an accuracy evaluation result. The matching dimensions include naming rules, format rules, data rules, logic rules and security rules.

[0075] The model, after accuracy assessment, is loaded into the substation automation system under test. The model quality level is evaluated based on the system characteristics after loading and the accuracy assessment results, and a model rating result is generated. The system characteristics include system downtime, system freeze, resource consumption, and no impact.

[0076] Preferably, the second evaluation module 504 generates a system appearance evaluation result based on the data output by the substation automation system under test, including:

[0077] After receiving the injected fault scenario, the substation automation system under test outputs graphical data, which includes the substation automation system under test operation control diagram, sequence control diagram, intelligent alarm diagram, and human-machine interface operation diagram.

[0078] Based on the established impact degree-evaluation result correspondence table, a system appearance evaluation result is generated according to the impact degree of the graphical data. The impact degree-evaluation result correspondence table reflects the correspondence between the impact degree of the graphical data output by the intelligent substation automation system after receiving the injected fault scenario and different evaluation results.

[0079] Preferably, the third evaluation module 505 determines a comprehensive judgment result based on the appearance evaluation result and the model rating result, including:

[0080] Based on the appearance evaluation results and model rating results, a comprehensive judgment result is generated by analyzing the internal data flow, control flow, application modules and API interfaces of the substation automation system under test, combined with rule checking, logic analysis and source tracing analysis.

[0081] Preferably, the result output module 506 generates a status assessment result based on the comprehensive judgment result and in conjunction with manual verification and analysis, including:

[0082] Based on the comprehensive judgment results and manual verification analysis, verification analysis results are generated. The verification analysis results include accuracy analysis of defects, investigation of the destructiveness of defects and prediction of the impact of defects, and predictive mining of existing defects, predicting the direct and secondary impacts of defects on the substation automation system under test.

[0083] To locate, assess, and classify faults in the intelligent substation automation system, and determine the fault level;

[0084] Based on the verification and analysis results and the fault level, output status assessment results.

[0085] The apparatus for evaluating the status of substation automation systems in a novel power system and the method for evaluating the status of substation automation systems in a novel power system, as described in this preferred embodiment, are based on the operational characteristics and application features of intelligent substation automation systems. They start with system models and fault examples to evaluate the substation automation system under test. Taking system appearance evaluation and model evaluation and classification as the entry point, they perform defect accuracy analysis and defect mining and prediction through data flow, control flow, and logic structure analysis. After fault location, they conduct evaluation and classification to form a status evaluation result applicable to substation testing, factory delivery, operation, scientific research, and development. The steps are the same, and the technical effects achieved are also the same. Therefore, they will not be described in detail here.

[0086] Exemplary electronic devices

[0087] Figure 6 This is a schematic diagram of the structure of an electronic device according to a preferred embodiment of the present invention. Figure 6 As shown, the electronic device includes one or more processors 601 and memory 602.

[0088] The processor 601 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.

[0089] The memory 602 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 601 may execute the program instructions to implement the methods for evaluating the state of a substation automation system in a novel power system and / or other desired functions as described in the various embodiments disclosed above. In one example, the electronic device may also include an input device 603 and an output device 604, these components being interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0090] In addition, the input device 603 may also include, for example, a keyboard, a mouse, etc.

[0091] The output device 604 can output various information to the outside. The output device 604 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0092] Of course, for the sake of simplicity, Figure 6Only some of the components of the electronic device relevant to this disclosure are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device may include any other suitable components depending on the specific application.

[0093] Exemplary computer program products and computer-readable storage media

[0094] In addition to the methods and apparatus described above, embodiments of this disclosure may also be computer program products comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods for evaluating the state of a substation automation system in a novel power system according to various embodiments of this disclosure as described in the "Exemplary Methods" section above.

[0095] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this disclosure. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0096] Furthermore, embodiments of this disclosure may also be computer-readable storage media storing computer program instructions that, when executed by a processor, cause the processor to perform steps in the method for evaluating the state of a substation automation system in a novel power system according to various embodiments of this disclosure, as described in the "Exemplary Methods" section above.

[0097] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0098] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0099] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For system embodiments, since they largely correspond to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0100] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0101] The apparatus and methods of this disclosure may be implemented in many ways. For example, they may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order of steps for the methods is for illustrative purposes only, and the steps of the methods of this disclosure are not limited to the order specifically described above unless otherwise specifically stated. Furthermore, in some embodiments, this disclosure may also be implemented as a program recorded on a recording medium, the program including machine-readable instructions for implementing the methods according to this disclosure. Thus, this disclosure also covers recording media storing programs for performing the methods according to this disclosure.

[0102] It should also be noted that in the apparatus, devices, and methods of this disclosure, the components or steps are decomposable and / or recombinable. Such decomposition and / or recombination should be considered equivalent to the present disclosure. The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0103] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A method for evaluating the status of a substation automation system in a novel power system, characterized in that, The method includes: A fault instance library is established based on the acquired fault data; Based on the fault instance library, the accuracy of the model of the substation automation system under test is evaluated, and the evaluated model is loaded into the substation automation system under test to generate the model rating result. Based on the fault instance library, fault scenarios are simulated and generated and injected into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios. Based on the data output by the automation system of the substation under test, generate system appearance evaluation results; Based on the aforementioned appearance evaluation results and model rating results, a comprehensive judgment result is determined; Based on the comprehensive judgment results and combined with manual verification and analysis, a status assessment result is generated.

2. The method according to claim 1, characterized in that, The step of establishing a fault instance library based on the acquired fault data includes: Acquire fault data, wherein the fault data includes historical operational fault data, test verification fault data, and simulation fault data; A basic fault is generated based on the first data in the fault data, wherein the first data includes untime-stamped data, out-of-tolerance measurement data, and illegal logic control commands; A complex fault scenario is generated based on the second data in the fault data, wherein the second data includes time signal anomaly data, non-uniform cross-section data, and reverse logic control sequence control data; A fault instance library is established based on the basic faults and fault scenarios. The fault instance library, combined with the basic faults and complex fault scenarios, can simulate and generate mixed fault scenarios.

3. The method according to claim 1, characterized in that, The accuracy of the model of the substation automation system under test based on the fault instance library is evaluated, and the evaluated model is loaded into the substation automation system under test to generate model rating results, including: The fault instance library is matched with the model of the substation automation system under test, and the accuracy of the model is evaluated according to the set matching dimensions to generate an accuracy evaluation result. The matching dimensions include naming rules, format rules, data rules, logic rules and security rules. The model, after accuracy assessment, is loaded into the substation automation system under test. The model quality level is evaluated based on the system characteristics after loading and the accuracy assessment results, and a model rating result is generated. The system characteristics include system downtime, system freeze, resource consumption, and no impact.

4. The method according to claim 1, characterized in that, The process of generating system appearance evaluation results based on the data output by the automation system of the substation under test includes: After receiving the injected fault scenario, the substation automation system under test outputs graphical data, which includes the substation automation system under test operation control diagram, sequence control diagram, intelligent alarm diagram, and human-machine interface operation diagram. Based on the established impact degree-evaluation result correspondence table, a system appearance evaluation result is generated according to the impact degree of the graphical data. The impact degree-evaluation result correspondence table reflects the correspondence between the impact degree of the graphical data output by the intelligent substation automation system after receiving the injected fault scenario and different evaluation results.

5. The method according to claim 1, characterized in that, The determination of the comprehensive judgment result based on the appearance evaluation result and the model rating result includes: Based on the appearance evaluation results and model rating results, a comprehensive judgment result is generated by analyzing the internal data flow, control flow, application modules and API interfaces of the substation automation system under test, combined with rule checking, logic analysis and source tracing analysis.

6. The method according to claim 1, characterized in that, The process of generating a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis includes: Based on the comprehensive judgment results and manual verification analysis, verification analysis results are generated. The verification analysis results include accuracy analysis of defects, investigation of the destructiveness of defects and prediction of the impact of defects, and predictive mining of existing defects, predicting the direct and secondary impacts of defects on the substation automation system under test. To locate, assess, and classify faults in the intelligent substation automation system, and determine the fault level; Based on the verification and analysis results and the fault level, output status assessment results.

7. An apparatus for evaluating the status of a substation automation system in a novel power system, characterized in that, The device includes: The instance library module is used to build a fault instance library based on the acquired fault data; The first evaluation module is used to evaluate the accuracy of the model of the substation automation system under test based on the fault instance library, load the evaluated model into the substation automation system under test, and generate the model rating result. The fault injection module is used to simulate and generate fault scenarios based on the fault instance library and inject them into the substation automation system under test. The fault scenarios include at least one of basic faults, complex fault scenarios, and mixed fault scenarios. The second evaluation module is used to generate system appearance evaluation results based on the data output by the automation system of the substation under test. The third evaluation module is used to determine the comprehensive judgment result based on the appearance evaluation results and the model rating results; The results output module is used to generate a status assessment result based on the comprehensive judgment result and combined with manual verification and analysis.

8. The apparatus according to claim 7, characterized in that, The instance library module establishes a fault instance library based on the acquired fault data, including: Acquire fault data, wherein the fault data includes historical operational fault data, test verification fault data, and simulation fault data; A basic fault is generated based on the first data in the fault data, wherein the first data includes untime-stamped data, out-of-tolerance measurement data, and illegal logic control commands; A complex fault scenario is generated based on the second data in the fault data, wherein the second data includes time signal anomaly data, non-uniform cross-section data, and reverse logic control sequence control data; A fault instance library is established based on the basic faults and fault scenarios. The fault instance library, combined with the basic faults and complex fault scenarios, can simulate and generate mixed fault scenarios.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the method as described in any one of claims 1-6.

10. An electronic device, characterized in that, include: The computer-readable storage medium as described in claim 9; as well as One or more processors for executing a program in the computer-readable storage medium.

Images