A method and system for evaluating the compatibility of power grid business applications with processor architecture.

Abstract

This invention provides a method and system for evaluating the compatibility of power grid business applications with processor architectures. The method includes: determining a power grid business scenario-based test suite based on the type of the power grid business application to be evaluated. The test suite includes a power industry protocol test script for verifying the processor architecture's power protocols, a real-time control performance test script for evaluating the processor architecture's control performance, and a power grid data consistency verification script for verifying the processor architecture's timing synchronization. On a multi-platform test environment cluster, an automated task scheduling engine is used to execute compatibility tests of the power grid business application on each processor architecture within the multi-platform test environment cluster, based on the power grid business scenario-based test suite. A rule engine is used to generate a compatibility rating level based on multi-dimensional test indicators collected during the testing process, achieving a comprehensive evaluation of the compatibility of the power grid business application with the processor architecture in terms of functional adaptation, performance, and data consistency.

Description

Technical Field

[0001] This invention relates to the fields of power information technology and processor architecture adaptation, specifically to a method and system for evaluating the compatibility of power grid business applications with processor architecture. Background Technology

[0002] Domestic processor architectures (such as Zhaoxin, Phytium, Hygon, and Siji Rockchip) use non-x86 instruction sets, while power grid business systems are typically optimized and compiled for x86 instruction sets (such as Intel / AMD), resulting in binary code that cannot be run directly and requires re-adaptation; hardware specifications also differ. The underlying mechanisms, such as bus protocols, of domestic processors are not entirely consistent with the x86 platform, potentially causing peripheral compatibility issues; and there is a strong ecosystem dependency. Power grid business systems have long been based on the x86 ecosystem (such as specific drivers and library functions), and migrating to processor architectures requires addressing the issue of broken software dependency chains.

[0003] In short, domestically produced processor architectures and the x86 architecture international commercial server platforms that power grid business systems have long relied on belong to different systems, requiring system adaptation for a smooth migration. However, there is currently a lack of systematic assessment methods for power grid business systems to adapt to and verify the compatibility of processor architectures. Directly applying domestically produced processor architectures to power grid business systems that have not been assessed and are incompatible with them can easily lead to risks such as business interruptions, performance degradation, or functional deficiencies, affecting the stable operation of power grid business systems. Therefore, there is an urgent need for a method to evaluate the compatibility of power grid business applications with multiple processor architectures. Summary of the Invention

[0004] To overcome the shortcomings of the prior art, this invention proposes a method for evaluating the compatibility of power grid business applications with processor architecture, including:

[0005] Based on the type of power grid business application to be evaluated, a power grid business scenario-based test suite is determined. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture.

[0006] On a pre-built multi-platform test environment cluster, an automated task scheduling engine is used to concurrently execute compatibility tests of the power grid business application on each processor architecture based on the power grid business scenario-based test suite; the multi-platform test environment cluster integrates multiple processor architectures.

[0007] The compatibility rating level is generated using a rule engine based on the multi-dimensional test indicators collected during the compatibility test.

[0008] Optionally, the multi-platform test environment cluster is pre-built as follows:

[0009] The unified management cluster integrates multiple processor architectures, including: Siji Rockchip, Phytium, Hygon, and Zhaoxin.

[0010] A standardized operating environment for power grid business applications is deployed in the unified management cluster. This operating environment includes an operating system and database middleware, which are used to simulate the real operating environment of power grid business applications.

[0011] Optionally, the step of using a rule engine to generate a compatibility rating level based on multi-dimensional test metrics collected during the compatibility test includes:

[0012] The collected multidimensional test metrics are weighted and normalized using a rule engine and then transformed into test metric feature vectors.

[0013] The feature vectors of the test indicators are input into a decision tree model for classification and prediction to generate a compatibility rating level.

[0014] The decision tree model is pre-trained based on historical data, which includes compatibility rating samples of power grid business applications and multiple processor architectures, as well as corresponding test index feature vector samples.

[0015] Optionally, the types of power grid business applications include dispatching systems, distribution systems, and marketing systems;

[0016] The same type of power grid business applications shall use the same power grid business scenario-based test suite;

[0017] Each of the aforementioned power grid business scenario-based test suites includes multiple test task sets for processor architectures, which are used to automatically load the test task set corresponding to the current processor architecture during compatibility testing.

[0018] Optionally, the step of concurrently executing compatibility tests of the power grid business application on each processor architecture using an automated task scheduling engine based on the power grid business scenario-based test suite on a pre-built multi-platform test environment cluster includes:

[0019] Upload the power grid business scenario-based test suite to the automated task scheduling engine;

[0020] Based on the power grid business application, specific test parameters are configured for each processor architecture in the power grid business scenario-based test suite to generate a test task set for each processor architecture;

[0021] On a pre-built multi-platform test environment cluster, the automated task scheduling engine is used to distribute the test task set to each processor architecture in parallel.

[0022] Based on the test task set, compatibility tests for power grid business applications are performed on each of the processor architectures.

[0023] Optionally, the compatibility testing of power grid service applications for each processor architecture based on the test task set includes:

[0024] Based on each of the aforementioned processor architectures:

[0025] Using the power industry protocol test scripts in the test task set, the processor architecture is subjected to manufacturing message specification read / write service tests and substation event subscription and publication tests to general objects to verify whether the processor architecture can correctly execute the basic operations defined by the protocol standard; the processor architecture is also subjected to simulated actual business tests to verify the protocol compatibility of the processor architecture in real business flows; and error message injection tests and communication interruption recovery tests are also used to evaluate the reliability of the processor architecture protocol stack.

[0026] Using the real-time control performance test scripts in the test task set, the processor architecture is tested for real-time control performance in power grid business applications.

[0027] Using the power grid data consistency verification script in the test task set, the processor architecture is used to perform power grid data consistency verification for power grid business applications.

[0028] Optionally, the step of using the real-time control performance test scripts in the test task set to perform real-time control performance testing on the processor architecture for power grid business applications includes:

[0029] Using the real-time control performance test script in the test task set, control commands are issued to the processor architecture;

[0030] A high-precision timer records the instruction response time from the issuance of the control instruction to the completion of the processor architecture's execution, which is used to quantify the real-time response capability of the processor architecture.

[0031] The latency fluctuations during the test are statistically analyzed to evaluate the reliability of the processor architecture's response time.

[0032] The measured latency and jitter metrics are compared with the real-time performance standards of the power grid to evaluate the real-time performance of the processor architecture in task scheduling.

[0033] Optionally, the step of using the power grid data consistency verification script in the test task set to perform power grid data consistency verification for power grid business applications on the processor architecture includes:

[0034] By running the same computing task synchronously with each of the aforementioned processor architectures on a reference international architecture platform, the numerical deviations of the output results are compared to quantify data consistency.

[0035] Verify the intermediate states and final outputs of key business processes in each processor architecture to evaluate the cross-platform consistency of transaction logic.

[0036] Optionally, the multidimensional test metrics include at least one of the following: response time, CPU load, memory utilization, database transaction consistency, and output log integrity.

[0037] Based on the same inventive concept, this invention proposes a compatibility evaluation system for power grid business applications to processor architecture, comprising:

[0038] The test suite selection module is used to determine the power grid business scenario-based test suite based on the type of power grid business application to be evaluated. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture.

[0039] The testing module is used to concurrently execute compatibility tests of the power grid business application on each processor architecture using an automated task scheduling engine based on the power grid business scenario-based test suite on a pre-built multi-platform testing environment cluster; the multi-platform testing environment cluster integrates multiple processor architectures.

[0040] The compatibility assessment module is used to generate a compatibility assessment level based on the multi-dimensional test indicators collected during the compatibility test using the rule engine.

[0041] Optionally, the system also includes a multi-platform test environment cluster construction module, used for:

[0042] The unified management cluster integrates multiple processor architectures, including: Siji Rockchip, Phytium, Hygon, and Zhaoxin.

[0043] A standardized operating environment for power grid business applications is deployed in the unified management cluster. This operating environment includes an operating system and database middleware, which are used to simulate the real operating environment of power grid business applications.

[0044] Optionally, the compatibility assessment module is specifically used for:

[0045] The collected multidimensional test metrics are weighted and normalized using a rule engine and then transformed into test metric feature vectors.

[0046] The feature vectors of the test indicators are input into a decision tree model for classification and prediction to generate a compatibility rating level.

[0047] The decision tree model is pre-trained based on historical data, which includes compatibility rating samples of power grid business applications and multiple processor architectures, as well as corresponding test index feature vector samples.

[0048] Optionally, in the test suite selection module, the types of power grid business applications include dispatching systems, distribution systems, and marketing systems;

[0049] The same type of power grid business applications shall use the same power grid business scenario-based test suite;

[0050] Each of the aforementioned power grid business scenario-based test suites includes test parameters for multiple processor architectures, which are used to automatically load the test parameters corresponding to the current processor architecture during compatibility testing.

[0051] Optionally, the test module is specifically used for:

[0052] Upload the power grid business scenario-based test suite to the automated task scheduling engine;

[0053] Based on the power grid business application, specific test parameters are configured for each processor architecture in the power grid business scenario-based test suite to generate a test task set for each processor architecture;

[0054] On a pre-built multi-platform test environment cluster, the automated task scheduling engine is used to distribute the test task set to each processor architecture in parallel.

[0055] Based on the test task set, compatibility tests for power grid business applications are performed on each of the processor architectures.

[0056] Optionally, the test module is specifically used for:

[0057] Based on each of the aforementioned processor architectures:

[0058] Using the power industry protocol test scripts in the test task set, the processor architecture is subjected to manufacturing message specification read / write service tests and substation event subscription and publication tests to general objects to verify whether the processor architecture can correctly execute the basic operations defined by the protocol standard; the processor architecture is also subjected to simulated actual business tests to verify the protocol compatibility of the processor architecture in real business flows; and error message injection tests and communication interruption recovery tests are also used to evaluate the reliability of the processor architecture protocol stack.

[0059] Using the real-time control performance test scripts in the test task set, the processor architecture is tested for real-time control performance in power grid business applications.

[0060] Using the power grid data consistency verification script in the test task set, the processor architecture is used to perform power grid data consistency verification for power grid business applications.

[0061] Optionally, the test module is specifically used for:

[0062] Using the real-time control performance test script in the test task set, control commands are issued to the processor architecture;

[0063] A high-precision timer records the instruction response time from the issuance of the control instruction to the completion of the processor architecture's execution, which is used to quantify the real-time response capability of the processor architecture.

[0064] The latency fluctuations during the test are statistically analyzed to evaluate the reliability of the processor architecture's response time.

[0065] The measured latency and jitter metrics are compared with the real-time performance standards of the power grid to evaluate the real-time performance of the processor architecture in task scheduling.

[0066] Optionally, the test module is specifically used for:

[0067] By running the same computing task synchronously with each of the aforementioned processor architectures on a reference international architecture platform, the numerical deviations of the output results are compared to quantify data consistency.

[0068] Verify the intermediate states and final outputs of key business processes in each processor architecture to evaluate the cross-platform consistency of transaction logic.

[0069] Optionally, the multi-dimensional test metrics in the test module include at least one of the following: response time, CPU load, memory utilization, database transaction consistency, and output log integrity.

[0070] In another aspect, this application also provides an electronic device, comprising: at least one processor and a memory; the memory and the processor are connected via a bus;

[0071] The memory is used to store one or more programs;

[0072] When the one or more programs are executed by the at least one processor, a method for evaluating the compatibility of a power grid business application with the processor architecture as described above is implemented.

[0073] In another aspect, this application also provides a computer-readable storage medium having an executable program stored thereon, which, when executed, implements the above-described method for evaluating the compatibility of a power grid business application with a processor architecture.

[0074] Compared with the closest existing technology, the present invention has the following beneficial effects:

[0075] This invention provides a method and system for evaluating the compatibility of power grid business applications with processor architectures, comprising: determining a power grid business scenario-based test suite based on the type of the power grid business application to be evaluated; the power grid business scenario-based test suite including a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture; concurrently executing compatibility tests of the power grid business application on each processor architecture using an automated task scheduling engine based on the power grid business scenario-based test suite on a pre-built multi-platform test environment cluster; integrating multiple processor architectures in the multi-platform test environment cluster; and generating a compatibility rating level using a rule engine based on multi-dimensional test indicators collected during the compatibility test. This solution provides an integrated evaluation framework for multi-processor architecture platforms through a multi-platform testing environment cluster, facilitating compatibility testing of power grid business applications across various processor architectures. Power industry protocol test scripts within the power grid business scenario-based test suite directly verify the support of different processor architectures for power-specific communication protocols. Real-time control performance test scripts quantitatively compare the differences in instruction execution efficiency and latency across processor architectures to determine performance. Power grid data consistency verification scripts detect numerical deviations in calculation results across processor architectures, ensuring that the business logic of power grid applications is unaffected by processor architecture. The combination of these three elements enables a comprehensive evaluation of the functional adaptation, performance, and data consistency of power grid business applications across multiple processor architectures. Furthermore, a rule engine-based automatic diagnostic system automatically generates the final compatibility level. This solution possesses automated and quantifiable evaluation capabilities for power grid business systems directly applied to processor architectures, mitigating risks such as business interruptions caused by incompatibility between power grid business applications and domestic processor architecture platforms. Attached Figure Description

[0076] Figure 1 A flowchart illustrating a method for evaluating the compatibility of power grid business applications with processor architecture, provided by this invention.

[0077] Figure 2 A schematic diagram of the structure of a compatibility evaluation system for processor architecture in power grid business applications provided by the present invention;

[0078] Figure 3 This is a schematic diagram of the structure of an electronic device provided by the present invention. Detailed Implementation

[0079] Based on the technical problems mentioned above, this invention constructs a compatibility evaluation method and system that covers multiple power application scenarios, is compatible with multiple processor architectures, and has automated and quantifiable evaluation capabilities. The specific embodiments of this invention will be further described in detail below with reference to the accompanying drawings.

[0080] Example 1

[0081] This invention provides a method for evaluating the compatibility of power grid business applications with processor architecture, such as... Figure 1 As shown, it includes:

[0082] S1. Based on the type of the power grid business application to be evaluated, determine the power grid business scenario-based test suite. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture.

[0083] S2. On a pre-built multi-platform test environment cluster, an automated task scheduling engine is used to concurrently execute compatibility tests of the power grid business application on each processor architecture based on the power grid business scenario-based test suite; the multi-platform test environment cluster integrates multiple processor architectures.

[0084] S3. Using the rule engine, generate a compatibility rating level based on the multi-dimensional test indicators collected during the compatibility test.

[0085] In step S1, the power grid business scenario-based test suite is determined based on the type of power grid business application to be evaluated.

[0086] The types of power grid business applications include dispatching systems, distribution systems, and marketing systems;

[0087] The same type of power grid business applications shall use the same power grid business scenario-based test suite;

[0088] Each of the aforementioned power grid business scenario-based test suites includes multiple test task sets for processor architectures, which are used to automatically load the test task set corresponding to the current processor architecture during compatibility testing.

[0089] In other words, different types of power grid business applications correspond to different test suites. When testing the same power grid business application, different platforms (processor architectures) correspond to different test parameters (parameter fine-tuning) of the same test suite. This design ensures test coverage and avoids the repeated development of scripts for each platform.

[0090] The testing focus for each processor architecture (reflected in the different test parameters in the power grid business scenario-based test suite, including the corresponding thresholds, compilation options, and dependency libraries) is determined based on the differences in technical characteristics and application scenarios.

[0091] Phytium (ARM, Advanced RISC Machine, a processor architecture): The ARM architecture needs to run the original x86 power grid business applications, such as the scheduling system, through binary translation. Therefore, the focus is on verifying the correctness of the translated logic, such as whether the state estimation algorithm results are biased.

[0092] Due to ARM's weak memory ordering model, additional testing of data consistency in multi-threaded concurrent scenarios is required.

[0093] Zhaoxin / Hygon (x86): As an x86 compatible platform, it is necessary to ensure instruction-level compatibility with legacy power grid systems to avoid functional abnormalities caused by missing extended instructions.

[0094] The test focuses on PCIe (Peripheral Component Interconnect Express, a high-speed serial bus standard for connecting high-speed electronic components inside a computer) device compatibility, as the PCIe controller implementation differs from that of Intel architecture processors.

[0095] LoongArch: Its proprietary instruction set includes power-specific extensions, such as matrix acceleration instructions. It is necessary to verify their optimization effect on power grid algorithms, such as the speedup ratio of power flow calculation.

[0096] That is, based on the testing focus of each processor architecture, the corresponding test parameters in the power grid business scenario-based test suite are determined, resulting in the corresponding test task set. The pre-configured power grid business scenario-based test suite contains multi-dimensional test scripts, covering indicators such as functional verification, performance evaluation, and data consistency. Each test item can be automatically loaded and run according to business requirements.

[0097] Specifically, the power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture.

[0098] In step S2, before conducting the evaluation, a multi-platform test environment cluster is pre-built as follows:

[0099] The unified management cluster integrates multiple processor architectures, including Sigi, Phytium, Hygon, and Zhaoxin. Most of these are domestic processor architectures, as this solution is primarily used to evaluate the compatibility of power grid business applications with domestic processor architectures, providing a foundation for migrating power grid business applications to domestic platforms. However, the processor architectures integrated in the unified management cluster can also include international commercial processor architectures, meaning this solution is also applicable to evaluating the compatibility of power grid business applications with international commercial processor architectures.

[0100] A standardized operating environment for power grid business applications is deployed within the unified management cluster. This operating environment includes an operating system and database middleware, used to simulate the real operating environment of power grid business applications. It also includes a unified test operating system deployed within the unified management cluster. The operating system includes mainstream domestic operating systems such as Kylin and UnionTech UOS (UnityOperating System).

[0101] After the build is completed, typical power industry business systems, namely typical power grid business applications, including dispatching systems, distribution systems, and marketing systems, are deployed on each test node (each processor architecture of the multi-platform test environment cluster). The deployment process is standardized and configured to ensure the consistency of the test environment.

[0102] On the multi-platform test environment cluster, an automated task scheduling engine is used to concurrently execute compatibility tests of the power grid business applications on each processor architecture based on the power grid business scenario-based test suite. The automated task scheduling engine is implemented based on the Jenkins engine and supports task concurrency control and failure retry mechanisms.

[0103] Specifically, in S2-1, the power grid business scenario-based test suite is uploaded to the automated task scheduling engine; based on the power grid business application, specific test parameters are configured for each processor architecture in the power grid business scenario-based test suite, and a test task set for each processor architecture is generated.

[0104] S2-2, On a pre-built multi-platform test environment cluster, the automated task scheduling engine is used to distribute the test task set to each processor architecture in parallel.

[0105] S2-3, Based on the test task set, perform compatibility testing of power grid business applications on each of the processor architectures.

[0106] Specifically, based on each of the aforementioned processor architectures:

[0107] a) Using the power industry protocol test scripts in the test task set, perform manufacturing message specification read / write service tests and substation event subscription and publication tests to general objects on the processor architecture to verify whether the processor architecture can correctly execute the basic operations defined by the protocol standard.

[0108] The processor architecture was subjected to simulated real-world business tests (such as protection device operation and measurement data transmission) to verify its protocol compatibility and stability in real business flows.

[0109] It is also used for error message injection testing and communication interruption recovery testing to evaluate the reliability of the processor architecture protocol stack and ensure that services are not interrupted in abnormal situations.

[0110] In other words, the test scripts for power industry protocols include verification of basic protocol functions, coverage of business scenarios, and fault tolerance detection. These test items together constitute the core content of the test scripts for power industry protocols, verifying the integrity of business functions and ensuring that the processor architecture supports power standard protocols.

[0111] b) Using the real-time control performance test scripts in the test task set, perform real-time control performance testing on the processor architecture for power grid business applications, including:

[0112] Using the real-time control performance test script in the test task set, control commands are issued to the processor architecture;

[0113] A high-precision timer records the instruction response time from the issuance of the control instruction to the completion of the processor architecture's execution, which is used to quantify the real-time response capability of the processor architecture.

[0114] The latency fluctuations (such as standard deviation) during the testing process are statistically analyzed to evaluate the response time reliability of the processor architecture and ensure millisecond-level stability that meets power control requirements.

[0115] The measured latency and jitter metrics are compared with the real-time performance standards of the power grid to evaluate the real-time performance of the processor architecture in task scheduling.

[0116] These test items test the processor architecture, verifying multiple core indicators such as instruction response latency and cycle jitter, and realize the performance test of the processor architecture when running power grid business applications.

[0117] c) Using the power grid data consistency verification script in the test task set, perform power grid data consistency verification on the processor architecture for power grid business applications, including:

[0118] The same computing task was run synchronously on the reference international architecture platform (X86 architecture) and each of the processor architectures, and the numerical deviations of the output results were compared to quantify data consistency.

[0119] Verify the intermediate states and final outputs of key business processes (such as electricity billing and topology analysis) in each processor architecture to evaluate the cross-platform consistency of transaction logic.

[0120] By using the power industry protocol test scripts in the power grid business scenario test suite, the support of different processor architectures for power-specific communication protocols is directly verified. Based on the real-time control performance test script, the differences in instruction execution efficiency and latency of each platform are quantitatively compared to determine the performance. Through the power grid data consistency verification script, the numerical deviation of cross-platform calculation results is detected to ensure that the business logic of power grid business applications is not affected by the processor architecture. The combination of these three can achieve a comprehensive evaluation of the functional adaptation, performance and data consistency of power grid business applications on multiple processor architectures.

[0121] In step S3, the indicator acquisition module is used to collect multi-dimensional test indicators in real time during the compatibility test process. The multi-dimensional test indicators include at least one of the following: response time, CPU load, memory utilization, database transaction consistency, and output log integrity.

[0122] The indicator acquisition module integrates the Prometheus monitoring system and supports Grafana visualization.

[0123] The collected multidimensional test indicators are weighted and normalized using a rule engine and then transformed into test indicator feature vectors.

[0124] The feature vectors of the test indicators are input into a decision tree model for classification and prediction to generate a compatibility rating level.

[0125] The decision tree model is pre-trained based on historical data, which includes compatibility rating samples of power grid business applications and multiple processor architectures, as well as corresponding test index feature vector samples.

[0126] This solution also includes automatically generating graphic reports after the rating is obtained: by integrating tools such as Grafana or ECharts, the test metrics are automatically converted into time series curves, architecture comparison bar charts and other visual charts, and the differences between the processor architecture and the x86 benchmark are marked.

[0127] Grafana is an open-source visualization and monitoring platform that excels at displaying time-series data (such as system performance metrics, network latency, resource utilization, etc.) in chart form and supports multiple data sources. ECharts is a front-end charting library that can generate rich and interactive visualization charts.

[0128] After obtaining the compatibility rating, this solution also includes:

[0129] Incompatible power grid business applications are output to the problem pool for operation and maintenance or development personnel to track and fix the power grid business applications;

[0130] The power grid service application was retested using a test rerun mechanism to verify the improved compatibility of the power grid service application.

[0131] Optionally, the multi-platform testing environment cluster described in this solution also supports automatically triggered test tasks based on the CI / CD mechanism (Continuous Integration / Continuous Deployment) to accelerate and automate the software building, testing, and release process. The testing process interfaces with the power grid business application version release system to achieve an automated pipeline from development to release, thereby improving the efficiency and reliability of power grid business application iteration.

[0132] To address the lack of effective compatibility evaluation methods for existing power grid business systems on processor architectures, this invention provides the above-mentioned technical solution, which can achieve a comprehensive evaluation of the functional adaptation, performance, and data consistency of mainstream power industry business applications on various processor architectures, and automatically generate compatibility evaluation results.

[0133] Example 2

[0134] Based on the compatibility evaluation method for processor architecture in power grid business applications provided by this invention, this embodiment adopts a platform-oriented architecture, combining a CI / CD toolchain and a virtualized resource scheduling platform to build an automated test cluster. Using Siji PanShi as the main control server, in the scheduling system compatibility test, the same test cases are run in parallel on sub-nodes such as Phytium and Hygon through simulated power flow calculation tasks and graphical interface interaction. Evaluation reports are output by comparing task output consistency, response latency, and system log integrity. The system schedules tasks through the Jenkins (an automated task scheduling engine) continuous integration engine and collects performance metrics through Prometheus + Grafana (Prometheus is an open-source monitoring and alerting system, adept at collecting and storing time-series data; Grafana is an open-source visualization and analysis platform that can intuitively display the metric data collected by Prometheus in chart form), achieving test visualization and data-driven optimization suggestion push.

[0135] This embodiment uses the Siji Rock domestic server as the master control node to build an evaluation platform based on a hybrid physical machine and virtualization architecture. The platform adopts KVM virtualization technology (Kernel-based Virtual Machine, an open-source virtualization technology), configures a unified template environment for each type of domestic CPU (processor architecture), installs domestic operating systems such as Galaxy Kylin, deploys a unified Docker container management system, and pre-installs mainstream power grid business application images (such as the distribution network automation system v4.2, the power metering data analysis system, etc.).

[0136] In terms of test scheduling, the platform uses a Jenkins pipeline to configure parallel test processes and combines GitLab code repository management with test case scripts. Each test task includes four phases: application startup, simulated user operations, execution of business transactions, and generation of data reports. Test coverage is calculated using the Allure framework to ensure that no critical business paths are missed.

[0137] Performance metrics are collected using Prometheus + Node Exporter (an open-source Prometheus monitoring data collector) to obtain server resource usage. Database transactions are sampled using MySQL Performance Schema (a performance monitoring framework built into the MySQL database), supporting the recording of multiple metrics such as query latency, index utilization, and lock wait time.

[0138] In the testing of the scheduling system, the platform loads the actual power flow calculation module, configures a topology simulation task of 1000 nodes, and compares the results data running on the Siji Panshi and Phytium platforms using an automatic comparison script written in Python to determine whether the deviation meets the business threshold (error not greater than ±0.5%). At the same time, screenshots are taken to compare the correctness of the graphical interface rendering.

[0139] After the test is completed, the platform automatically generates an evaluation report, which includes:

[0140] - Functional item test pass rate and details of failed test cases;

[0141] - Performance comparison graphs (CPU utilization, response time, transaction throughput).

[0142] - Log anomaly clustering analysis and key stack trace identification;

[0143] - Targeted compatibility optimization suggestions, such as switching kernel parameters and replacing incompatible third-party libraries.

[0144] The system also has an issue management mechanism. Incompatible items will be automatically imported into an issue tracking platform (such as ZenTao), where the technical team can associate fixes and perform regression testing.

[0145] Overall, the testing platform of this invention has good scalability and can be extended to support more industry applications (such as water management and traffic dispatch).

[0146] Example 3

[0147] Based on the same inventive concept, this invention also provides a compatibility evaluation system for processor architecture in power grid business applications, such as... Figure 2 As shown, it includes:

[0148] The test suite selection module is used to determine the power grid business scenario-based test suite based on the type of power grid business application to be evaluated. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture.

[0149] The testing module is used to concurrently execute compatibility tests of the power grid business application on each processor architecture using an automated task scheduling engine based on the power grid business scenario-based test suite on a pre-built multi-platform testing environment cluster; the multi-platform testing environment cluster integrates multiple processor architectures.

[0150] The compatibility assessment module is used to generate a compatibility assessment level based on the multi-dimensional test indicators collected during the compatibility test using the rule engine.

[0151] In one possible implementation, the system further includes a multi-platform test environment cluster building module, used for:

[0152] The unified management cluster integrates multiple processor architectures, including: Siji Rockchip, Phytium, Hygon, and Zhaoxin.

[0153] A standardized operating environment for power grid business applications is deployed in the unified management cluster. This operating environment includes an operating system and database middleware, which are used to simulate the real operating environment of power grid business applications.

[0154] In one possible implementation, the aforementioned compatibility assessment module is specifically used for:

[0155] The collected multidimensional test indicators are weighted and normalized using a rule engine and then transformed into test indicator feature vectors.

[0156] The feature vectors of the test indicators are input into a decision tree model for classification and prediction to generate a compatibility rating level.

[0157] The decision tree model is pre-trained based on historical data, which includes compatibility rating samples of power grid business applications and multiple processor architectures, as well as corresponding test index feature vector samples.

[0158] In one possible implementation, the types of power grid business applications in the above-mentioned test suite selection module include dispatching systems, distribution systems, and marketing systems;

[0159] The same type of power grid business applications shall use the same power grid business scenario-based test suite;

[0160] Each of the aforementioned power grid business scenario-based test suites includes test parameters for multiple processor architectures, which are used to automatically load the test parameters corresponding to the current processor architecture during compatibility testing.

[0161] In one possible implementation, the above-mentioned test module is specifically used for:

[0162] Upload the power grid business scenario-based test suite to the automated task scheduling engine;

[0163] Based on the power grid business application, specific test parameters are configured for each processor architecture in the power grid business scenario-based test suite to generate a test task set for each processor architecture;

[0164] On a pre-built multi-platform test environment cluster, the automated task scheduling engine is used to distribute the test task set to each processor architecture in parallel.

[0165] Based on the test task set, compatibility tests for power grid business applications are performed on each of the processor architectures.

[0166] In one possible implementation, the above-mentioned test module is specifically used for:

[0167] Based on each of the aforementioned processor architectures:

[0168] Using the power industry protocol test scripts in the test task set, the processor architecture is subjected to manufacturing message specification read / write service tests and substation event subscription and publication tests to general objects to verify whether the processor architecture can correctly execute the basic operations defined by the protocol standard; the processor architecture is also subjected to simulated actual business tests to verify the protocol compatibility of the processor architecture in real business flows; and error message injection tests and communication interruption recovery tests are also used to evaluate the reliability of the processor architecture protocol stack.

[0169] Using the real-time control performance test scripts in the test task set, the processor architecture is tested for real-time control performance in power grid business applications.

[0170] Using the power grid data consistency verification script in the test task set, the processor architecture is used to perform power grid data consistency verification for power grid business applications.

[0171] In one possible implementation, the above-mentioned test module is specifically used for:

[0172] Using the real-time control performance test script in the test task set, control commands are issued to the processor architecture;

[0173] A high-precision timer records the instruction response time from the issuance of the control instruction to the completion of the processor architecture's execution, which is used to quantify the real-time response capability of the processor architecture.

[0174] The latency fluctuations during the testing process are statistically analyzed to evaluate the reliability of the processor architecture's response time.

[0175] The measured latency and jitter metrics are compared with the real-time performance standards of the power grid to evaluate the real-time performance of the processor architecture in task scheduling.

[0176] In one possible implementation, the above-mentioned test module is specifically used for:

[0177] By running the same computing task synchronously with each of the aforementioned processor architectures on a reference international architecture platform, the numerical deviations of the output results are compared to quantify data consistency.

[0178] Verify the intermediate states and final outputs of key business processes in each processor architecture to evaluate the cross-platform consistency of transaction logic.

[0179] In one possible implementation, the multi-dimensional test metrics in the above test module include at least one of the following: response time, CPU load, memory utilization, database transaction consistency, and output log integrity.

[0180] Example 4

[0181] like Figure 3 As shown, the present invention also provides an electronic device, which may be a computer device, a microcontroller device, a smart mobile device, etc. The electronic device in this embodiment may include a processor, a memory, a transceiver component, etc. The memory, processor, and transceiver component are connected via a bus; the memory can be used to store executable programs, and an exemplary executable program may include instructions; the processor is used to execute the instructions stored in the memory. The memory can also be used to store data, which can be accessed and / or modified when instructions are executed.

[0182] The processor may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. It is the computing and control core of the terminal, and it is suitable for implementing one or more instructions. Specifically, it is suitable for loading and executing one or more instructions in the storage medium to implement the corresponding method flow or corresponding function, so as to realize the steps of the above embodiment of the compatibility evaluation method of power grid business application to processor architecture.

[0183] Example 5

[0184] Based on the same inventive concept, this invention also provides a readable storage medium, specifically an electronic device readable storage medium (Memory). This readable storage medium is a memory device within an electronic device used to store programs and data. It is understood that the storage medium here can include both built-in storage media within the electronic device and extended storage media supported by the electronic device. The storage medium provides storage space, which stores the terminal's operating system. Furthermore, this storage space also stores one or more instructions suitable for loading and execution by a processor. These instructions can be one or more executable programs (including program code). It should be noted that the storage medium here can be high-speed RAM or non-volatile memory, such as at least one disk storage device. Loading and executing one or more instructions stored in the storage medium by the processor enables the implementation of the steps in the above embodiment of a method for evaluating the compatibility of a power grid business application with the processor architecture.

[0185] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0186] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0187] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1The function specified in one or more boxes.

[0188] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0189] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit its scope of protection. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that after reading the present invention, they can still make various changes, modifications or equivalent substitutions to the specific implementation methods of the application, but these changes, modifications or equivalent substitutions are all within the scope of protection of the claims pending approval.

Claims

1. A method for evaluating the compatibility of power grid business applications with processor architecture, characterized in that, include: Based on the type of power grid business application to be evaluated, a power grid business scenario-based test suite is determined. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture. On a pre-built multi-platform test environment cluster, an automated task scheduling engine is used to concurrently execute compatibility tests of the power grid business application on each processor architecture based on the power grid business scenario-based test suite. This includes: uploading the power grid business scenario-based test suite to the automated task scheduling engine, with different processor architectures corresponding to different test parameters of the same power grid business scenario-based test suite; configuring specific test parameters for each processor architecture in the power grid business scenario-based test suite according to the power grid business application, generating test task sets for each processor architecture; on the pre-built multi-platform test environment cluster, using the automated task scheduling engine to distribute the test task sets to each processor architecture in parallel; and performing compatibility tests of the power grid business application on each processor architecture based on the test task sets. The multi-platform test environment cluster integrates multiple processor architectures. The compatibility rating level is generated using a rule engine based on the multi-dimensional test indicators collected during the compatibility test. The multi-platform test environment cluster is pre-built as follows: multiple processor architectures are integrated in the unified management cluster, including: Sigi Rockchip, Phytium, Hygon, and Zhaoxin; and a standardized power grid business application runtime environment is deployed in the unified management cluster, including an operating system and database middleware, to simulate the real power grid business application runtime environment.

2. The method as described in claim 1, characterized in that, The process of generating a compatibility rating level using a rule engine based on multi-dimensional test metrics collected during the compatibility test includes: The collected multidimensional test indicators are weighted and normalized using a rule engine and then transformed into test indicator feature vectors. The feature vectors of the test indicators are input into a decision tree model for classification and prediction to generate a compatibility rating level. The decision tree model is pre-trained based on historical data, which includes compatibility rating samples of power grid business applications and multiple processor architectures, as well as corresponding test index feature vector samples.

3. The method as described in claim 1 or 2, characterized in that, The types of power grid business applications include dispatching systems, distribution systems, and marketing systems; The same type of power grid business applications shall use the same power grid business scenario-based test suite; Each of the aforementioned power grid business scenario-based test suites includes multiple test task sets for processor architectures, which are used to automatically load the test task set corresponding to the current processor architecture during compatibility testing.

4. The method as described in claim 1, characterized in that, The compatibility testing of power grid business applications for each processor architecture based on the test task set includes: Based on each of the aforementioned processor architectures: Using the power industry protocol test scripts in the test task set, the processor architecture is subjected to manufacturing message specification read / write service tests and substation event subscription and publication tests to general objects to verify whether the processor architecture can correctly execute the basic operations defined by the protocol standard; the processor architecture is also subjected to simulated actual business tests to verify the protocol compatibility of the processor architecture in real business flows; and error message injection tests and communication interruption recovery tests are also used to evaluate the reliability of the processor architecture protocol stack. Using the real-time control performance test scripts in the test task set, the processor architecture is tested for real-time control performance in power grid business applications. Using the power grid data consistency verification script in the test task set, the processor architecture is used to perform power grid data consistency verification for power grid business applications.

5. The method as described in claim 4, characterized in that, The step of using the real-time control performance test scripts in the test task set to perform real-time control performance testing on the processor architecture for power grid business applications includes: Using the real-time control performance test script in the test task set, control commands are issued to the processor architecture; A high-precision timer records the instruction response time from the issuance of the control instruction to the completion of the processor architecture's execution, which is used to quantify the real-time response capability of the processor architecture. The latency fluctuations during the test are statistically analyzed to evaluate the reliability of the processor architecture's response time. The measured latency and jitter metrics are compared with the real-time performance standards of the power grid to evaluate the real-time performance of the processor architecture in task scheduling.

6. The method as described in claim 4, characterized in that, The step of using the power grid data consistency verification script in the test task set to perform power grid data consistency verification on the processor architecture for power grid business applications includes: By running the same computing task synchronously with each of the aforementioned processor architectures on a reference international architecture platform, the numerical deviations of the output results are compared to quantify data consistency. Verify the intermediate states and final outputs of key business processes in each processor architecture to evaluate the cross-platform consistency of transaction logic.

7. The method as described in claim 1, characterized in that, The multidimensional test metrics include at least one of the following: response time, CPU load, memory utilization, database transaction consistency, and output log integrity.

8. A compatibility evaluation system for processor architecture in power grid business applications, characterized in that, include: The test suite selection module is used to determine the power grid business scenario-based test suite based on the type of power grid business application to be evaluated. The power grid business scenario-based test suite includes a power industry protocol test script for verifying the power protocol of the processor architecture, a real-time control performance test script for evaluating the control performance of the processor architecture, and a power grid data consistency verification script for verifying the timing synchronization of the processor architecture. The testing module is used to concurrently execute compatibility tests of the power grid business application on each processor architecture using an automated task scheduling engine based on the power grid business scenario-based test suite on a pre-built multi-platform testing environment cluster. This includes: uploading the power grid business scenario-based test suite to the automated task scheduling engine, with different processor architectures corresponding to different test parameters of the same power grid business scenario-based test suite; configuring specific test parameters for each processor architecture in the power grid business scenario-based test suite according to the power grid business application, generating test task sets for each processor architecture; distributing the test task sets to each processor architecture in parallel using the automated task scheduling engine on the pre-built multi-platform testing environment cluster; and performing compatibility tests of the power grid business application on each processor architecture based on the test task sets. The multi-platform testing environment cluster integrates multiple processor architectures. The compatibility assessment module is used to generate a compatibility assessment level based on the multi-dimensional test indicators collected during the compatibility test using the rule engine; The multi-platform test environment cluster is pre-built as follows: multiple processor architectures are integrated in the unified management cluster, including: Sigi Rockchip, Phytium, Hygon, and Zhaoxin; and a standardized power grid business application runtime environment is deployed in the unified management cluster, including an operating system and database middleware, to simulate the real power grid business application runtime environment.

Images