Information network performance evaluation method and platform

Abstract

An information network performance evaluation platform belongs to the technical field of network simulation, and is characterized in that an evaluation system sub-platform is responsible for operation promotion of the whole platform and data interaction among subsystems and modules, and transmits a basic network performance index original value output by an evaluation index statistics subsystem to a network performance evaluation subsystem; an evaluation index system scheme, a basic network performance index normalized value, an index weight value and a network comprehensive performance evaluation result output by the network performance evaluation subsystem are transmitted to an evaluation task management subsystem, and evaluation task data stored by the evaluation task management subsystem are transmitted to an evaluation task comparison subsystem; and outputting a basic network performance index statistical result output by the evaluation index statistical subsystem, a network comprehensive performance evaluation result output by the network performance evaluation subsystem and different evaluation task comparison results output by the evaluation task comparison subsystem to an evaluation result display subsystem.

Description

Technical Field

[0001] The invention relates to an information network performance evaluation method and platform, belonging to the technical field of network simulation. Background Art

[0002] Network performance evaluation is an effective means of evaluating network protocols, technical solutions, etc. By evaluating and analyzing the indicator results obtained based on actual measurements or simulations, the performance evaluation results of a certain network system or a certain technical method can be obtained. Further comparative analysis can assist designers to better optimize network models or technical solutions in order to achieve better results.

[0003] At present, there are two main methods for network performance evaluation, one is network performance evaluation based on discrete indicators, and the other is network performance evaluation based on multi-indicator weighting. The method based on discrete indicators mainly evaluates the network communication capability based on indicators such as end-to-end delay, packet loss rate, network throughput, and network overhead. The evaluation of network performance using this method is relatively one-sided, and only reflects the strength of the network in certain aspects, and cannot reflect the comprehensive capability of the network under the joint action of multiple protocols. The method based on multi-indicator weighting selects multiple important indicators that affect network performance, assigns weights to each indicator according to the degree of influence on the overall performance of the network, and obtains the comprehensive evaluation result of network performance by weighted average. This method avoids the one-sidedness of using a single discrete indicator to evaluate network performance. However, once it is designed into software, it cannot be directly reused when the network scenario changes, because the type and number of network indicators selected may not reflect the typical characteristics of the changed network, and the obtained network performance evaluation results are also inaccurate. It is necessary to adjust the selected indicators and their weights according to the characteristics of the new network to obtain more accurate evaluation results.

[0004] The comprehensive performance of a network is closely related to the network protocol and the network scenario. When the network protocol is the same but the network scenario changes, the comprehensive performance of the network will change; when the network scenario is the same but the network protocol changes, the comprehensive performance of the network may also change. The current network performance evaluation method has not yet directly given the cause of the above changes. At present, the information network performance evaluation method mainly focuses on the evaluation of network performance. The performance comparison of different network solutions is only a simple comparison of performance advantages and disadvantages. There is a lack of in-depth comparative analysis of different solutions, and the key indicators that affect the network solution have not been obtained, and an effective basis for optimizing the network solution has not been generated.

[0005] In addition, due to the various forms of information network demonstration and verification, network protocols can run on network simulation platforms or physical terminals, and network performance indicators can be statistically analyzed in real time or in log records. In view of these differences, designers often design network performance evaluation platforms and methods based on their characteristics. Such design results are closely related to the network protocol operation platform communication interface, indicator statistics interface protocol, etc., resulting in the incompatibility and reuse of the network performance evaluation platform. Summary of the invention

[0006] The technical problem to be solved by the present invention is: to overcome the shortcomings of the prior art, solve the problems of a single evaluation index system of an information network performance evaluation platform, simple network performance comparison results, poor compatibility and low flexibility of the evaluation method in adapting to different network demonstration and verification strategies, and the problem that a customized information network performance evaluation method can only be used for specific network solutions or network scenarios and cannot be customized and dynamically adjusted to adapt to the characteristics of different network solutions and network scenarios.

[0007] The purpose of the present invention is achieved through the following technical solutions:

[0008] An information network performance evaluation platform, comprising an evaluation system sub-platform, an evaluation task management sub-system, an evaluation index statistics sub-system, a network performance evaluation sub-system, an evaluation task comparison sub-system, and an evaluation result display sub-system;

[0009] The evaluation system subplatform is responsible for the operation and promotion of the entire platform and the data interaction between each subsystem and module. It passes the original values ​​of the basic network performance indicators output by the evaluation indicator statistics subsystem to the network performance evaluation subsystem, and passes the evaluation indicator system scheme, the normalized values ​​of the basic network performance indicators, the indicator weight values, and the network comprehensive performance evaluation results output by the network performance evaluation subsystem to the evaluation task management subsystem. It passes the evaluation task data stored in the evaluation task management subsystem to the evaluation task comparison subsystem, and outputs the basic network performance indicator statistics output by the evaluation indicator statistics subsystem, the network comprehensive performance evaluation results output by the network performance evaluation subsystem, and the comparison results of different evaluation tasks output by the evaluation task comparison subsystem to the evaluation result display subsystem. The evaluation result display subsystem is used to display the statistical results and generate an evaluation result report.

[0010] An evaluation method based on the information network performance evaluation platform comprises the following steps:

[0011] (1) Enter the evaluation task management subsystem and check whether the required test plan exists in the test plan library. If not, edit and store the network scenario information, including network scale, network protocol, and test cases. Otherwise, directly execute step (2);

[0012] (2) Create a new assessment task in the assessment task management module, associate it with the test plan, and register and store the assessment task in the assessment task library;

[0013] (3) Enter the evaluation indicator statistics subsystem and check in the indicator set management module whether the basic network performance indicators required for the evaluation task are included. If not, edit and add relevant indicators and update the entries in the indicator database. Otherwise, directly execute step (4);

[0014] (4) Enter the network performance evaluation subsystem, and in the evaluation system dynamic construction module, select the required indicators from the evaluation indicator set of the evaluation indicator statistics subsystem to customize the evaluation indicator system according to the test plan characteristics of the evaluation task, and associate the evaluation indicator system plan with the corresponding evaluation task in the evaluation task library;

[0015] (5) Enter the evaluation index statistics subsystem and set the index statistics mode in the index statistics module. If it is in offline mode, load the basic network performance index data obtained offline into the index statistics module; otherwise, directly execute step (6);

[0016] (6) Run the indicator statistics module to count the process indicators and result indicators respectively, obtain the original values ​​of the basic network performance indicators, store them in the indicator database, and pass them to the evaluation result display subsystem for real-time display;

[0017] (7) Enter the network performance evaluation subsystem, configure the normalization factor and normalization function in the indicator attribute calculation module, run it to obtain the normalized value of the basic network performance indicator, and associate it with the corresponding evaluation task in the evaluation task library;

[0018] (8) configuring the expert scoring method or the hierarchical analysis method in the indicator weight calculation module, and running it in each layer of the evaluation indicator system respectively, obtaining the indicator weight value of each layer in turn, and associating it with the corresponding evaluation task in the evaluation task library;

[0019] (9) Run the network performance calculation module to obtain the network comprehensive performance evaluation results, associate them with the corresponding evaluation tasks in the evaluation task library, and pass them to the evaluation result display subsystem for display;

[0020] (10) If there are multiple evaluation tasks, perform network performance evaluation on other tasks in sequence according to the above steps (1) to (9); otherwise, directly execute step (12);

[0021] (11) If it is necessary to conduct a comparative analysis on the results of multiple evaluation tasks, enter the evaluation task comparison subsystem, configure the comparison method in the comparison task editing module, select the evaluation task item to be compared and analyzed from the evaluation task library, run the comparison analysis module, obtain the evaluation task comparison analysis results, and pass them to the evaluation result display subsystem for display; otherwise, directly execute step (12).

[0022] (12) After the evaluation is completed, enter the evaluation result display subsystem to generate and export the evaluation data, and exit the information network performance evaluation platform.

[0023] Compared with the prior art, the present invention has the following beneficial effects:

[0024] (1) The present invention builds an information network performance evaluation platform, which effectively solves the shortcomings of the information network performance evaluation platform, such as a single evaluation index system, simple network performance comparison results, poor compatibility and low flexibility in adapting the evaluation method to different network demonstration and verification strategies. The network simulation platform has the ability to customize the network performance evaluation index system according to the characteristics of the network scenario, analyze the key indicators that affect the network performance, and perform network performance evaluation by decoupling from the network protocol operation platform or the indicator statistics interface protocol.

[0025] (2) The present invention proposes a method for dynamically constructing an information network performance evaluation index system, which effectively solves the shortcomings of the network performance evaluation index system constructed for fixed tasks, such as inaccurate evaluation results, poor reusability, and low expansion flexibility when applied to new tasks. An evaluation index set is constructed to store multiple orthogonal or weakly correlated indicators that affect network performance, which can be dynamically increased or decreased. After determining the task to be evaluated, the required indicators are selected from the evaluation index set according to the characteristics of the task to customize the evaluation index system. This can support performance evaluation of a variety of information networks and improve the flexibility and accuracy of the evaluation method.

[0026] (3) The information network comprehensive performance comparison and analysis module proposed in the present invention realizes in-depth analysis of key indicators that affect network performance or indicators that have a smaller impact on network performance based on the comparison of network comprehensive performance results based on the control variable method, thereby solving the problems of unclear network optimization goals and incomplete network performance comparison and analysis.

[0027] (4) The information network performance evaluation architecture supporting online / offline dual-mode operation proposed in the present invention can not only support the connection between the network performance evaluation platform and the network simulation platform or the physical terminal for real-time network performance evaluation, but also support offline network performance evaluation based on the index test results, thereby improving the application compatibility of the information network performance evaluation platform and being able to flexibly adapt to the network performance evaluation needs under various network demonstration and verification forms. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1The information network performance evaluation platform composition and software implementation architecture diagram of the present invention;

[0029] Figure 2 A diagram showing the data interaction relationship between the systems of the present invention;

[0030] Figure 3 It is a composition diagram of the assessment task management subsystem of the present invention;

[0031] Figure 4 It is a composition diagram of the evaluation index statistical subsystem of the present invention;

[0032] Figure 5 It is a structural diagram of the evaluation index set of the present invention;

[0033] Figure 6 It is a composition diagram of the network performance evaluation subsystem of the present invention;

[0034] Figure 7 It is a structural diagram of the network performance calculation method of the present invention;

[0035] Figure 8 It is a composition diagram of the evaluation task comparison subsystem of the present invention;

[0036] Fig. 9 This is a flowchart of the information network performance evaluation method and platform of the present invention. DETAILED DESCRIPTION

[0037] To make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0038] An information network performance evaluation platform includes an evaluation system sub-platform, an evaluation task management sub-system, an evaluation index statistics sub-system, a network performance evaluation sub-system, an evaluation task comparison sub-system, and an evaluation result display sub-system. Figure 1 shown.

[0039] The evaluation system sub-platform is responsible for the operation and promotion of the entire platform and the data interaction between the sub-systems and modules. The interaction relationship between the various parts is as follows: Figure 2As shown. The evaluation system sub-platform passes the original values ​​of the basic network performance indicators output by the evaluation indicator statistics sub-system to the network performance evaluation sub-system, passes the evaluation indicator system scheme, the normalized values ​​of the basic network performance indicators, the indicator weight values, and the network comprehensive performance evaluation results output by the network performance evaluation sub-system to the evaluation task management sub-system, passes the evaluation task data (including the test scheme information related to the evaluation task, the evaluation indicator system scheme information, the normalized values ​​of the basic network performance indicators, the indicator weight values, and the network comprehensive performance evaluation results) stored in the evaluation task management sub-system to the evaluation task comparison sub-system, and outputs the basic network performance indicator statistics output by the evaluation indicator statistics sub-system, the network comprehensive performance evaluation results output by the network performance evaluation sub-system, and the comparison results of different evaluation tasks output by the evaluation task comparison sub-system to the evaluation result display sub-system.

[0040] like Figure 3 As shown, the evaluation task management subsystem consists of a test plan library, an evaluation task library, and an evaluation task management module. The test plan library is used to edit and store information network test instances, each of which contains information such as scenario scale, network protocol, and test cases. The evaluation task library stores the evaluation task data created by the user, and each evaluation task contains test plan information, evaluation index system plan information, normalized values ​​of basic network performance indicators, indicator weight values, and network comprehensive performance evaluation results. The evaluation task management module can create, edit, modify, or delete evaluation tasks. When creating an evaluation task, first associate the corresponding test plan and register and store it in the evaluation task library. Then, in the subsequent network performance index system construction and evaluation task comparison process, the corresponding information will be edited or automatically associated and stored in the corresponding evaluation task in the evaluation task library.

[0041] like Figure 4 As shown in Figure 1, the evaluation index statistics subsystem consists of an index set management module, an index database, and an index statistics module. The index set management module constructs a tree-like evaluation index set and manages the network performance indicators that can be used to construct the evaluation index system according to the hierarchical classification method, such as Figure 5As shown in the figure, the bottom layer of the evaluation index set is the basic network performance index, which is summarized layer by layer to form the comprehensive network performance index; users can add, modify or delete various indicators at all levels in the index set according to their needs. The index statistics module counts the basic network performance indicators at the bottom layer of the index set, including process indicators (periodic statistics) and result indicators (trigger statistics). The statistical results will be stored in the index database and passed to the evaluation result display subsystem by the evaluation system subplatform for real-time display. In order to enhance application compatibility, the index statistics module builds an online / offline dual-mode architecture. In the online mode, the platform obtains the real-time operation data of the network simulation platform or physical terminal through the Ethernet interface and passes it to the evaluation index statistics subsystem; in the offline mode, the log data obtained through external simulation or physical testing can be injected into the index statistics module.

[0042] like Figure 6 As shown, the network performance evaluation subsystem consists of an evaluation system dynamic construction module, an indicator attribute calculation module, an indicator weight calculation module, and a network performance calculation module. According to the characteristics of the test plan of the evaluation task, the evaluation system dynamic construction module selects a certain classification and number of indicators from the evaluation indicator set managed and maintained by the evaluation indicator statistics subsystem to customize a multi-level and multi-layer evaluation indicator system. After completing the construction of the evaluation indicator system, the indicator attribute calculation module obtains the original value of the basic network performance indicator at the bottom layer of the indicator system from the indicator database of the evaluation indicator statistics subsystem, and normalizes it according to the configured normalization factor and normalization function. The indicator weight calculation module calculates the weight values ​​of the indicators at each layer of the indicator system based on the hierarchical analysis method or the expert scoring method. As shown Figure 7 As shown, the network performance calculation module calculates the upper-layer indicator value based on the weighted method according to the normalized value of the basic network performance indicator obtained above and the corresponding indicator weight value. Each layer uses the same method to calculate its own upper-layer indicator value, and so on, and the comprehensive network performance evaluation result is obtained by aggregating upward step by step.

[0043] like Figure 8 As shown, the evaluation task comparison subsystem consists of a comparison task editing module and a comparison analysis module. The comparison task editing module selects multiple evaluation tasks from the evaluation task library of the evaluation task management subsystem to form a comparison task. After selecting the evaluation task to be compared and analyzed, the comparison rules of the control variable method are set in the comparison analysis module, and the comparison analysis is performed to obtain the key indicators that cause the performance differences of different tasks, or the indicators that have little impact on network performance.

[0044] The evaluation result display subsystem displays the output results of the aforementioned subsystems in real time and intuitively through bar charts, line charts, pie charts, tables, etc., and generates a PDF report after classification and aggregation, including the original values ​​of basic network performance indicators, network comprehensive performance evaluation results, evaluation task comparison and analysis results, etc.

[0045] like Figure 1 As shown, the information network performance evaluation platform runs on a computer and is implemented by front-end interface software, interface gateway software, background microservice software and resource management software. The front-end interface software provides a human-computer interaction interface for each subsystem and module, which is convenient for configuring information and intuitively displaying data; the interface gateway software is responsible for completing the data interaction between each subsystem; the background microservice software is composed of software functional components of the evaluation task management subsystem, the evaluation index statistics subsystem, the network performance evaluation subsystem, the evaluation task comparison subsystem and the evaluation result display subsystem, realizing the functions related to the whole process of performance evaluation; the resource management software is responsible for the data management of each subsystem, including the test plan library and evaluation task library of the evaluation task management subsystem, the evaluation index set and index database of the evaluation index statistics subsystem, etc.; each microservice component and resource management software provides data drive for the display of the front-end interface and the human-computer interaction operation.

[0046] An information network performance evaluation method comprises the following steps:

[0047] (1) Open the information network performance evaluation platform, enter the evaluation task management subsystem, and check whether the required test plan exists in the test plan library. If not, edit and store the network scenario information, including network scale, network protocol, and test cases. Otherwise, directly execute step (2);

[0048] (2) Create a new assessment task in the assessment task management module, associate it with the test plan, and register and store the assessment task in the assessment task library;

[0049] (3) Enter the evaluation indicator statistics subsystem and check in the indicator set management module whether the basic network performance indicators required for the evaluation task are included. If not, edit and add relevant indicators and update the entries in the indicator database. Otherwise, directly execute step (4);

[0050] (4) Enter the network performance evaluation subsystem, and in the evaluation system dynamic construction module, select the required indicators from the evaluation indicator set of the evaluation indicator statistics subsystem to customize the evaluation indicator system according to the test plan characteristics of the evaluation task, and associate the evaluation indicator system plan with the corresponding evaluation task in the evaluation task library;

[0051] (5) Enter the evaluation index statistics subsystem and set the index statistics mode in the index statistics module. If it is in offline mode, load the basic network performance index data obtained offline into the index statistics module; otherwise, directly execute step (6);

[0052] (6) Run the indicator statistics module to count the process indicators and result indicators respectively, obtain the original values ​​of the basic network performance indicators, store them in the indicator database, and pass them to the evaluation result display subsystem for real-time display;

[0053] (7) Enter the network performance evaluation subsystem, configure the normalization factor and normalization function in the indicator attribute calculation module, run it to obtain the normalized value of the basic network performance indicator, and associate it with the corresponding evaluation task in the evaluation task library;

[0054] (8) configuring the expert scoring method or the hierarchical analysis method in the indicator weight calculation module, and running it in each layer of the evaluation indicator system respectively, obtaining the indicator weight value of each layer in turn, and associating it with the corresponding evaluation task in the evaluation task library;

[0055] (9) Run the network performance calculation module to obtain the network comprehensive performance evaluation results, associate them with the corresponding evaluation tasks in the evaluation task library, and pass them to the evaluation result display subsystem for display;

[0056] (10) If there are multiple evaluation tasks, perform network performance evaluation on other tasks in sequence according to the above steps (1) to (9); otherwise, directly execute step (12);

[0057] (11) If it is necessary to conduct a comparative analysis on the results of multiple evaluation tasks, enter the evaluation task comparison subsystem, configure the comparison method in the comparison task editing module, select the evaluation task item to be compared and analyzed from the evaluation task library, run the comparison analysis module, obtain the evaluation task comparison analysis results, and pass them to the evaluation result display subsystem for display; otherwise, directly execute step (12).

[0058] (12) After the evaluation is completed, enter the evaluation result display subsystem to generate and export the evaluation data, and exit the information network performance evaluation platform.

[0059] like Fig. 9 Shown is the information network performance evaluation method and platform workflow.

[0060] The contents not described in detail in the specification of the present invention belong to the common knowledge of those skilled in the art.

[0061] Although the present invention has been disclosed as above in the form of a preferred embodiment, it is not intended to limit the present invention. Any person skilled in the art may make possible changes and modifications to the technical solution of the present invention by using the methods and technical contents disclosed above without departing from the spirit and scope of the present invention. Therefore, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention shall fall within the protection scope of the technical solution of the present invention.

Claims

1. An information network performance evaluation platform, characterized in that: It includes evaluation system sub-platform, evaluation task management sub-system, evaluation index statistics sub-system, network performance evaluation sub-system, evaluation task comparison sub-system and evaluation result display sub-system; The evaluation system subplatform is responsible for the operation and promotion of the entire platform and the data interaction between each subsystem and module. It passes the original values ​​of the basic network performance indicators output by the evaluation indicator statistics subsystem to the network performance evaluation subsystem, and passes the evaluation indicator system scheme, the normalized values ​​of the basic network performance indicators, the indicator weight values, and the network comprehensive performance evaluation results output by the network performance evaluation subsystem to the evaluation task management subsystem. It passes the evaluation task data stored in the evaluation task management subsystem to the evaluation task comparison subsystem, and outputs the basic network performance indicator statistics output by the evaluation indicator statistics subsystem, the network comprehensive performance evaluation results output by the network performance evaluation subsystem, and the comparison results of different evaluation tasks output by the evaluation task comparison subsystem to the evaluation result display subsystem. The evaluation result display subsystem is used to display the statistical results and generate an evaluation result report.

2. The information network performance evaluation platform according to claim 1, characterized in that: The assessment task data stored in the assessment task management subsystem includes test plan information related to the assessment task, evaluation index system plan information, normalized values ​​of basic network performance indicators, indicator weight values, and network comprehensive performance evaluation results.

3. The information network performance evaluation platform according to claim 1, characterized in that: The assessment task management subsystem is used to create, edit, modify or delete assessment tasks. Each assessment task contains test plan information, evaluation indicator system plan information, normalized values ​​of basic network performance indicators, indicator weight values, and network comprehensive performance evaluation results. The test plan information covers the network scenario scale, network protocol, and test case of the network performance test instance.

4. The information network performance evaluation platform according to claim 1, characterized in that: The evaluation indicator statistics subsystem is used to build and manage the evaluation indicator set, covering all basic network performance indicators at the bottom of the evaluation indicator system, performing statistical calculations on the original values ​​of the basic network performance indicators, and storing them in the indicator data set.

5. The information network performance evaluation platform according to claim 1, characterized in that: The evaluation index statistics subsystem includes an index set management module, an index database, and an index statistics module; the index set management module constructs a tree-like evaluation index set, and manages the network performance indicators used to construct the evaluation index system according to the hierarchical classification method. The bottom layer of the evaluation index set is the basic network performance indicator, and the network comprehensive performance indicators are summarized layer by layer upwards; Users can add, modify or delete various indicators at all levels in the indicator set as needed; the indicator statistics module collects statistics on the basic network performance indicators at the bottom level of the indicator set, including process indicators and result indicators. The statistical results will be stored in the indicator database and transmitted to the evaluation result display subsystem by the evaluation system subplatform for real-time display.

6. The information network performance evaluation platform according to claim 1, characterized in that: The network performance evaluation subsystem is used to dynamically build a multi-layer and multi-level evaluation index system, normalize the original values ​​of the bottom-level indicators, calculate the weight values ​​of each layer of indicators according to the hierarchical analysis method or expert scoring method, and complete the evaluation result calculation based on the weighted method.

7. The information network performance evaluation platform according to claim 1, characterized in that: The network performance evaluation subsystem is mainly composed of an evaluation system dynamic construction module, an indicator attribute calculation module, an indicator weight calculation module, and a network performance calculation module. According to the test scheme characteristics of the evaluation task, the evaluation system dynamic construction module selects a certain number of indicators of a certain category from the evaluation indicator set managed and maintained by the evaluation indicator statistics subsystem to customize a multi-level and multi-layer evaluation indicator system. After completing the construction of the evaluation indicator system, the indicator attribute calculation module obtains the original value of the basic network performance indicator at the bottom of the indicator system from the indicator database of the evaluation indicator statistics subsystem, and performs normalization processing according to the configured normalization factor and normalization function. The indicator weight calculation module calculates the weight values ​​of indicators at each level of the indicator system based on the hierarchical analysis method or expert scoring method.

8. The information network performance evaluation platform according to claim 1, characterized in that: The evaluation task comparison subsystem is used to select the evaluation tasks to be compared and analyzed from the evaluation task library, set the control variable method comparison rules, perform the comparison analysis, and obtain the comparison analysis results.

9. The information network performance evaluation platform according to claim 1, characterized in that: The evaluation task comparison subsystem is mainly composed of a comparison task editing module and a comparison analysis module; the comparison task editing module selects multiple evaluation tasks from the evaluation task library of the evaluation task management subsystem to form a comparison task. After selecting the evaluation tasks to be compared and analyzed, the control variable method comparison rules are set in the comparison analysis module, and the comparison analysis is performed to obtain the key indicators that cause performance differences between different tasks, or indicators that have less impact on network performance.

10. An evaluation method based on the information network performance evaluation platform according to claim 1, characterized in that: The following steps are involved: (1) Enter the evaluation task management subsystem and check whether the required test plan exists in the test plan library. If not, edit and store the network scenario information, including network scale, network protocol, and test cases. Otherwise, directly execute step (2); (2) Create a new assessment task in the assessment task management module, associate it with the test plan, and register and store the assessment task in the assessment task library; (3) Enter the evaluation indicator statistics subsystem and check in the indicator set management module whether the basic network performance indicators required for the evaluation task are included. If not, edit and add relevant indicators and update the entries in the indicator database. Otherwise, directly execute step (4); (4) Enter the network performance evaluation subsystem, and in the evaluation system dynamic construction module, select the required indicators from the evaluation indicator set of the evaluation indicator statistics subsystem to customize the evaluation indicator system according to the test plan characteristics of the evaluation task, and associate the evaluation indicator system plan with the corresponding evaluation task in the evaluation task library; (5) Enter the evaluation index statistics subsystem and set the index statistics mode in the index statistics module. If it is in offline mode, load the basic network performance index data obtained offline into the index statistics module; otherwise, directly execute step (6); (6) Run the indicator statistics module to count the process indicators and result indicators respectively, obtain the original values ​​of the basic network performance indicators, store them in the indicator database, and pass them to the evaluation result display subsystem for real-time display; (7) Enter the network performance evaluation subsystem, configure the normalization factor and normalization function in the indicator attribute calculation module, run it to obtain the normalized value of the basic network performance indicator, and associate it with the corresponding evaluation task in the evaluation task library; (8) configuring the expert scoring method or the hierarchical analysis method in the indicator weight calculation module, and running it in each layer of the evaluation indicator system respectively, obtaining the indicator weight value of each layer in turn, and associating and storing it in the corresponding evaluation task of the evaluation task library; (9) Run the network performance calculation module to obtain the network comprehensive performance evaluation results, associate them with the corresponding evaluation tasks in the evaluation task library, and pass them to the evaluation result display subsystem for display; (10) If there are multiple evaluation tasks, perform network performance evaluation on other tasks in sequence according to the above steps (1) to (9); otherwise, directly execute step (12); (11) If it is necessary to conduct comparative analysis on the results of multiple evaluation tasks, enter the evaluation task comparison subsystem, configure the comparison method in the comparison task editing module, select the evaluation task item to be compared and analyzed from the evaluation task library, run the comparison analysis module, obtain the evaluation task comparison analysis results, and pass them to the evaluation result display subsystem for display; Otherwise, go directly to step (12). (12) After the evaluation is completed, enter the evaluation result display subsystem to generate and export the evaluation data, and exit the information network performance evaluation platform.

Images