A space-based networking effectiveness evaluation system and method based on analytic hierarchy process
Through the space-based network performance evaluation system based on hierarchical analysis method, the problem of index integration and analysis framework in the space-based network system is solved, the system is accurately evaluated and optimized guidance is achieved, and the system's reliability and security is improved.
Patent Information
- Application Number
- CN202210473721.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-29
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2042-04-29
AI Technical Summary
It is difficult for the existing technology to effectively integrate the main indicators with low correlation in the space-based networking system, provide a reasonable analysis framework and accurate performance evaluation results, resulting in delays in construction and optimization or serious consequences.
The space-based network performance evaluation system based on hierarchical analysis method is adopted. Through the evaluation algorithm subsystem and data processing subsystem, the weights of each indicator are calculated, and the hierarchical structure model is constructed for consistency testing to ensure the accuracy and applicability of the evaluation results. .
It has achieved efficient quantitative integration of space-based network system indicators, provided a clear analysis framework and accurate performance evaluation results, guided system construction and optimization, and improved system reliability and security.
Smart Images

Figure CN114884828B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a space-based networking effectiveness evaluation system and method based on hierarchical analysis method, belonging to the technical field of system effectiveness evaluation test. Background Art
[0002] In recent years, with the rapid development of the satellite field, it has been widely used in earth observation, meteorology, communication and other aspects. With the continuous integration and interweaving of network carriers such as mobile communication, satellite communication, fixed communication, and computer communication, space-based network technology is changing with each passing day, and the scope of business and demand it can carry are also increasing. Space-based network is a space network system composed of multi-orbit and multi-type satellites jointly networked and interconnected through interstellar and satellite-to-ground links. According to different types of business, the space-based network can also integrate high-altitude platforms and aircraft, ground fixed base stations, mobile terminals, etc. into the network system as needed. At the same time, the complexity of the space-based network structure and the characteristics of heterogeneous integration have brought great challenges to the reliability and security of the space-based network. Therefore, the most reliable method to provide a reliable basis for the construction and optimization of the space-based networking system to ensure the normal operation of the space-based networking system and the efficient and safe business is to evaluate the system performance of the space-based networking system. To study the space-based networking system from the perspective of performance evaluation, it is first necessary to determine scientific and reasonable system evaluation indicators. Considering the actual situation of the proposed space-based networking system, the indicators involved in the space-based networking performance evaluation system will be selected from the main output indicators of the space-based networking system. Secondly, it is necessary to determine a comprehensive and effective system evaluation method. At present, the commonly used methods for performance evaluation are mainly the following: hierarchical analysis method, fuzzy comprehensive evaluation method, ADC model evaluation method and BP neural network evaluation method. We need to combine the actual situation of the proposed space-based networking system to select the most suitable performance evaluation method for the space-based networking performance evaluation system. Finally, it is necessary to provide a reasonable and clear analysis framework for the system evaluation results. The accurate evaluation of system performance is the key to all work. Effective evaluation results will help to build and optimize the space-based networking system after analysis. Invalid evaluation results will delay the construction of the space-based networking system and even bring extremely serious consequences. Therefore, how to apply appropriate performance evaluation methods, reasonably quantify and integrate the main indicators with low correlation, and give comprehensive performance evaluation results is the first problem faced by the space-based networking performance evaluation system; how to adopt an appropriate analysis framework and provide effective guidance to the space-based networking system through effective performance evaluation results is the second problem faced by the space-based networking performance evaluation system. Summary of the invention
[0003] The technical problem solved by the present invention is: in view of the two problems faced by traditional technologies in the current existing technologies, a system and method for evaluating the effectiveness of space-based networking based on hierarchical analysis method are proposed.
[0004] The present invention solves the above technical problems by the following technical solutions:
[0005] A space-based networking performance evaluation system based on hierarchical analysis method includes an evaluation algorithm subsystem and a data processing subsystem. The evaluation algorithm subsystem calculates the weights of various indicators of the space-based networking system according to empirical data and a preset hierarchical structure. The data processing subsystem extracts various indicators from the space-based networking system data file for quantification, thereby providing a corresponding analysis framework for the space-based networking system performance evaluation results.
[0006] The data processing subsystem will evaluate the quantified indicator data according to the weight data of each indicator proposed by the evaluation algorithm subsystem, and determine the effectiveness of the space-based networking system under the corresponding analysis framework based on the evaluation results.
[0007] The evaluation algorithm subsystem includes a routing capability evaluation module, a networking capability evaluation module, an application service capability evaluation module, and a comprehensive evaluation module, wherein:
[0008] The routing capability evaluation module sets the weight of the routing reconvergence time index of the space-based networking system according to the empirical data, and performs consistency check;
[0009] The networking capability evaluation module sets weights of the inter-satellite switching interruption time, network control mode, service access type, and networking system switching indicators of the space-based networking system based on empirical data, and performs consistency checks;
[0010] The application service capability evaluation module performs weight setting of service automatic deployment, typical service mode, IMS multimedia communication service, Internet download service, and LOT information push service indicators of the space-based networking system based on empirical data, and performs consistency verification;
[0011] The capability assessment module, networking capability assessment module, and application service capability assessment module all receive the quantified indicator data of the data processing subsystem, perform assessments based on the weight settings, and obtain assessment results.
[0012] The comprehensive evaluation module performs consistency check on the evaluation results of the routing capability evaluation module, the networking capability evaluation module, and the application service capability evaluation module based on the empirical data.
[0013] The data processing subsystem includes a performance evaluation index quantification module and a data processing module, wherein:
[0014] The performance evaluation index quantification module extracts and quantifies the values of various indicators of the space-based networking system in the space-based networking system data file, constructs a hierarchical structure model for each indicator required for evaluation, and constructs a pairwise judgment matrix for each indicator;
[0015] The data processing module performs numerical quantification and calculates the performance evaluation results according to the index weights set by the hierarchical structure and the evaluation algorithm subsystem.
[0016] In the routing capability evaluation module, the networking capability evaluation module, the application service capability evaluation module, and the comprehensive evaluation module, the consistency judgment is based on the consistency judgment principle. In the consistency judgment principle, the calculation method of the consistency intermediate parameter CI is:
[0017]
[0018] In the formula, I max is the maximum eigenvalue of the module judgment matrix, and n is the order of the module judgment matrix.
[0019] In the consistency judgment principle, the calculation method of the consistency index CR is:
[0020]
[0021] In the formula, RI is the average random consistency index, which is obtained by repeatedly constructing a random judgment matrix, calculating the eigenvalues and taking the arithmetic mean;
[0022] In the consistency judgment principle, if CR < 0.1, the value of the judgment matrix complies with the consistency principle; otherwise, the value of the judgment matrix violates the consistency principle and the validity of the evaluation result is unreliable.
[0023] A space-based networking effectiveness evaluation method based on hierarchical analysis method, comprising:
[0024] (1) The indicators required for evaluation are constructed into a hierarchical structure model, and the data of each indicator in the space-based networking system are obtained and quantified through the data processing subsystem;
[0025] (2) The quantified data obtained in step (1) are used in the data processing subsystem to construct a pairwise judgment matrix for each indicator according to the hierarchical structure model, and the importance of the elements in the matrix is judged. The values of the elements in the matrix are selected according to the results of the importance judgment, and the consistency judgment is performed after the element selection is completed;
[0026] (3) Make a judgment based on the consistency test result. If it meets the matrix consistency principle, proceed to step (4). If it does not meet the matrix consistency principle, return to step (2) and reconstruct the pairwise judgment matrix.
[0027] (4) Input the pairwise judgment matrix of each indicator into the data processing subsystem, perform the performance evaluation calculation test according to the hierarchical structure model, and obtain the performance evaluation result data;
[0028] (5) Outputting the performance evaluation result data obtained in step (4) to an external data file and displaying it in the performance evaluation system composed of the evaluation algorithm subsystem and the data processing subsystem.
[0029] In the step (1), the performance evaluation index quantification module in the data processing subsystem is used to acquire the data of each index in the space-based networking system, and the acquired data is quantified.
[0030] In the step (2), the quantified data is processed in the data processing module of the data processing subsystem, and a pairwise judgment matrix of each indicator is constructed according to the hierarchical model. The importance is judged according to the empirical data, the elements in the judgment matrix are selected, and a consistency check is performed.
[0031] In the step (4), the pairwise judgment matrices of the indicators are input into the data processing module of the data processing subsystem, and the performance evaluation calculation test is performed based on the quantitative data output by the data processing module and the hierarchical model as a benchmark to obtain the performance evaluation result data.
[0032] In the step (5), the performance evaluation result data is displayed in the external data file in the form of numerical values, bar graphs, pie charts and curves.
[0033] The advantages of the present invention compared with the prior art are:
[0034] The present invention provides a space-based networking performance evaluation system and method based on the analytic hierarchy process. The space-based networking performance evaluation system based on the analytic hierarchy process is used to quantitatively integrate the main indicators of the space-based networking system according to the degree of correlation. While introducing experts to judge the importance of each indicator, the consistency judgment principle is used to verify the applicability and accuracy of the evaluation results. The evaluation is performed through an analytical framework to provide effective guidance for the construction and optimization of the space-based networking system. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 A flow chart of the space-based networking effectiveness evaluation method provided for the invention; DETAILED DESCRIPTION
[0036] A space-based networking performance evaluation system and method based on hierarchical analysis method can reasonably and appropriately quantitatively integrate different types of data indicators while having universal applicability and scalability, and can clearly provide an analysis framework after obtaining the performance evaluation results, so as to ensure the accuracy and effectiveness of the space-based networking performance evaluation system. The evaluation system includes an evaluation algorithm subsystem and a data processing subsystem, wherein:
[0037] The evaluation algorithm subsystem calculates the weights of various indicators of the space-based networking system based on empirical data and preset hierarchical structures. The data processing subsystem extracts various indicators from the space-based networking system data files for quantification, providing a corresponding analysis framework for the space-based networking system performance evaluation results. Specifically:
[0038] The evaluation algorithm subsystem includes routing capability evaluation module, networking capability evaluation module, application service capability evaluation module and comprehensive evaluation module, among which:
[0039] The routing capability evaluation module sets the weight of the routing reconvergence time index of the space-based networking system based on empirical data and performs consistency verification;
[0040] The networking capability assessment module sets the weights of the inter-satellite switching interruption time, network control mode, service access type, and networking system switching indicators of the space-based networking system based on empirical data, and performs consistency checks;
[0041] The application service capability assessment module sets the weights of the service automatic deployment, typical service mode, IMS multimedia communication service, Internet download service, and LOT information push service indicators of the space-based networking system based on empirical data, and performs consistency checks;
[0042] The comprehensive evaluation module sets weights for the evaluation results of the routing capability evaluation module, the networking capability evaluation module, and the application service capability evaluation module based on empirical data, and performs consistency checks.
[0043] The data processing subsystem includes the performance evaluation index quantification module and the data processing module, among which:
[0044] The performance evaluation index quantification module is used to extract and quantify the values of various indicators of the space-based networking system;
[0045] The data processing module quantifies the values and calculates the performance evaluation results according to the indicator weights set by the hierarchical structure and evaluation algorithm subsystem.
[0046] Furthermore, in the routing capability evaluation module, the networking capability evaluation module, the application service capability evaluation module, and the comprehensive evaluation module, consistency judgment is given the consistency judgment principle. In the consistency judgment principle, the calculation method of the consistency index CI is:
[0047]
[0048] In the formula, I max is the maximum eigenvalue of the module judgment matrix, and n is the order of the module judgment matrix.
[0049] In the consistency judgment principle, the calculation method of the consistency index CR is:
[0050]
[0051] Where RI is the average random consistency index, which is obtained by repeatedly constructing a random judgment matrix and calculating the eigenvalues and taking the arithmetic mean.
[0052] In the consistency judgment principle, if CR < 0.1, the value of the judgment matrix complies with the consistency principle; otherwise, the value of the judgment matrix violates the consistency principle and the validity of the evaluation result is unreliable.
[0053] The space-based network effectiveness evaluation method based on the hierarchical analysis method has the following specific steps:
[0054] (1) The indicators required for evaluation are organized into a hierarchical result model, and the data of each indicator in the space-based networking system is obtained and quantified through the data processing subsystem;
[0055] (2) The quantitatively processed data obtained in step (1) are used in the data processing subsystem to construct a pairwise judgment matrix for each indicator according to the hierarchical structure model, and importance judgment is performed to determine the values of the elements in the judgment matrix;
[0056] (3) Make a judgment based on the consistency test result. If it meets the matrix consistency principle, proceed to step (4). If it does not meet the matrix consistency principle, return to step (2) and reconstruct the pairwise judgment matrix.
[0057] (4) Input the pairwise judgment matrix of each indicator into the data processing subsystem, perform the performance evaluation calculation test according to the hierarchical structure model, and obtain the performance evaluation result data;
[0058] (5) Outputting the performance evaluation result data obtained in step (4) to an external data file and displaying it in the performance evaluation system composed of the evaluation algorithm subsystem and the data processing subsystem.
[0059] In step (1), the performance evaluation index quantification module in the data processing subsystem is used to obtain the data of each index in the space-based networking system, and the obtained data is quantified;
[0060] In step (2), the quantified data is processed in the data processing module of the data processing subsystem, and a pairwise judgment matrix of each indicator is constructed according to the hierarchical structure model, and importance judgment is performed according to empirical data, and the element values in the judgment matrix are completed, and a consistency test is performed;
[0061] In step (4), the pairwise judgment matrix of each indicator is input into the data processing module of the data processing subsystem, and the performance evaluation calculation test is performed based on the quantitative data output by the data processing module and the hierarchical structure model is used as a benchmark to obtain the performance evaluation result data;
[0062] In step (5), the performance evaluation result data is displayed in the external data file in the form of numerical values, bar graphs, pie charts and curves.
[0063] The following is further described based on specific embodiments:
[0064] In the current embodiment, the evaluation algorithm system consists of four modules: routing capability evaluation module, networking capability evaluation module, application service capability evaluation module and comprehensive evaluation module. The data processing system consists of performance evaluation index quantification module and data processing module.
[0065] The evaluation algorithm system is used to complete the weight calculation of the main indicators of the space-based networking system by combining expert experience and hierarchical structure. The data processing system is used to extract the main indicators from the data files of the space-based networking system for quantification and provide various forms of analysis frameworks for the performance evaluation results, including:
[0066] In the evaluation algorithm system:
[0067] The routing capability assessment module is used for setting weights and consistency verification of the routing reconvergence time indicators of the space-based networking system based on expert experience; the networking capability assessment module is used for setting weights and consistency verification of the inter-satellite switching interruption time, network control mode, service access type and networking system switching indicators of the space-based networking system based on expert experience; the application service capability assessment module is used for setting weights and consistency verification of the indicators of automatic deployment of space-based networking system services, typical service modes, IMS multimedia communication services, Internet download services and LOT information push services based on expert experience; the comprehensive assessment module is used for setting weights and consistency verification of the routing capability assessment module, networking capability assessment module and application service capability assessment module of the space-based networking system based on expert experience.
[0068] In data processing systems:
[0069] The performance evaluation index quantification module is used to extract and quantify the numerical values of the main indicators of the space-based networking system. The data processing module is used to calculate the performance evaluation results based on the hierarchical structure combined with the indicator weights and quantitative values.
[0070] According to the above-mentioned space-based networking effectiveness evaluation system, a space-based networking effectiveness evaluation test method based on hierarchical analysis method is carried out. The specific steps are as follows:
[0071] Step 1: The main indicators are organized into a hierarchical structure model, and the performance evaluation indicator quantification module of the data processing system is used to obtain the main indicator data of the space-based networking system and perform quantitative processing;
[0072] Step 2: Input the quantitative data of the main indicators obtained in step 1 into the data processing module of the data processing system; combine the hierarchical model to build a pairwise judgment matrix for each indicator, and have experts make importance judgments to complete the element values in the judgment matrix, and perform consistency checks at the same time; wherein, in the consistency check, if the matrix is judged to comply with the consistency principle, proceed to step 3; if it is judged not to comply with the consistency principle, the effectiveness of the evaluation results is insufficient and the judgment matrix needs to be reconstructed.
[0073] Step 3: Input the judgment matrix of each indicator obtained in step 2 into the data processing module of the data processing system, combine it with the quantitative data in the data processing module, start the performance evaluation calculation test according to the hierarchical model, and obtain the performance evaluation result data.
[0074] Step 4: Output the performance evaluation result data obtained in step 3 to a data file, and present the evaluation results in the form of numerical values, bar charts, pie charts and curves in the performance evaluation system to facilitate further analysis of the evaluation results.
[0075] like Figure 1 As shown, a flow chart of the space-based networking effectiveness evaluation system based on the hierarchical analysis method is formed:
[0076] (1) Data indicators
[0077] Data indicators refer to the specific indicator items that need to be evaluated in the sample data and their corresponding specific values. The indicator items include: routing reconvergence time, inter-satellite switching interruption time, network control mode, service access type, networking system switching, service automatic deployment, typical service mode, IMS multimedia communication service, Internet download service and LOT information push service;
[0078] (2)Consistency test
[0079] The consistency check is used to calculate whether the values of the elements in the judgment matrix generated based on expert judgment are consistent. The judgment rule is: if the consistency check calculation result is less than the threshold value, the value of the judgment matrix complies with the consistency principle; otherwise, the value of the judgment matrix violates the general principle, the effectiveness of the evaluation result is insufficient, and it needs to be recalculated.
[0080] It can be seen from the above embodiments that the space-based networking system performance evaluation model is constructed by the hierarchical analysis method, and the judgment matrix is given in combination with expert experience for consistency verification, which effectively solves the quantitative integration between data indicators with low correlation and improves the accuracy of system performance evaluation. It can provide a reasonable and clear analysis framework for the system evaluation results, present the evaluation results in the form of change curves, bar charts, pie charts and sample data grouping values, provide effective performance feedback and guidance for the space-based networking system, and improve the effectiveness of system performance evaluation.
[0081] Among them, in step (2), the pairwise judgment matrix is the judgment matrix mentioned in the table below, that is: all the influencing factors for evaluating a certain ability are compared two by two, and the comparison results are expressed in the form of a matrix. For example, if there are 6 influencing factors for the evaluation of a certain ability, the constructed judgment matrix is a 6X6 matrix, and each element value in the matrix is the result of pairwise comparison and importance judgment of all the influencing factors mentioned in the table below. Importance judgment will affect the weight of the element in the evaluation subsystem, that is, the more important the element is, the greater the corresponding weight in the evaluation subsystem. Elements are not indicators, but reflect the importance relationship between indicators.
[0082] The description of the pairwise judgment matrix is as follows:
[0083] According to the basic principle of hierarchical analysis method, we should first construct the pairwise judgment matrix of each indicator. The reference scale for constructing the pairwise judgment matrix is shown in Table 3-1.
[0084] Table 3-1 Pairwise Judgment Matrix Element Value Measurement Table
[0085]
[0086] Although the present invention has been disclosed as above in the form of a preferred embodiment, it is not intended to limit the present invention. Any person skilled in the art may make possible changes and modifications to the technical solution of the present invention by using the methods and technical contents disclosed above without departing from the spirit and scope of the present invention. Therefore, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention shall fall within the protection scope of the technical solution of the present invention.
[0087] The contents not described in detail in the specification of the present invention belong to the common knowledge of those skilled in the art.
Claims
1. A space-based networking effectiveness evaluation system based on analytic hierarchy process. Features: It includes an evaluation algorithm subsystem and a data processing subsystem. The evaluation algorithm subsystem calculates the weights of various indicators of the space-based networking system according to empirical data and a preset hierarchy. The data processing subsystem extracts various indicators from the space-based networking system data file for quantification, and provides a corresponding analysis framework for the space-based networking system performance evaluation results. The data processing subsystem sends the quantified indicator data to the evaluation algorithm subsystem, which determines the weight data of each indicator and performs evaluation based on the weight data of each indicator. After obtaining the evaluation results, the effectiveness of the space-based networking system is determined under the corresponding analysis framework. The evaluation algorithm subsystem includes a routing capability evaluation module, a networking capability evaluation module, an application service capability evaluation module, and a comprehensive evaluation module, wherein: The routing capability evaluation module sets the weight of the routing reconvergence time index of the space-based networking system according to the empirical data, and makes a consistency judgment; The networking capability evaluation module sets weights of the inter-satellite switching interruption time, network control mode, service access type, and networking system switching indicators of the space-based networking system based on empirical data, and makes consistency judgments; The application service capability evaluation module sets the weights of service automatic deployment, typical service modes, IMS multimedia communication services, Internet download services, and LOT information push service indicators of the space-based networking system based on empirical data, and makes consistency judgments; The routing capability assessment module, networking capability assessment module, and application service capability assessment module all receive the quantified indicator data of the data processing subsystem, perform assessments based on the weight settings, and obtain assessment results; The comprehensive evaluation module makes consistency judgment on the evaluation results of the routing capability evaluation module, the networking capability evaluation module, and the application service capability evaluation module based on the empirical data; The data processing subsystem includes a performance evaluation index quantification module and a data processing module, wherein: The performance evaluation index quantification module extracts and quantifies the values of various indicators of the space-based networking system in the space-based networking system data file, constructs a hierarchical structure model for each indicator required for evaluation, and constructs a pairwise judgment matrix for each indicator; The data processing module sends the quantified indicator data to the evaluation algorithm subsystem, and the evaluation algorithm subsystem obtains the evaluation results according to the set indicator weights to determine the effectiveness of the space-based networking system.
2. According to the space-based networking effectiveness evaluation system based on hierarchical analysis method as described in claim 1, Features: In the routing capability evaluation module, the networking capability evaluation module, the application service capability evaluation module, and the comprehensive evaluation module, the consistency judgment is based on the consistency judgment principle. In the consistency judgment principle, the calculation method of the consistency intermediate parameter CI is: C.I= I max -n n-1 In the formula, I max is the maximum eigenvalue of the judgment matrix corresponding to each module, and n is the order of the pairwise judgment matrix of each module.
3. According to the space-based networking effectiveness evaluation system based on hierarchical analysis method as described in claim 2, Features: In the consistency judgment principle, the calculation method of the consistency index CR is: C.R= CI RI In the formula, RI is the average random consistency index, which is obtained by repeatedly constructing a random judgment matrix, calculating the eigenvalues and taking the arithmetic mean; In the consistency judgment principle, if CR < 0.1, the value of the judgment matrix complies with the consistency principle; otherwise, the value of the judgment matrix violates the consistency principle and the validity of the evaluation result is unreliable.
4. An evaluation method for a space-based networking effectiveness evaluation system based on the analytic hierarchy process according to claim 1, Features include: Step (1), constructing a hierarchical structure model of various indicators required for evaluation, obtaining the data of various indicators in the space-based networking system through the data processing subsystem and performing quantitative processing; Step (2), constructing a pairwise judgment matrix of each indicator in the data processing subsystem according to the hierarchical structure model using the quantified data obtained in step (1), and making importance judgments on the elements in the matrix, selecting values for the elements in the matrix according to the results of the importance judgments, and making consistency judgments after completing the element selections; Step (3), make a judgment based on the consistency judgment result. If it meets the matrix consistency principle, proceed to step (4). If it does not meet the matrix consistency principle, return to step (2) to reconstruct the pairwise judgment matrix. Step (4), inputting the pairwise judgment matrix of each indicator into the data processing subsystem, performing the performance evaluation calculation test according to the hierarchical structure model, and obtaining the performance evaluation result data; Step (5), outputting the performance evaluation result data obtained in step (4) to an external data file and displaying it in the performance evaluation system composed of the evaluation algorithm subsystem and the data processing subsystem; Wherein, in step (1), the performance evaluation index quantification module in the data processing subsystem is used to obtain the data of each index in the space-based networking system, and the obtained data is quantified; In step (2), the quantified data is processed in the data processing module of the data processing subsystem, and a pairwise judgment matrix of each indicator is constructed according to the hierarchical model. The importance is judged according to the empirical data, the element values in the judgment matrix are completed, and the consistency judgment is performed, wherein: The pairwise judgment matrix of any indicator is determined based on all the influencing factors of the indicator. According to the number of influencing factors K, a KXK matrix is constructed. The values of each element in the matrix are the importance judgment results between different influencing factors. In the step (4), the pairwise judgment matrices of the indicators are input into the data processing module of the data processing subsystem, and the performance evaluation calculation test is performed based on the quantitative data output by the data processing module and the hierarchical model as a benchmark to obtain the performance evaluation result data.
5. The evaluation method according to claim 4, Features: In the step (5), the performance evaluation result data is displayed in the external data file in the form of numerical values, bar graphs, pie charts and curves.
