Full-performance comprehensive evaluation method and system applied to acquisition terminal and intelligent electric meter prototype

Abstract

The invention relates to a full-performance comprehensive evaluation method and system applied to an acquisition terminal and an intelligent electric meter prototype, and belongs to the technical field of acquisition terminal and intelligent electric meter evaluation. According to the method, the performances of the acquisition terminals and the intelligent electric meter prototype are evaluated and scored through a plurality of test items with data indexes, and the total score of each acquisition terminal and each intelligent electric meter prototype is calculated more accurately by calculating the advanced weight of each test on the basis of the previous evaluation method. The method is used for evaluating the performance of the acquisition terminal and the intelligent ammeter prototype. The method is used for solving the problems that the evaluation comprehensiveness of the acquisition terminal and the intelligent electric meter model machine is insufficient, and the consistency of the acquisition terminal and the intelligent electric meter model machine in a certain experiment cannot be evaluated.

Description

Technical Field

[0001] The invention relates to a comprehensive performance evaluation method and system for a data acquisition terminal and a smart meter prototype, belonging to the field of data acquisition terminal and smart meter evaluation. Background Art

[0002] The data acquisition terminal and smart meter are new data acquisition devices that integrate functions such as energy measurement, data acquisition, remote communication and control. As an important part of the smart grid, the stability and reliability of the performance of the data acquisition terminal and smart meter are directly related to the accuracy of power measurement and the safety and efficiency of the grid operation. Therefore, it is particularly important to conduct comprehensive performance tests on the data acquisition terminal and smart meter.

[0003] Usually, the performance of the data acquisition terminal and the smart meter prototype is judged by test projects with data indicators. These test projects with data indicators provide specific performance data of the data acquisition terminal and the smart meter in different aspects, which is the key to fully understand the performance of the data acquisition terminal and the smart meter.

[0004] Existing technical solutions often only use one or several test items with data indicators to score the acquisition terminal and smart meter prototypes, and then determine the total score of the prototype by multiplying the score by the basic weight. The basic weight in this solution is determined based on the degree of impact that each test item may have on the overall performance of the acquisition terminal and smart meter prototype, which has a certain degree of error; and this solution only relies on a few data indicators and cannot fully reflect the performance, reliability, durability and other characteristics of the acquisition terminal and smart meter prototype. Summary of the invention

[0005] The purpose of the present invention is to provide a comprehensive performance evaluation method and system for data acquisition terminals and smart meter prototypes, so as to solve the problem that the evaluation of data acquisition terminals and smart meter prototypes is not comprehensive enough and the consistency of the data acquisition terminals and smart meter prototypes in a certain experiment cannot be evaluated.

[0006] To achieve the above object, the solution of the present invention includes:

[0007] The present invention provides a comprehensive performance evaluation method for a data acquisition terminal and a smart meter prototype, comprising the following steps: selecting items with specific data indicators in a full performance test as scoring items; determining a unique scoring basis value for each test item; performing an original scoring on the scoring basis value according to the original scoring rule for each test item; for each test item, calculating the coefficient of variation of each test item according to the standard deviation of the scoring basis values ​​of all the devices to be tested corresponding to the test item and the average value of the scoring basis values ​​of all the devices to be tested corresponding to the test item; normalizing the coefficient of variation of each test item to obtain an advanced weight; performing a weighted summation according to the original score and the advanced weight to confirm the total score of each device to be tested; and comprehensively ranking the devices to be tested according to the total score.

[0008] Furthermore, for each test item, the coefficient of variation CV i Calculated by the following formula:

[0009]

[0010] Among them, σ i is the standard deviation of the score basis values ​​of the i-th test item of all N devices under test, μ i It is the average value of the score basis of the i-th test item of all N devices under test.

[0011] Furthermore, the normalization process is to divide the coefficient of variation of each test item by the coefficient of variation of all test items, and the advanced weight ω i Calculated by the following formula:

[0012]

[0013] Among them, CV i is the coefficient of variation for each test item, and n is the total number of all test items.

[0014] Furthermore, the total score S of each device under test k Calculated by the following formula:

[0015]

[0016] Among them, F ki is the original score of the kth device under test in the i-th test item, ω i is the advanced weight of the ith trial item.

[0017] Furthermore, the total score of each device under test is also confirmed based on the basic weight; the basic weight is confirmed based on the degree of influence of each test item on the overall performance of the device under test.

[0018] Furthermore, the total score of each device under test is also confirmed according to the basic weight; the total score of each device under test is confirmed by weighted summation according to the original score, basic weight and advanced weight; the total score S of each device under test k Calculated by the following formula:

[0019]

[0020] Among them, F ki is the original score of the kth device under test in the i-th test item, λ i is the basic weight on the ith trial item, ω i is the advanced weight of the ith trial item.

[0021] Furthermore, the scoring basis value is a unique data value obtained by statistical methods from the collected data obtained in the test of each test project, which can reflect the quality of the corresponding experimental project. The statistical method includes averaging the collected data, taking the maximum value of the absolute value of the collected data, or taking the unique collected data as the scoring basis value.

[0022] Furthermore, the original scoring rule is to set the same full score for each test item, set the same number of levels for each test item, divide the full score equally according to the designated intervals, and when the full score and the number of levels are the same, score the corresponding test item according to the interval of the scoring basis value to be evaluated.

[0023] A comprehensive performance evaluation system for data acquisition terminals and smart meter prototypes of the present invention includes a processor for executing a computer program to implement the steps of the comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes as described above.

[0024] The beneficial effects of the present invention are: the performance of the acquisition terminal and the smart meter prototype is evaluated and scored through a variety of test items with data indicators, and the total score of each acquisition terminal and smart meter prototype is more accurately calculated by calculating the advanced weight of each test on the basis of the previous evaluation method, so as to evaluate the performance of the acquisition terminal and the smart meter prototype. The problem that the evaluation of the acquisition terminal and the smart meter prototype is not comprehensive enough and the consistency of the equipment under test in a certain experiment cannot be evaluated is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a flow chart of the comprehensive performance evaluation method applied to the acquisition terminal and the smart meter prototype. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention is described in detail in a clear and complete manner in conjunction with the accompanying drawings and embodiments.

[0027] The idea of ​​the present invention is to evaluate and score the performance of the data collection terminal and the smart meter prototype through a variety of test items with data indicators. On the basis of previous evaluation methods, the high-level weight of each test is calculated to more accurately calculate the total score of each data collection terminal and the smart meter prototype, so as to evaluate the performance of the data collection terminal and the smart meter prototype.

[0028] Method Example:

[0029] The present invention provides a comprehensive performance evaluation method for a data acquisition terminal and a smart meter prototype, which is applicable to the data acquisition terminal and the smart meter prototype, that is, the device to be tested can be the data acquisition terminal or the smart meter prototype. This embodiment is specifically described by taking the evaluation of the smart meter prototype as an example, and the evaluation method of the data acquisition terminal and the device to be tested is the same.

[0030] The prior art mentioned in the background technology is used as the preliminary preparation work of the present invention, including the following steps: 1) determining the test items; 2) determining the scoring basis value for each test item; 3) determining the original scoring rule for each test item; 4) determining the basic weight of each test item.

[0031] like Figure 1 As shown in the figure, the overall performance evaluation method of the smart meter prototype is divided into: 1) test data collection; 2) test data standardization processing; 3) original score; 4) basic weight processing; 5) advanced weight processing; 6) weighted summation; 7) prototype sorting.

[0032] The specific steps are as follows:

[0033] 1. Preliminary preparation:

[0034] (1) Determine the test items:

[0035] From more than 60 full-performance test items of smart meters, 20 tests with specific data indicators were selected as test items, including basic error test, power consumption test, voltage change test, frequency change test, ambient temperature change test, self-heating test, and high-order harmonic test.

[0036] (2) Determine the scoring basis value for each test item:

[0037] Each test item corresponds to a different scoring basis value, and the corresponding scoring basis value needs to be confirmed according to different tests. For example, the experimental data of the basic error test includes a total of 160 test points, and the average value of the absolute values ​​of all error points is taken as the scoring basis value for scoring; there is only one data for the power consumption test value of the voltage line in the non-communication state, and this value is used as the scoring basis value for scoring; the test data of the frequency change test includes a total of 12 test points, and the maximum value of the absolute values ​​of all error points is taken as the scoring basis value for scoring.

[0038] (3) Determine the original scoring rules for each test item:

[0039] Each test item is divided into 10 levels, with a full score of 100. For example:

[0040] 1) Scoring rules for basic error test:

[0041] grade Average value X score 1 X≤0.01 100 2 0.01＜X≤0.02 90 3 0.02＜X≤0.03 80 4 0.03＜X≤0.04 70 5 0.04＜X≤0.05 60 6 0.05＜X≤0.06 50 7 0.06＜X≤0.07 40 8 0.07＜X≤0.08 30 9 0.08＜X≤0.09 20 10 X＞0.10 10

[0042] If the score value X of the No. 1 smart meter prototype is 0.005, then the score is 100 points; if the score value X of the No. 2 smart meter prototype is 0.035, then the score is 70 points, and so on.

[0043] 2) Scoring rules for power consumption test in non-communication state of voltage line:

[0044] grade Test value Y score 1 Y≤0.2 100 2 0.2＜Y≤0.3 90 3 0.3＜Y≤0.4 80 4 0.4＜Y≤0.5 70 5 0.5＜Y≤0.6 60 6 0.6＜Y≤0.7 50 7 0.7＜Y≤0.8 40 8 0.8＜Y≤0.9 30 9 0.9＜Y≤1.0 20 10 Y＞1.0 10

[0045] If the power consumption measurement value Y of the No. 1 smart meter prototype is 0.1, the score is 100 points; if the power consumption measurement value Y of the No. 2 smart meter prototype is 0.65, the score is 50 points; and so on.

[0046] (4) Determine the basic weight of each test item:

[0047] The basic weight is determined according to the possible impact of each test item on the overall performance of the prototype. For example, the basic weight of the basic error test is 10%, the power consumption test is 10%, the voltage change test is 6%, the frequency change test is 6%, the self-heating test is 5%, and the high-order harmonic test is 3%.

[0048] 2. Full performance evaluation method of smart meter prototype:

[0049] (1) Test data collection:

[0050] All the test data of the determined 20 tests were collected into the system.

[0051] (2) Standardization of test data:

[0052] All the data collected for each test item are standardized and finally a value is determined as the scoring basis. For example, the experimental data of the basic error test collected a total of 160 test points, and the average value of the absolute values ​​of all error points was taken as the scoring basis; the power consumption test value of the voltage line in the non-communication state has only one data, so this value is used as the scoring basis; the experimental data of the frequency change test includes a total of 12 test points, and the maximum value of the absolute values ​​of all error points is taken as the scoring basis, etc.

[0053] (3) Provide original scores for each test item:

[0054] According to the original scoring rules of each test item, the scoring basis value obtained by the test data standardization processing module is originally scored. For example, if the scoring basis value of the basic error test of the No. 1 smart meter prototype is 0.035, the score of this test item is 70 points, and the scoring basis value of the power consumption test of the prototype is 0.16, then the score of this test item is 100 points, and so on. In this way, the scores of the 20 test items of all prototypes are obtained.

[0055] (4) Basic weight processing:

[0056] The basic weight processing module is used to store the basic weight corresponding to each test item. For example, the basic weight of the basic error test is 10%, the power consumption test is 10%, the voltage change test is 6%, the frequency change test is 6%, the self-heating test is 5%, the high-order harmonic test is 3%, etc. The total of all experiments is 100%.

[0057] The basic weights can be adjusted according to actual conditions. If no adjustment is made, the default values ​​will be used.

[0058] (5) Advanced weight processing:

[0059] The advanced weights are determined based on the dispersion of all trial items.

[0060] 1) Calculate the coefficient of variation for each test:

[0061] The coefficient of variation is used to measure the degree of dispersion of data. The larger the coefficient of variation, the higher the degree of dispersion of the data and the greater the performance difference between the prototypes on this project.

[0062] For each test item, taking the basic error test as an example, the coefficient of variation is the ratio of the standard deviation of the basic error test score basis values ​​X1, X2, X3, ...Xn of all N prototypes to the average value. The calculation formula of the coefficient of variation is:

[0063]

[0064] Among them, σ i is the standard deviation of the score basis values ​​of the i-th test item of all N prototypes, μ i It is the average value of the score basis of the i-th test item of all N prototypes.

[0065] 2) Determine the advanced weight of each test item according to the size of the coefficient of variation:

[0066] Items with larger coefficients of variation are assigned higher weights, and items with smaller coefficients of variation are assigned lower weights. The weight allocation method is to normalize the coefficient of variation of each item, that is, the weight of each item is equal to its coefficient of variation divided by the sum of the coefficients of variation of all items. The calculation formula for advanced weights is:

[0067]

[0068] Wherein, n is the total number of test items, and in this embodiment, n=20.

[0069] (6) Weighted summation:

[0070] Based on the original score, basic weights, and advanced weights, a total score is calculated for each prototype.

[0071] The calculation formula for the total score of the kth prototype is:

[0072]

[0073] Among them, F ki is the original score of the k-th prototype in the i-th test item, λ i is the basic weight on the ith trial item, ω i is the advanced weight of the ith trial item.

[0074] (7) Prototype sorting:

[0075] Sort by the total score of each prototype obtained by the weighted sum module.

[0076] System Example:

[0077] The present invention provides a comprehensive performance evaluation system for data acquisition terminals and smart meter prototypes. The system includes a processor, which executes computer program instructions to implement a comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes introduced in a method embodiment. The method has been clearly introduced in the method embodiment and will not be repeated here.

Claims

1. A comprehensive performance evaluation method for acquisition terminals and smart meter prototypes, characterized in that: The method comprises the following steps: selecting items with specific data indicators in the full performance test as scoring items; determining a unique scoring basis value for each test item; performing an original scoring on the scoring basis value according to the original scoring rule for each test item; for each test item, calculating the coefficient of variation of each test item according to the standard deviation of the scoring basis values ​​of all the devices under test corresponding to the test item and the average value of the scoring basis values ​​of all the devices under test corresponding to the test item; normalizing the coefficient of variation of each test item to obtain an advanced weight; and performing a weighted summation based on the original score and the advanced weight to confirm the total score of each device under test; The devices under test are ranked comprehensively according to the total scores.

2. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: For each test item, the coefficient of variation CV i Calculated by the following formula: Among them, σ i is the standard deviation of the score basis values ​​of the i-th test item of all N devices under test, μ i It is the average value of the score basis of the i-th test item of all N devices under test.

3. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: The normalization process is to divide the coefficient of variation of each test item by the coefficient of variation of all test items. i Calculated by the following formula: Among them, CV i is the coefficient of variation for each test item, and n is the total number of all test items.

4. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: The total score S of each device under test k Calculated by the following formula: Among them, F ki is the original score of the kth device under test in the i-th test item, ω i is the advanced weight of the ith trial item.

5. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: The total score of each device under test is also determined according to the basic weight; the basic weight is determined according to the degree of influence of each test item on the overall performance of the device under test.

6. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: The total score of each device under test is also confirmed according to the basic weight; the total score of each device under test is confirmed by weighted summation based on the original score, basic weight and advanced weight; the total score of each device under test S k Calculated by the following formula: Among them, F ki is the original score of the kth device under test in the i-th test item, λ i is the basic weight on the ith trial item, ω i is the advanced weight of the ith trial item.

7. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 1 is characterized in that: The scoring basis value is a unique data value obtained by statistical methods from the collected data obtained in each test project, which can reflect the quality of the corresponding experimental project. The statistical method includes averaging the collected data, taking the maximum value of the absolute value of the collected data, or taking the unique collected data as the scoring basis value.

8. The comprehensive performance evaluation method for data acquisition terminals and smart meter prototypes according to claim 7 is characterized in that: The original scoring rule is to set the same full score for each test item, set the same number of grades for each test item, divide the full score equally according to the designated intervals, and score the corresponding test item according to the interval in which the scoring basis value to be evaluated lies when the full score and the number of grades are the same.

9. A comprehensive performance evaluation system for a data acquisition terminal and a smart meter prototype, comprising a processor, characterized in that: The processor is used to execute a computer program to implement the steps of the comprehensive performance evaluation method applied to a data acquisition terminal and a smart meter prototype as described in any one of claims 1 to 8.

Images