Method, device, equipment and medium for evaluating prototype of measuring equipment based on type evaluation system

Through the prototype evaluation method of the metering equipment of the type evaluation system, the problem of inefficient traditional type evaluation is solved, and the accuracy and efficient evaluation of the metering equipment is achieved. Combined with automatic and manual evaluation, the accuracy and convenience of the metering system are improved.

CN114372088BActive Publication Date: 2024-12-06HENAN PROVINCE INST OF METROLOGY +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210028722.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-11
Publication Date
2024-12-06
Estimated Expiration
2042-01-11

AI Technical Summary

Technical Problem

Due to irregular operations and complex work processes, traditional type evaluation work has inefficiency, overdue tasks and unclear division of responsibilities, and lacks information-based inspection methods.

Method used

The prototype evaluation method of the metrology equipment based on the type evaluation system, by obtaining the data to be evaluated input by the user, determining the evaluation score and starting the prototype evaluation process, combining the scanning device to obtain equipment information, obtaining test data, performing data feature extraction and weight coefficient correction, Calculate the target evaluation score and output the comprehensive evaluation results.

Benefits of technology

It improves the accuracy and convenience of the type evaluation system, ensures the accuracy and efficiency of the evaluation of metrology equipment, and can conduct comprehensive evaluation automatically and manually.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114372088B_ABST
    Figure CN114372088B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a prototype evaluation method for metrology equipment based on a model evaluation system, the method comprising: obtaining data to be evaluated input by a user through the model evaluation system; determining a first evaluation score corresponding to the data to be evaluated output by the model evaluation system, and starting a prototype evaluation process corresponding to the metrology equipment to be evaluated when the first evaluation score meets a preset first evaluation threshold; obtaining test data given by a corresponding evaluation sub-laboratory; determining the evaluation sub-score corresponding to the evaluation sub-process according to the test data; determining a first weight coefficient corresponding to each evaluation sub-process; determining a second evaluation score corresponding to the prototype evaluation process according to the first weight coefficient and the evaluation sub-score after correction; determining a second weight coefficient, and calculating a target evaluation score according to the second weight coefficient and the first evaluation score and the second evaluation score; and outputting an evaluation result corresponding to the target evaluation score. The present invention can improve the accuracy of the evaluation of the model evaluation system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of equipment testing, and in particular to a method, device, computer equipment and computer-readable storage medium for evaluating a prototype of a metrological equipment based on a type evaluation system. Background Art

[0002] Inspection and testing work mainly includes type inspection, supervisory inspection, and commissioned inspection. Due to the non-standard operation and complex workflow of traditional type evaluation work, its working mode has always remained in the relatively primitive state of manual transfer and manual certification. This working method has caused a series of problems such as low work efficiency, serious task overdue, and unclear division of responsibilities. How to provide an information-based type evaluation method for inspection work is an urgent problem to be solved. Summary of the invention

[0003] Based on this, it is necessary to propose a metrology equipment prototype evaluation method, device, computer equipment and computer-readable storage medium based on a type evaluation system to address the above problems.

[0004] In the present invention, a method for evaluating a prototype of a metrological equipment based on a type evaluation system is provided, the method comprising:

[0005] Acquire the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measuring equipment to be evaluated of the user to be evaluated meets the measurement standard;

[0006] Determine a first evaluation score output by the model evaluation system and corresponding to the data to be evaluated, and when the first evaluation score meets a preset first evaluation threshold, start a prototype evaluation process corresponding to the metrological device to be evaluated, wherein the prototype evaluation process includes at least one evaluation subprocess;

[0007] Acquire the equipment information of the measuring equipment to be evaluated through the connected scanning device;

[0008] In each evaluation sub-process, the test data provided by the corresponding evaluation sub-laboratory is obtained, wherein the test data is the data provided by the evaluation sub-laboratory when testing the metrological equipment to be evaluated; and the evaluation sub-score corresponding to the evaluation sub-process is determined according to the test data;

[0009] Determine a first weight coefficient corresponding to each evaluation sub-process, and correct the first weight coefficient according to the evaluation sub-score to obtain a corrected first weight coefficient;

[0010] Determine a second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score;

[0011] Determine a second weight coefficient, calculate a target evaluation score based on the second weight coefficient and the first evaluation score and the second evaluation score; and output an evaluation result corresponding to the target evaluation score.

[0012] Optionally, the step of determining the evaluation sub-score corresponding to the evaluation sub-process according to the test data further includes:

[0013] dividing the test data into first test data and second test data;

[0014] Obtaining vector features of the first experimental data, wherein the vector features include multiple features at multiple scales, and obtaining a first feature subset of the vector features; fusing the multiple features included in the vector features to obtain a first feature after fusion; wherein the vector features are input into a preset feature fusion model, wherein the number of layers of the feature fusion model is the same as the number of features included in the vector features; at the i-th layer, fusing the i-th feature with other features, wherein the fusion process is performed based on a coefficient corresponding to the i-th feature, i=1,...,N, where N is the number of layers of the feature fusion model; and splicing the fused features obtained at each layer based on the coefficients to obtain the first feature;

[0015] Acquire the time domain features and frequency domain features of the second test data; sample the acquired time domain features and frequency domain features according to a preset sampling interval to acquire a second feature subset;

[0016] Performing feature processing on the second feature subset according to the first feature to obtain a second feature; wherein at least two key features in the second feature subset are determined according to the first feature, and the determined key features are fused to obtain the second feature;

[0017] The evaluation score of the first feature and the evaluation score of the second feature are obtained respectively, and the evaluation sub-score corresponding to the evaluation sub-process is calculated.

[0018] Optionally, the step of correcting the first weight coefficient according to the evaluation sub-score to obtain the corrected first weight coefficient further includes:

[0019] If the evaluation sub-score is less than a preset value, determining a correction function corresponding to the evaluation sub-score, wherein the score of the evaluation sub-score corresponds to the correction function;

[0020] Correcting the first weight coefficient according to the correction function to obtain the corrected first weight coefficient; wherein the corrected first weight coefficient is greater than the first weight coefficient before the correction;

[0021] The step of determining the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score also includes:

[0022] According to a preset second evaluation score calculation function, the second evaluation score is calculated by taking the corrected first weight coefficient and the evaluation sub-score as input.

[0023] Optionally, in each evaluation sub-process, after the step of obtaining test data provided by a corresponding evaluation sub-laboratory, wherein the test data is data provided by the evaluation sub-laboratory when performing a test on the metrology equipment to be evaluated, the process further includes:

[0024] Determine whether the test data meets the preset requirements. If not, trigger the manual inspection process;

[0025] Obtain a manual judgment result on whether the manually input test data meets the preset requirements. If the manual judgment result is not satisfied, set the evaluation sub-score corresponding to the evaluation sub-process to 0; if the manual judgment result is satisfied, execute the step of determining the evaluation sub-score corresponding to the evaluation sub-process based on the test data.

[0026] Optionally, the step of determining the first evaluation score output by the model evaluation system and corresponding to the data to be evaluated further includes:

[0027] Group the data to be evaluated;

[0028] For each data group, extract at least one feature data corresponding to the data to be evaluated in each data group;

[0029] Determine the standard data corresponding to each data group and the first weight coefficient corresponding to each data group, and under each data group, calculate the matching degree between the standard data and the characteristic data, wherein the matching degree is used to identify whether the characteristic data meets the requirements of the standard data; determine the evaluation sub-score corresponding to each data group according to the matching degree;

[0030] According to the first weight coefficient and the evaluation sub-score corresponding to each data group, the first evaluation score corresponding to the data to be evaluated is calculated.

[0031] Optionally, the step of grouping the data to be evaluated further includes:

[0032] Performing a first grouping process on the data to be evaluated to obtain a plurality of first data groups, wherein the data to be evaluated in the plurality of first data groups obtained by the first grouping process do not overlap;

[0033] Using a first data processing algorithm, performing a first screening operation on the data to be evaluated in each first data group according to the importance value;

[0034] Performing a second grouping process on the data to be evaluated in the first data group after the first screening, so as to obtain a plurality of second data groups under each first data group, wherein the data to be evaluated in the plurality of second data groups obtained by the second grouping process may overlap;

[0035] Performing a second screening operation on the data to be evaluated in the second data group according to the data characteristic value;

[0036] The step of performing a second grouping process on the data to be evaluated in the first data group after the first screening to obtain a plurality of second data groups under each first data group further includes:

[0037] Performing a combination operation on the plurality of pieces of data to be evaluated in the first data group after the first screening, wherein each combined data packet obtained by the combination operation contains one or more pieces of data to be evaluated;

[0038] Performing a second grouping process on the combined data under the first data group to obtain a plurality of second data groups;

[0039] The step of performing a second screening operation on the data to be evaluated in the second data group according to the data characteristic value also includes:

[0040] The combined features corresponding to each combined data are calculated as data feature values, and a second screening operation is performed on the combined data in the second data group according to the data feature values.

[0041] Optionally, the step of calculating the degree of match between the standard data and the characteristic data in each data group further includes:

[0042] Perform prediction analysis on each combined feature to obtain the predicted value corresponding to the combined feature; calculate the predicted residual value based on the combined feature and the predicted value;

[0043] Calculate the negative entropy corresponding to the predicted residual value, and calculate the contribution value corresponding to the combined feature based on the calculated negative entropy;

[0044] The similarity between the standard data and the combined data is calculated, and the matching degree between the standard data and the feature data is calculated based on the contribution value and similarity of the combined features.

[0045] The present invention also provides a metrology equipment prototype evaluation device based on the type evaluation system, the device comprising:

[0046] A data acquisition module is used to acquire the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measurement equipment to be evaluated of the user to be evaluated meets the measurement standard;

[0047] A first evaluation module, used to determine a first evaluation score output by the model evaluation system and corresponding to the data to be evaluated;

[0048] A second evaluation starting module, used to start a prototype evaluation process corresponding to the metrological equipment to be evaluated when the first evaluation score meets a preset first evaluation threshold, wherein the prototype evaluation process includes at least one evaluation sub-process;

[0049] An equipment confirmation module is used to obtain equipment information of the metering equipment to be evaluated through a connected scanning device;

[0050] The second evaluation module is used to obtain the test data given by the corresponding evaluation sub-laboratory in each evaluation sub-process, wherein the test data is the data given by the evaluation sub-laboratory when testing the metrological equipment to be evaluated; determine the evaluation sub-score corresponding to the evaluation sub-process according to the test data; determine the first weight coefficient corresponding to each evaluation sub-process, and correct the first weight coefficient according to the evaluation sub-score to obtain the corrected first weight coefficient; determine the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score;

[0051] The third evaluation module is used to determine the second weight coefficient, calculate the target evaluation score according to the second weight coefficient and the first evaluation score and the second evaluation score; and output the evaluation result corresponding to the target evaluation score.

[0052] In the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the metrology equipment prototype evaluation method based on the type evaluation system as described above.

[0053] In the present invention, a computer device is provided, which includes a memory and a processor. The memory has executable code. When the executable code runs on the processor, the method for evaluating a prototype of a metrological device based on a type evaluation system as described above is implemented.

[0054] The embodiments of the present invention have the following beneficial effects:

[0055] After adopting the above-mentioned metrological equipment prototype evaluation method, device, computer equipment and computer-readable storage medium based on the type evaluation system, when it is necessary to perform type evaluation on the metrological equipment, obtain the data to be evaluated input by the user through the type evaluation system, and the data to be evaluated is the inspection data of whether the metrological equipment to be evaluated by the user to be evaluated meets the metrological standard; determine the first evaluation score output by the type evaluation system and corresponding to the data to be evaluated, and when the first evaluation score meets the preset first evaluation threshold, start the prototype evaluation process corresponding to the metrological equipment to be evaluated, and the prototype evaluation process includes at least one evaluation sub-process; obtain the equipment information of the metrological equipment to be evaluated through the connected scanning device; in each In each evaluation sub-process, the test data given by the corresponding evaluation sub-laboratory is obtained, and the test data is the data given by the evaluation sub-laboratory for testing the metrological equipment to be evaluated; the evaluation sub-score corresponding to the evaluation sub-process is determined according to the test data; the first weight coefficient corresponding to each evaluation sub-process is determined, and the first weight coefficient is corrected according to the evaluation sub-score to obtain the corrected first weight coefficient; according to the corrected first weight coefficient and the evaluation sub-score, the second evaluation score corresponding to the prototype evaluation process is determined; the second weight coefficient is determined, and the target evaluation score is calculated according to the second weight coefficient and the first evaluation score and the second evaluation score; and the evaluation result corresponding to the target evaluation score is output. In other words, whether it is the automatic evaluation of system data or the evaluation of prototype test, it can be comprehensively considered in the evaluation of metrological equipment, and a comprehensive evaluation result is given, which improves the accuracy and convenience of the model evaluation system. Moreover, in the embodiment of the present invention, for each sub-process of the prototype evaluation, each sub-process can be accurately evaluated through data evaluation, coefficient correction, feature extraction, etc., so as to accurately evaluate the prototype arrangement, further improving the accuracy of the model evaluation system in evaluating the metrological equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0057] in:

[0058] Figure 1 A schematic flow chart of a method for evaluating a prototype of a metering device based on a type evaluation system in one embodiment;

[0059] Figure 2 It is a structural schematic diagram of a metrology equipment prototype evaluation device based on a type evaluation system in one embodiment;

[0060] Figure 3 The structure diagram of a computer device for running the above-mentioned metrology equipment prototype evaluation method based on the type evaluation system in one embodiment is shown. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0062] In this embodiment, a type evaluation system is provided, which can evaluate whether the metrological equipment meets the inspection requirements. The user submits data (data to be evaluated) through the type evaluation system, and then the type evaluation system automatically and experts manually evaluate whether the metrological equipment meets the inspection requirements. After the evaluation of the submitted data to be evaluated is qualified, the user is notified to submit a sample of the metrological equipment to be evaluated, and then the sample is further inspected, thereby completing the type evaluation of the metrological equipment.

[0063] Furthermore, in this embodiment, an evaluation method based on the above-mentioned model evaluation system is provided, which can evaluate whether the data to be evaluated submitted by the user meets the inspection requirements and output the evaluation results.

[0064] For details, see Figure 1 , a flow chart of the above-mentioned metrological equipment prototype evaluation method based on the type evaluation system is given. Among them, the metrological equipment prototype evaluation method based on the type evaluation system includes the following: Figure 1 Steps S101-S108 are shown.

[0065] Step S101: obtaining the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measuring equipment to be evaluated of the user to be evaluated meets the measurement standard.

[0066] The user submits the data of the metering equipment to be evaluated through the type evaluation system, so as to evaluate whether the metering equipment meets the inspection requirements through the type evaluation system. Among them, the data to be evaluated submitted by the user to the type evaluation system is submitted separately for each item according to the requirements for data submission in the type evaluation system. The data here can be formatted data including multiple attribute items defined by the type evaluation system, or can be submitted by submitting attachments, etc. Therefore, the data to be evaluated here includes multiple data to be evaluated.

[0067] Although the user has entered multiple pieces of data to be evaluated, not every piece of data to be evaluated can enter the next step of the evaluation process. Here, each piece of data to be evaluated needs to be screened first to determine the data to be evaluated that enters the next step of the evaluation process. In the event that some necessary data to be evaluated is missing or has problems, the user needs to be reminded to resubmit the data to be evaluated.

[0068] Specifically, each piece of data to be evaluated has a corresponding data format requirement, which is defined by the model evaluation system. When the user inputs the data to be evaluated, each piece of data to be evaluated is screened according to the data format requirement defined by the model evaluation system to determine whether each model evaluation system meets the corresponding data format requirement.

[0069] If the requirements are met, continue to execute the following steps; if the requirements are not met, the data will be returned to the user to resubmit the data for evaluation.

[0070] Step S102: determining a first evaluation score output by the model evaluation system corresponding to the data to be evaluated.

[0071] When evaluating the data to be evaluated, it is first necessary to group the data to be evaluated, and then evaluate based on the grouped data to improve the effectiveness and accuracy of the evaluation of the data to be evaluated.

[0072] In a specific embodiment, multiple pieces of data to be evaluated are grouped according to preset grouping requirements to obtain multiple pieces of data to be evaluated corresponding to multiple data groups, wherein each data group contains at least one piece of data to be evaluated, and there is at least one common characteristic or similarity between the multiple pieces of data to be evaluated contained in each data group.

[0073] Furthermore, how to perform grouping is explained in detail.

[0074] First, a first grouping process is performed on a plurality of pieces of data to be evaluated to obtain a plurality of first data groups, wherein the data to be evaluated in different first data groups do not overlap. Here, the first grouping process is a preliminary grouping process of the data to be evaluated to divide the data to be evaluated into a plurality of large groups, and then further refinement processing is performed on the data under the large groups.

[0075] Then, further screening is performed on the data in each first data group. According to the first data processing algorithm, the first screening operation is performed on the data to be evaluated in each first data group according to the importance value; for example, here the importance value of each data to be evaluated can be calculated according to the gradient boosting tree algorithm, and then the first screening operation is performed on the multiple data in each first data group. According to the random sample, the importance value corresponding to each data to be evaluated can be calculated, and then the first screening operation is performed according to whether the calculated importance value is greater than or equal to the preset importance value threshold.

[0076] The data to be evaluated in the first data group after the first screening is subjected to a second grouping process. The second grouping process here is a further subdivision grouping process, which is more refined than the first grouping process, and can perform more refined feature grouping on the data to be evaluated, so that multiple second data groups under each first data group can be obtained, that is, the second data group is obtained by further grouping the data to be evaluated in each first data group, and will not be processed across multiple first data groups. Among them, there may be overlaps between the data to be evaluated in the multiple second data groups obtained by the second grouping process. It should be noted that in the step, during the second grouping process, the data to be evaluated in each first data group will be combined, and the combined data after the combination may contain one or more data to be evaluated. Then, the combined data is grouped. The second grouping process here is to group according to whether a certain feature is contained in the combined feature to obtain a combined feature with the same feature, that is, in the second data group obtained by the second grouping process, each second data group contains multiple combined data obtained according to the data to be evaluated.

[0077] Then, a second screening operation is performed on all the combined data obtained, wherein the second screening operation is performed by calculating the data feature values ​​corresponding to each combined data, wherein the combined data is input into a preset screening model (wherein the model is a neural network model), and then the corresponding data feature values ​​are obtained, and then the combined data screened in the second screening operation is determined based on whether the data feature values ​​meet the preset feature value screening conditions.

[0078] In a specific embodiment, the combined features of the combined data may be extracted by first extracting features corresponding to multiple data to be evaluated in the combined data, and then performing cross-fusion processing on the extracted features. In a specific example, when the combined data includes A1, A2, and A3, the corresponding extracted features are B1, B2, and B3, then the combined feature B is:

[0079] B=contact(f1(B1,B2,B3),f2(B1,B2,B3),f3(B1,B2,B3)),

[0080] Among them, contact is a fusion function, such as a splicing function, an addition function, etc., f1, f2, and f3 are preset feature cross-fusion algorithms, and, in one embodiment, the feature cross-fusion algorithm may not be limited to the three cross-fusion algorithms of f1, f2, and f3 mentioned above, but may also include fewer or more cross-fusion algorithms.

[0081] It should be noted that the second screening operation here can be to calculate the importance value of each combination data according to the gradient boosting tree algorithm, and then perform the second screening operation on each combination data. Among them, the importance value corresponding to each combination data can be calculated based on a random sample, and then the second screening operation is performed based on whether the calculated importance value is greater than or equal to a preset importance value threshold.

[0082] After the data to be evaluated is grouped, further evaluation processing operations can be performed.

[0083] Here, it is necessary to further extract corresponding feature data for each data group (the data group here may include a first data group and a second data group), and then perform further evaluation and processing operations based on the extracted feature data.

[0084] For each piece of data to be evaluated, feature data of the data to be evaluated is extracted according to a preset feature extraction algorithm. Here, the feature extraction algorithm may be a feature extraction algorithm defined for each data group, and the feature extraction algorithm corresponding to each data group is different, so as to accurately extract feature data corresponding to each piece of data to be evaluated.

[0085] Furthermore, in the case of the second data group, the characteristic data corresponding to each combination of data may be the aforementioned extracted combination feature (ie, the aforementioned data characteristic value).

[0086] In this embodiment, the data in different data groups contribute to the evaluation of the results to different degrees, and have different degrees of influence on whether the evaluation results are qualified. Therefore, for each data group, a different weight coefficient (third weight coefficient) is configured. This third weight coefficient is used to identify the degree of influence of data in different data groups on the evaluation results.

[0087] Furthermore, different users may also correspond to different standard data requirements. For example, for users of different systems, different types, and different historical data, the corresponding standard data requirements are different; the different standard data referred to here does not mean that the standard data is different, but that the corresponding requirements are different, for example, the confidence corresponding to the standard data is different. Specifically, the historical evaluation data of the user to be evaluated corresponding to the data to be evaluated in the evaluation system is obtained, and the confidence corresponding to the user to be evaluated is determined based on the historical evaluation data; then the requirements of the standard data corresponding to each data group are determined based on the confidence, where different confidences can correspond to different standard data requirements. After calculating and determining the confidence, the matching degree between the standard data and the feature data under each data group can be further calculated. The matching degree here is used to identify whether the feature data meets the requirements of the standard data; that is, this matching degree is also related to the confidence, that is, according to the requirements of different standard data determined by the confidence, it is determined whether the feature data meets the requirements of the standard data and the matching degree is determined. In other words, for different users, the calculation of the corresponding matching degree is also different. The formula for calculating the matching degree is consistent, but the calculated matching degree can be further corrected according to the confidence level to obtain the final matching degree that matches the user.

[0088] Furthermore, after determining the degree of match, the evaluation sub-score corresponding to each data group can be determined based on the degree of match. The evaluation sub-score is the score corresponding to whether the data in the corresponding data group meets the requirements of the standard data, that is, the score obtained according to the requirements of the model evaluation system.

[0089] In a specific embodiment, a prediction analysis is performed for each combined feature to obtain a prediction value corresponding to the combined feature; the prediction value here refers to the prediction value corresponding to feature extraction or result evaluation, and then the prediction residual value is calculated based on the combined feature and the prediction value, and the prediction residual value indicates the loss value between the combined feature and the prediction value. Then, according to a preset entropy function, the negative entropy corresponding to the prediction residual value is calculated, and further, the contribution value corresponding to the combined feature is calculated based on the calculated negative entropy; the contribution value here refers to the degree of influence of the combined feature on the result.

[0090] The similarity between the standard data and the combined data is calculated, and the matching degree between the standard data and the feature data is calculated based on the contribution value and similarity of the combined feature. Here, the contribution value can correct the similarity to obtain the final matching degree.

[0091] Different data groups have different first weight coefficients. Based on the third weight coefficients corresponding to different data groups and the corresponding calculated evaluation sub-scores, the first evaluation score corresponding to the data to be evaluated can be further calculated according to a preset formula. The first evaluation score is the evaluation score automatically calculated by the model evaluation system based on the data to be evaluated input by the user, and the user evaluates whether the data to be evaluated input by the user meets the corresponding requirements.

[0092] Step S103: when the first evaluation score meets a preset first evaluation threshold, starting a prototype evaluation process corresponding to the metrology equipment to be evaluated.

[0093] In this embodiment, only when the first evaluation score meets the preset first evaluation threshold value, will the subsequent other evaluation processes be entered. This is to screen the type evaluation through the system to reduce the labor cost of the subsequent process to improve efficiency. For example, it is determined whether the first evaluation score is greater than or equal to the preset first evaluation threshold value. If so, it means that the currently submitted data to be evaluated meets the requirements of the type evaluation system, and the subsequent evaluation process can be carried out; if not, it means that the currently submitted data to be evaluated does not meet the requirements of the type evaluation system, and it is directly returned to the user for resubmission.

[0094] When the first evaluation score meets the preset first evaluation threshold, the process of obtaining the second evaluation score is started. In this embodiment, the second evaluation score is obtained based on the evaluation score obtained by performing a sample evaluation on the metrological device to be evaluated. That is to say, when the first evaluation score meets the preset first evaluation threshold, the prototype evaluation process corresponding to the metrological device to be evaluated is started, wherein the prototype evaluation process includes at least one evaluation sub-process, and each evaluation sub-process corresponds to an evaluation sub-laboratory, which tests the prototype of the metrological device to be evaluated, provides corresponding test data, and then evaluates whether the prototype meets the requirements of the evaluation sub-process based on the test data.

[0095] Step S104: Acquire the device information of the measuring device to be evaluated through the connected scanning device.

[0096] In each evaluation sub-process, in order to accurately correspond to the equipment information of the prototype, it is necessary to use a scanning device connected to the type evaluation system to scan the information set on the measuring equipment to be evaluated (for example, a QR code) to obtain the equipment information of the prototype of the measuring equipment to be evaluated, so that the test data can accurately correspond to the measuring equipment to be evaluated.

[0097] Step S105: In each evaluation sub-process, obtain the test data provided by the corresponding evaluation sub-laboratory, wherein the test data is the data provided by the evaluation sub-laboratory when testing the metrological equipment to be evaluated; determine the evaluation sub-score corresponding to the evaluation sub-process according to the test data.

[0098] Under each evaluation sub-process, after receiving the prototype of the metrological equipment to be evaluated, the staff of the corresponding evaluation sub-laboratory needs to test the prototype of the metrological equipment to be evaluated according to the corresponding process and standards, and input the corresponding data into the type evaluation system as the test data under the evaluation sub-process. Then, it can be determined whether the metrological equipment to be evaluated has passed the evaluation under the evaluation sub-process based on the corresponding test data.

[0099] It should be noted that, in this embodiment, after obtaining the test data, it is first necessary to judge whether the test data meets the preset requirements. If not, it means that the metering equipment to be evaluated may not have passed the corresponding evaluation sub-process; in this case, it is necessary to trigger a manual inspection process to judge whether the metering equipment to be evaluated has passed the evaluation sub-process. Specifically, the test data is manually judged whether it meets the preset requirements, and the manual judgment result is determined and input into the type evaluation system. If the manual judgment result is not satisfied, it means that the evaluation sub-process has not passed, and the evaluation sub-score corresponding to the evaluation sub-process is set to 0; if the manual judgment result is satisfied, it means that the current evaluation sub-process can enter the next process to continue further judgment on whether it passes the evaluation, and specifically execute the step of determining the evaluation sub-score corresponding to the evaluation sub-process according to the test data.

[0100] According to the test data, the evaluation sub-score of the metering equipment to be evaluated under the evaluation sub-process needs to be further determined, which can be obtained through a neural network model.

[0101] In other embodiments, the evaluation sub-score of the metering equipment to be evaluated in the evaluation sub-process may also be calculated through the following process.

[0102] First, the test data is divided into first test data and second test data; wherein the first test data is basic data, for example, basic information of the equipment, and the second test data is test data for testing the metering equipment to be evaluated. Then, the vector features of the first experimental data are obtained, and the vector features contain multiple features at multiple scales, the number of features is N, and the multiple scales are determined according to the corresponding evaluation sub-process. Then, the first feature subset of the vector features is obtained, for example, repeated data is screened, or some features are obtained from it according to a preset rule as the first feature subset, which can reduce the amount of data for subsequent data processing and reduce the amount of calculation. Moreover, the comprehensiveness of the first feature subset can be guaranteed by the screening criteria here to ensure the accuracy of data processing. Then, the multiple features contained in the vector features are fused to obtain the first feature after fusion.

[0103] In a specific implementation, the vector feature is input into a preset feature fusion model, the number of layers of the feature fusion model is the same as the number of features contained in the vector feature; at the i-th layer, the i-th feature is fused with other features, wherein the fusion process is performed according to the coefficient corresponding to the i-th feature, i=1,...,N, N is the number of layers of the feature fusion model; the fused features obtained at each layer are spliced ​​according to the coefficient to obtain the first feature. At the i-th layer, the i-th feature is used as the main feature, and the weight of the main feature is the coefficient calculated according to the i-th feature, and then the weights of other features are determined according to the determined coefficient, and then the N features are fused according to the determined weights to obtain the fused features of each layer respectively.

[0104] Then, for each layer of fused features, further splicing processing is required. The splicing processing here is not a simple splicing processing, but a splicing processing based on the coefficients corresponding to the main features of each layer. The larger the coefficient value, the higher the proportion of the corresponding fused feature in the first feature after splicing.

[0105] For the second test data, it is necessary to extract the time domain features and frequency domain features of the second test data according to a preset transformation method. In order to avoid excessive data processing volume, it is necessary to sample the acquired time domain features and frequency domain features according to a preset sampling interval to obtain a second feature subset. The sampling interval can be obtained based on the second test data, and the second test data is input into a preset sampling interval model to obtain the corresponding sampling interval, wherein the sampling interval can be determined based on parameters such as data integrity, data volume, and data continuity of the second test data, thereby ensuring that the data after sampling can characterize the characteristics of the second test data as comprehensively as possible.

[0106] Then, because the first feature represents the basic information of the measuring equipment to be evaluated and part of the basic information in the test data, here, for the processing of the second feature subset, it is necessary to process the first feature. Specifically, the second feature itself is feature processed according to the first feature to obtain the second feature. Among them, the feature processing here can be to determine at least two key features in the second feature subset according to the first feature, and then fuse the determined key features to obtain the second feature; so as to obtain a feature that can better characterize the second test data.

[0107] Further, according to the preset evaluation score calculation method, the evaluation score of the first feature and the evaluation score of the second feature are calculated, and the evaluation sub-score corresponding to the evaluation sub-process is calculated. The evaluation score of the first feature and the evaluation score of the second feature can be calculated by a preset evaluation score calculation model, wherein the model can be a deep learning model or any other model, which is not limited here. Further, the final evaluation sub-score is determined by the evaluation score of the first feature and the evaluation score of the second feature.

[0108] Step S106: Determine the first weight coefficient corresponding to each evaluation sub-process, and calibrate the first weight coefficient according to the evaluation sub-score to obtain the calibrated first weight coefficient.

[0109] Different evaluation sub-processes have different degrees of influence on the final result. Therefore, each evaluation sub-process corresponds to a weight coefficient (first weight coefficient). This weight coefficient is determined and is determined by the importance of the evaluation sub-process in the entire evaluation process. Then, for each evaluation sub-process, if the evaluation sub-score corresponding to a certain evaluation sub-process is too low, its proportion in the entire evaluation process needs to be increased to avoid the poor result of a certain evaluation sub-process being hidden by other results. Specifically, the first weight coefficient is corrected according to the evaluation sub-score, wherein, when the evaluation sub-score is too low (for example, when the evaluation sub-score is lower than the preset value), the correction function or correction coefficient corresponding to the evaluation sub-score is determined, and then the first weight coefficient is corrected based on the correction function and the correction coefficient, and the first weight coefficient after correction is greater than the first weight coefficient before correction.

[0110] Specifically, in one embodiment, if the evaluation sub-score is less than a preset value, a correction function corresponding to the evaluation sub-score is determined, wherein the score of the evaluation sub-score corresponds to the correction function; the first weight coefficient is corrected according to the correction function to obtain the first weight coefficient after correction; wherein the first weight coefficient after correction is greater than the first weight coefficient before correction.

[0111] Step S107: Determine the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score.

[0112] After obtaining the evaluation sub-score of each evaluation sub-process, the corresponding second evaluation score can be calculated, wherein the second evaluation score is calculated according to the corrected first weight coefficient and the evaluation sub-score corresponding to each evaluation sub-process according to a preset second evaluation score calculation function.

[0113] Step S108: Determine a second weight coefficient, calculate a target evaluation score according to the second weight coefficient and the first evaluation score and the second evaluation score; and output an evaluation result corresponding to the target evaluation score.

[0114] The first evaluation score and the second evaluation score obtained by the model evaluation system respectively correspond to the contribution values ​​corresponding to the final target evaluation score, and thus correspond to the corresponding second weight coefficient. Then, according to the determined second weight coefficient and the first evaluation score and the second evaluation score, the corresponding target evaluation score is calculated and output according to the preset calculation formula.

[0115] Furthermore, in one embodiment, both the first evaluation score and the second evaluation score include multiple evaluation sub-scores; in the process of calculating the target evaluation score, it is necessary to further perform cross-fusion processing on the multiple evaluation sub-scores included in the first evaluation score to obtain the first target score after the cross-fusion processing; and, perform cross-fusion processing on the multiple evaluation sub-scores included in the second evaluation score to obtain the second target score after the cross-fusion processing. Then, the first target score and the second target score are cross-fused according to the second weight coefficient to obtain the target evaluation score.

[0116] In another embodiment, the calculation of each evaluation score may also be performed based on a preset model, and does not conflict with the aforementioned calculation process, except that the implementation process may be based on the model.

[0117] Specifically, when calculating the first evaluation score, firstly, for each data group, an evaluation sub-model corresponding to each data group is constructed to output the evaluation sub-score corresponding to each data group; then, according to the first weight coefficient and the preset superposition algorithm, the sub-model corresponding to each data group is superimposed to construct the first evaluation model; and based on the first evaluation model, the evaluation sub-score corresponding to each data group is used as input to obtain the first evaluation score. In addition, the second evaluation score can also be obtained based on the preset second evaluation model.

[0118] Furthermore, when calculating the target evaluation score, the first evaluation model and the second evaluation model are superimposed on each other according to a preset superposition algorithm based on the second weight coefficient to construct a target evaluation model; the first evaluation score and the second evaluation score are used as input, and the target evaluation score is calculated according to the target evaluation model.

[0119] In another embodiment, a prototype evaluation device for a metrological device based on a type evaluation system is also provided. Figure 2 As shown, the device comprises:

[0120] The data acquisition module 101 is used to acquire the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measurement equipment to be evaluated of the user to be evaluated meets the measurement standard;

[0121] A first evaluation module 102, used to determine a first evaluation score output by the model evaluation system corresponding to the data to be evaluated;

[0122] A second evaluation starting module 103, configured to start a prototype evaluation process corresponding to the metrological device to be evaluated when the first evaluation score meets a preset first evaluation threshold, wherein the prototype evaluation process includes at least one evaluation sub-process;

[0123] The equipment confirmation module 104 is used to obtain the equipment information of the measuring equipment to be evaluated through the connected scanning device;

[0124] The second evaluation module 105 is used to obtain the test data provided by the corresponding evaluation sub-laboratory in each evaluation sub-process, wherein the test data is the data provided by the evaluation sub-laboratory for testing the metrological equipment to be evaluated; determine the evaluation sub-score corresponding to the evaluation sub-process according to the test data; determine the first weight coefficient corresponding to each evaluation sub-process, and correct the first weight coefficient according to the evaluation sub-score to obtain the corrected first weight coefficient; determine the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score;

[0125] The third evaluation module 106 is used to determine the second weight coefficient, calculate the target evaluation score according to the second weight coefficient and the first evaluation score and the second evaluation score; and output the evaluation result corresponding to the target evaluation score.

[0126] After adopting the above-mentioned metrological equipment prototype evaluation method, device, computer equipment and computer-readable storage medium based on the type evaluation system, when it is necessary to perform type evaluation on the metrological equipment, obtain the data to be evaluated input by the user through the type evaluation system, and the data to be evaluated is the inspection data of whether the metrological equipment to be evaluated by the user to be evaluated meets the metrological standard; determine the first evaluation score output by the type evaluation system and corresponding to the data to be evaluated, and when the first evaluation score meets the preset first evaluation threshold, start the prototype evaluation process corresponding to the metrological equipment to be evaluated, and the prototype evaluation process includes at least one evaluation sub-process; obtain the equipment information of the metrological equipment to be evaluated through the connected scanning device; in each In each evaluation sub-process, the test data given by the corresponding evaluation sub-laboratory is obtained, and the test data is the data given by the evaluation sub-laboratory for testing the metrological equipment to be evaluated; the evaluation sub-score corresponding to the evaluation sub-process is determined according to the test data; the first weight coefficient corresponding to each evaluation sub-process is determined, and the first weight coefficient is corrected according to the evaluation sub-score to obtain the corrected first weight coefficient; according to the corrected first weight coefficient and the evaluation sub-score, the second evaluation score corresponding to the prototype evaluation process is determined; the second weight coefficient is determined, and the target evaluation score is calculated according to the second weight coefficient and the first evaluation score and the second evaluation score; and the evaluation result corresponding to the target evaluation score is output. In other words, whether it is the automatic evaluation of system data or the evaluation of prototype test, it can be comprehensively considered in the evaluation of metrological equipment, and a comprehensive evaluation result is given, which improves the accuracy and convenience of the model evaluation system. Moreover, in the embodiment of the present invention, for each sub-process of the prototype evaluation, each sub-process can be accurately evaluated through data evaluation, coefficient correction, feature extraction, etc., so as to accurately evaluate the prototype arrangement, further improving the accuracy of the model evaluation system in evaluating the metrological equipment.

[0127] Figure 3 The internal structure diagram of a computer device for implementing the above-mentioned method for evaluating a prototype of a metering device based on a type evaluation system in one embodiment is shown. The computer device may be a terminal or a server. Figure 3 As shown, the computer device includes a processor, a memory and a network interface connected via a system bus. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program. When the computer program is executed by the processor, the processor can implement the above method. The internal memory may also store a computer program. When the computer program is executed by the processor, the processor can implement the above method. Those skilled in the art can understand that Figure 3The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0128] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0129] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0130] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims. Please enter the specific implementation content part.

Claims

1. A method for evaluating a prototype of a metrological equipment based on a type evaluation system, characterized in that: The method comprises: Acquire the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measuring equipment to be evaluated of the user to be evaluated meets the measurement standard; Determine a first evaluation score output by the model evaluation system and corresponding to the data to be evaluated, and when the first evaluation score meets a preset first evaluation threshold, start a prototype evaluation process corresponding to the metrological device to be evaluated, wherein the prototype evaluation process includes at least one evaluation subprocess; Acquire the equipment information of the measuring equipment to be evaluated through the connected scanning device; In each evaluation sub-process, the test data provided by the corresponding evaluation sub-laboratory is obtained, wherein the test data is the data provided by the evaluation sub-laboratory when testing the metrological equipment to be evaluated; and the evaluation sub-score corresponding to the evaluation sub-process is determined according to the test data; Determine a first weight coefficient corresponding to each evaluation sub-process, and correct the first weight coefficient according to the evaluation sub-score to obtain a corrected first weight coefficient; Determine a second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score; Determine a second weight coefficient, calculate a target evaluation score based on the second weight coefficient and the first evaluation score and the second evaluation score; and output an evaluation result corresponding to the target evaluation score.

2. The method according to claim 1, characterized in that The step of determining the evaluation sub-score corresponding to the evaluation sub-process according to the test data also includes: dividing the test data into first test data and second test data; Obtaining vector features of the first test data, wherein the vector features include multiple features at multiple scales, and obtaining a first feature subset of the vector features; fusing the multiple features included in the vector features to obtain a first feature after fusion; wherein the vector features are input into a preset feature fusion model, and the number of layers of the feature fusion model is the same as the number of features included in the vector features; at the i-th layer, fusing the i-th feature with other features, wherein the fusion process is performed based on a coefficient corresponding to the i-th feature, i=1,...,N, where N is the number of layers of the feature fusion model; splicing the fused features obtained at each layer based on the coefficients to obtain the first feature; Acquire the time domain features and frequency domain features of the second test data; sample the acquired time domain features and frequency domain features according to a preset sampling interval to acquire a second feature subset; Performing feature processing on the second feature subset according to the first feature to obtain a second feature; wherein at least two key features in the second feature subset are determined according to the first feature, and the determined key features are fused to obtain the second feature; The evaluation score of the first feature and the evaluation score of the second feature are obtained respectively, and the evaluation sub-score corresponding to the evaluation sub-process is calculated.

3. The method according to claim 1, characterized in that: The step of correcting the first weight coefficient according to the evaluation sub-score to obtain the corrected first weight coefficient also includes: If the evaluation sub-score is less than a preset value, determining a correction function corresponding to the evaluation sub-score, wherein the score of the evaluation sub-score corresponds to the correction function; Correcting the first weight coefficient according to the correction function to obtain the corrected first weight coefficient; wherein the corrected first weight coefficient is greater than the first weight coefficient before the correction; The step of determining the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score also includes: According to a preset second evaluation score calculation function, the second evaluation score is calculated by taking the corrected first weight coefficient and the evaluation sub-score as input.

4. The method according to claim 1, characterized in that: In each evaluation sub-process, after the step of obtaining the test data provided by the corresponding evaluation sub-laboratory, wherein the test data is the data provided by the evaluation sub-laboratory after testing the metrological equipment to be evaluated, the process further includes: Determine whether the test data meets the preset requirements. If not, trigger the manual inspection process; Obtain a manual judgment result on whether the manually input test data meets the preset requirements. If the manual judgment result is not satisfied, set the evaluation sub-score corresponding to the evaluation sub-process to 0; if the manual judgment result is satisfied, execute the step of determining the evaluation sub-score corresponding to the evaluation sub-process based on the test data.

5. The method according to claim 1, characterized in that The step of determining the first evaluation score output by the model evaluation system and corresponding to the data to be evaluated further includes: Group the data to be evaluated; For each data group, extract at least one feature data corresponding to the data to be evaluated in each data group; Determine the standard data corresponding to each data group and the first weight coefficient corresponding to each data group, and under each data group, calculate the matching degree between the standard data and the characteristic data, wherein the matching degree is used to identify whether the characteristic data meets the requirements of the standard data; determine the evaluation sub-score corresponding to each data group according to the matching degree; According to the first weight coefficient and the evaluation sub-score corresponding to each data group, the first evaluation score corresponding to the data to be evaluated is calculated.

6. The method according to claim 5, characterized in that The step of grouping the data to be evaluated further includes: Performing a first grouping process on the data to be evaluated to obtain a plurality of first data groups, wherein the data to be evaluated in the plurality of first data groups obtained by the first grouping process do not overlap; Using a first data processing algorithm, performing a first screening operation on the data to be evaluated in each first data group according to the importance value; performing a second grouping process on the data to be evaluated in the first data group after the first screening, so as to obtain a plurality of second data groups under each first data group, wherein the data to be evaluated in the plurality of second data groups obtained by the second grouping process overlap; Performing a second screening operation on the data to be evaluated in the second data group according to the data characteristic value; The step of performing a second grouping process on the data to be evaluated in the first data group after the first screening to obtain a plurality of second data groups under each first data group further includes: Performing a combination operation on the plurality of pieces of data to be evaluated in the first data group after the first screening, wherein each combined data packet obtained by the combination operation contains one or more pieces of data to be evaluated; Performing a second grouping process on the combined data under the first data group to obtain a plurality of second data groups; The step of performing a second screening operation on the data to be evaluated in the second data group according to the data characteristic value also includes: The combined features corresponding to each combined data are calculated as data feature values, and a second screening operation is performed on the combined data in the second data group according to the data feature values.

7. The method according to claim 1, characterized in that The step of calculating the matching degree between the standard data and the characteristic data in each data group further includes: Perform prediction analysis on each combined feature to obtain the predicted value corresponding to the combined feature; calculate the predicted residual value based on the combined feature and the predicted value; Calculate the negative entropy corresponding to the predicted residual value, and calculate the contribution value corresponding to the combined feature based on the calculated negative entropy; The similarity between the standard data and the combined data is calculated, and the matching degree between the standard data and the feature data is calculated based on the contribution value and similarity of the combined features.

8. A prototype evaluation device for measuring equipment based on a type evaluation system, characterized in that: The device comprises: A data acquisition module is used to acquire the data to be evaluated input by the user through the type evaluation system, wherein the data to be evaluated is the inspection data of whether the measurement equipment to be evaluated of the user to be evaluated meets the measurement standard; A first evaluation module, used to determine a first evaluation score output by the model evaluation system and corresponding to the data to be evaluated; A second evaluation starting module, used to start a prototype evaluation process corresponding to the metrological equipment to be evaluated when the first evaluation score meets a preset first evaluation threshold, wherein the prototype evaluation process includes at least one evaluation sub-process; The equipment confirmation module is used to obtain the equipment information of the metering equipment to be evaluated through the connected scanning device; The second evaluation module is used to obtain the test data given by the corresponding evaluation sub-laboratory in each evaluation sub-process, wherein the test data is the data given by the evaluation sub-laboratory when testing the metrological equipment to be evaluated; determine the evaluation sub-score corresponding to the evaluation sub-process according to the test data; determine the first weight coefficient corresponding to each evaluation sub-process, and correct the first weight coefficient according to the evaluation sub-score to obtain the corrected first weight coefficient; determine the second evaluation score corresponding to the prototype evaluation process according to the corrected first weight coefficient and the evaluation sub-score; The third evaluation module is used to determine the second weight coefficient, calculate the target evaluation score according to the second weight coefficient and the first evaluation score and the second evaluation score; and output the evaluation result corresponding to the target evaluation score.

9. A computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, wherein the computer program is used to execute the metrology equipment prototype evaluation method based on the type evaluation system according to any one of claims 1 to 7.

10. A computer device, characterized in that: The computer device includes a memory and a processor, the memory has executable code, and when the executable code is run on the processor, the method for evaluating a prototype of a metrological device based on a type evaluation system as described in any one of claims 1 to 7 is implemented.