Consistency test method and device for scoring matrix

Abstract

The present invention provides a consistency check method and device for a scoring matrix. It is used to improve the efficiency of consistency check. It includes: after receiving the scoring matrix sent by the user, using a first preset algorithm to determine whether the scoring matrix passes the consistency check; if the scoring matrix does not pass the consistency check, dividing the scoring matrix and the intermediate matrix to obtain a disturbance matrix, wherein each element in the intermediate matrix is ​​obtained based on each element in the scoring matrix; performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value; determining the Hadamard product between the first matrix and the intermediate matrix as a second matrix, and after determining the second matrix as the scoring matrix, returning to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check, until the scoring matrix passes the consistency check.

Description

Background Art

[0002] With the continuous development of society, sensing devices are an indispensable part of urban digitalization and intelligence. Since most of these devices are installed in windy and sunny environments, it is necessary to monitor and evaluate the quality of these sensing devices in a timely manner. Due to the large number of these devices, it is unrealistic to use manpower to check them. Therefore, it is necessary to use big data technology to build a set of sensing device quality scoring models to monitor the quality of these sensing devices in a timely manner.

[0003] The perceptual device quality scoring model is usually designed as a tree-like hierarchical structure. Each node of each layer of the tree represents an indicator, and all its child nodes constitute the sub-indicators of the indicator. How to correctly assign weights to these sub-indicators is the key to the successful implementation of the scoring model. The hierarchical analysis method requires experts to score the importance of these sub-indicators and obtain a scoring matrix about the relative importance of these sub-indicators. Before using the scoring matrix to calculate the weights of the sub-indicators, it must be ensured that the scoring matrix can pass the consistency test.

[0004] In the prior art, if the scoring matrix fails the consistency check, experts are required to re-score the importance of these sub-indicators and then perform the consistency check again until the scoring matrix passes the consistency check. However, this method requires experts to manually score the importance of the sub-indicators multiple times, which results in a low efficiency of the scoring matrix consistency check. Summary of the invention

[0005] In an exemplary embodiment of the present invention, a method and apparatus for checking consistency of a scoring matrix are provided to improve the efficiency of checking consistency of a scoring matrix.

[0006] A first aspect of the present invention provides a method for checking consistency of a scoring matrix, the method comprising:

[0007] After receiving the scoring matrix sent by the user, using a first preset algorithm to determine whether the scoring matrix passes the consistency check, wherein the consistency check is based on the scoring matrix to check whether the scores of various indicators of the sensing device are consistent;

[0008] If it is determined that the scoring matrix fails the consistency check, the scoring matrix and the intermediate matrix are divided to obtain a perturbation matrix, wherein each element in the intermediate matrix is ​​obtained based on each element in the scoring matrix;

[0009] Performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and the number of columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value;

[0010] After determining the Hadamard product between the first matrix and the intermediate matrix as the second matrix and determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

[0011] In this embodiment, when the scoring matrix fails the consistency check, the scoring matrix and the intermediate matrix are divided to obtain a perturbation matrix, and the perturbation matrix and the zero perturbation matrix are weighted and summed to obtain the first matrix, and the Hadamard product between the first matrix and the intermediate matrix is ​​determined as the second matrix, and after the second matrix is ​​determined as the scoring matrix, the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check is returned until the scoring matrix passes the consistency check. Therefore, in this embodiment, when the scoring matrix fails the consistency check, it is not necessary for the expert to re-score each indicator to obtain a new scoring matrix, but the scoring matrix is ​​automatically adjusted to obtain a new scoring matrix, thereby improving the efficiency of the consistency check of the scoring matrix.

[0012] In one embodiment, the method further comprises:

[0013] If it is determined that the scoring matrix passes the consistency check, the scoring matrix is ​​input into a quality scoring model to determine the weight of each indicator of the sensing device based on the scoring matrix; and,

[0014] For any sensing device, determine the score of each indicator of the sensing device according to the historical sensing data of the sensing device, and obtain the total quality evaluation score of the sensing device through the score of each indicator and the weight of each indicator; and

[0015] The quality of the sensing device is determined using the total quality evaluation score.

[0016] In this embodiment, when the scoring matrix passes the consistency check, the scoring matrix is ​​input into the quality scoring model to determine the quality of the perception device, thereby improving the accuracy of determining the quality of the perception device.

[0017] In one embodiment, the step of using a first preset algorithm to determine whether the scoring matrix passes the consistency check includes:

[0018] After determining the target eigenvalue corresponding to the scoring matrix by using a first preset algorithm, obtaining a consistency index value based on the target eigenvalue and the order of the scoring matrix;

[0019] Dividing the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices;

[0020] If the consistency ratio index value is less than a preset threshold, it is determined that the scoring matrix passes the consistency test;

[0021] If the consistency ratio index is not less than the preset threshold, it is determined that the scoring matrix fails the consistency test.

[0022] In this embodiment, a consistency ratio index value is determined based on the scoring matrix, and then the consistency ratio index value is compared with a preset threshold value to determine whether the scoring matrix passes the consistency test, thereby improving the accuracy of the consistency test.

[0023] In one embodiment, the intermediate matrix is ​​obtained by:

[0024] For any element in the scoring matrix, divide the element by each element in the scoring matrix to obtain each intermediate matrix element;

[0025] For any intermediate matrix element, the position of the element in the target element that serves as a divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element that serves as a dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element, to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element;

[0026] The intermediate matrix is ​​determined according to the intermediate matrix elements and the target positions of the intermediate matrix elements.

[0027] In this embodiment, a new intermediate matrix is ​​constructed based on the scoring matrix, so that the intermediate matrix retains the characteristics of the original scoring matrix.

[0028] In one embodiment, performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix includes:

[0029] The first matrix is ​​determined by the following formula:

[0030] D k′ =λD k +(A-λ)DI;

[0031] Among them, D k′ is the first matrix, λ is the preset weight, D kis the disturbance matrix, DI is the zero disturbance matrix, and A is the set value.

[0032] A second aspect of the present invention provides a consistency check device for a scoring matrix, the device comprising:

[0033] A consistency check module, configured to determine whether the scoring matrix has passed the consistency check by using a first preset algorithm after receiving the scoring matrix sent by the user, wherein the consistency check is based on the scoring matrix to check whether the scores of various indicators of the sensing device are consistent;

[0034] a perturbation matrix determination module, configured to divide the scoring matrix and the intermediate matrix to obtain a perturbation matrix if it is determined that the scoring matrix fails the consistency check, wherein each element in the intermediate matrix is ​​obtained based on each element in the scoring matrix;

[0035] A first matrix determination module, used for performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value;

[0036] The second matrix determination module is used to determine the Hadamard product between the first matrix and the intermediate matrix as the second matrix, and after determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

[0037] In one embodiment, the apparatus further comprises:

[0038] an indicator weight determination module, configured to input the scoring matrix into a quality scoring model if it is determined that the scoring matrix passes the consistency check, so as to determine the weight of each indicator of the perception device based on the scoring matrix; and

[0039] A total quality evaluation score determination module is used to determine the score of each indicator of any perception device according to the historical perception data of the perception device, and obtain the total quality evaluation score of the perception device through the score of each indicator and the weight of each indicator; and

[0040] The quality determination module is used to determine the quality of the sensing device using the total quality evaluation score.

[0041] In one embodiment, the consistency checking module is specifically configured as follows:

[0042] After determining the target eigenvalue corresponding to the scoring matrix by using a first preset algorithm, obtaining a consistency index value based on the target eigenvalue and the order of the scoring matrix;

[0043] Dividing the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices;

[0044] If the consistency ratio index value is less than a preset threshold, it is determined that the scoring matrix passes the consistency test;

[0045] If the consistency ratio index is not less than the preset threshold, it is determined that the scoring matrix fails the consistency test.

[0046] In one embodiment, the apparatus further comprises:

[0047] The intermediate matrix determination module is used to obtain the intermediate matrix in the following manner:

[0048] For any element in the scoring matrix, divide the element by each element in the scoring matrix to obtain each intermediate matrix element;

[0049] For any intermediate matrix element, the position of the element in the target element that serves as a divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element that serves as a dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element, to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element;

[0050] The intermediate matrix is ​​determined according to the intermediate matrix elements and the target positions of the intermediate matrix elements.

[0051] In one embodiment, the first matrix determination module is specifically used to:

[0052] The first matrix is ​​determined by the following formula:

[0053] D k′ =λD k +(A-λ)DI;

[0054] Among them, D k′ is the first matrix, λ is the preset weight, D k is the disturbance matrix, DI is the zero disturbance matrix, and A is the set value.

[0055] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, including:

[0056] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executed by the at least one processor; the instructions are executed by the at least one processor so that the at least one processor can execute the method as described in the first aspect.

[0057] According to a fourth aspect provided by an embodiment of the present invention, a computer storage medium is provided, wherein the computer storage medium stores a computer program, and the computer program is used to execute the method as described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0059] Figure 1 A schematic diagram of an applicable scenario according to an embodiment of the present invention;

[0060] Figure 2 This is one of the flow charts of a method for checking consistency of a scoring matrix according to an embodiment of the present invention;

[0061] Figure 3 This is a second flow chart of a method for checking consistency of a scoring matrix according to an embodiment of the present invention;

[0062] Figure 4 A consistency checking device for a scoring matrix according to an embodiment of the present invention;

[0063] Figure 5 FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] In the embodiments of the present invention, the term "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0066] The application scenarios described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. It is known to those skilled in the art that with the emergence of new application scenarios, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0067] In the prior art, if the scoring matrix fails the consistency check, experts are required to re-score the importance of these sub-indicators and then perform the consistency check again until the scoring matrix passes the consistency check. However, this method requires experts to manually score the importance of the sub-indicators multiple times, which results in a low efficiency of the scoring matrix consistency check.

[0068] Therefore, the present invention provides a consistency test method for a scoring matrix. When the scoring matrix fails the consistency test, the scoring matrix and the intermediate matrix are divided to obtain a perturbation matrix, and the perturbation matrix and the zero perturbation matrix are weighted and summed to obtain a first matrix. The Hadamard product between the first matrix and the intermediate matrix is ​​determined as a second matrix, and after the second matrix is ​​determined as the scoring matrix, the step of using a preset algorithm to determine whether the scoring matrix passes the consistency test is returned until the scoring matrix passes the consistency test. Therefore, in this embodiment, when the scoring matrix fails the consistency test, it is not necessary for the expert to re-score each indicator to obtain a new scoring matrix, but the scoring matrix is ​​automatically adjusted to obtain a new scoring matrix, thereby improving the efficiency of the consistency test of the scoring matrix. Below, the scheme of the present invention is described in detail in conjunction with the accompanying drawings.

[0069] like Figure 1 FIG. 1 is a flow chart of a consistency check method for a scoring matrix of the present invention, which may include the following steps:

[0070] Step 101: after receiving the rating matrix sent by the user, using a first preset algorithm to determine whether the rating matrix passes a consistency check, wherein the consistency check is based on the rating matrix to check whether the ratings of various indicators of the sensing device are consistent;

[0071] Step 102: If it is determined that the scoring matrix fails the consistency check, the scoring matrix and the intermediate matrix are divided to obtain a disturbance matrix, wherein each element in the intermediate matrix is ​​obtained based on each element in the scoring matrix;

[0072] It should be noted that dividing the score matrix and the intermediate matrix means dividing the score matrix and each element in the same position in the intermediate matrix respectively to obtain a disturbance matrix.

[0073] In one embodiment, the intermediate matrix is ​​obtained in the following manner: for any element in the scoring matrix, the element is divided by each element in the scoring matrix to obtain each intermediate matrix element; for any intermediate matrix element, the position of the element in the target element as the divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element as the dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element; the intermediate matrix is ​​determined according to each intermediate matrix element and the target position of each intermediate matrix element.

[0074] For example, if the rating matrix is ​​[A, B], the intermediate matrix elements are

[0075] Among them, the intermediate matrix elements The corresponding target elements are A and A, where A is the divisor, A is the dividend, and A is the first position, A is the first position, then determine the intermediate matrix element The position in the intermediate matrix is ​​row 1, column 1.

[0076] Intermediate Matrix Elements The corresponding target elements are A and B, where A is the divisor and B is the dividend, and A is the first and B is the second, then determine the intermediate matrix element The position in the intermediate matrix is ​​row 1, column 2.

[0077] Intermediate Matrix Elements The corresponding target elements are B and A, where B is the divisor and A is the dividend, and A is the first and B is the second, then determine the intermediate matrix element The position in the middle matrix is ​​row 2, column 1.

[0078] Intermediate Matrix Elements The corresponding target elements are B and B, where B is the divisor and dividend, and B is the second position, then determine the intermediate matrix element The position in the middle matrix is ​​row 2, column 2.

[0079] Based on the above-obtained intermediate matrix elements and the positions of the intermediate matrix elements, the intermediate matrix is ​​obtained as follows:

[0080] It should be noted that the position of an element in the scoring matrix is ​​the sorting number of the element in the scoring matrix, and the sorting number is determined in order from left to right and from top to bottom.

[0081] For example, if the scoring matrix is ​​[ABC], the position of element A in the scoring matrix is ​​1. The position of element B in the scoring matrix is ​​2, and the position of element C in the scoring matrix is ​​3.

[0082] If the rating matrix is Then element A is at position 1 in the scoring matrix, element B is at position 2 in the scoring matrix, element C is at position 3 in the scoring matrix, and element D is at position 4 in the scoring matrix.

[0083] Step 103: performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value;

[0084] In one embodiment, the first matrix can be obtained by formula (1):

[0085] D k′ =λD k +(A-λ)DI……(1);

[0086] Among them, D k′ is the first matrix, λ is the preset weight, D k is the disturbance matrix, DI is the zero disturbance matrix, and A is a set value, for example, A is 1.

[0087] Step 104: After determining the Hadamard product between the first matrix and the intermediate matrix as the second matrix and determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

[0088] In one embodiment, the second matrix can be obtained by formula (2):

[0089]

[0090] Among them, A k1is the second matrix, D k′ is the first matrix, W k is the intermediate matrix.

[0091] For example, The second matrix obtained is

[0092] In one embodiment, Figure 2 As shown in FIG. 1 , a flowchart for determining whether a scoring matrix passes a consistency check may include the following steps:

[0093] Step 201: after determining the target eigenvalue corresponding to the scoring matrix using a first preset algorithm, obtain a consistency index value based on the target eigenvalue and the order of the scoring matrix;

[0094] In one embodiment, the target feature value is determined by:

[0095] Normalize each element in the scoring matrix to obtain a normalized scoring matrix; add each row element in the normalized scoring matrix to obtain a first submatrix, add each element in the first submatrix to obtain a first parameter; divide each element in the first submatrix by the first parameter to obtain a eigenvector; multiply the scoring matrix by the eigenvector to obtain a second submatrix, divide each element in the second submatrix by the target element at the same position in the eigenvector to obtain a third submatrix, and determine the average value of each element in the third submatrix as the target eigenvalue.

[0096] For example, the rating matrix is Then the score matrix is ​​normalized, and the normalized score matrix is ​​obtained as The elements of each row in the normalized score matrix are added together to obtain the first submatrix: Then, each element in the first submatrix is ​​added to obtain a first parameter of 2, and then each element in the first submatrix is ​​divided by the first parameter to obtain a eigenvector Multiply the score matrix by the feature vector to obtain the second sub-matrix Divide each element in the second submatrix by the target element in the same position in the eigenvector, and the third submatrix is ​​obtained: An average value of each element in the third submatrix is ​​determined as the target eigenvalue.

[0097] In one embodiment, the consistency index value can be determined by formula (3):

[0098]

[0099] Among them, CI A is the consistency index value, ρ A is the target eigenvalue corresponding to the scoring matrix A, and n is the order of the scoring matrix.

[0100] Step 202: Divide the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices;

[0101] In one embodiment, the consistency ratio index value is obtained by formula (4):

[0102]

[0103] Among them, CR A is the consistency ratio index, CI A is the consistency index value, and RI is the random consistency index.

[0104] Step 203: Compare the consistency ratio index value with a preset threshold value to determine whether the consistency ratio index is less than the preset threshold value. If so, execute step 204; if not, execute step 205;

[0105] Among them, the preset threshold in this embodiment can be 0.1. The specific preset threshold can be set according to actual conditions. This embodiment does not limit the preset threshold.

[0106] Step 204: Determine whether the scoring matrix passes the consistency test;

[0107] Step 205: Determine whether the scoring matrix fails the consistency check.

[0108] In order to ensure the accuracy of the quality scoring model of the perception device, in one embodiment, if it is determined that the scoring matrix passes the consistency check, the scoring matrix is ​​input into the quality scoring model to determine the weights of each indicator of the perception device based on the scoring matrix; and for any perception device, the score of each indicator of the perception device is determined according to the historical perception data of the perception device, and the total quality evaluation score of the perception device is obtained through the score of each indicator and the weight of each indicator; and the quality of the perception device is determined using the total quality evaluation score.

[0109] In one embodiment, the score of each indicator and the weight of each indicator are weighted and summed to obtain the total quality evaluation score of the perception device.

[0110] The eigenvector corresponding to the scoring matrix is ​​determined by the method described above, and each element in the eigenvector is determined as the weight corresponding to each indicator.

[0111] In one embodiment, the total quality evaluation group is compared with a preset score. If the total quality evaluation score is greater than the preset score, it is determined that the quality of the perception device is qualified. If the total quality evaluation score is not greater than the preset score, it is determined that the quality of the perception device is unqualified.

[0112] It should be noted that the scores of the various indicators corresponding to the historical perception data of the perception device may be determined according to the corresponding relationship between the preset historical perception data and the scores of the various indicators.

[0113] In order to further understand the technical solution of the present invention, Figure 3 A detailed description may include the following steps:

[0114] Step 300: receiving a rating matrix sent by a user;

[0115] Step 301: Determine a target feature value corresponding to a scoring matrix using a first preset algorithm;

[0116] Step 302: Obtaining a consistency index value based on the target feature value and the order of the scoring matrix;

[0117] Step 303: Divide the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices;

[0118] Step 304: Determine whether the consistency ratio index is less than a preset threshold, if so, execute step 308, if not, execute step 305;

[0119] Step 305: Divide the score matrix and the intermediate matrix to obtain a disturbance matrix, wherein each element in the intermediate matrix is ​​obtained based on each element in the score matrix;

[0120] Step 306: performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value;

[0121] Step 307: after determining the Hadamard product between the first matrix and the intermediate matrix as the second matrix and determining the second matrix as the scoring matrix, return to step 301;

[0122] Step 308: inputting the scoring matrix into a quality scoring model to determine the weight of each indicator of the sensing device based on the scoring matrix;

[0123] Step 309: for any sensing device, determine the score of each indicator of the sensing device according to the historical sensing data of the sensing device, and obtain the total quality evaluation score of the sensing device through the score of each indicator and the weight of each indicator;

[0124] Step 310: Determine the quality of the sensing device using the total quality evaluation score.

[0125] Below, the scheme of the present invention is described in detail by taking the indicators of the accuracy of the perception device including data format validity, data value range validity, data content uniqueness, device information accuracy and device performance compliance as examples:

[0126] If the scoring matrix corresponding to each indicator is determined as The consistency of the scoring matrix A is then tested: it is determined that the consistency ratio index value of the scoring matrix A is 0.616, and the preset threshold is 0.1, so it is determined that the scoring matrix A has failed the consistency test.

[0127] Then, based on the above process, the scoring matrix A is processed to improve its consistency, and the modified scoring matrix A′ is obtained as follows:

[0128]

[0129] The consistency of the modified scoring matrix A′ is tested: the consistency ratio index of the scoring matrix A′ is calculated to be 0.098. Because the consistency ratio index at this time is less than the preset threshold, the modified scoring matrix A′ passes the consistency test.

[0130] The eigenvector corresponding to the modified scoring matrix A′ is ω=[0.4671, 0.1972, 0.2293, 0.0378, 0.0687]. The five elements of the vector ω correspond to the weights of the five indicators: data format validity, data range validity, data content uniqueness, device information accuracy, and device performance compliance.

[0131] Based on the same disclosed concept, the scoring matrix consistency verification method of the present invention can also be implemented by a scoring matrix consistency verification device. The effect of the scoring matrix consistency verification device is similar to that of the above method, and will not be repeated here.

[0132] Figure 4 Schematic diagram of the structure of a consistency verification device for a scoring matrix according to an embodiment of the present invention.

[0133] like Figure 4 As shown, the scoring matrix consistency verification device 400 of the present invention may include a consistency verification module 410 , a disturbance matrix determination module 420 , a first matrix determination module 430 , and a second matrix determination module 440 .

[0134] A consistency check module 410 is used to determine whether the scoring matrix passes the consistency check by using a first preset algorithm after receiving the scoring matrix sent by the user, wherein the consistency check is based on the scoring matrix to check whether the scores of various indicators of the sensing device are consistent;

[0135] A disturbance matrix determination module 420 is configured to divide the scoring matrix and the intermediate matrix to obtain a disturbance matrix if it is determined that the scoring matrix fails the consistency check, wherein each element in the intermediate matrix is ​​obtained based on each element in the scoring matrix;

[0136] A first matrix determination module 430 is used to perform weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value;

[0137] The second matrix determination module 440 is used to determine the Hadamard product between the first matrix and the intermediate matrix as the second matrix, and after determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

[0138] In one embodiment, the apparatus further comprises:

[0139] An indicator weight determination module 450, configured to input the scoring matrix into a quality scoring model if it is determined that the scoring matrix passes the consistency check, so as to determine the weight of each indicator of the sensing device based on the scoring matrix;

[0140] A total quality evaluation score determination module 460 is used to determine the score of each indicator of any perception device according to the historical perception data of the perception device, and obtain the total quality evaluation score of the perception device through the score of each indicator and the weight of each indicator; and

[0141] The quality determination module 470 is used to determine the quality of the sensing device using the total quality evaluation score.

[0142] In one embodiment, the consistency checking module 410 is specifically configured to:

[0143] After determining the target eigenvalue corresponding to the scoring matrix by using a first preset algorithm, obtaining a consistency index value based on the target eigenvalue and the order of the scoring matrix;

[0144] Dividing the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices;

[0145] If the consistency ratio index value is less than a preset threshold, it is determined that the scoring matrix passes the consistency test;

[0146] If the consistency ratio index is not less than the preset threshold, it is determined that the scoring matrix fails the consistency test.

[0147] In one embodiment, the apparatus further comprises:

[0148] The intermediate matrix determination module 480 is used to obtain the intermediate matrix by:

[0149] For any element in the scoring matrix, divide the element by each element in the scoring matrix to obtain each intermediate matrix element;

[0150] For any intermediate matrix element, the position of the element in the target element that serves as a divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element that serves as a dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element, to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element;

[0151] The intermediate matrix is ​​determined according to the intermediate matrix elements and the target positions of the intermediate matrix elements.

[0152] In one embodiment, the first matrix determination module 430 is specifically configured to:

[0153] The first matrix is ​​determined by the following formula:

[0154] D k′ =λD k +(A-λ)DI;

[0155] Among them, D k′ is the first matrix, λ is the preset weight, D k is the disturbance matrix, DI is the zero disturbance matrix, and A is the set value.

[0156] After introducing a method and device for checking consistency of a scoring matrix according to an exemplary embodiment of the present invention, next, an electronic device according to another exemplary embodiment of the present invention is introduced.

[0157] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0158] In some possible implementations, the electronic device according to the present invention may include at least one processor and at least one computer storage medium. The computer storage medium stores program code, and when the program code is executed by the processor, the processor executes the steps of the consistency check method of the scoring matrix according to various exemplary embodiments of the present invention described above in this specification. For example, the processor may execute the following steps: Figure 1 Steps 101-104 shown in FIG.

[0159] Refer to the following Figure 5 The electronic device 500 according to this embodiment of the present invention is described. Figure 5 The electronic device 500 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0160] like Figure 5 As shown, the electronic device 500 is in the form of a general electronic device. The components of the electronic device 500 may include but are not limited to: at least one processor 501, at least one computer storage medium 502, and a bus 503 connecting different system components (including the computer storage medium 502 and the processor 501).

[0161] Bus 503 represents one or more of several types of bus structures, including a computer storage media bus or computer storage media controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.

[0162] The computer storage media 502 may include readable media in the form of volatile computer storage media, such as random access computer storage media (RAM) 521 and / or cache storage media 522 , and may further include read-only computer storage media (ROM) 523 .

[0163] The computer storage medium 502 may also include a program / utility 525 having a set (at least one) of program modules 524, such program modules 524 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0164] The electronic device 500 may also communicate with one or more external devices 504 (e.g., keyboards, pointing devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 500, and / or communicate with any device that enables the electronic device 500 to communicate with one or more other electronic devices (e.g., routers, modems, etc.). This communication may be performed through an input / output (I / O) interface 505. In addition, the electronic device 500 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 506. As shown, the network adapter 506 communicates with other modules for the electronic device 500 through a bus 503. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0165] In some possible implementations, various aspects of a scoring matrix consistency verification method provided by the present invention may also be implemented in the form of a program product, which includes a program code. When the program product runs on a computer device, the program code is used to enable the computer device to execute the steps of the scoring matrix consistency verification method according to various exemplary embodiments of the present invention described above in this specification.

[0166] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access computer storage medium (RAM), a read-only computer storage medium (ROM), an erasable programmable read-only computer storage medium (EPROM or flash memory), an optical fiber, a portable compact disk read-only computer storage medium (CD-ROM), an optical computer storage medium, a magnetic computer storage medium, or any suitable combination of the above.

[0167] The program product of the consistency check of the scoring matrix of the embodiment of the present invention can adopt a portable compact disk read-only computer storage medium (CD-ROM) and include program code, and can be run on an electronic device. However, the program product of the present invention is not limited to this. In this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0168] The readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, wherein the readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable signal medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0169] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0170] Program code for performing the operation of the present invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and also conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code can be executed entirely on the user electronic device, partially on the user device, as an independent software package, partially on the user electronic device and partially on the remote electronic device, or completely on the remote electronic device or server. In the case of involving a remote electronic device, the remote electronic device can be connected to the user electronic device through any type of network including a local area network (LAN) or a wide area network (WAN), or can be connected to an external electronic device (e.g., using an Internet service provider to connect through the Internet).

[0171] It should be noted that although several modules of the device are mentioned in the above detailed description, this division is only exemplary and not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules described above can be embodied in one module. Conversely, the features and functions of one module described above can be further divided into multiple modules to be embodied.

[0172] In addition, although the operations of the method of the present invention are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0173] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk computer storage media, CD-ROM, optical computer storage media, etc.) that contain computer-usable program code.

[0174] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0175] These computer program instructions may also be stored in a computer-readable computer storage medium that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable computer storage medium produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0176] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0177] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A consistency test method for a scoring matrix, characterized in that: The method comprises: After receiving the scoring matrix sent by the user, using a first preset algorithm to determine whether the scoring matrix passes the consistency check, wherein the consistency check is based on the scoring matrix to check whether the scores of various indicators of the sensing device are consistent; If it is determined that the scoring matrix fails the consistency check, the scoring matrix and the intermediate matrix are divided to obtain a perturbation matrix, wherein the intermediate matrix is ​​obtained in the following manner: for any element in the scoring matrix, the element is divided by each element in the scoring matrix to obtain each intermediate matrix element; for any intermediate matrix element, the position of the element in the target element as the divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element as the dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element; the intermediate matrix is ​​determined according to each intermediate matrix element and the target position of each intermediate matrix element; Performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and the number of columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value; After determining the Hadamard product between the first matrix and the intermediate matrix as the second matrix and determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

2. The method according to claim 1, characterized in that The method further comprises: If it is determined that the scoring matrix passes the consistency check, the scoring matrix is ​​input into a quality scoring model to determine the weight of each indicator of the sensing device based on the scoring matrix; and, For any sensing device, determine the score of each indicator of the sensing device according to the historical sensing data of the sensing device, and obtain the total quality evaluation score of the sensing device through the score of each indicator and the weight of each indicator; and The quality of the sensing device is determined using the total quality evaluation score.

3. The method according to claim 1, characterized in that The using a first preset algorithm to determine whether the scoring matrix passes the consistency check includes: After determining the target eigenvalue corresponding to the scoring matrix by using a first preset algorithm, obtaining a consistency index value based on the target eigenvalue and the order of the scoring matrix; Dividing the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices; If the consistency ratio index value is less than a preset threshold, it is determined that the scoring matrix passes the consistency test; If the consistency ratio index is not less than the preset threshold, it is determined that the scoring matrix fails the consistency test.

4. The method according to any one of claims 1 to 3, characterized in that: The weighted summation of the disturbance matrix and the zero disturbance matrix to obtain a first matrix includes: The first matrix is ​​determined by the following formula: D k′ =λD k +(A-λ)DI; Among them, D k′ is the first matrix, λ is the preset weight, and 0≤λ≤1, D k is the disturbance matrix, DI is the zero disturbance matrix, and A is the set value.

5. A consistency check device for a scoring matrix, characterized in that: The device comprises: A consistency check module, configured to determine whether the scoring matrix has passed the consistency check by using a first preset algorithm after receiving the scoring matrix sent by the user, wherein the consistency check is based on the scoring matrix to check whether the scores of various indicators of the sensing device are consistent; A perturbation matrix determination module is used for dividing the scoring matrix and the intermediate matrix to obtain a perturbation matrix if it is determined that the scoring matrix fails the consistency check, wherein the intermediate matrix is ​​obtained in the following manner: for any element in the scoring matrix, the element is divided by each element in the scoring matrix to obtain each intermediate matrix element; for any intermediate matrix element, the position of the element in the target element as the divisor in the scoring matrix is ​​determined as the row number of the intermediate matrix element, and the position of the element in the target element as the dividend in the scoring matrix is ​​determined as the column number of the intermediate matrix element to obtain the target position of the intermediate matrix element, wherein the target element is each element in the scoring matrix used to determine the intermediate matrix element; the intermediate matrix is ​​determined according to each intermediate matrix element and the target position of each intermediate matrix element; A first matrix determination module, used for performing weighted summation on the disturbance matrix and the zero disturbance matrix to obtain a first matrix, wherein the number of rows and columns of the zero disturbance matrix are the same as those of the disturbance matrix, and each element of the zero disturbance matrix is ​​the same set value; The second matrix determination module is used to determine the Hadamard product between the first matrix and the intermediate matrix as the second matrix, and after determining the second matrix as the scoring matrix, return to the step of using a preset algorithm to determine whether the scoring matrix passes the consistency check until the scoring matrix passes the consistency check.

6. The device according to claim 5, characterized in that The device also includes: an indicator weight determination module, configured to input the scoring matrix into a quality scoring model if it is determined that the scoring matrix passes the consistency check, so as to determine the weight of each indicator of the perception device based on the scoring matrix; and, A total quality evaluation score determination module is used to determine the score of each indicator of any perception device according to the historical perception data of the perception device, and obtain the total quality evaluation score of the perception device through the score of each indicator and the weight of each indicator; and The quality determination module is used to determine the quality of the sensing device using the total quality evaluation score.

7. The device according to claim 5, characterized in that The consistency check module is specifically configured as follows: After determining the target eigenvalue corresponding to the scoring matrix by using a first preset algorithm, obtaining a consistency index value based on the target eigenvalue and the order of the scoring matrix; Dividing the consistency index by a random consistency index value to obtain a consistency ratio index value of the scoring matrix; wherein the random consistency index value is obtained based on the average value of consistency indexes of a specified number of randomly generated positive reciprocal matrices; If the consistency ratio index value is less than a preset threshold, it is determined that the scoring matrix passes the consistency test; If the consistency ratio index is not less than the preset threshold, it is determined that the scoring matrix fails the consistency test.

8. The device according to any one of claims 5 to 7, characterized in that: The first matrix determination module is specifically used to: The first matrix is ​​determined by the following formula: D k′ =λD k +(A-λ)DI; Among them, D k′ is the first matrix, λ is the preset weight, D k is the disturbance matrix, DI is the zero disturbance matrix, and A is the set value.

9. An electronic device, characterized in that: It comprises at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executed by the at least one processor; and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1-4.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer program, and the computer program is used to execute the method according to any one of claims 1-4.

Images