Data quality management method, system and terminal

Abstract

The present invention relates to a data quality management method, system and terminal, and to the field of data management technology. The method includes: obtaining stored data information collected and stored in a database; retrieving data type information and data parameter information based on the stored data information; determining the type requirement parameter information corresponding to the data type information according to the correspondence between the data type information and the preset type requirement parameter information; analyzing the deviation between the data parameter information and the type requirement parameter information and using it as data parameter deviation information; determining the storage data quality value according to the data parameter deviation information; determining the quality adjustment information according to the storage data quality value, and adjusting the storage data information based on the quality adjustment information and outputting it to the terminal held by the collector for prompting. The present invention has the effect of improving the quality of stored data.

Description

Technical Field

[0001] The present invention relates to the technical field of data management, and in particular to a data quality management method, system and terminal. Background Art

[0002] Data management refers to the sum of a series of activities such as data collection, storage, integration, maintenance, protection and utilization.

[0003] In the process of enterprise data management, currently, relevant employees generally manually input business operation data such as sales records, inventory data, employee information, and management data such as financial statements and performance evaluation data for collection, and then input the collected data into the same enterprise storage database for storage, so as to facilitate subsequent use.

[0004] Since enterprises generally have their employees manually collect various business operation data and management data, errors are prone to occur during the collection process, resulting in low quality of stored data. Summary of the invention

[0005] In order to improve the quality of stored data, the present invention provides a data quality management method, system and terminal.

[0006] In a first aspect, the present invention provides a data quality management method, which adopts the following technical solution:

[0007] A data quality management method, comprising:

[0008] Obtaining stored data information collected and stored in a database;

[0009] Retrieving data type information and data parameter information based on stored data information;

[0010] According to the correspondence between the data type information and the preset type requirement parameter information, the type requirement parameter information corresponding to the data type information is determined;

[0011] Analyze the deviation between the data parameter information and the category requirement parameter information and use it as the data parameter deviation information;

[0012] Determine the quality value of the stored data according to the data parameter deviation information;

[0013] The quality adjustment information is determined according to the quality value of the stored data, and the stored data information is adjusted based on the quality adjustment information and output to the terminal held by the collector for prompting.

[0014] Optionally, a method for determining a storage data quality value includes:

[0015] Retrieving deviation type information and deviation type information based on data parameter deviation information;

[0016] According to the correspondence between the deviation type information and the preset type quality reference value, the type quality reference value corresponding to the deviation type information is determined;

[0017] Determine category department information based on deviation category information;

[0018] According to the correspondence between the category department information and the preset category department impact value, the category department impact value corresponding to the category department information is determined;

[0019] The product value between the type quality baseline value and the category department impact value is calculated and used as the quality adjustment value, and the quality adjustment value is used as the storage data quality value.

[0020] Optionally, the method for determining the type department information includes:

[0021] According to the correspondence between the data type information and the preset data department information, the data department information corresponding to the data type information is determined;

[0022] According to the correspondence between the data department information and the preset department type information, the department type information corresponding to the data department information is determined;

[0023] Based on the deviation category information, the consistent ones are selected from the department category information and used as the selected category information;

[0024] Based on the selected category information, the corresponding data department information is retrieved and used as the estimated department information of the selected category;

[0025] Based on the estimated department information of the selected category, retrieve the estimated department individual value of the selected category;

[0026] Determine whether the estimated value of the selected category is only one;

[0027] If yes, the estimated department information of the selected category will be directly used as the category department information;

[0028] If not, then retrieve the deviation parameter time point based on the data parameter deviation information;

[0029] The time estimation department information is determined according to the deviation parameter time point and the selected category estimation department information, and the time estimation department information is used as the category department information.

[0030] Optionally, the method for determining the time estimation department information includes:

[0031] Retrieve the estimated department collection time period based on the estimated department information of the selected category;

[0032] Determine whether the deviation parameter time point is within the estimated department collection time period;

[0033] If yes, calculate the middle time of the estimated department collection time period and use it as the collection middle time point;

[0034] Calculate the deviation between the deviation parameter time point and the acquisition middle time point and use it as the middle time deviation value;

[0035] Sort the data from small to large based on the intermediate time deviation values, and use the selected category estimation department information corresponding to the first ranked intermediate time deviation value as the time estimation department information;

[0036] If not, the deviation between the deviation parameter time point and the estimated department collection time period is calculated and used as the collection time deviation value;

[0037] According to the collection time deviation value, the estimated department information of the selected category is selected and used as the time deviation selected department information, and the time deviation selected department information is used as the time estimated department information.

[0038] Optionally, the method for selecting department information by time deviation includes:

[0039] According to the corresponding relationship between the acquisition time deviation value and the preset acquisition time deviation impact value, the acquisition time deviation impact value corresponding to the acquisition time deviation value is determined;

[0040] Retrieve historical collection time points based on the estimated department information of the selected category;

[0041] Calculate the deviation of each adjacent historical collection time point and use it as the historical time deviation value;

[0042] Calculate the average of all historical time deviation values ​​and use it as the historical time deviation average;

[0043] According to the correspondence between the historical time deviation average value and the preset historical time deviation impact value, the historical time deviation impact value corresponding to the historical time deviation average value is determined;

[0044] Calculate the sum of the impact value of the acquisition time deviation and the impact value of the historical time deviation and use it as the comprehensive impact value of the time deviation;

[0045] The information is sorted from small to large based on the comprehensive impact value of the time deviation, and the estimated department information of the selected category ranked first is used as the time deviation selected department information.

[0046] Optionally, a method for determining the quality adjustment information includes:

[0047] Determine whether the stored data quality value is greater than a preset data quality reference value;

[0048] If yes, output the preset quality benchmark adjustment information as the quality adjustment information;

[0049] If not, then based on the stored data quality value, retrieve the category department information and use it as the quality impact department information, and based on the stored data quality value, retrieve the data parameter deviation information and use it as the quality impact deviation information;

[0050] According to the correspondence between the quality influencing department information and the preset quality benchmark value of the influencing department, the quality benchmark value of the influencing department corresponding to the quality influencing department information is determined;

[0051] Calculate the difference between the stored data quality value and the quality benchmark value of the affected department and use it as the data department quality deviation value;

[0052] The quality department adjustment information is determined based on the data department quality deviation value and the quality impact deviation information, and the quality department adjustment information is used as the quality adjustment information.

[0053] Optionally, methods for determining quality department adjustment information include:

[0054] Based on the quality impact deviation information, the corresponding deviation type information is retrieved and used as the deviation impact type information; based on the quality impact deviation information, the corresponding deviation category information is retrieved and used as the deviation impact category information;

[0055] According to the correspondence between the deviation impact category information and the preset category adjustment requirement value, the category adjustment requirement value corresponding to the deviation impact category information is determined;

[0056] According to the corresponding relationship between the data department quality deviation value and the preset quality deviation requirement value, the quality deviation requirement value corresponding to the data department quality deviation value is determined;

[0057] Calculate the sum of the quality deviation requirement value and the type adjustment requirement value and use it as the adjustment comprehensive requirement value;

[0058] Determine whether the comprehensive adjustment demand value is greater than the preset adjustment demand benchmark value;

[0059] If yes, then according to the correspondence between the deviation impact type information and the preset type adjustment information, the type adjustment information corresponding to the deviation impact type information is determined, and the type adjustment information is used as the quality department adjustment information;

[0060] If not, the preset demand baseline adjustment information is output and used as the quality department adjustment information.

[0061] Optionally, the method further includes calculating the sum of the quality deviation requirement value and the type adjustment requirement value as a step after adjusting the comprehensive requirement value, which is as follows:

[0062] Based on the quality impact deviation information, the corresponding deviation parameter time point is retrieved and used as the deviation impact time point;

[0063] Get the current time point;

[0064] Calculate the time interval between the current time point and the deviation impact time point and use it as the current time interval value;

[0065] Determine whether the current time interval value is greater than the preset interval reference value;

[0066] If yes, then determine the time interval requirement value corresponding to the current time interval value according to the correspondence between the current time interval value and the preset time interval requirement value, and add the time interval requirement value to the adjusted comprehensive requirement value to form a new adjusted comprehensive requirement value;

[0067] If not, continue to output the adjusted comprehensive demand value.

[0068] In a second aspect, the present invention provides a data quality management system, which adopts the following technical solution:

[0069] A data quality management system, comprising:

[0070] The acquisition module is used to obtain the stored data information and the current time point;

[0071] A memory, used to store a program of the data quality management method as described in any one of the first aspects;

[0072] The processor loads and executes the program in the memory.

[0073] In a third aspect, the present invention provides an intelligent terminal, which adopts the following technical solution:

[0074] An intelligent terminal comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes the data quality management method as described in any one of the first aspects.

[0075] In summary, the present invention includes at least one of the following beneficial technical effects:

[0076] 1. By acquiring the stored data information and retrieving the data type information and data parameter information, and querying and determining the type requirement parameter information to analyze and obtain the data parameter deviation information, the stored data quality value is determined by the data parameter deviation information, and the quality adjustment information is determined by the stored data quality value, and the stored data information is adjusted and output to the terminal held by the collector, so as to adjust the stored data and prompt the collector at the same time, so as to facilitate the collector to reduce such deviations in the subsequent collection process, thereby improving the quality of the stored data;

[0077] 2. Retrieve the deviation type information and deviation type information through the data parameter deviation information and query to determine the type quality benchmark value, determine the type department information through the deviation type information to query to determine the type department impact value, and then calculate the quality adjustment value, and use the quality adjustment value as the storage data quality value, thereby improving the accuracy of the acquired storage data quality value;

[0078] 3. Determine the data department information through data type information query, determine the department type information through data department information query, then select the selected type information and call the selected type estimated department information, so as to call the selected type estimated department individual value through the selected type estimated department information, and then judge whether the selected type estimated department individual value is only one. When there is only one, directly use the selected type estimated department information as the type department information. When there is more than one, call the deviation parameter time point through the data parameter deviation information, and determine the time estimated department information through the deviation parameter time point and the selected type estimated department information and use it as the type department information, thereby improving the accuracy of the acquired type department information. BRIEF DESCRIPTION OF THE DRAWINGS

[0079] Figure 1 is a flow chart of a method for data quality management in an embodiment of the present application;

[0080] Figure 2 is a flow chart of a method for determining a storage data quality value according to an embodiment of the present application;

[0081] Figure 3 is a flow chart of a method for determining type department information of an embodiment of the present application;

[0082] Figure 4 is a flow chart of a method for determining time estimation department information according to an embodiment of the present application;

[0083] Figure 5 is a flow chart of a method for selecting department information by time deviation according to an embodiment of the present application;

[0084] Figure 6 is a flow chart of a method for determining quality adjustment information in an embodiment of the present application;

[0085] Figure 7 is a flow chart of a method for determining quality department adjustment information in an embodiment of the present application;

[0086] Figure 8 It is a method flow chart of an embodiment of the present application, which is located at calculating the sum of the quality deviation requirement value and the type adjustment requirement value and serving as a step after adjusting the comprehensive requirement value. DETAILED DESCRIPTION

[0087] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0088] A data quality management method obtains stored data information and the current time point, determines data quality by the data type and data parameter deviation, and associates the data quality with the department to which the data belongs, thereby improving the accuracy of data management and further improving the quality of stored data.

[0089] Reference Figure 1 , an embodiment of the present invention discloses a data quality management method. A data quality management method includes:

[0090] Step S100: Acquire the stored data information collected and stored in the database.

[0091] Among them, the stored data information refers to the data information collected by the collector at the current time and stored in the database. The stored data information is retrieved from the database after the collector collects and stores the data.

[0092] Step S101: Retrieve data type information and data parameter information based on stored data information.

[0093] Among them, data type information refers to the type information of the data collected at the current time, and data parameter information refers to the parameter information corresponding to the data collected at the current time. By storing data information, data type information and data parameter information are retrieved for subsequent use. Data type information includes sales record types, inventory data types, employee information types, financial report types, and performance evaluation data types.

[0094] Step S102: determining the category requirement parameter information corresponding to the data category information according to the correspondence between the data category information and the preset category requirement parameter information.

[0095] The category requirement parameter information refers to the parameter information required by the category of the collected data. Different data category information corresponds to different category requirement parameter information. The category requirement parameter information is obtained by querying from a database storing different data category information and corresponding category requirement parameter information. The database is obtained after pre-input. The category requirement parameter information is determined by querying the data category information to facilitate subsequent use.

[0096] Step S103: Analyze the deviation between the data parameter information and the category requirement parameter information and use it as data parameter deviation information.

[0097] Among them, data parameter deviation information refers to the deviation information corresponding to the existence of deviation in the collected data. By analyzing the deviation between the data parameter information and the type requirement parameter information and using it as the data parameter deviation information, it is convenient for subsequent use.

[0098] Step S104: determining the storage data quality value according to the data parameter deviation information.

[0099] The stored data quality value refers to the quality value corresponding to the collected data. The stored data quality value is determined by analyzing the data parameter deviation information to facilitate subsequent use. The specific steps for determining the stored data quality value refer to steps S200 to S204.

[0100] Step S105: Determine quality adjustment information according to the quality value of the stored data, and adjust the stored data information based on the quality adjustment information and output it to the terminal held by the collector for prompting.

[0101] The quality adjustment information refers to the adjustment information for adjusting the data according to the quality of the data, and the quality adjustment information is determined by analyzing the quality value of the stored data. The terminal held by the collector refers to the terminal at which the collector can receive information, and the terminal held by the collector can be a mobile phone or a computer. The specific steps for determining the quality adjustment information refer to steps S600 to S605.

[0102] The quality adjustment information is used to adjust the stored data information, thereby improving the quality of the stored data. The quality adjustment information is output to the terminal held by the collector for prompting, so that the collector can timely understand the existence of deviations and other abnormalities in the collected data, thereby improving the accuracy of subsequent collectors when collecting similar data, and further improving the quality of the stored data.

[0103] exist Figure 1 In step S104, in order to further ensure the rationality of the stored data quality value, it is necessary to further analyze and calculate the stored data quality value. Figure 2 The steps shown are explained in detail.

[0104] Reference Figure 2 , the method for determining the storage data quality value includes the following steps:

[0105] Step S200: Retrieving deviation type information and deviation category information based on the data parameter deviation information.

[0106] The deviation type information refers to the type information of the data corresponding to the deviation when the collected data has a deviation, and the deviation type information refers to the type information corresponding to the deviation when the collected data has a deviation. The deviation type information and deviation type information are retrieved through the data parameter deviation information for subsequent use.

[0107] Step S201: determining a type quality reference value corresponding to the deviation type information according to a correspondence between the deviation type information and a preset type quality reference value.

[0108] Among them, the type quality reference value refers to the reference quality value of the type corresponding to the deviation on the data quality. Different deviation type information corresponds to different type quality reference values. The type quality reference value is obtained by querying from a database storing different deviation type information and corresponding type quality reference values. The database is obtained after pre-input. The type quality reference value is determined by querying the deviation type information to facilitate subsequent use.

[0109] Step S202: Determine the category department information according to the deviation category information.

[0110] The category department information refers to the department information corresponding to the category to which the deviation data belongs. By analyzing the deviation category information, the category department information is determined for subsequent use. The specific steps for determining the category department information refer to steps S300 to S308.

[0111] Step S203: determining the category department impact value corresponding to the category department information according to the correspondence between the category department information and the preset category department impact value.

[0112] Among them, the category department impact value refers to the impact degree value of the department corresponding to the category of the deviation data on the data quality. Different category department information corresponds to different category department impact values. The category department impact value is obtained by querying from a database storing different category department information and corresponding category department impact values. The database is obtained after pre-input. The category department impact value is determined by querying the category department information to facilitate subsequent use.

[0113] Step S204: Calculate the product value between the type quality reference value and the category department impact value and use it as the quality adjustment value, and use the quality adjustment value as the storage data quality value.

[0114] Among them, the quality adjustment value refers to the adjustment value after adjusting the data quality. The product value between the type quality benchmark value and the category department impact value is calculated and used as the quality adjustment value, and the quality adjustment value is used as the storage data quality value, thereby improving the accuracy of the acquired storage data quality value.

[0115] exist Figure 2 In step S202, in order to further ensure the rationality of the category and department information, it is necessary to further analyze and calculate the category and department information separately. Figure 3 The steps shown are explained in detail.

[0116] Reference Figure 3 , the method for determining the type department information includes the following steps:

[0117] Step S300: determining data department information corresponding to the data type information according to the correspondence between the data type information and the preset data department information.

[0118] The data department information refers to the department information corresponding to the type of collected data. Different data type information corresponds to different data department information. The data department information is obtained by querying from a database storing different data type information and corresponding data department information. The data department information is determined by querying the data type information, which is convenient for subsequent use.

[0119] Step S301: determining the department type information corresponding to the data department information according to the corresponding relationship between the data department information and the preset department type information.

[0120] Among them, department type information refers to the type information of the data to be collected in the department corresponding to the type of the collected data. Different data department information corresponds to different department type information. The department type information is obtained by querying from a database that stores different data department information and corresponding department type information. The department type information is determined by querying the data department information to facilitate subsequent use.

[0121] Step S302: based on the deviation category information, select the consistent one from the department category information and use it as the selected category information.

[0122] The selected category information refers to the category information corresponding to the department category after selection. By selecting the category consistent with the deviation category information from the department category information and using it as the selected category information, subsequent use is facilitated.

[0123] Step S303: Retrieve corresponding data department information based on the selected category information and use it as the estimated department information of the selected category.

[0124] Among them, the estimated department information of the selected category refers to the department information corresponding to the estimation of the department to which the selected category belongs. By retrieving the data department information corresponding to the selected category information and using it as the estimated department information of the selected category, subsequent use is facilitated.

[0125] Step S304: Retrieve the number of estimated departments of the selected category based on the estimated department information of the selected category.

[0126] Among them, the estimated number of departments of the selected category refers to the estimated number of departments to which the selected category belongs. The number of departments in the estimated department information of the selected category is counted, and the counting result is used as the estimated number of departments of the selected category for convenience in subsequent use.

[0127] Step S305: Determine whether the number of estimated departments of the selected category is only one. If yes, execute step S306; if no, execute step S307.

[0128] Among them, by judging whether the estimated number of departments of the selected type is only one, it is judged whether it is necessary to continue selecting the department.

[0129] Step S306: directly select the estimated department information of the selected category as the category department information.

[0130] Among them, when the number of estimated departments of the selected category is only one, it means that there is no need to continue selecting the department at this time, so the estimated department information of the selected category is directly used as the category department information.

[0131] Step S307: Retrieve the deviation parameter time point based on the data parameter deviation information.

[0132] Among them, the deviation parameter time point refers to the time point when the deviation data is collected. When the estimated department value of the selected category is not only one, it means that the department needs to continue to be selected at this time. Therefore, the deviation parameter time point is retrieved through the data parameter deviation information to facilitate subsequent use.

[0133] Step S308: determining the time estimation department information according to the deviation parameter time point and the selected category estimation department information, and using the time estimation department information as the category department information.

[0134] Among them, the time estimation department information refers to the estimation information of the department based on the collection time. The time estimation department information is determined by analyzing the deviation parameter time point and the selected type estimation department information, and the time estimation department information is used as the type department information to improve the accuracy of the obtained type department information.

[0135] exist Figure 3 In step S308, in order to further ensure the rationality of the time estimation department information, it is necessary to further analyze and calculate the time estimation department information separately, specifically by Figure 4 The steps shown are explained in detail.

[0136] Reference Figure 4,The method for determining the time estimation department information includes the following steps:

[0137] Step S400: Retrieving the estimated department collection time period based on the estimated department information of the selected category.

[0138] Among them, the estimated department collection time period refers to the time period corresponding to when the estimated department collects data. The estimated department collection time period can be retrieved by selecting the type of estimated department information to facilitate subsequent use.

[0139] Step S401: Determine whether the deviation parameter time point is within the estimated department collection time period. If yes, execute step S402; if no, execute step S405.

[0140] Among them, by judging whether the time point of the deviation parameter is within the estimated department collection time period, it is judged whether the collection time of the deviation data is within the department collection time period.

[0141] Step S402: Calculate the middle time of the estimated department collection time period and use it as the collection middle time point.

[0142] Among them, the middle time point of collection refers to the middle time point corresponding to the time period when the estimation department collects data. When the deviation parameter time point is within the collection time period of the estimation department, it means that the collection time of the deviation data is within the collection time period of the department. Therefore, the middle time of the collection time period of the estimation department is calculated and used as the middle time point of collection for subsequent use.

[0143] Step S403: Calculate the deviation between the deviation parameter time point and the acquisition middle time point and use it as the middle time deviation value.

[0144] Among them, the intermediate time deviation value refers to the deviation value when there is a deviation between the collection time of the deviation data and the middle time of the time period collected by the department. The deviation between the deviation parameter time point and the collection middle time point is calculated and used as the intermediate time deviation value, which is convenient for subsequent use.

[0145] Step S404: sorting from small to large based on the intermediate time deviation values, and taking the selected category estimation department information corresponding to the first ranked intermediate time deviation value as the time estimation department information.

[0146] Among them, by sorting the intermediate time deviation values ​​from small to large, and using the selected category estimation department information corresponding to the first-ranked intermediate time deviation value as the time estimation department information, the accuracy of the acquired time estimation department information is improved.

[0147] Step S405: Calculate the deviation between the deviation parameter time point and the estimated department collection time period and use it as the collection time deviation value.

[0148] Among them, the collection time deviation value refers to the deviation value corresponding to the deviation between the collection time and the department collection time period. When the deviation parameter time point is not within the estimated department collection time period, it means that the collection time of the deviation data at this time is not within the department collection time period. Therefore, the deviation between the deviation parameter time point and the estimated department collection time period is calculated and used as the collection time deviation value for convenience in subsequent use.

[0149] Step S406: selecting the estimated department information of the selected category according to the collection time deviation value and using the selected department information as the time deviation selected department information, and using the time deviation selected department information as the time estimated department information.

[0150] Among them, time deviation selected department information refers to the department information after the department is selected according to the time deviation. It is sorted from small to large according to the collection time deviation value, and the corresponding selection type estimated department information is selected with the first-ranked collection time deviation value, and the selected selection type estimated department information is used as the time deviation selected department information, and then the time deviation selected department information is used as the time estimated department information, thereby improving the accuracy of the acquired time estimated department information.

[0151] exist Figure 4 In step S406, in order to further ensure the rationality of the time deviation selected department information, it is necessary to further analyze and calculate the time deviation selected department information separately, specifically through Figure 5 The steps shown are explained in detail.

[0152] Reference Figure 5 ,The method for selecting department information by time deviation includes the following steps:

[0153] Step S500: determining a collection time deviation impact value corresponding to the collection time deviation value according to a correspondence between the collection time deviation value and a preset collection time deviation impact value.

[0154] The collection time deviation impact value refers to the impact degree value on department selection when there is a deviation in the collection time. Different collection time deviation values ​​correspond to different collection time deviation impact values. The collection time deviation impact value is obtained by querying from a database storing different collection time deviation values ​​and corresponding collection time deviation impact values. The database is obtained after pre-input. The collection time deviation impact value is determined by querying the collection time deviation value to facilitate subsequent use.

[0155] Step S501: Retrieve historical collection time points based on the estimated department information of the selected category.

[0156] Among them, the historical collection time point refers to the time point when the estimation department collected data in historical time. The historical collection time point can be retrieved by selecting the type of estimation department information to facilitate subsequent use.

[0157] Step S502: Calculate the deviations between adjacent historical collection time points and use them as historical time deviation values.

[0158] The historical time deviation value refers to the deviation value corresponding to the time when the estimation department collects data in the historical time. The deviation of each adjacent historical collection time point is calculated and used as the historical time deviation value for convenience in subsequent use.

[0159] Step S503: Calculate the average value of all historical time deviation values ​​and use it as the historical time deviation average value.

[0160] The historical time deviation average refers to the average deviation value corresponding to the deviation in the time when the estimation department collects data in the historical time. The average value of all historical time deviation values ​​is calculated and used as the historical time deviation average for convenience of subsequent use.

[0161] Step S504: determining the historical time deviation impact value corresponding to the historical time deviation average value according to the correspondence between the historical time deviation average value and the preset historical time deviation impact value.

[0162] The historical time deviation impact value refers to the impact of the deviation in the time of historical time collection data on department selection. Different historical time deviation average values ​​correspond to different historical time deviation impact values. The historical time deviation impact value is obtained by querying from a database storing different historical time deviation average values ​​and corresponding historical time deviation impact values. The database is obtained after pre-input. The historical time deviation impact value is determined by querying the historical time deviation average value to facilitate subsequent use.

[0163] Step S505: Calculate the sum of the collection time deviation impact value and the historical time deviation impact value and use it as the time deviation comprehensive impact value.

[0164] Among them, the comprehensive impact value of time deviation refers to the comprehensive impact degree value of the time deviation of collected data on department selection. The sum of the collection time deviation impact value and the historical time deviation impact value is calculated and used as the comprehensive impact value of time deviation for convenience in subsequent use.

[0165] Step S506: Sort the information from small to large based on the comprehensive impact value of the time deviation, and use the estimated department information of the selected category that ranks first as the time deviation selected department information.

[0166] Among them, the comprehensive impact values ​​of time deviation are sorted from small to large, and the estimated department information of the selected category ranked first is used as the time deviation selected department information, thereby improving the accuracy of the acquired time deviation selected department information.

[0167] exist Figure 1 In step S105, in order to further ensure the rationality of the quality adjustment information, it is necessary to further analyze and calculate the quality adjustment information. Figure 6 The steps shown are explained in detail.

[0168] Reference Figure 6 , the method for determining the quality adjustment information includes the following steps:

[0169] Step S600: Determine whether the quality value of the stored data is greater than a preset data quality reference value. If yes, execute step S601; if no, execute step S602.

[0170] The data quality reference value refers to the minimum quality value corresponding to the data quality when no adjustment is required, and the data quality reference value is obtained after pre-input. By judging whether the stored data quality value is greater than the preset data quality reference value, it is judged whether the data quality meets the requirements.

[0171] Step S601: outputting preset quality reference adjustment information as quality adjustment information.

[0172] Among them, the quality benchmark adjustment information refers to the adjustment information corresponding to the data quality that does not need to be adjusted. When the stored data quality value is greater than the preset data quality benchmark value, it means that the data quality meets the requirements at this time, so the preset quality benchmark adjustment information is output and used as the quality adjustment information.

[0173] Step S602: based on the stored data quality value, retrieve the category department information and use it as the quality impact department information; based on the stored data quality value, retrieve the data parameter deviation information and use it as the quality impact deviation information.

[0174] Among them, quality impact department information refers to the department information to which the data type belongs when the data quality does not meet the requirements, and quality impact deviation information refers to the deviation parameter information of the corresponding data when the data quality does not meet the requirements. When the stored data quality value is not greater than the preset data quality reference value, it means that the data quality does not meet the requirements at this time. Therefore, the type department information is retrieved by storing the data quality value and used as the quality impact department information, and the data parameter deviation information is retrieved by storing the data quality value and used as the quality impact deviation information, which is convenient for subsequent use.

[0175] Step S603: According to the correspondence between the quality influencing department information and the preset influencing department quality reference value, the influencing department quality reference value corresponding to the quality influencing department information is determined.

[0176] Among them, the quality benchmark value of the influencing department refers to the benchmark value of the quality requirements of the department to which the corresponding data type belongs when the data quality does not meet the requirements. Different quality influencing department information corresponds to different quality benchmark values ​​of the influencing department. The quality benchmark value of the influencing department is obtained by querying from a database that stores different quality influencing department information and the corresponding quality benchmark values ​​of the influencing department. The database is obtained after pre-input. The quality benchmark value of the influencing department is determined by querying the quality influencing department information to facilitate subsequent use.

[0177] Step S604: Calculate the difference between the stored data quality value and the impact department quality benchmark value and use it as the data department quality deviation value.

[0178] Among them, the data department quality deviation value refers to the deviation value when there is a deviation in data quality. The difference between the stored data quality value and the quality baseline value of the influencing department is calculated and used as the data department quality deviation value to facilitate subsequent use.

[0179] Step S605: Determine quality department adjustment information according to the data department quality deviation value and the quality impact deviation information, and use the quality department adjustment information as the quality adjustment information.

[0180] The quality department adjustment information refers to the adjustment information based on the department's adjustment of data quality. The quality department adjustment information is determined by analyzing the data department's quality deviation value and the quality impact deviation information, and the quality department adjustment information is used as the quality adjustment information to improve the accuracy of the acquired quality adjustment information. The specific steps for determining the quality adjustment information refer to steps S700 to S706.

[0181] exist Figure 6 In step S605, in order to further ensure the rationality of the quality department adjustment information, it is necessary to further analyze and calculate the quality department adjustment information. Figure 7 The steps shown are explained in detail.

[0182] Reference Figure 7 , the method for determining the quality department adjustment information includes the following steps:

[0183] Step S700: based on the quality impact deviation information, corresponding deviation type information is retrieved and used as deviation impact type information; based on the quality impact deviation information, corresponding deviation category information is retrieved and used as deviation impact category information.

[0184] The deviation impact type information refers to the deviation type information corresponding to the deviation parameter of the corresponding data when the data quality does not meet the requirements, and the deviation impact category information refers to the category information of the deviation parameter of the corresponding data when the data quality does not meet the requirements. The corresponding deviation type information is retrieved through the quality impact deviation information and used as the deviation impact type information, and the corresponding deviation category information is retrieved through the quality impact deviation information and used as the deviation impact category information, which is convenient for subsequent use.

[0185] Step S701: determining a type adjustment requirement value corresponding to the deviation impact type information according to a correspondence between the deviation impact type information and a preset type adjustment requirement value.

[0186] The type adjustment requirement value refers to the requirement value corresponding to the deviation impact type when making adjustments. Different deviation impact type information corresponds to different type adjustment requirement values. The type adjustment requirement value is obtained by querying from a database storing different deviation impact type information and corresponding type adjustment requirement values. The database is obtained after pre-input. The type adjustment requirement value is determined by querying the deviation impact type information to facilitate subsequent use.

[0187] Step S702: According to the correspondence between the data department quality deviation value and the preset quality deviation requirement value, a quality deviation requirement value corresponding to the data department quality deviation value is determined.

[0188] Among them, the quality deviation requirement value refers to the requirement value corresponding to the parameter deviation when making adjustments. Different data department quality deviation values ​​correspond to different quality deviation requirement values. The quality deviation requirement value is obtained by querying from a database storing different data department quality deviation values ​​and corresponding quality deviation requirement values. The database is obtained after pre-input. The quality deviation requirement value is determined by querying the data department quality deviation value to facilitate subsequent use.

[0189] Step S703: Calculate the sum of the quality deviation requirement value and the type adjustment requirement value and use it as the comprehensive adjustment requirement value.

[0190] Among them, the adjustment comprehensive demand value refers to the comprehensive demand value corresponding to the adjustment. The sum of the quality deviation demand value and the type adjustment demand value is calculated and used as the adjustment comprehensive demand value to facilitate subsequent use.

[0191] Step S704: Determine whether the adjustment comprehensive demand value is greater than the preset adjustment demand reference value. If yes, execute step S705; if no, execute step S706.

[0192] The adjustment demand reference value refers to the minimum demand value corresponding to when adjustment is required, and whether adjustment is required is determined by judging whether the adjustment comprehensive demand value is greater than the preset adjustment demand reference value.

[0193] Step S705: Determine the type adjustment information corresponding to the deviation impact type information according to the correspondence between the deviation impact type information and the preset type adjustment information, and use the type adjustment information as the quality department adjustment information.

[0194] Among them, type adjustment information refers to adjustment information adjusted according to the deviation impact type. Different deviation impact type information corresponds to different type adjustment information. The type adjustment information is obtained by querying from a database that stores different deviation impact type information and corresponding type adjustment information. The database is obtained after pre-input.

[0195] When the comprehensive adjustment demand value is greater than the preset adjustment demand benchmark value, it means that adjustment is needed at this time. Therefore, the type adjustment information is determined by querying the deviation impact type information, and the type adjustment information is used as the quality department adjustment information, thereby improving the accuracy of the quality department adjustment information obtained.

[0196] Step S706: Output the preset demand benchmark adjustment information and use it as the quality department adjustment information.

[0197] The demand benchmark adjustment information refers to the benchmark adjustment information corresponding to when no adjustment is made, and the demand benchmark adjustment information is obtained by pre-input. When the adjustment comprehensive demand value is not greater than the preset adjustment demand benchmark value, it means that no adjustment is required at this time, so the preset demand benchmark adjustment information is output and used as the quality department adjustment information, thereby improving the accuracy of the obtained quality department adjustment information.

[0198] exist Figure 7 After step S703, in order to further ensure the rationality of adjusting the comprehensive demand value, it is necessary to further analyze and calculate the adjusted comprehensive demand value. Figure 8 The steps shown are explained in detail.

[0199] Reference Figure 8 The steps after calculating the sum of the quality deviation requirement value and the type adjustment requirement value and adjusting the comprehensive requirement value include the following steps:

[0200] Step S800: based on the quality impact deviation information, retrieve the corresponding deviation parameter time point and use it as the deviation impact time point.

[0201] Among them, the deviation impact time point refers to the collection time point of the corresponding data when the data quality does not meet the requirements. The corresponding deviation parameter time point is retrieved through the quality impact deviation information and used as the deviation impact time point to facilitate subsequent use.

[0202] Step S801: Get the current time point.

[0203] The current time point refers to the time point corresponding to the current time, and the current time point is obtained by querying the current time from a database used for timing.

[0204] Step S802: Calculate the time interval between the current time point and the deviation impact time point and use it as the current time interval value.

[0205] Among them, the current time interval value refers to the interval time value between the current time and the collection time of the corresponding data when the data quality does not meet the requirements. By calculating the time interval between the current time point and the deviation impact time point and using it as the current time interval value, it is convenient for subsequent use.

[0206] Step S803: Determine whether the current time interval value is greater than a preset interval reference value. If yes, execute step S804; if no, execute step S805.

[0207] The interval reference value refers to the minimum interval value that can be tolerated between the current time and the collection time, and the interval reference value is obtained after pre-input. By judging whether the current time interval value is greater than the preset interval reference value, it is judged whether the interval between the current time and the collection time affects the adjustment demand.

[0208] Step S804: determining a time interval requirement value corresponding to the current time interval value according to the correspondence between the current time interval value and the preset time interval requirement value, and adding the time interval requirement value to the adjusted comprehensive requirement value to form a new adjusted comprehensive requirement value.

[0209] The time interval requirement value refers to the requirement value corresponding to the time interval when making an adjustment. Different current time interval values ​​correspond to different time interval requirement values. The time interval requirement value is obtained by querying from a database storing different current time interval values ​​and corresponding time interval requirement values. The database is obtained after pre-input. The time interval requirement value is determined by querying the current time interval value, and the time interval requirement value is added to the adjustment comprehensive requirement value to form a new adjustment comprehensive requirement value, thereby improving the accuracy of the obtained adjustment comprehensive requirement value.

[0210] Step S805: Continue to output and adjust the comprehensive demand value.

[0211] Among them, if the current time interval value is not greater than the preset interval reference value, it means that the interval between the current time and the collection time does not affect the adjustment demand, so the adjustment comprehensive demand value continues to be output.

[0212] Based on the same inventive concept, an embodiment of the present invention provides a data quality management system, including:

[0213] The acquisition module is used to obtain the stored data information and the current time point;

[0214] A memory for storing a program of the data quality management method as described above;

[0215] The processor loads and executes the program in the memory.

[0216] Based on the same inventive concept, an embodiment of the present invention provides an intelligent terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the data quality management method as described above.

[0217] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0218] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A data quality management method, characterized in that: include: Obtaining stored data information collected and stored in a database; Retrieving data type information and data parameter information based on stored data information; According to the correspondence between the data type information and the preset type requirement parameter information, the type requirement parameter information corresponding to the data type information is determined; Analyze the deviation between the data parameter information and the category requirement parameter information and use it as the data parameter deviation information; Determine the quality value of the stored data according to the data parameter deviation information; Determine quality adjustment information according to the quality value of the stored data, and adjust the stored data information based on the quality adjustment information and output it to the terminal held by the collector for prompting; Methods for determining the quality value of stored data include: Retrieving deviation type information and deviation type information based on data parameter deviation information; According to the correspondence between the deviation type information and the preset type quality reference value, the type quality reference value corresponding to the deviation type information is determined; Determine category department information based on deviation category information; According to the correspondence between the category department information and the preset category department impact value, the category department impact value corresponding to the category department information is determined; The product value between the type quality baseline value and the category department impact value is calculated and used as the quality adjustment value, and the quality adjustment value is used as the storage data quality value.

2. The data quality management method according to claim 1, characterized in that: Methods for determining category department information include: According to the correspondence between the data type information and the preset data department information, the data department information corresponding to the data type information is determined; According to the correspondence between the data department information and the preset department type information, the department type information corresponding to the data department information is determined; Based on the deviation category information, the consistent ones are selected from the department category information and used as the selected category information; Based on the selected category information, the corresponding data department information is retrieved and used as the estimated department information of the selected category; Based on the estimated department information of the selected category, retrieve the estimated department individual value of the selected category; Determine whether the estimated value of the selected category is only one; If yes, the estimated department information of the selected category will be directly used as the category department information; If not, then retrieve the deviation parameter time point based on the data parameter deviation information; The time estimation department information is determined according to the deviation parameter time point and the selected category estimation department information, and the time estimation department information is used as the category department information.

3. The data quality management method according to claim 2, characterized in that: Methods for determining time estimate department information include: Retrieve the estimated department collection time period based on the estimated department information of the selected category; Determine whether the deviation parameter time point is within the estimated department collection time period; If yes, calculate the middle time of the estimated department collection time period and use it as the collection middle time point; Calculate the deviation between the deviation parameter time point and the acquisition middle time point and use it as the middle time deviation value; Sort the data from small to large based on the intermediate time deviation values, and use the selected category estimation department information corresponding to the first ranked intermediate time deviation value as the time estimation department information; If not, the deviation between the deviation parameter time point and the estimated department collection time period is calculated and used as the collection time deviation value; According to the collection time deviation value, the estimated department information of the selected category is selected and used as the time deviation selected department information, and the time deviation selected department information is used as the time estimated department information.

4. The data quality management method according to claim 3, characterized in that: The selection method of the time deviation selection department information includes: According to the corresponding relationship between the acquisition time deviation value and the preset acquisition time deviation impact value, the acquisition time deviation impact value corresponding to the acquisition time deviation value is determined; Retrieve historical collection time points based on the estimated department information of the selected category; Calculate the deviation of each adjacent historical collection time point and use it as the historical time deviation value; Calculate the average of all historical time deviation values ​​and use it as the historical time deviation average; According to the correspondence between the historical time deviation average value and the preset historical time deviation impact value, the historical time deviation impact value corresponding to the historical time deviation average value is determined; Calculate the sum of the impact value of the acquisition time deviation and the impact value of the historical time deviation and use it as the comprehensive impact value of the time deviation; The information is sorted from small to large based on the comprehensive impact value of the time deviation, and the estimated department information of the selected category ranked first is used as the time deviation selected department information.

5. The data quality management method according to claim 2, characterized in that: Quality adjustment information is determined by: Determine whether the stored data quality value is greater than a preset data quality reference value; If yes, output the preset quality benchmark adjustment information as the quality adjustment information; If not, then based on the stored data quality value, retrieve the category department information and use it as the quality impact department information, and based on the stored data quality value, retrieve the data parameter deviation information and use it as the quality impact deviation information; According to the correspondence between the quality influencing department information and the preset quality benchmark value of the influencing department, the quality benchmark value of the influencing department corresponding to the quality influencing department information is determined; Calculate the difference between the stored data quality value and the quality benchmark value of the affected department and use it as the data department quality deviation value; The quality department adjustment information is determined based on the data department quality deviation value and the quality impact deviation information, and the quality department adjustment information is used as the quality adjustment information.

6. The data quality management method according to claim 5, characterized in that: Methods for determining quality unit adjustment information include: Based on the quality impact deviation information, the corresponding deviation type information is retrieved and used as the deviation impact type information; based on the quality impact deviation information, the corresponding deviation category information is retrieved and used as the deviation impact category information; According to the correspondence between the deviation impact category information and the preset category adjustment requirement value, the category adjustment requirement value corresponding to the deviation impact category information is determined; According to the corresponding relationship between the data department quality deviation value and the preset quality deviation requirement value, the quality deviation requirement value corresponding to the data department quality deviation value is determined; Calculate the sum of the quality deviation requirement value and the type adjustment requirement value and use it as the adjustment comprehensive requirement value; Determine whether the comprehensive adjustment demand value is greater than the preset adjustment demand benchmark value; If yes, then according to the correspondence between the deviation impact type information and the preset type adjustment information, the type adjustment information corresponding to the deviation impact type information is determined, and the type adjustment information is used as the quality department adjustment information; If not, the preset demand baseline adjustment information is output and used as the quality department adjustment information.

7. The data quality management method according to claim 6, characterized in that: The step of calculating the sum of the quality deviation requirement value and the type adjustment requirement value and adjusting the comprehensive requirement value is also included, as follows: Based on the quality impact deviation information, the corresponding deviation parameter time point is retrieved and used as the deviation impact time point; Get the current time point; Calculate the time interval between the current time point and the deviation impact time point and use it as the current time interval value; Determine whether the current time interval value is greater than the preset interval reference value; If yes, then determine the time interval requirement value corresponding to the current time interval value according to the correspondence between the current time interval value and the preset time interval requirement value, and add the time interval requirement value to the adjusted comprehensive requirement value to form a new adjusted comprehensive requirement value; If not, continue to output the adjusted comprehensive demand value.

8. A data quality management system, characterized in that: include: The acquisition module is used to obtain the stored data information and the current time point; A memory for storing a program of the data quality management method according to any one of claims 1 to 7; The processor loads and executes the program in the memory.

9. An intelligent terminal, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute the data quality management method according to any one of claims 1 to 7.

Images