A data cloud quality inspection control method and a data cloud quality inspection system
Through the data cloud quality inspection system and control methods, the problem of low efficiency in quality inspection of traditional land survey database results is solved, and the automated quality inspection process is realized, which improves work efficiency and the accuracy of quality inspection results.
Patent Information
- Application Number
- CN202410413143.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-08
- Publication Date
- 2025-03-11
- Estimated Expiration
- 2044-04-08
AI Technical Summary
The quality inspection of traditional land survey database results is inefficient, requires multiple serial links, takes time, and may ignore the quality inspection error records, affecting the quality inspection effect.
The control methods and systems of data cloud quality inspection are adopted to realize automated quality inspection processes through the coordinated work of database, inspection rule database and multiple quality inspection modules, reducing redundant rules and improving quality inspection efficiency.
It improves the work efficiency of data quality inspection and database construction, reduces the time-consuming waiting time for quality inspection, and enhances the accuracy and reliability of quality inspection results.
Smart Images

Figure CN118394735B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data quality inspection, and in particular to a control method for data cloud quality inspection and a data cloud quality inspection system. Background Art
[0002] The quality inspection of land survey database results is an important means to ensure the quality of results, including basic quality inspection and survey results verification in terms of data results graphics and attributes. At present, in order to meet the needs of basic quality inspection and results verification, corresponding inspection software is generally formulated according to corresponding rules and requirements to ensure the correctness of data results. Among them, for the basic quality inspection of results, the state formulates corresponding quality inspection software (hereinafter referred to as "national inspection software") and distributes it to local use. Under the traditional operation mode, after the county-level survey unit completes the construction of the land survey database results, it will use the national inspection software and results verification software for self-inspection in turn. The database results that pass the county-level self-inspection will be submitted to the provincial and national levels for inspection in turn. The provincial and national levels will use the national inspection software and results verification software for review in turn.
[0003] To ensure the quality of database results, all levels use national inspection software and results verification software to repeatedly check and modify the database. This process involves multiple steps such as county-level database construction, national inspection software self-inspection, verification software self-inspection, provincial quality inspection, and county-level modification and improvement. Each step is performed in series, and the next step can only be inspected after the previous step is completed, which consumes a lot of time and has low work efficiency. Moreover, when conducting self-inspection, there may be a situation where quality inspection error records are ignored and quality inspection results are reported directly to superiors, affecting the effectiveness of quality inspection work. Summary of the invention
[0004] The present invention provides a data cloud quality inspection control method and a data cloud quality inspection system to improve the work efficiency of data quality inspection and database construction.
[0005] The present invention provides a control method for data cloud quality inspection, which is applied to a data cloud quality inspection system, wherein the data cloud quality inspection system comprises a database, an inspection rule base and a plurality of quality inspection modules; the plurality of quality inspection modules at least comprises a first quality inspection module and a second quality inspection module; the first quality inspection module is used to perform quality inspection on first data to be inspected in the database, and the second quality inspection module is used to perform quality inspection on second data inspected by the first quality inspection module;
[0006] The method comprises:
[0007] Control the first quality inspection module to obtain the first data to be inspected in the database, perform quality inspection on the first data according to the first inspection rule, and generate a first quality inspection result; the first inspection rule is obtained from the inspection rule library; if the quality inspection of the first quality inspection module passes, the second data after quality inspection and the first quality inspection result are sent to the second quality inspection module, so that the second quality inspection module reviews the second data according to the first quality inspection result and generates a second quality inspection result.
[0008] Furthermore, the inspection rule base further includes:
[0009] If the inspection rule base receives at least two inspection rule groups, each of which includes several inspection rules, the similarity between the inspection rules in each inspection rule group is detected, the two inspection rules with similarity higher than a preset threshold are merged, and the inspection rules in the inspection rule base are updated.
[0010] Further, the first data is quality checked according to the first inspection rule to generate a first quality inspection result, specifically:
[0011] If an error is detected in the first data, a first error record is generated; according to a preset self-checking rule, it is determined whether there is an unmarkable exception type in the first error record;
[0012] If yes, it is determined that the quality inspection of the first quality inspection module fails, and a modification suggestion is generated according to the first error record as a first quality inspection result, and returned to the database;
[0013] If not, for the exception type corresponding to the error mark of the first data, it is determined that the quality inspection of the first quality inspection module has passed, and a first quality inspection record is generated according to the first error record as a first quality inspection result.
[0014] Furthermore, if an error is detected in the first data, generating a first error record also includes:
[0015] If no error is detected in the first data, a second quality inspection record is generated as the first quality inspection result.
[0016] Furthermore, after determining the exception type corresponding to the error mark of the first data, determining that the quality inspection of the first quality inspection module passes, and generating a first quality inspection record as a quality inspection result, the method further includes:
[0017] The first data is sent to the user end so that the user end reviews or modifies the first data, and the reviewed or modified data is returned to the first quality inspection module as the second data after quality inspection by the first quality inspection module.
[0018] Further, the second quality inspection module reviews the second data according to the first quality inspection result to generate a second quality inspection result, which is specifically:
[0019] If the first quality inspection result has a first error record, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked respectively according to the quality inspection auxiliary information and the parsing information to generate a second quality inspection result.
[0020] Further, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information, specifically:
[0021] Obtaining one or more of the error rule code, error rule name, quality inspection link name, error description and reference layer recorded in the first error record as quality inspection auxiliary information; and inspecting the second data according to the quality inspection auxiliary information;
[0022] According to the error positioning layer or error spot identification code recorded in the first error record, the corresponding error spot is extracted from the database as analysis information, and the second data is checked according to the analysis information.
[0023] Furthermore, after generating the second quality inspection result, the method further includes:
[0024] If the inspection of the second quality inspection module passes, and the second quality inspection module is not the last quality inspection module, sending the second data to the next quality inspection module for quality inspection;
[0025] If the inspection of the second quality inspection module passes, and the second quality inspection module is the last quality inspection module, the third data that passes the inspection of the second quality inspection module is stored.
[0026] Furthermore, it also includes:
[0027] The first data to be checked in the storage database and the intermediate data generated by each quality inspection module during the quality inspection process are stored in the dynamic file module for acquisition by each quality inspection module; the intermediate data generated by each quality inspection module during the quality inspection process includes: one or more of the quality inspection results, error records and second data after quality inspection generated by each quality inspection module.
[0028] As a preferred solution, the present invention formulates a unified quality inspection rule base, integrates similar rules, and removes redundant rules. Each quality inspection module obtains the inspection rules in the rule base to perform quality inspection on the data, thereby reducing the time consumption of quality inspection operation and improving the efficiency of quality inspection execution.
[0029] As a preferred solution, the present invention uses quality inspection error record generation and analysis technology to record quality inspection errors after the quality inspection of the previous quality inspection module is completed. The next quality inspection module only needs to parse the quality inspection error file, and there is no need to repeat quality inspection on the same content of the data, thereby reducing the waiting time for quality inspection and improving overall work efficiency.
[0030] As a preferred solution, the present invention sets up a rule exception control mechanism to stipulate that error records must be reviewed and modified, and only those that meet the conditions can be exported and reported as results packages, thereby improving the quality of database results and the effectiveness of the self-inspection work of the quality inspection module.
[0031] As a preferred solution, the present invention uses shared folder technology to store the data generated by the quality inspection module and the database, ensuring that the quality inspection module and the database use auxiliary data from the same source, and automatically loading the quality inspection results into the database after the quality inspection is completed, avoiding the repetition of related data results in the two softwares, and improving the work efficiency of database construction.
[0032] Other features and advantages of the present invention will be described in detail in the following detailed description.
[0033] Accordingly, the present invention also provides a data cloud quality inspection system, comprising: a database, a plurality of quality inspection modules and a dynamic file module; the plurality of quality inspection modules at least comprises a first quality inspection module and a second quality inspection module;
[0034] The first quality inspection module is used to perform quality inspection on the first data to be inspected in the database;
[0035] The second quality inspection module is used to perform quality inspection on the second data after quality inspection by the first quality inspection module;
[0036] The dynamic file module is used to store the first data to be checked in the database and the intermediate data generated by each quality inspection module during the quality inspection process for acquisition by each quality inspection module.
[0037] Correspondingly, the present invention also provides a computer-readable storage medium, which includes a stored computer program; wherein, when the computer program is running, it controls the device where the computer-readable storage medium is located to execute a control method for data cloud quality inspection as described in the content of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 It is a flow chart of an embodiment of a control method for data cloud quality inspection provided by the present invention;
[0039] Figure 2 It is a structural schematic diagram of an embodiment of the data cloud quality inspection system provided by the present invention. DETAILED DESCRIPTION
[0040] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0041] Embodiment 1
[0042] Please refer to Figure 1 , a control method for data cloud quality inspection provided by an embodiment of the present invention is applied to a data cloud quality inspection system, wherein the data cloud quality inspection system comprises a database, an inspection rule base and a plurality of quality inspection modules; the plurality of quality inspection modules comprises at least a first quality inspection module and a second quality inspection module; the first quality inspection module is used to perform quality inspection on first data to be inspected in the database, and the second quality inspection module is used to perform quality inspection on second data inspected by the first quality inspection module;
[0043] The present invention is preferably applied to the quality inspection of the results of the land survey database. The usual business process of this work is: after the county-level survey unit completes the construction of the land survey database results using the database construction software, it uses the national inspection software and the results verification software to conduct self-inspection in turn. The database results that pass the self-inspection of the county-level survey unit will be submitted to the provincial and national survey units for inspection in turn. The provincial and national survey units respectively use the national inspection software or the results verification software for review in turn.
[0044] As one of the preferred implementation plans, the data cloud quality inspection system integrates the national inspection software and the results verification software rules to formulate a unified results quality inspection rule base for the county level to carry out database self-inspection. At the same time, the relevant information of the county-level self-inspection is recorded, and the municipal, provincial and national levels are provided in turn for review. The specific modules include: a land survey database built by the county-level survey unit, an inspection rule base and two quality inspection modules; the three quality inspection modules are: a county-level database self-inspection module based on the integrated results quality inspection rule base, and a provincial review module based on the county-level database self-inspection error records. The county-level database self-inspection module obtains inspection rules from the unified inspection rule base to connect to the database results for inspection. The provincial review module conducts further manual review based on the error records generated by the county-level self-inspection.
[0045] The control method of data cloud quality inspection includes steps S101-S102:
[0046] Step S101: controlling a first quality inspection module to obtain first data to be inspected in a database, performing quality inspection on the first data according to a first inspection rule, and generating a first quality inspection result; the first inspection rule is obtained from an inspection rule library;
[0047] Furthermore, the inspection rule base further includes:
[0048] If the inspection rule base receives at least two inspection rule groups, each of which includes several inspection rules, the similarity between the inspection rules in each inspection rule group is detected, the two inspection rules with similarity higher than a preset threshold are merged, and the inspection rules in the inspection rule base are updated.
[0049] In this embodiment, the inspection rules written in the inspection rule library include: quality inspection rule name, quality inspection rule execution content, reference layers required for quality inspection rule execution, and quality inspection rule error description, etc. Different quality inspection rules have different above contents.
[0050] Under the current model, some of the rules and regulations for national inspection and results verification are similar or repeated. County-level self-inspection and provincial-level quality inspection work both implement all national inspection rules and results verification rules to check database results. Due to the large number of quality inspection rules, the more patches a county has, the longer it takes to run the database quality inspection, which affects the efficiency of data rectification and submission. At the same time, the county and provincial levels use relevant quality inspection software to execute the inspection rules, which takes a long time to wait and affects the overall work efficiency.
[0051] As a preferred solution, this embodiment formulates a unified quality inspection rule base, integrates similar rules, and removes redundant rules. The county-level self-inspection module obtains the inspection rules in the rule base to perform quality inspection on the data, reducing the time consumption of quality inspection operation and improving the efficiency of quality inspection execution.
[0052] Further, the first data is quality checked according to the first inspection rule to generate a first quality inspection result, specifically:
[0053] If an error is detected in the first data, a first error record is generated; according to a preset self-checking rule, it is determined whether there is an unmarkable exception type in the first error record;
[0054] If yes, it is determined that the quality inspection of the first quality inspection module fails, and a modification suggestion is generated according to the first error record as a first quality inspection result, and returned to the database;
[0055] If not, for the exception type corresponding to the error mark of the first data, it is determined that the quality inspection of the first quality inspection module has passed, and a first quality inspection record is generated according to the first error record as a first quality inspection result.
[0056] Furthermore, if an error is detected in the first data, generating a first error record also includes:
[0057] If no error is detected in the first data, a second quality inspection record is generated as the first quality inspection result.
[0058] Furthermore, after determining the exception type corresponding to the error mark of the first data, determining that the quality inspection of the first quality inspection module passes, and generating a first quality inspection record as a quality inspection result, the method further includes:
[0059] The first data is sent to the user end so that the user end reviews or modifies the first data, and the reviewed or modified data is returned to the first quality inspection module as the second data after quality inspection by the first quality inspection module.
[0060] As a preferred solution, in order to effectively ensure the effect of county-level self-inspection, a self-inspection rule exception control mechanism is set up to distinguish whether different error results can be exceptions. If the error result detected is an exception type that can be marked, the error result is marked as an exception, and the corresponding exception type is marked. The specific situation is as follows:
[0061] If there are no error records after the quality inspection is completed, no marking is required and a quality inspection record can be generated.
[0062] If, after the quality inspection is completed, there are errors of the type that cannot be marked as exceptions in the error record, the quality inspection record cannot be generated. The county-level investigation unit shall modify and improve the errors of the type that cannot be marked as exceptions according to the requirements of the relevant database construction.
[0063] If, after the quality inspection is completed, all error records are marked as exception types, a quality inspection record can be generated. The county-level investigation unit will review or modify the error records one by one according to the relevant database construction requirements, including: correcting the error results; or marking the error results that do not need to be modified as exceptions and marking the corresponding exception types.
[0064] Under the current model, according to relevant work requirements, county-level survey units need to use relevant quality inspection software to conduct a comprehensive self-inspection of database results before submitting them to the provincial level. After inspection, if the results meet the national and provincial requirements, they will be submitted to the provincial level for verification; if they do not meet the requirements, the county level needs to make rectifications according to the relevant database construction. In actual work, due to time constraints and heavy tasks, there may be cases where county-level survey units directly export the corresponding reported database results after performing self-inspection work, making the self-inspection work a formality.
[0065] As a preferred implementation scheme, this embodiment sets up a rule exception control mechanism, formulates a logical control mechanism between quality inspection error record generation, quality inspection error exceptions, and report result export, implements county-level database result self-inspection work, and ensures the quality of database results. At the same time, it is stipulated that error records must be reviewed and modified and improved, and only those that meet the conditions can be exported and reported result packages, which improves the quality of database results and improves the effectiveness of the self-inspection work of the quality inspection module.
[0066] On the basis of setting up the quality inspection rule exception control mechanism, in order to reduce the waiting time for provincial-level verification work, a quality inspection error record generation and analysis technology is designed. During the county-level quality inspection, the relevant information of the error record is recorded to form a quality inspection error record file corresponding to the reported results package, which is convenient for the provincial level to parse the file after receiving the results package and directly generate provincial-level quality inspection tasks, avoiding the provincial level from executing the rules for quality inspection again, reducing the waiting time for work and improving work efficiency.
[0067] Step S102: If the quality inspection of the first quality inspection module passes, the inspected second data and the first quality inspection result are sent to the second quality inspection module, so that the second quality inspection module reviews the second data according to the first quality inspection result and generates a second quality inspection result.
[0068] Further, the second quality inspection module reviews the second data according to the first quality inspection result to generate a second quality inspection result, which is specifically:
[0069] If the first quality inspection result has a first error record, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked respectively according to the quality inspection auxiliary information and the parsing information to generate a second quality inspection result.
[0070] Further, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information, specifically:
[0071] Obtaining one or more of the error rule code, error rule name, quality inspection link name, error description and reference layer recorded in the first error record as quality inspection auxiliary information; and inspecting the second data according to the quality inspection auxiliary information;
[0072] According to the error positioning layer or error spot identification code recorded in the first error record, the corresponding error spot is extracted from the database as analysis information, and the second data is checked according to the analysis information.
[0073] In this embodiment, when the quality inspection error record is generated, the county-level survey unit forms a corresponding quality inspection error record file based on the synchronous recording of the error rule code, error rule name, quality inspection link name, error positioning layer, error spot identification code (i.e., unique code), error description, reference layer and other provincial quality inspection related information. When the county-level survey unit submits the database results to the provincial-level survey unit, it also submits the quality inspection error record file.
[0074] After acceptance by the provincial investigation unit, the quality inspection error record file is parsed, and the corresponding error spots are extracted from the database results based on the "error spot identification code" and "error positioning layer"; the corresponding error spots are included in the corresponding links of the provincial quality inspection based on the "quality inspection link name"; based on the "error rule name", "error description" and "reference layer", the provincial quality inspection auxiliary information is extracted and displayed in the provincial quality inspection link.
[0075] When the data results are executing the quality inspection rules, if the data does not meet the requirements of the quality inspection rules, the system will report an error, record the error result information, and display the "quality inspection rule name" and "quality inspection rule error description". At the same time, the corresponding layer is extracted according to the "reference layer required for quality inspection rule execution" to assist users in checking the error.
[0076] As a preferred solution, this embodiment uses quality inspection error record generation and analysis technology to record quality inspection errors after the quality inspection of the previous quality inspection module is completed. The next quality inspection module only needs to parse the quality inspection error file, and there is no need to repeat quality inspection on the same content of the data, thereby reducing the waiting time for quality inspection and improving overall work efficiency.
[0077] Furthermore, after generating the second quality inspection result, the method further includes:
[0078] If the inspection of the second quality inspection module passes, and the second quality inspection module is not the last quality inspection module, sending the second data to the next quality inspection module for quality inspection;
[0079] If the inspection of the second quality inspection module passes, and the second quality inspection module is the last quality inspection module, the third data that passes the inspection of the second quality inspection module is stored.
[0080] In this embodiment, after the data is verified by the provincial survey unit, the database results will be exported to the country for national verification.
[0081] Furthermore, it also includes:
[0082] The first data to be checked in the storage database and the intermediate data generated by each quality inspection module during the quality inspection process are stored in the dynamic file module for acquisition by each quality inspection module; the intermediate data generated by each quality inspection module during the quality inspection process includes: one or more of the quality inspection results, error records and second data after quality inspection generated by each quality inspection module.
[0083] In this embodiment, the intermediate result data generated when the county-level survey units use database construction software to build the database, and the national inspection software or results verification software of the survey units at all levels check the data results are stored in a dynamic folder, so that each software can read or call the data in the folder in real time.
[0084] Exemplarily, when the county-level investigation unit uses database construction software to build a database, the first data to be checked in the database is stored in a dynamic folder, and the first quality inspection module is controlled to obtain the first data to be checked in the database in the dynamic folder; it should be noted that the "obtain" operation in this article includes: reading or calling.
[0085] The first quality inspection module performs quality inspection on the first data, and stores the generated first quality inspection result (first error record and first quality inspection record) and the second data after quality inspection by the first quality inspection module in a dynamic folder; sends the second data in the dynamic folder and the first quality inspection result to the second quality inspection module, or controls the second quality inspection module to obtain the second data and the first quality inspection result in the dynamic folder, and performs quality inspection on the second data.
[0086] Under the current model, the county-level survey unit first uses the database construction software to build the database results. After the database results are exported, they are loaded into the quality inspection software together with the auxiliary data for quality inspection. If there are erroneous records that need to be modified and improved after the quality inspection, the quality inspection results need to be exported and returned to the database construction software for modification. Since there are many reference data for the construction of the land survey database, the import and export of relevant data results between the two softwares not only poses the risk of database construction personnel using the wrong data, but also involves a lot of waiting time. As a preferred solution, the present invention uses the connection technology of quality inspection software and database construction software and the shared folder technology to ensure that the quality inspection software and the database construction software use auxiliary data from the same source, so that the quality inspection results are automatically loaded in the database construction software after the quality inspection is completed, avoiding the repetition of relevant data results in the two softwares, and improving the efficiency of database construction.
[0087] Embodiment 2
[0088] Please refer to Figure 2, a data cloud quality inspection system provided by an embodiment of the present invention includes: a database 201, a plurality of quality inspection modules and a dynamic file module 203; the plurality of quality inspection modules at least include a first quality inspection module 2021 and a second quality inspection module 2022;
[0089] The first quality inspection module is used to perform quality inspection on the first data to be inspected in the database;
[0090] The second quality inspection module is used to perform quality inspection on the second data after quality inspection by the first quality inspection module;
[0091] The dynamic file module is used to store the first data to be checked in the database and the intermediate data generated by each quality inspection module during the quality inspection process for acquisition by each quality inspection module.
[0092] The above-mentioned data cloud quality inspection system can implement the control method of data cloud quality inspection of the above-mentioned method embodiment. The options in the above-mentioned method embodiment are also applicable to this embodiment and will not be described in detail here. The rest of the contents of the embodiment of this application can refer to the contents of the above-mentioned method embodiment, and will not be repeated in this embodiment.
[0093] Embodiment 3
[0094] Correspondingly, the present invention also provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the control method for data cloud quality inspection as described in any one of the above embodiments.
[0095] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program in the terminal device.
[0096] The terminal device may be a computing device such as a desktop computer, a notebook, a PDA, a cloud server, etc. The terminal device may include, but is not limited to, a processor and a memory.
[0097] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the terminal device, and uses various interfaces and lines to connect various parts of the entire terminal device.
[0098] The memory can be used to store the computer program and / or module, and the processor realizes various functions of the terminal device by running or executing the computer program and / or module stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, etc.; the data storage area can store data created according to the use of the mobile terminal, etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0099] Wherein, if the module / unit integrated in the terminal device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.
[0100] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.
Claims
1. A control method for data cloud quality inspection, characterized in that: Applied to a data cloud quality inspection system, the data cloud quality inspection system includes a database, an inspection rule base and a plurality of quality inspection modules; the plurality of quality inspection modules include at least a first quality inspection module and a second quality inspection module; the first quality inspection module is used to perform quality inspection on first data to be inspected in the database, and the second quality inspection module is used to perform quality inspection on second data inspected by the first quality inspection module; The method comprises: Control the first quality inspection module to obtain the first data to be inspected in the database, perform quality inspection on the first data according to the first inspection rule, and generate a first quality inspection result, specifically: If an error is detected in the first data, a first error record is generated; according to a preset self-checking rule, it is determined whether there is an unmarkable exception type in the first error record; If yes, it is determined that the quality inspection of the first quality inspection module fails, and a modification suggestion is generated according to the first error record as a first quality inspection result, and returned to the database; If not, determining that the quality inspection of the first quality inspection module passes for the exception type corresponding to the error mark of the first data, and generating a first quality inspection record as a first quality inspection result according to the first error record; The first inspection rule is obtained from an inspection rule library; If the quality inspection of the first quality inspection module passes, the second data after the quality inspection and the first quality inspection result are sent to the second quality inspection module, so that the second quality inspection module reviews the second data according to the first quality inspection result and generates a second quality inspection result; After determining the exception type corresponding to the error mark of the first data, determining that the quality inspection of the first quality inspection module passes, and generating a first quality inspection record as a quality inspection result, the method further includes: Sending the first data to a user terminal so that the user terminal reviews or modifies the first data, and returning the reviewed or modified data to the first quality inspection module as second data after quality inspection by the first quality inspection module; The second quality inspection module reviews the second data according to the first quality inspection result to generate a second quality inspection result, which is specifically: If the first quality inspection result has a first error record, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information to generate a second quality inspection result; The first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information, specifically: Obtaining one or more of the error rule code, error rule name, quality inspection link name, error description and reference layer recorded in the first error record as quality inspection auxiliary information; and inspecting the second data according to the quality inspection auxiliary information; According to the error positioning layer or the error spot identification code recorded in the first error record, extract the corresponding error spot from the database as parsing information, and check the second data according to the parsing information; If the inspection rule base receives at least two inspection rule groups, each of which includes several inspection rules, the similarity between the inspection rules in each inspection rule group is detected, the two inspection rules with similarity higher than a preset threshold are merged, and the inspection rules in the inspection rule base are updated.
2. A control method for data cloud quality inspection as claimed in claim 1, characterized in that: If an error is detected in the first data, a first error record is generated, which also includes: If no error is detected in the first data, a second quality inspection record is generated as the first quality inspection result.
3. A control method for data cloud quality inspection according to claim 1, characterized in that: After generating the second quality inspection result, the method further includes: If the inspection of the second quality inspection module passes, and the second quality inspection module is not the last quality inspection module, sending the second data to the next quality inspection module for quality inspection; If the inspection of the second quality inspection module passes, and the second quality inspection module is the last quality inspection module, the third data that passes the inspection of the second quality inspection module is stored.
4. A control method for data cloud quality inspection as claimed in claim 1, characterized in that: Also includes: The first data to be checked in the storage database and the intermediate data generated by each quality inspection module during the quality inspection process are stored in the dynamic file module for acquisition by each quality inspection module; The intermediate data generated by each quality inspection module during the quality inspection process includes: one or more of the quality inspection results, error records and second data after quality inspection generated by each quality inspection module.
5. A data cloud quality inspection system, characterized in that: include: A database, an inspection rule base, several quality inspection modules and a dynamic file module; the several quality inspection modules include at least a first quality inspection module and a second quality inspection module; The first quality inspection module is used to perform quality inspection on the first data to be inspected in the database, including: obtaining the first data to be inspected in the database, performing quality inspection on the first data according to a first inspection rule, and generating a first quality inspection result, specifically: If an error is detected in the first data, a first error record is generated; according to a preset self-checking rule, it is determined whether there is an unmarkable exception type in the first error record; If yes, it is determined that the quality inspection of the first quality inspection module fails, and a modification suggestion is generated according to the first error record as a first quality inspection result, and returned to the database; If not, determining that the quality inspection of the first quality inspection module passes for the exception type corresponding to the error mark of the first data, and generating a first quality inspection record as a first quality inspection result according to the first error record; After determining the exception type corresponding to the error mark of the first data, determining that the quality inspection of the first quality inspection module passes, and generating a first quality inspection record as a quality inspection result, the method further includes: Sending the first data to a user terminal so that the user terminal reviews or modifies the first data, and returning the reviewed or modified data to the first quality inspection module as second data after quality inspection by the first quality inspection module; The first inspection rule is obtained from an inspection rule library; The second quality inspection module is used to perform quality inspection on the second data after quality inspection by the first quality inspection module, including: performing a review check on the second data according to the first quality inspection result to generate a second quality inspection result; The second quality inspection module reviews the second data according to the first quality inspection result to generate a second quality inspection result, which is specifically: If the first quality inspection result has a first error record, the first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information to generate a second quality inspection result; The first error record is parsed to generate quality inspection auxiliary information and parsing information, and the second data is checked according to the quality inspection auxiliary information and the parsing information, specifically: Obtaining one or more of the error rule code, error rule name, quality inspection link name, error description and reference layer recorded in the first error record as quality inspection auxiliary information; and inspecting the second data according to the quality inspection auxiliary information; According to the error positioning layer or the error spot identification code recorded in the first error record, extract the corresponding error spot from the database as parsing information, and check the second data according to the parsing information; The dynamic file module is used to store the first data to be checked in the database and the intermediate data generated by each quality inspection module during the quality inspection process for acquisition by each quality inspection module; If the inspection rule base receives at least two inspection rule groups, each of which includes several inspection rules, the similarity between the inspection rules in each inspection rule group is detected, the two inspection rules with similarity higher than a preset threshold are merged, and the inspection rules in the inspection rule base are updated.
Citation Information
Patent Citations
Electronic map data incremental data checking and correcting method, electronic map data incremental data checking and correcting apparatus, and navigation system
CN108279013A