Model-based data quality checking method and device

A data quality and data technology, applied in the computer field, can solve problems that affect the normal use of database resources by users, increase the pressure on database services, and multiple database resources, so as to meet individual needs, avoid excessive occupation of database resources, and ensure The effect of normal use

Pending Publication Date: 2022-04-12
上海柯林布瑞信息技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that this verification method requires frequent reading operations on the database, such as complex operations such as data judgment, sorting, type conversion, and logic judgment, which will occupy too many database resources and increase the service pressure of the database. Affect the normal use of database resources by users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model-based data quality checking method and device
  • Model-based data quality checking method and device
  • Model-based data quality checking method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] figure 1 It is a flow chart of a model-based data quality checking method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of performing quality checking on database table data stored in a database. The method can be executed by a model-based data quality checking device, which can be realized by software and / or hardware, and integrated in electronic equipment. Such as figure 1 As shown, the method specifically includes the following steps:

[0027] S110. Obtain the data to be checked in the target database.

[0028] Wherein, the target database may refer to a relational database that needs to verify data. The data to be checked may refer to the data stored in the target database whose quality needs to be checked.

[0029] S120. Input the data to be verified into the data verification model for data verification, wherein the data verification model is pre-created based on verification configuration information, and the ver...

Embodiment 2

[0042] figure 2 A flow chart of a model-based data quality verification method provided by Embodiment 2 of the present invention. This embodiment describes the creation process of the data verification model in detail on the basis of the above-mentioned embodiments, and on this basis , further optimized the data quality verification process. The explanations of terms that are the same as or corresponding to the above-mentioned embodiments will not be repeated here.

[0043] see figure 2 The model-based data quality checking method provided in this embodiment specifically includes the following steps:

[0044] S310. Obtain verification configuration information.

[0045] Specifically, a corresponding configuration file can be generated based on the verification information configured by the user on the configuration interface, so that the verification configuration information corresponding to the target database can be obtained by parsing the configuration file, and the v...

Embodiment 3

[0070] image 3 It is a schematic structural diagram of a model-based data quality checking device provided by Embodiment 3 of the present invention. This embodiment is applicable to the case of performing quality checking on database table data stored in a database. Such as image 3 As shown, the device includes: a data to be checked acquisition module 710 , a data to be checked input module 720 and a check result determination module 730 .

[0071] Among them, the data to be checked acquisition module 710 is used to acquire the data to be checked in the target database; the data to be checked input module 720 is used to input the data to be checked into the data checking model for data checking, wherein the data checking model is pre- Created based on the verification configuration information, which is obtained through configuration based on the metadata corresponding to the target database; the verification result determination module 730 is used to determine the verifica...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data quality checking method and device based on a model. The method comprises the steps of obtaining to-be-checked data in a target database; the to-be-checked data is input into a data checking model for data checking, the data checking model is created in advance based on checking configuration information, and the checking configuration information is obtained through configuration based on metadata corresponding to the target database; and determining a checking result corresponding to the to-be-checked data based on the output of the data checking model. According to the technical scheme, the situation that too much database resources are occupied due to data checking can be avoided, the service pressure of the database is reduced, and normal use of the database is guaranteed.

Description

technical field [0001] The embodiments of the present invention relate to computer technology, and in particular to a model-based data quality checking method and device. Background technique [0002] With the rapid development of computer technology, it is usually necessary to check the quality of the data stored in the database. For example, to detect data consistency, relevance, standardization and integrity, etc. [0003] At present, the corresponding data verification SQL statement is usually generated based on the specific structure of the database table, and the data verification is performed on the database by executing the SQL statement. It can be seen that this verification method requires frequent reading operations on the database, such as complex operations such as data judgment, sorting, type conversion, and logic judgment, which will occupy too many database resources and increase the service pressure of the database. Affect the normal use of database resour...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06F16/22G06F16/2453G06F16/28
Inventor 秦晓宏黄主斌
Owner 上海柯林布瑞信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap