Data quality auditing method and device, equipment and storage medium

A data quality and data configuration technology, applied in the computer field, can solve problems such as cumbersome operation, program solidification, and inconvenient data quality auditing, and achieve the effects of improving efficiency, strong versatility, and convenient acquisition methods

Pending Publication Date: 2021-06-22
ALIBABA GRP HLDG LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, with this method, when the data to be audited changes, it needs to be recoded to reset the execution program on the computing platform. The operation is cumbersome and the program is fixed, which makes the data quality audit very inconvenient.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality auditing method and device, equipment and storage medium
  • Data quality auditing method and device, equipment and storage medium
  • Data quality auditing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to make the above objects, features and advantages of the present application more obvious and understandable, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0036] figure 1A structure diagram of a data quality auditing system according to an embodiment of the present application is shown. The data quality auditing system mainly includes a configuration server, an audit server, a calculation processing end, and a database. Among them, the configuration server is used to define relevant rules and data for data quality audit; the audit server performs data audit processing according to the data and rules configured by the configuration server, such as generating corresponding data configuration information and audit rules, and the data configuration information can be It is understood as the information related to the audited indicators Metrics, and the statist...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data quality auditing method, device and equipment and a storage medium. The method comprises the steps: determining an auditing rule and data configuration information corresponding to the auditing rule, the data configuration information is used for determining to-be-auditing data in a storage database, and the to-be-auditing data is stored in the storage database; the auditing rule is used for evaluating the data quality of the to-be-audited data; generating a data collection task according to a target database and the data configuration information; acquiring the to-be-audited data according to the data collection task; and performing auditing processing on the to-be-audited data according to the auditing rule to obtain an auditing result. The auditing data determination and collection mode is convenient and fast, the universality is high, and the data quality auditing efficiency can be improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data quality auditing method, device, equipment and storage medium. Background technique [0002] Data quality audit is the data quality control in each link of production, processing, transmission, storage, use and exchange in the data life cycle. Usually, data quality rules are configured to detect whether data quality meets the requirements of data users. Currently, data quality rules are configured and audited from data integrity, data consistency, data timeliness, data accuracy, and data logic. For quality rules Monitor and alarm for rules that do not pass. [0003] In the existing data quality audit method, the computing platform executes the set executable program to obtain the source data, obtains the source data stored in the database according to the set execution program, and analyzes the source data to obtain the data to be audited , and then the compu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215
CPCG06F16/215
Inventor 徐攀登黄晓婧韩翼
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap