Data quality detection method and device

A technology of data quality and detection methods, applied in the field of data processing

Pending Publication Date: 2020-01-31
BEIJING MININGLAMP SOFTWARE SYST CO LTD
View PDF11 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present invention provides a data quality detection method and device to at least solve the problem of how to comprehensively judge the quality of data in related technologies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality detection method and device
  • Data quality detection method and device
  • Data quality detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0023] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.

[0024] In this embodiment, a data quality detection method is provided, figure 1 is a flow chart of a method according to an embodiment of the present invention, such as figure 1 As shown, the process includes the following steps:

[0025] Step S102, obtaining a data table that needs to be inspected for data quality;

[0026] Step S104, performing data quality inspection on each field of the data table using corresponding checking rules to obtain th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data quality detection method and device. The method comprises the steps of obtaining a data table needing to be subjected to data quality detection; carrying out data qualitydetection on each field of the data table by adopting a corresponding check rule to obtain a data quality detection value of each field under each dimension, the dimension at least comprising one ofconsistency, timeliness, accuracy and uniqueness; and performing weighted calculation on the data quality detection value of each field under each dimension to obtain a data quality detection value ofthe data table. According to the invention, quality detection is carried out on the data quality from multiple dimensions of consistency, timeliness, accuracy and uniqueness, and the data quality canbe evaluated step by step from a field level, a data table level, a data source level and a database level, so that the quality reliability of access data is ensured to a great extent.

Description

technical field [0001] The present invention relates to the field of data processing, in particular to a data quality detection method and device. Background technique [0002] In the process of data collection, storage, and transmission, it is inevitable that there will be problems such as data errors and missing data. The existence of data is because of its value. Some data are used as evidence, and some data are used for analysis and prediction. No matter what the role of data is, if there are errors, deletions and other problems in the data, the value of the data will be reduced, and sometimes even bring serious disasters. Therefore, ensuring the high quality of data is the basis for effective use of data. However, how to comprehensively judge the quality of data is also a problem currently facing. Contents of the invention [0003] Embodiments of the present invention provide a data quality detection method and device, so as to at least solve the problem of how to c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215
CPCG06F16/215
Inventor 郑伟波张毅然
Owner BEIJING MININGLAMP SOFTWARE SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap