Data quality detection method and device and storage medium

A technology for data quality and detection methods, applied in the field of data processing, can solve the problems of difficulty in guaranteeing detection efficiency, limited test case coverage, and missed detection of abnormal data, so as to improve coverage and accuracy, and reduce labor and time costs. , the effect of improving the detection efficiency

Pending Publication Date: 2019-04-19
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because this method involves human participation and the coverage rate of test cases is limited, there is a possibility of missed detection of abnor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality detection method and device and storage medium
  • Data quality detection method and device and storage medium
  • Data quality detection method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0035] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with several drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0036] The invention provides an electronic device. Reference figure 1 Shown is a schematic diagram of an embodiment of the electronic device 1 of the present invention. In this embodiment, the electronic device 1 may be a terminal device with storage and computing functions, such as a server, a smart phone, a tablet computer, a portable computer, a desktop computer, and the like. In an embodime...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a big data technology, and provides a data quality detection method and device and a computer readable storage medium. The method comprises the steps of acquiring at least onepiece of to-be-detected data from a data source,wherein each piece of to-be-detected data comprises content data and metadata; matching at least one detection rule for each piece of to-be-detected data in a pre-established detection rule base according to a preset matching rule; and detecting the to-be-detected data by using a matched detection rule to obtain a data quality detection result. According to the invention, data quality detection automation can be realized, the data quality detection efficiency is improved, and the labor and time costs are reduced.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data quality detection method, device and computer-readable storage medium. Background technique [0002] With the development of information technology and the advent of the era of big data, data information is developing in a massive and diversified direction, and data quality is increasingly valued by various enterprises and government departments. Among them, how to flexibly, accurately and efficiently detect data quality is a research direction worthy of attention. [0003] At present, for the detection of data quality, testers usually need to construct a comprehensive test case for each field according to the business logic, that is, the tester writes the code and execution logic of the test case, and the tester judges whether there is an exception in the execution result , Whether to meet business needs. If the repair of abnormal data is involved after the test...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/36G06F16/215
CPCG06F11/3684G06F11/3688G06F11/3692
Inventor 袁泉
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap