Unlock instant, AI-driven research and patent intelligence for your innovation.

Data quality monitoring method and device, electronic equipment and storage medium

A data quality and database technology, applied in the field of data processing, can solve problems such as network transmission waste and storage space waste, and achieve the effect of solving storage space waste and network transmission waste

Pending Publication Date: 2022-04-15
杭州隆埠科技有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides a data quality monitoring method, device, electronic equipment, and storage medium, which can solve the problems of storage space waste and network transmission waste in multi-data source data quality monitoring, and realize one verification task to support multiple data at the same time source engine

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality monitoring method and device, electronic equipment and storage medium
  • Data quality monitoring method and device, electronic equipment and storage medium
  • Data quality monitoring method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0020] The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein, and that references to "first," "second," et...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data quality monitoring method and device, electronic equipment and a storage medium, belongs to the technical field of data processing, and is used for solving the problems of storage space waste and network transmission waste in multi-data-source data quality monitoring, and realizing that one verification task supports a plurality of data source engines at the same time. The method comprises the following steps: determining a target verification rule; determining a target data source engine, wherein the target data source engine is used for linking one or more target data sources; according to the target verification rule and the target data source engine, target data is verified, a target verification result is determined, and the target data is from the one or more target data sources; according to a preset verification rule, the target verification result is verified, a verification result is obtained, and the preset verification rule comprises a preset verification value and a preset verification type.

Description

technical field [0001] The present application belongs to the technical field of data processing, and in particular relates to a data quality monitoring method, device, electronic equipment and storage medium. Background technique [0002] With the advent of the era of big data, the application of data is ubiquitous. The importance of data quality as the basis for the validity and accuracy of data analysis and data mining conclusions is self-evident. Data quality monitoring is to periodically check and verify the original data, intermediate data, and result data of the data task to ensure the correctness or rationality of the output results of the data task. [0003] In reality, the data that needs to be monitored may be stored in different data engines, that is, data from multiple data sources needs to be monitored. The first method is to design a set of data verification tasks for each data source, but this method only supports a single computing engine, and cannot reali...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/28
Inventor 周觅
Owner 杭州隆埠科技有限公司