Data quality audit method based on database schema

A technology of data quality and database, applied in data processing applications, electrical digital data processing, special data processing applications, etc., can solve problems such as data anomalies, achieve the goal of strengthening measurement management capabilities, improving measurement work quality, and improving measurement work efficiency Effect

Inactive Publication Date: 2012-07-25
ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
View PDF4 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a data quality audit method based on database mode, which solves the data abnormality caused by various complicated reasons in the data extraction process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality audit method based on database schema
  • Data quality audit method based on database schema
  • Data quality audit method based on database schema

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The data quality audit function is divided into three modules, namely KPI indicator management, data quality analysis and alarm management.

[0021] 1), KPI indicator management

[0022] The data to be verified is divided into three types: basic data, measurement data and documents. The basic data data needs to be checked for correlation integrity and important attribute non-empty; for the measurement data, it needs to be checked for the mutation of the detailed data and the summary measurement data, the line loss data exceeds the threshold value, and the summary measurement data consistency check, details Data integrity rate verification. File verification refers to the normative verification of interface files and the normative verification of interface file loading data.

[0023] a. Create indicators

[0024] Add the function of creating KPI indicators on the front page, allowing users to establish data value ranges, verification rules, and verification strategies.

[0025]...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data quality audit method based on a database schema. The data quality audit method comprises a preprocessing module, a gathering module, a KPI (key performance indicator) processing module, an alarm information warehousing module and a KPI information warehousing module. With the adoption of the data quality audit method, data abnormalities caused by various complex reasons appearing in the data extraction process are solved. According to the data quality audit method, all data needing to be focused on are monitored in real time, various abnormal data are fast monitored, fast positioned and accurately alarmed, and the reliability, the usability and the authenticity of system data are improved.

Description

technical field [0001] The invention relates to the technical field of data quality auditing, in particular to providing a data quality auditing method based on a rule parser in a database mode. Background technique [0002] In the massive power metering data, through the establishment of a data warehouse or data mart system, the massive concentration, calculation, data mining, and predictive analysis of various data can be realized. And these basic source data are generally considered to be correct. However, in the actual process, we found that through the analysis of the province's metering automation master station system, there may be data anomalies and errors in the process of data collection, data uploading, and final data intermediate calculation of each source data. For example: the master station metering data is missing due to the inability to collect remote terminal data, or the availability and reliability of system data is reduced due to business management and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06Q50/06
Inventor 杨劲锋陈锐民肖勇孙卫明党三磊阙华坤刘健刘明王祖祥
Owner ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap