Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Modular data quality checking method

A technology of data quality and componentization, which is applied in digital data information retrieval, electronic digital data processing, special data processing applications, etc., can solve the problems of long data inspection cycle, human misjudgment and missed judgment, and shorten the inspection time. Effects of Periodicity, Reduced Periodicity, Increased Flexibility and Dynamics

Pending Publication Date: 2020-01-17
中电万维信息技术有限责任公司
View PDF11 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This process relies on a large number of relevant personnel, there are human errors and missed judgments, and the data verification cycle is long and other problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Modular data quality checking method
  • Modular data quality checking method
  • Modular data quality checking method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Such as figure 1 , figure 2 , image 3 As shown, a componentized data quality inspection method of the present invention includes the following steps,

[0020] a. Customize the data source component to obtain the data source, data table structure and field information that needs to be checked;

[0021] b. Customization of checking rule components, including customized components, custom components and combined components,

[0022] c. Check process configuration, set the source table and problem storage table based on the data source component defined in step a by dragging and dropping, and use the check rule component defined in step b to freely combine the task check process;

[0023] d. Quality report management, according to the customized data quality report template, through the verification results of step c, statistically generate a quality report;

[0024] e. Scheduling of the verification process, unified scheduling of the verification process of step c, s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of data quality processing, in particular to a modular data quality checking method, which comprises the following steps: a, customizing a data source component; b, customizing a check rule component; c, check process configuration: setting a source table and a problem storage table based on the data source components defined in the step a in a draggingmanner, and freely combining task check processes by using the check rule components defined in the step b; d, quality report management: performing statistics to generate a quality report; e, scheduling a check process; and f, data rectification and feedback. The modular data quality checking method simplifies the traditional data quality check process from the operation level, reduces the periodicity of data quality check, and provides the modular data quality self-service check method. By adopting the modular data quality checking method, a basis can be provided for improvement and rectification of data quality, and a check process is converted into a component type operation process, and the flexibility and dynamics of the check process are improved, and the personnel coupling degreeis reduced, and the check periodicity is shortened.

Description

technical field [0001] The invention relates to the technical field of data quality processing, in particular to a componentized data quality checking method. Background technique [0002] With the development of business and technology, the scale of data is growing in a spurt, the data standards are different, the data structure is becoming more and more complex, the types of data are increasing, and the requirements for data application and analysis are increasing. Data quality problems are the first to be solved and need to be resolved quickly. Data quality aims to find problematic data, invalid data, and non-standard data, and feed back to relevant departments for data rectification, help improve data quality, and support leadership decision-making and business analysis. It usually requires the cooperation of business personnel and technical personnel to complete. According to the business requirements put forward by the business personnel and the current data, the techn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/2458G06F16/248
CPCG06F16/2458G06F16/248
Inventor 田永艳刘涛张宝玉刘博
Owner 中电万维信息技术有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com