Data quality big data treatment implementing method, electronic device and storage medium

A technology of data quality and realization method, which is applied in the fields of electronic digital data processing, database management system, special data processing application, etc.

Inactive Publication Date: 2018-06-08
FOSHAN POWER SUPPLY BUREAU GUANGDONG POWER GRID
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the deficiencies of the existing technology, one of the purposes of the present invention is to provide a data quality big

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality big data treatment implementing method, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] Below, the present invention will be further described in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of not conflicting, the various embodiments described below or the technical features can be combined arbitrarily to form new embodiments. .

[0030] like figure 1 As shown, the present invention provides a method for implementing data quality big data governance, which includes the following steps:

[0031] S1: Extracting page data according to a first preset rule, and classifying the page data according to a second preset rule to form metadata corresponding to a corresponding category;

[0032] Before the application, first combine the experience of data quality governance, refine the assessment rules of data quality, sort out the scope of data capture, and formulate appropriate capture conditions, which is the first preset rule. In the present invention, the first preset rule is: when it...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data quality big data treatment implementing method. The method includes the following steps of extracting page data according to a first preset rule and classifying the pagedata according to a second preset rule to form metadata corresponding to a corresponding type, conducting code refactoring on the page data on the basis of a program analysis technology to automatically generate a service interface, combining the page data, rule identification corresponding to the first preset rule and data source information of the page data to form a data file, and sending thedata file to a server so that the data file can be analyzed and storage by the server. Data reconstruction can be achieved without depending on an existing manufacturer by means of a data support implementing API interface, and the technical implementation of a data quality treatment mode can be conducted under the conditions of a closed data base, a lacked file source code, an absent developmentteam and a third-party commercial component.

Description

technical field [0001] The invention relates to a heterogeneous data governance technology, in particular to a data governance big data governance implementation method, electronic equipment and a storage medium. Background technique [0002] At present, in the field of data quality optimization, the industry mainstream uses a centralized data quality management system. The traditional centralized data quality management system realizes the standardized management of verification rules, the scheduling of rule execution time, and the unified management of data quality reports, which improves the efficiency and management level of data quality verification. The limitation of this centralized data quality management system lies in the use of traditional database centralized storage, which is prone to performance bottlenecks when processing massive amounts of data. [0003] In the process of data governance, data collection is an indispensable part. With the increasing amount o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F8/72G06F9/451
CPCG06F8/72G06F16/215G06F16/25G06F16/27G06F16/951
Inventor 王永才庞伟林余永忠陈轶斌宋才华林浩范婷徐培瑶刘胜强蓝源娟
Owner FOSHAN POWER SUPPLY BUREAU GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap