Data quality management system and method based on message bus
A technology of data quality and message bus, which is applied in the field of data quality management system based on message bus, can solve problems such as poor credibility, achieve the effect of reducing circles and improving reliability
Active Publication Date: 2022-06-03
WUHAN NARI LIABILITY OF STATE GRID ELECTRIC POWER RES INST +1
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] The purpose of the present invention is to provide a data quality management system and method based on a message bus, and the present invention can solve the problem of poor credibility of power system monitoring data quality assessment
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0072]
[0073]
[0074]
[0076] represents the n-dimensional random unit vector of the beard search,
[0082] Normalize the sample points in the data subset;
[0085]
[0086]
[0088]
[0090] Among them, I is the total number of data in the data subset, and the sample points in the data subset p=1, 2, . . . I, γ
[0094] The power monitoring data availability assessments include availability or utilization assessments of field, process, and event data.
[0098]
[0100] The contents not described in detail in this specification belong to the prior art known to those skilled in the art.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a data quality management system based on a message bus. The invention receives and stores power monitoring data sent by a plurality of data sending ends through the message bus; determines power monitoring data quality evaluation indicators, and builds a data quality rule verification library; The k-means clustering method based on the gray wolf-beetle whisker search algorithm is used to cluster the power monitoring data, and the power monitoring data is divided into multiple data subsets; for each data subset, LOF outlier detection is performed The accuracy is evaluated by the algorithm, and the integrity, consistency, usability, and real-time evaluation are performed through the verification of the data quality rules; the weight of each evaluation index is calculated by the improved analytic hierarchy process, and the comprehensive evaluation result of the power monitoring data quality is calculated. The invention realizes the multi-dimensional quality evaluation of the electric power monitoring data, and improves the reliability of the quality management of the electric power monitoring data.
Description
Data quality management system and method based on message bus technical field The present invention relates to automation information system technology neighborhood, be specifically related to a kind of data quality management based on message bus systems and methods. Background technique With the increasing number of automated information systems, the scale and capacity of power systems are increasing, and the amount of information is increasing. huge. With the vigorous promotion of monitoring terminals, the characteristics of monitoring objects are different, and the correlation calculation of monitoring data is used for early warning gradually. step highlighted. With the rapid growth of data, the data quality of different data sources is uneven, and data quality has different concepts and standards Data quality generally includes quantitative descriptions such as accuracy, completeness, timeliness, and consistency of data. For the power system in the era of b...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06Q10/06G06Q50/06G06K9/62G06N3/00
CPCG06Q10/06393G06Q10/06395G06Q50/06G06N3/006G06F18/23213Y04S10/50
Inventor 陶汉涛王海涛方玉河李健张磊林卿陈玥姜志博吴大伟李旺
Owner WUHAN NARI LIABILITY OF STATE GRID ELECTRIC POWER RES INST




