Data quality management system and method based on message bus

A technology of data quality and message bus, which is applied in the field of data quality management system based on message bus, can solve problems such as poor credibility, achieve the effect of reducing circles and improving reliability

CN112330164BActive Publication Date: 2022-06-03WUHAN NARI LIABILITY OF STATE GRID ELECTRIC POWER RES INST +1
6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2022-06-03

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to a data quality management system based on a message bus. The invention receives and stores power monitoring data sent by a plurality of data sending ends through the message bus; determines power monitoring data quality evaluation indicators, and builds a data quality rule verification library; The k-means clustering method based on the gray wolf-beetle whisker search algorithm is used to cluster the power monitoring data, and the power monitoring data is divided into multiple data subsets; for each data subset, LOF outlier detection is performed The accuracy is evaluated by the algorithm, and the integrity, consistency, usability, and real-time evaluation are performed through the verification of the data quality rules; the weight of each evaluation index is calculated by the improved analytic hierarchy process, and the comprehensive evaluation result of the power monitoring data quality is calculated. The invention realizes the multi-dimensional quality evaluation of the electric power monitoring data, and improves the reliability of the quality management of the electric power monitoring data.
Need to check novelty before this filing date? Find Prior Art

Description

Data quality management system and method based on message bus technical field The present invention relates to automation information system technology neighborhood, be specifically related to a kind of data quality management based on message bus systems and methods. Background technique With the increasing number of automated information systems, the scale and capacity of power systems are increasing, and the amount of information is increasing. huge. With the vigorous promotion of monitoring terminals, the characteristics of monitoring objects are different, and the correlation calculation of monitoring data is used for early warning gradually. step highlighted. With the rapid growth of data, the data quality of different data sources is uneven, and data quality has different concepts and standards Data quality generally includes quantitative descriptions such as accuracy, completeness, timeliness, and consistency of data. For the power system in the era of b...

Examples

Embodiment Construction

[0072]

[0073]

[0074]

[0076] represents the n-dimensional random unit vector of the beard search,

[0082] Normalize the sample points in the data subset;

[0085]

[0086]

[0088]

[0090] Among them, I is the total number of data in the data subset, and the sample points in the data subset p=1, 2, . . . I, γ

[0094] The power monitoring data availability assessments include availability or utilization assessments of field, process, and event data.

[0098]

[0100] The contents not described in detail in this specification belong to the prior art known to those skilled in the art.