Data quality evaluation method based on convolutional neural network

CN119066489AInactive Publication Date: 2024-12-03CHINA NAT INST OF STANDARDIZATION
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411104024.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-12-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Traditional data quality assessment methods, particularly in real-time data processing and anomaly detection, are inefficient and inadequate for complex and large-scale data environments, especially in time series data with multimodal classification based on deviation and time skewness of abnormal data.

Method used

A data quality assessment method using convolutional neural networks (CNN) that includes time series anomaly recognition, multimodal classification, and construction of quality functions to evaluate data quality, incorporating preprocessing, standard deviation calculation, hypersphere classification, correlation analysis, and time skewness estimation.

Benefits of technology

Improves the accuracy and efficiency of data quality assessment by automatically learning complex patterns, enabling real-time evaluation and adapting to diverse data standards, thus optimizing resource utilization and enhancing precision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119066489A_ABST
    Figure CN119066489A_ABST
Patent Text Reader

Abstract

The invention discloses a data quality evaluation method based on a convolutional neural network. The method comprises the steps of collecting target data, preprocessing the target data, performing time sequence anomaly recognition on the target data to obtain abnormal data, and obtaining evaluation data according to the abnormal data. The evaluation data comprises first evaluation data and second evaluation data; the first evaluation data represents the subsidence degree of the abnormal data; the second evaluation data represents the time skewness of the abnormal data; performing multi-modal classification on the evaluation data according to the deviation degree to obtain grading data, constructing a quality function according to the grading number, constructing a data quality evaluation model according to the quality function, inputting to-be-evaluated data into the data quality evaluation model, and outputting an identification result. The method not only can improve the precision of data quality evaluation based on the convolutional neural network, but also has good interpretability, and can be directly applied to a data quality evaluation system.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Cited By

  • Multi-level document retrieval method

    CN119415482A