An Efficient Data Cleaning and Transformation Method Based on CIM

A technology of data cleaning and conversion methods, applied in structured data retrieval, electronic digital data processing, database management systems, etc. The effect of cluster deployment and concurrent computing, ensuring data quality and reliability, and wide applicability

Active Publication Date: 2021-12-24
STATE GRID ANHUI ELECTRIC POWER CO LTD +3
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional power grid operation data platform can no longer meet the needs of enterprise operation data storage optimization and parallel processing
The traditional data storage structure is intuitive, but its significant disadvantage is the large amount of data redundancy
The operation information is stored repeatedly, which brings certain difficulties to the fusion operation between different operation data tables, resulting in low query efficiency of operation data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Efficient Data Cleaning and Transformation Method Based on CIM
  • An Efficient Data Cleaning and Transformation Method Based on CIM
  • An Efficient Data Cleaning and Transformation Method Based on CIM

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail with reference to the accompanying drawings. This description presents, by way of illustration and not limitation, specific embodiments consistent with the principles of the invention in sufficient detail to enable those skilled in the art to practice the invention without departing from this disclosure. Other embodiments may be utilized and the structure of elements may be changed and / or substituted within the scope and spirit of the invention. Accordingly, the following detailed description should not be read in a limiting sense. In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific illustrations.

[0021] One aspect of the present invention provides a CIM-bas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a high-efficiency data cleaning and conversion method based on CIM. The method includes: receiving a data cleaning and conversion task requested from a power system user; interpreting the data cleaning and conversion task into a workflow diagram; converting the workflow diagram and Optimizing, executing the cleaning conversion task based on the optimized workflow graph. The present invention proposes a high-efficiency data cleaning and conversion method based on CIM. With the support of the improved power grid operation data model and the distributed data platform, the source data is extracted, cleaned, and integrated to ensure data quality and reliability. The unified standard data output of the database has wide applicability to support cluster deployment and concurrent computing, and can provide reliable support for grid data automation integration and analysis.

Description

technical field [0001] The invention belongs to the field of big data mining and information retrieval, and in particular relates to a CIM-based efficient data cleaning and conversion method. Background technique [0002] With the wide application of various power transmission and transformation equipment, the amount of power grid operation data has shown geometric growth. For the rapid analysis and processing of massive operating data and the detection and mining of abnormal data, the challenge is how to perform effective data processing and efficient data analysis on the big data of power grid operation. Due to the large differences in the software and hardware systems and resources of companies in various network provinces, it is more difficult to build a data online analysis platform. The traditional power grid operation data platform has been unable to meet the needs of enterprise operation data storage optimization and parallel processing. The traditional data storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/215G06F16/25
Inventor 陆俊李葵周明刘军吴极项旭黄影辛永黄文思陆鑫
Owner STATE GRID ANHUI ELECTRIC POWER CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap