Method for synchronizing and processing data by data pool

A data synchronization and data pool technology, applied in the field of synchronization and processing of massive data, can solve problems such as resource consumption and scheduling delay, and achieve the effect of efficient query and real-time processing

Inactive Publication Date: 2016-08-03
ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current way of processing data files in the system is to store the files in the relational database and then schedule the output through the program. In this process, there will be a problem of scheduling delay.
Moreover, the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for synchronizing and processing data by data pool
  • Method for synchronizing and processing data by data pool
  • Method for synchronizing and processing data by data pool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0030] Such as figure 1 As shown, a data pool in the present invention performs data synchronization and processing technology through data extraction of various types of data in the metering automation master station system, and then performs data transmission and data analysis processing on the extracted data, and through unified The data loading module realizes data loading, and finally forms different data set collections according to business analysis requirements and business subject classification.

[0031] A kind of data pool described in the present invention is to data synchronization and processing technology and comprises the following steps:

[0032] Step 1: Data extraction, extract various types of data from the metering automation master station system, including calculated streaming data and structured data of the database. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide a technique for synchronizing and processing data by a data pool. The technique comprises four steps of data extracting, data processing, data storage, and data mart. According to the method, a conventional manner of storing, treating, querying and applying measurement data is changed, flexible storage and real-time treatment of massive measurement data are realized, and the real-time requirements of other service systems for data is conveniently met; besides, a high-efficient data query function is also realized, and a flexible data dissemination manner is provided.

Description

technical field [0001] The invention relates to data synchronization and processing technology, in particular to a method for synchronizing and processing massive data. Background technique [0002] With the advancement of technology ushered in the era of big data. The so-called big data is a data set with a particularly large volume and data category, and such a data set cannot be captured, managed and processed by traditional database tools. [0003] Now that time has entered the 21st century, all walks of life have been deeply affected by technology. The accumulated data of all walks of life is also quite huge, and the value of data is more and more worth studying. [0004] At present, the provincial centralized metering automation system of an electric power research institute realizes online monitoring of metering devices and real-time collection of important information such as user load, electricity, voltage, etc., and has accumulated massive data. The system needs...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/283G06F16/254G06F16/284
Inventor 卢世祥阙华坤林国营雷晓江柳志明
Owner ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap