Massive electricity marketing data integration method uploaded by ETL cloud platform

A technology of power marketing and data integration, which is applied in the direction of power digital data processing, data processing applications, special data processing applications, etc., and can solve the problems of difficulty in integrating massive power marketing data

Inactive Publication Date: 2014-07-30
ELECTRIC POWER RES INST OF GUANGXI POWER GRID CO LTD +1
View PDF2 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to solve the problem that the integration of massive power marketing data i

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive electricity marketing data integration method uploaded by ETL cloud platform
  • Massive electricity marketing data integration method uploaded by ETL cloud platform
  • Massive electricity marketing data integration method uploaded by ETL cloud platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The technical solution of the present invention will be further specifically described below in conjunction with the accompanying drawings.

[0022] figure 1 It is a schematic structural diagram of the present invention, which includes a massive power marketing data integration platform composed of 8 servers, of which 6 computing servers, 1 database server and 1 intermediate server MS, that is, WEB servers, use ETL (Extraction-Transformation -Loading (extraction, conversion and loading) tool is characterized in that it also includes: business-related data module, monitoring module, ETL operation process, protocol cluster module, intermediate server data storage module, protocol cluster upload process and cloud platform data storage system module ,in

[0023] The business-related data modules are database server modules of various provinces and cities;

[0024] The monitoring module is mainly composed of operation monitoring and platform server monitoring;

[0025] T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a massive electricity marketing data integration method uploaded by an ETL cloud platform. The whole process module of the method comprises a business relevant data module, a monitoring module, an ETL operation process, a protocol stack module, a middle server data memory module, a protocol stack uploading process, and a cloud platform data memory system module. The method utilizes an ETL tool to develop series 'operation' relevant to the business, the business data of various platforms is processed by a series of steps such as cleaning, extracting, converting and 'protocol stack' rules to generate text files on a middle server, and the text files are model index text files which can be directly applied to the latter cloud platform algorithm modeling. Finally, model index text files on the middle server are uploaded to the cloud platform according to the /protocol stack' rules, the uploading from the business data of a database to the index data of the cloud platform is completed, and the rapid integration for the massive electricity marketing data is realized.

Description

technical field [0001] The invention relates to the technical field of extraction, conversion and integration of source data, in particular to the automatic uploading of massive power marketing data to a cloud platform data storage system based on an ETL cloud platform, so as to realize rapid integration of massive data. technical background [0002] At present, the system of prefectural and municipal power supply bureaus has realized the integrated use of the four systems of plant power terminal, negative control terminal, distribution transformer terminal, and low-voltage centralized reading terminal, realizing the metering of plant stations, special transformer users, distribution transformer areas, and residents. The meter data collection of the community, the coverage rate of each power supply bureau station, the load management terminal coverage rate, the distribution transformer monitoring metering terminal coverage rate basically reached 100%, the low-voltage resident...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L29/08G06Q50/06
CPCG06F16/254G06Q50/06H04L67/1097
Inventor 何艺陈俊刘路陈勇成秦丽娟唐利涛曾博张良均陈俊德刘名军樊哲郑宗锐
Owner ELECTRIC POWER RES INST OF GUANGXI POWER GRID CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products