Mixed storage method and system for distribution and utilization multi-source heterogeneous data

A multi-source heterogeneous data and hybrid storage technology, applied in the field of electric power, can solve the problems of difficult system interaction and the inability to mount distributed file systems.

Inactive Publication Date: 2017-02-22
POWER GRID TECH RES CENT CHINA SOUTHERN POWER GRID +1
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although the Hadoop architecture has many generally recognized advantages, it also has the disadvantage that the distributed f

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mixed storage method and system for distribution and utilization multi-source heterogeneous data
  • Mixed storage method and system for distribution and utilization multi-source heterogeneous data
  • Mixed storage method and system for distribution and utilization multi-source heterogeneous data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] Embodiment 1 of the present invention provides a hybrid storage method for distributing and using multi-source heterogeneous data. see figure 1 As shown in FIG. 1 , it is a schematic flowchart of the implementation of the method for hybrid storage of power distribution and multi-source heterogeneous data according to Embodiment 1 of the present invention. Such as figure 1 As shown, the hybrid storage method for multi-source heterogeneous data of power distribution and consumption in this embodiment includes the following steps:

[0026] Step S101: Determine the data type of the power distribution data in the target power distribution data source according to the target power distribution data source;

[0027] Specifically, firstly determine which distribution data source the distribution and consumption data currently needs to acquire comes from, that is, determine the target distribution and consumption data, and then determine the target distribution and consumption...

Embodiment 2

[0051] According to the hybrid storage method for multi-source heterogeneous data of power distribution and consumption in the first embodiment above, Embodiment 2 of the present invention provides a hybrid storage system for multi-source heterogeneous data of distribution and consumption. image 3 It is a schematic diagram of the composition and structure of a hybrid storage system for distributing power and using multi-source heterogeneous data according to Embodiment 2 of the present invention. Such as image 3 As shown, the hybrid storage system for power distribution and multi-source heterogeneous data in Embodiment 2 includes a type determination unit 201, a mode determination unit 202, an extraction unit 203, a storage unit 204, and a processing unit 205, wherein:

[0052] A type determining unit 201, configured to determine the data type of the power distribution data in the target power distribution data source according to the target power distribution data source; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a mixed storage method for distribution and utilization multi-source heterogeneous data. The method includes the steps that the data type of the distribution and utilization data in a target distribution and utilization data source is judged according to the target distribution and utilization data source; the data extraction mode and data storage mode of the distribution and utilization data in the target distribution and utilization data source are determined according to the data type; the distribution and utilization data in the target distribution and utilization data source are extracted from the target distribution and utilization data source according to the data extraction mode of the distribution and utilization data in the target distribution and utilization data source; the extracted distribution and utilization data are stored according to the data storage mode of the distribution and utilization data in the target distribution and utilization data source; data cleaning and conversion are carried out on the stored distribution and utilization data in various distribution and utilization data sources to obtain cleaning and conversion results, and the cleaning and conversion results are stored in the Oracle database. By adopting the scheme, convenience of reading calculation is ensured while achieving storage of mass distribution and utilization multi-source data.

Description

technical field [0001] The invention relates to the field of electric power technology, in particular to a hybrid storage method and system for multi-source heterogeneous data of distribution and consumption. Background technique [0002] With the construction of smart grids and the application of the Internet of Things, unstructured data and massive time-series data are showing a rapid growth trend. However, the storage and calculation forms of traditional relational databases have been difficult to meet the data storage, real-time query and high-performance computing requirements of the PB (petabyte, a storage unit) level of electric power meters. [0003] The Hadoop architecture is currently the most mainstream storage and computing solution in the field of big data. It greatly optimizes the analysis environment and can provide features such as accurate and fast reports, cross-domain business drivers and dynamic discovery of key indicators. The Hadoop architecture is als...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06Q10/06G06Q50/06
CPCG06Q10/063G06Q50/06G06F16/215G06F16/22G06F16/284
Inventor 赵云李鹏钱斌肖勇李秋硕赖宇阳
Owner POWER GRID TECH RES CENT CHINA SOUTHERN POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap