Hadoop-based electric power cloud platform design scheme

A design scheme and power cloud technology, applied in the field of cloud computing, can solve problems such as poor performance, difficult to guarantee data consistency and cluster stability, low efficiency, etc., achieve high throughput, solve data consistency, and avoid costs Effect

Inactive Publication Date: 2016-02-10
NANJING UNIV OF INFORMATION SCI & TECH
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a Hadoop-based electric power cloud platform design scheme, which solves the shortcomings of low efficiency and poor performance in the traditional data processing process. In the case of a traditional single machine, the data processing process is inefficient. The consistency of data and the stability of the cluster are also difficult to guarantee. The disadvantage of poor performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop-based electric power cloud platform design scheme
  • Hadoop-based electric power cloud platform design scheme

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments. The present invention will be described below in combination with an actual deployment situation as an example.

[0048] Platform structure such as figure 1 Shown: The design of the power cloud platform includes: HDFS, MapReduce, HBase, WebService and website. DFS is used as a distributed file storage system for general storage of power data; at the same time, some data is conveniently queried and stored in HBase; MapReduce can read data from HBase or HDFS for processing and write back; secondly, the website can also be accessed from HBase performs read and write operations. Both APP and power data can interact with HBase through WebService.

[0049] Further, the cloud platform is composed of 1 master node, 1 second master node, and 20 slave nodes, and 15 slave nodes have 15 physical machines with a hard disk of 500GB and a memory ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a Hadoop-based electric power cloud platform design scheme. Through the HDFS and HBase, the efficiency of data storage and index is increased; MapReduce is employed for offline analysis of data and efficient processing of data. Rest-standard Web Service facilitates uploading of user data and brings convenience for the development of a third party. The scheme solves the problems of low efficiency and poor performance in a conventional data processing process, solves the problem of low efficiency in solving the problem in data consistency in the data processing process under the conventional single machine condition, guarantees the stable operation of clusters and has a high handling capacity; data interfaces of higher standards are used, and thus the cost for repeated development is prevented.

Description

technical field [0001] The invention relates to distributed computing technology and distributed storage technology, and belongs to the field of cloud computing, in particular to a Hadoop-based power cloud platform design scheme. Background technique [0002] With the increase of various electrical equipment, power data is becoming larger and more complex. Traditional data issuance and processing methods are difficult to handle TB or even PB-level data. Even if they can be processed correctly, the efficiency is very low. Secondly, data consistency and reliability cannot be guaranteed, and even with a complete system, the throughput of the system The amount is also limited, and there is no suitable interface that can provide third-party data access. [0003] Cloud computing has been extensively studied not only in the academic field but also in the industrial field. Due to its large scale, virtualization, control between failed connection components, and asynchronous commun...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q50/06H04L29/08
Inventor 刘琦蔡卫东肖博沈剑付章杰
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap