Energy Internet information platform based on Spark and application thereof

Abstract

The invention discloses an energy Internet information platform based on Spark and application thereof. The energy Internet information platform comprises a Spark Streaming module which is used for finishing receiving data and detecting, filtering and analyzing the data rapidly; a memory parallel computing module which is connected with the Spark Streaming module and is used for finishing various general analysis algorithms through utilization of a memory computing technology of the Spark; a distributed file module which is connected with the memory parallel computing module and is used for finishing real-time big data computing analysis and finishing a scheduling algorithm, dynamic prediction and security analysis, wherein through utilization of big data, purchase quantity of power or other energy is analyzed, energy consumption is predicted, energy users are managed, the energy efficiency is improved and the energy cost is reduced; and an application module which is connected with the memory parallel computing module and is used for providing energy sharing and sharing service for a client. According to the platform and the application, the high-efficiency processing of the real-time big data is ensured, and the high-efficiency analysis of the real-time big data in the energy Internet is finished.

Description

technical field [0001] The invention belongs to the technical field of the Internet, and in particular relates to a Spark-based energy Internet information platform and an application thereof. Background technique [0002] At present, the "Energy Internet" (Energy Internet) is based on the power system, based on the Internet and other cutting-edge information technologies, with distributed renewable energy as the main primary energy, and deeply integrated with other systems such as natural gas networks and transportation networks. Formed a new energy utilization system. As a product of interdisciplinary subjects such as electrical engineering, energy, information, transportation, and environment, the construction of the Energy Internet system involves the development and transformation of many industries and technical fields. The Energy Internet will realize the dynamic balance of energy in a wide area, involving many technical issues such as massive distributed equipment a...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a Spark-based Energy Internet information platform and its application, aiming to solve the problem of lack of efficient analysis methods for real-time big data in Energy Internet

Images