Railway power distribution network mass information processing method integrating real-time calculation and offline calculation

Abstract

The invention discloses a railway power distribution network mass information processing method integrating real-time calculation and offline calculation. The method comprises the steps of railway power distribution network mass monitoring data access, monitoring data real-time processing, offline data analysis and processing result distributed storage. When mass monitoring data of the railway power distribution network are accessed, a distributed message publishing and subscribing system used for being connected with a monitoring information source of the railway power distribution network isinstalled in a computer cluster of a Linux operation system, and the mass monitoring data are rapidly and efficiently accessed into the distributed cluster. When a large number of monitoring data processing tasks are executed, independent real-time processing, independent offline data analysis or real-time calculation and offline calculation can be selectively carried out on the data according toactual processing requirements, the processing requirements of different occasions can be met, and the flexibility and the processing efficiency of the railway power distribution network monitoring system are improved.

Description

technical field [0001] The invention relates to the technical field of distribution network monitoring, in particular to a massive information processing method for a railway distribution network that integrates real-time calculation and offline calculation. Background technique [0002] Railway transportation is the main artery of my country's material turnover, personnel flow and even the national economy. In recent years, in order to meet the needs of speed-up, heavy-duty transportation and economic construction, electrified railways have developed very rapidly. A large number of AT stations have been added for traction power supply monitoring of speed-up railways. The isolating switch is fully included in the monitoring. At the same time, the railway power monitoring also includes the communication, signal, optical fiber repeater box substation, and ring main unit into the monitoring. All high and low voltage circuits are included in the monitoring of the railway distribut...

AI Technical Summary

Problems solved by technology

[0005] With the continuous expansion of the scale and capacity of the power grid, the collection points and sampling frequency of the equipment have increased sharply, and the data volume has increased geometrically. The traditional monitoring information processing methods can no longer meet the real-time processing requirements of this massive data access. A method is proposed to transmit the massive real-time monitoring information of the railway distribution network to the Spark computing framework through the distributed publish and subscribe message system. After Spark performs real-time computing and offline computing fusion processing on the monitoring information, the computing results are transferred to the distributed file system. A New Method for Fast Parallel Processing with Distributed Databases

Images