Quick processing method and system for stream meteorological data

Abstract

The invention discloses a quick processing method for stream meteorological data. A specific implementation process comprises the steps of acquiring the stream meteorological data in real time, wherein the stream meteorological data includes national station data and regional station data; sending the stream meteorological data to specified computing node ports; and monitoring the computing node ports, when it is monitored that the stream meteorological data passes through the computing node ports, storing the stream meteorological data in computing node memories and backing up the stream meteorological data in a distributed file system, then performing structured processing based on the stream meteorological data, designing a corresponding table structure, and establishing an index for a user to query. According to the method, the characteristics of the stream meteorological data of typical industries are fully considered, and the real-time acquisition and statistics analysis of the stream meteorological data can be realized, so that the stream meteorological data can be provided for the user to query.

Description

technical field [0001] The present application relates to the field of meteorological business processing, in particular to a fast processing method and system for streaming meteorological data. Background technique [0002] In recent years, with the progress of meteorological modernization, meteorological services have become more and more dependent on automatic stations, and the requirements for data storage, management and use of automatic stations have also become higher and higher. [0003] At present, the number of surface meteorological observation stations has increased rapidly, and the number of surface meteorological observation stations in the Yangtze River Basin has reached more than 20,000. The increase in the number of surface meteorological observation stations and the increase in observation frequency have made surface observation data a typical "streaming meteorological data". Streaming meteorological data analysis puts forward higher requirements for never...

AI Technical Summary

Problems solved by technology

[0005] The present invention proposes a fast processing method for streaming meteorological data. Aiming at the current situation that the existing streaming meteorological data cannot achieve real-time statistical analysis, real-time collection of regional station data (ie: local automatic station live files) and national station data ( Namely: CIMISS data), and adopt distributed memory-based storage, transmission and parallel processing technology to realize the display and analysis of observation data of all automatic stations in the jurisdiction by business personnel, comprehensively promote the modernization of grass-roots meteorological services, and continuously enhance the comprehensiveness of meteorological institutions Strength and influence of meteorological work

Images