Meteorological gateway system and multi-element data acquisition method based on meteorological gateway system

Abstract

The invention discloses a meteorological gateway system and a multi-element data acquisition method based on the meteorological gateway system, belongs to the technical field of data processing, and aims to solve the technical problem of how to avoid abnormal acquired data in the meteorological data acquisition and analysis process. Comprising a data acquisition module used for acquiring monitoring data from a corresponding sensor according to a preset sampling frequency and performing legal validity check on the monitoring data; the data processing module is used for regularly reading the monitoring data from the file system, selecting the legal and effective monitoring data as calculation participation data, selecting the calculation participation data for different meteorological elements, performing calculation and correction processing through a related algorithm model according to meteorological characteristics and rules, and writing the meteorological data into the file system; and the data reporting module is used for acquiring the meteorological data from the file system regularly and reporting the meteorological data to the central station.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, in particular to a meteorological gateway system and a multi-factor data collection method based on the meteorological gateway system. Background Art

[0002] Meteorological data is closely related to people's daily travel, industrial production and agricultural production. Accurately collecting meteorological data and analyzing meteorological data to generate meteorological elements are crucial to production and life.

[0003] In the process of meteorological data collection and analysis, how to avoid abnormal data collection is a technical problem that needs to be solved. Summary of the invention

[0004] The technical task of the present invention is to address the above deficiencies and provide a meteorological gateway system and a multi-factor data collection method based on the meteorological gateway system to solve the technical problem of how to avoid abnormal collection data during the meteorological data collection and analysis process.

[0005] In a first aspect, the present invention provides a meteorological gateway system, including a data acquisition module, a data processing module, a data reporting module and a file system;

[0006] The data acquisition module is used to collect monitoring data from the corresponding sensors according to a predetermined sampling frequency, and to check the legality and validity of the monitoring data, write the monitoring data into the file system, and mark the legality and validity of the monitoring data;

[0007] The data processing module has multiple built-in algorithm models. The data processing module is used to read monitoring data from the file system at regular intervals and select legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and the meteorological data is calculated and corrected through relevant algorithm models according to meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system. Meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation;

[0008] The data reporting module is used to obtain meteorological data from the file system at a regular interval and report the meteorological data to the central station.

[0009] Preferably, the data processing module is used to calculate the mean value of the specified type of monitoring data within a predetermined time period as meteorological data.

[0010] Preferably, the algorithm model includes an arithmetic mean model, a sliding mean model, a unit vector mean and a cumulative value model.

[0011] Preferably, the data reporting module uploads the meteorological data to the central station based on the TCP / IP protocol.

[0012] Preferably, the sensors include a temperature, humidity and pressure sensor, a wind speed sensor, a wind direction sensor, a rainfall sensor and a water accumulation sensor.

[0013] In a second aspect, the present invention provides a multi-factor data collection method based on a meteorological gateway system, which is used to obtain meteorological data through a meteorological gateway system as described in any one of the first aspects, comprising the following steps:

[0014] According to the predetermined sampling frequency, the monitoring data is collected from the corresponding sensor through the data acquisition module, and the monitoring data is checked for legality and validity through the data acquisition module, and the monitoring data is written into the file system, and the legality and validity are marked for the monitoring data;

[0015] The data processing module periodically reads monitoring data from the file system, and selects legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and the meteorological data is calculated and corrected through the relevant algorithm model according to the meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system. The meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation;

[0016] The data reporting module obtains meteorological data from the file system at regular intervals and reports the meteorological data to the central station.

[0017] Preferably, the data processing module calculates the mean value of the specified type of monitoring data within a predetermined time period as meteorological data.

[0018] Preferably, the algorithm model includes an arithmetic mean model, a sliding mean model, a unit vector mean and a cumulative value model.

[0019] Preferably, the meteorological data is uploaded to the central station through a data reporting module based on the TCP / IP protocol.

[0020] Preferably, the sensors include a temperature, humidity and pressure sensor, a wind speed sensor, a wind direction sensor, a rainfall sensor and a water accumulation sensor.

[0021] The meteorological gateway system of the present invention and the multi-factor data collection method based on the meteorological gateway system have the following advantages: collecting data from corresponding sensors, calculating and correcting them according to meteorological characteristics and laws, forming a correction processing algorithm based on a large amount of data records, ensuring accurate correction of the collected data, avoiding abnormal collected data, and realizing the generation of meteorological data. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] The present invention is further described below in conjunction with the accompanying drawings.

[0024] Figure 1 This is a schematic diagram of the structure of a meteorological gateway system in Example 1. DETAILED DESCRIPTION

[0025] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments so that those skilled in the art can better understand the present invention and implement it. However, the embodiments are not intended to limit the present invention. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments may be combined with each other.

[0026] The embodiment of the present invention provides a meteorological gateway system and a multi-factor data collection method based on the meteorological gateway system, which are used to solve the technical problem of how to avoid abnormal collection data during the meteorological data collection and analysis process.

[0027] Embodiment 1:

[0028] The invention discloses a meteorological gateway system, which comprises a data acquisition module, a data processing module, a data reporting module and a file system.

[0029] The data acquisition module is used to collect monitoring data from corresponding sensors according to a predetermined sampling frequency, and to check the legality and validity of the monitoring data, write the monitoring data into the file system, and mark the legality and validity of the monitoring data.

[0030] In this embodiment, after the data acquisition module collects data from the corresponding sensor according to the sampling frequency, it performs a validity check on the collected instantaneous data to determine whether the collected instantaneous data is legal and valid data, that is, the value of the instantaneous data should conform to meteorological common sense and be within the capability of the sensor, and the legality and validity of the instantaneous data is marked when it is written to the file system.

[0031] The data processing module has multiple algorithm models built in. The data processing module is used to read monitoring data from the file system at regular intervals and select legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and calculation and correction processing is performed through relevant algorithm models according to meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system. Meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation.

[0032] In this embodiment, the data processing module periodically obtains data in the file system according to the calculation cycle requirements and performs meteorological data calculations. Data with questionable legality and validity are not included in the calculation. Different algorithms are used for calculations for different meteorological elements, that is, the mean of a certain type within a certain period of time is calculated as the meteorological data to ensure the smoothness and relative rationality of the meteorological data, and the final meteorological data is written into the file system.

[0033] Among them, the algorithm models include arithmetic mean model, sliding average model, unit vector average and cumulative value model.

[0034] The calculation formula in the arithmetic mean model is as follows:

[0035]

[0036] The meanings of the parameters in the formula are as follows:

[0037] ——the average value of the meteorological variable during the observation period;

[0038] y i ——The sampled value (sample) of the ith meteorological variable during the observation period, among which “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation, that is, let y i =0;

[0039] N——The total number of samples in the observation period, which is determined by the "sampling frequency" and "average time interval";

[0040] m – the number of “correct” samples during the observation period (m≤N).

[0041] The calculation formula in the moving average model is as follows:

[0042]

[0043] The meanings of the parameters in the formula are as follows:

[0044] ——the average value of the meteorological variable calculated for the nth time;

[0045] y i ——The i-th sample value, where “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation;

[0046] a——a sample in the moving average time interval: when n≤N, a=1; when n>N, a=n-N+1;

[0047] N is the total number of samples in the average time interval, which is determined by the sampling frequency and the average time interval;

[0048] m – the number of “correct” data samples within the moving average time interval (m≤N).

[0049] The calculation formula in the unit vector average model is as follows:

[0050]

[0051] The meanings of the parameters in the formula are as follows:

[0052] ——average wind direction during the observation period;

[0053] D i ——the argument of the i-th wind vector during the observation period (the angle with the y-axis);

[0054] ——The average component of the unit vector on the x-axis (east-west direction) during the observation period;

[0055] ——The average component of the unit vector on the y-axis (north-south direction) during the observation period;

[0056] N - the number of samples in the observation period, determined by the "sampling frequency" and "average time interval".

[0057] The correction of mean wind direction follows the following rules:

[0058] (1) Should be based on The positive and negative make corrections;

[0059] (2) No correction is required;

[0060] (3) or Add 180°;

[0061] (4) Add 360°.

[0062] The calculation formula in the cumulative value calculation model is as follows:

[0063]

[0064] The meanings of the parameters in the formula are as follows:

[0065] Y——the cumulative value of meteorological element variables during the observation period;

[0066] y i——The i-th sampling value (sample) of the meteorological element variable during the observation period, among which “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation, that is, let y i =0;

[0067] N is the total number of samples during the observation period.

[0068] The data reporting module is used to obtain meteorological data from the file system at a regular interval and report the meteorological data to the central station.

[0069] The meteorological factors related to the meteorological gateway are shown in Table 1.

[0070] Table 1

[0071]

[0072]

[0073] The gateway system of the present application collects data from corresponding sensors for basic meteorological elements such as temperature, air pressure, humidity, wind speed, wind direction, rainfall, and water accumulation, and calculates and corrects the data according to meteorological characteristics and laws. A correction processing algorithm is formed based on a large amount of data records to ensure accurate correction of the collected data, avoid abnormal collected data, and ultimately generate meteorological element data.

[0074] Embodiment 2:

[0075] The present invention provides a multi-factor data collection method based on a meteorological gateway system, which realizes multi-factor data collection through the system disclosed in Example 1. The method comprises the following steps:

[0076] Step S100: collecting monitoring data from corresponding sensors through a data acquisition module according to a predetermined sampling frequency, checking the validity of the monitoring data through the data acquisition module, writing the monitoring data into a file system, and marking the validity of the monitoring data;

[0077] Step S200: The data processing module periodically reads monitoring data from the file system, and selects legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and the meteorological data is calculated and corrected by the relevant algorithm model according to the meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system, wherein the meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation;

[0078] Step S300: The data reporting module periodically obtains meteorological data from the file system and reports the meteorological data to the central station.

[0079] In this embodiment, after the data acquisition module in step S100 collects data from the corresponding sensor according to the sampling frequency, it performs a validity check on the collected instantaneous data to determine whether the collected instantaneous data is legal and valid data, that is, the value of the instantaneous data should conform to meteorological common sense and be within the capability of the sensor, and the legality and validity of the instantaneous data is marked when it is written into the file system.

[0080] In step S200 of this embodiment, the data processing module obtains data in the file system regularly according to the calculation cycle requirements, performs meteorological data calculations, and does not participate in the calculation of data whose legality and validity are questionable. Different algorithms are used for calculations of different meteorological elements, that is, the mean of a certain type within a certain period of time is calculated as the meteorological data to ensure the smoothness and relative rationality of the meteorological data, and write the final meteorological data into the file system.

[0081] Among them, the algorithm models include arithmetic mean model, sliding average model, unit vector average and cumulative value model.

[0082] The calculation formula in the arithmetic mean model is as follows:

[0083]

[0084] The meanings of the parameters in the formula are as follows:

[0085] ——the average value of the meteorological variable during the observation period;

[0086] y i ——The sampled value (sample) of the ith meteorological variable during the observation period, among which “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation, that is, let y i =0;

[0087] N——The total number of samples in the observation period, which is determined by the "sampling frequency" and "average time interval";

[0088] m – the number of “correct” samples during the observation period (m≤N).

[0089] The calculation formula in the moving average model is as follows:

[0090]

[0091] The meanings of the parameters in the formula are as follows:

[0092] ——the average value of the meteorological variable calculated for the nth time;

[0093] y i ——The i-th sample value, where “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation;

[0094] a——a sample in the moving average time interval: when n≤N, a=1; when n>N, a=n-N+1;

[0095] N is the total number of samples in the average time interval, which is determined by the sampling frequency and the average time interval;

[0096] m – the number of “correct” data samples within the moving average time interval (m≤N).

[0097] The calculation formula in the unit vector average model is as follows:

[0098]

[0099] The meanings of the parameters in the formula are as follows:

[0100] ——average wind direction during the observation period;

[0101] D i ——the argument of the i-th wind vector during the observation period (the angle with the y-axis);

[0102] ——The average component of the unit vector on the x-axis (east-west direction) during the observation period;

[0103] ——The average component of the unit vector on the y-axis (north-south direction) during the observation period;

[0104] N - the number of samples in the observation period, determined by the "sampling frequency" and "average time interval".

[0105] The correction of mean wind direction follows the following rules:

[0106] (1) Should be based on The positive and negative make corrections;

[0107] (2) No correction is required;

[0108] (3) or Add 180°;

[0109] (4) Add 360°.

[0110] The calculation formula in the cumulative value calculation model is as follows:

[0111]

[0112] The meanings of the parameters in the formula are as follows:

[0113] Y——the cumulative value of meteorological element variables during the observation period;

[0114] y i ——The i-th sampling value (sample) of the meteorological element variable during the observation period, among which “wrong”, “suspicious” and other non-“correct” samples should be discarded and not used for calculation, that is, let y i =0;

[0115] N is the total number of samples during the observation period.

[0116] The method of this embodiment targets the basic meteorological elements such as temperature, air pressure, humidity, wind speed, wind direction, rainfall, and water accumulation, collects data from corresponding sensors, calculates and corrects the data according to meteorological characteristics and laws, and forms a correction processing algorithm based on a large amount of data records to ensure accurate correction of the collected data, avoid abnormal collected data, and ultimately generate meteorological element data.

[0117] The present invention has been shown and described in detail above through the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Based on the above multiple embodiments, those skilled in the art can know that the means in the above different embodiments can be combined to obtain more embodiments of the present invention, and these embodiments are also within the protection scope of the present invention.

Claims

1. A meteorological gateway system, characterized in that: It includes data collection module, data processing module, data reporting module and file system; The data acquisition module is used to collect monitoring data from the corresponding sensors according to a predetermined sampling frequency, and to check the legality and validity of the monitoring data, write the monitoring data into the file system, and mark the legality and validity of the monitoring data; The data processing module has multiple built-in algorithm models. The data processing module is used to read monitoring data from the file system at regular intervals and select legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and the meteorological data is calculated and corrected through relevant algorithm models according to meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system. Meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation; The data reporting module is used to obtain meteorological data from the file system at a regular interval and report the meteorological data to the central station.

2. The meteorological gateway system according to claim 1, characterized in that: The data processing module is used to calculate the mean value of the specified type of monitoring data within a predetermined time period as meteorological data.

3. The meteorological gateway system according to claim 1 or 2, characterized in that: The algorithm models include arithmetic mean model, sliding average model, unit vector average and cumulative value model.

4. The meteorological gateway system according to claim 1, characterized in that: The data reporting module uploads meteorological data to the central station based on the TCP / IP protocol.

5. The weather gateway system according to claim 1, characterized in that: The sensors include temperature, humidity and pressure sensors, wind speed sensors, wind direction sensors, rainfall sensors and water accumulation sensors.

6. A multi-factor data collection method based on a meteorological gateway system, characterized in that: The method for obtaining meteorological data through a meteorological gateway system according to any one of claims 1 to 5 comprises the following steps: According to the predetermined sampling frequency, the monitoring data is collected from the corresponding sensor through the data acquisition module, and the monitoring data is checked for legality and validity through the data acquisition module, and the monitoring data is written into the file system, and the legality and validity are marked for the monitoring data; The data processing module periodically reads monitoring data from the file system, and selects legal and valid monitoring data as calculation participating data. For different meteorological elements, the calculation participating data is selected, and the meteorological data is calculated and corrected through the relevant algorithm model according to the meteorological characteristics and laws to obtain meteorological data, and the meteorological data is written into the file system. The meteorological elements include temperature, air pressure, humidity, wind speed, wind direction, rainfall and water accumulation; The data reporting module obtains meteorological data from the file system at regular intervals and reports the meteorological data to the central station.

7. The multi-factor data collection method based on the meteorological gateway system according to claim 6 is characterized in that: The data processing module calculates the mean of the specified type of monitoring data within a predetermined time period as meteorological data.

8. The multi-factor data collection method based on the meteorological gateway system according to claim 6 or 7, characterized in that: The algorithm models include arithmetic mean model, sliding average model, unit vector average and cumulative value model.

9. The multi-factor data collection method based on the meteorological gateway system according to claim 6 is characterized in that: Based on TCP / IP protocol, meteorological data is uploaded to the central station through the data reporting module.

10. The multi-factor data collection method based on the meteorological gateway system according to claim 6 is characterized in that: The sensors include temperature, humidity and pressure sensors, wind speed sensors, wind direction sensors, rainfall sensors and water accumulation sensors.

Images