A method for quality control of spatiotemporally consistent hourly precipitation data

Abstract

This invention relates to the field of data quality control technology, and particularly to a method for quality control of hourly precipitation data with multi-temporal and spatial consistency. The method includes: constructing a precipitation database for a target area; obtaining a first precipitation dataset and several second precipitation datasets from the database; wherein the first precipitation dataset is the precipitation dataset of the ground station corresponding to the target ground station identifier, and the second precipitation datasets are the precipitation datasets of neighboring ground stations of the ground station corresponding to the target ground station identifier; and employing a multi-iterative judgment method, based on a preset precipitation threshold coefficient, a station number threshold, and the several second precipitation datasets, performing spatial consistency checks on the precipitation data of the time intervals to be inspected in the first precipitation dataset, and obtaining the inspection results of the precipitation data of the time intervals to be inspected in the first precipitation dataset. This method enables rapid and accurate inspection of the precipitation data of the time intervals to be inspected, achieving effective quality control of precipitation data.

Description

Technical Field

[0001] This invention relates to the field of data quality control technology, and in particular to a method for quality control of multi-temporal and spatial consistency hourly precipitation data. Background Technology

[0002] With the continuous advancement of the construction of a modern meteorological observation system, a high-spatial-density meteorological automatic observation network has been formed through the construction of national-level automatic stations, various types of densified automatic observation stations, and rainstorm monitoring stations. This provides a data foundation for promoting the high-quality development of scientific research and operational services such as research on extreme characteristics of rainstorms, issuance of rainstorm warning signals, calculation of rainstorm return periods, and risk assessment of rainstorm disasters.

[0003] Due to instrument malfunctions, maintenance issues, and other factors, precipitation data from ground observation stations may contain erroneous values, requiring quality control methods for processing. Current quality control methods for surface meteorological data include climatological boundary checks, single-station extreme value checks, internal consistency checks, temporal consistency checks, and spatial consistency checks. However, due to the complexity of precipitation, effective quality control of precipitation data is difficult. Summary of the Invention

[0004] Based on this, the purpose of this invention is to provide a quality control method for multi-temporal and spatial consistency hourly precipitation data. By employing a multi-iteration method, it is possible to quickly and accurately verify the precipitation data of the time period to be inspected in the precipitation data of the ground station corresponding to the target ground station identifier, thereby achieving effective quality control of precipitation data.

[0005] In a first aspect, embodiments of this application provide a method for quality control of multi-temporal and spatial consistency hourly precipitation data, comprising the following steps:

[0006] Construct a precipitation database for the target area, wherein the precipitation database includes precipitation datasets from several ground stations in the target area, and the precipitation datasets include precipitation data from several time periods;

[0007] Obtain the target ground station identifier, and based on the target ground station identifier, obtain a first precipitation dataset and several second precipitation datasets from the precipitation database, wherein the first precipitation dataset is the precipitation dataset of the ground station corresponding to the target ground station identifier, and the second precipitation dataset is the precipitation dataset of neighboring ground stations of the ground station corresponding to the target ground station identifier.

[0008] Traverse the several second precipitation datasets, and combine the precipitation data before and after the time to be tested and the reference time according to the preset reference time to construct the precipitation test dataset corresponding to the time to be tested.

[0009] Extract the precipitation data of the time to be inspected from the first precipitation dataset, and multiply the precipitation data of the time to be inspected by a preset precipitation threshold coefficient to obtain the precipitation threshold data of the time to be inspected.

[0010] Several precipitation data points in the precipitation test dataset corresponding to the time to be tested are compared with the precipitation threshold data of the time to be tested to obtain the number of stations, wherein the number of stations is the number of precipitation data points that are greater than the precipitation threshold data.

[0011] The number of stations is compared with a preset threshold. If the number of stations meets the threshold, the precipitation data corresponding to the time period to be inspected is obtained as a correct result for precipitation verification. If the number of stations does not meet the threshold, the precipitation data of the time period to be inspected is iteratively inspected according to a preset number of iterations until a correct result for precipitation verification of the precipitation data of the time period to be inspected is obtained. If the number of iterations is exceeded, the precipitation data of the time period to be inspected is found to be an error in precipitation verification.

[0012] In this embodiment of the application, a method for quality control of hourly precipitation data with multi-temporal consistency is provided. The method adopts a multi-iteration method, which can quickly and accurately verify the precipitation data of the precipitation data of the ground station corresponding to the target ground station identifier at the time of the test, thereby realizing effective quality control of precipitation data.

[0013] To better understand and implement this invention, the following detailed description is provided in conjunction with the accompanying drawings. Attached Figure Description

[0014] Figure 1 A flowchart illustrating a multi-temporal and spatial consistency hourly precipitation data quality control method provided in one embodiment of this application;

[0015] Figure 2 This is a flowchart illustrating step S2 of a multi-temporal and spatial consistency hourly precipitation data quality control method provided in one embodiment of this application.

[0016] Figure 3 This is a flowchart illustrating step S6 of a multi-temporal and spatial consistency hourly precipitation data quality control method provided in one embodiment of this application. Detailed Implementation

[0017] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0018] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0019] It should be understood that although the terms first, second, third, etc., may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0020] Please see Figure 1 , Figure 1 This is a flowchart illustrating a method for quality control of multi-temporal and spatial consistency hourly precipitation data according to an embodiment of this application. The method includes the following steps:

[0021] S1: Construct a precipitation database for the target area.

[0022] The execution subject of the multi-temporal and spatial consistency hourly precipitation data quality control method is the control device of the multi-temporal and spatial consistency hourly precipitation data quality control method (hereinafter referred to as the control device). In an optional embodiment, the control device may be a computer device, a server, or a server cluster composed of multiple computer devices.

[0023] In this embodiment, the control device acquires precipitation datasets from several ground stations in the target area, and uses the station numbers of the several ground stations as ground station identifiers to construct a precipitation database for the target area. The precipitation database includes precipitation datasets from several ground stations in the target area, and the precipitation datasets include precipitation data for several time periods. Specifically, the precipitation datasets include precipitation data for time periods from 0 to 24 hours.

[0024] The ground station identifier is a unique identifier for each ground station. The ground station identifier can be the station name, the station number, etc., and is not limited in detail here.

[0025] In an optional embodiment, the analysis device further preprocesses the precipitation data in the precipitation dataset of several ground stations in the target area to obtain preprocessed precipitation data. The preprocessing includes missing measurement checks, equipment limit value checks, climate limit value checks, and time consistency checks.

[0026] S2: Obtain the target ground station identifier, and based on the target ground station identifier, obtain a first precipitation dataset and several second precipitation datasets from the precipitation database.

[0027] In this embodiment, the control device obtains the target ground station identifier input by the user, and obtains a first precipitation dataset and several second precipitation datasets from the precipitation database based on the target ground station identifier. The first precipitation dataset is the precipitation dataset of the ground station corresponding to the target ground station identifier, and the second precipitation dataset is the precipitation dataset of the neighboring ground stations of the ground station corresponding to the target ground station identifier.

[0028] Please see Figure 2 , Figure 2 The flowchart of step S2 in the multi-temporal and spatial consistency hourly precipitation data quality control method provided in one embodiment of this application includes steps S21 to S23, as follows:

[0029] S21: Taking each ground station as the center, obtain the neighboring area of ​​each ground station according to the preset neighboring area extension data, and take other ground stations in the neighboring area as the neighboring ground stations of the ground station to construct a list of neighboring ground stations of the plurality of ground stations.

[0030] In this embodiment, the control device takes each ground station as the center, obtains the neighboring area of ​​each ground station according to the preset neighboring area extension data, and takes other ground stations in the neighboring area as the neighboring ground stations of the ground station to construct a list of neighboring ground stations of the plurality of ground stations.

[0031] Specifically, based on the latitude and longitude information of each ground station, the control device can establish a neighboring area of ​​each ground station by using a preset 100×100 km neighboring area extension data, take each ground station as the center, and use the station number of the neighboring ground station as the neighboring ground station identifier to construct a list of neighboring ground stations of the several ground stations.

[0032] S22: Based on the target ground station identifier, obtain the list of neighboring ground stations corresponding to the target ground station.

[0033] In this embodiment, the control device obtains a list of neighboring ground stations corresponding to the target ground station based on the target ground station identifier, wherein the list of neighboring ground stations includes several neighboring ground stations.

[0034] S23: Based on the list of neighboring ground stations corresponding to the target ground station, obtain the precipitation dataset of several neighboring ground stations of the ground station corresponding to the target ground station identifier, and use it as the second precipitation dataset.

[0035] In this embodiment, the control device matches several neighboring ground station identifiers in the neighboring ground station list corresponding to the target ground station with the precipitation datasets corresponding to several ground station identifiers in the precipitation database to obtain the precipitation datasets of several neighboring ground stations corresponding to the target ground station identifier, which is used as the second precipitation dataset.

[0036] S3: Traverse the several second precipitation datasets, and combine the precipitation data of the reference times before and after the time to be tested according to the preset reference times to construct the precipitation test dataset corresponding to the time to be tested.

[0037] In this embodiment, the control device traverses the plurality of second precipitation datasets and, according to a preset reference time, combines the precipitation data before and after the time to be inspected with the reference time to construct a precipitation test dataset corresponding to the time to be inspected. The precipitation test dataset includes a plurality of precipitation data.

[0038] Specifically, the reference time can be 3, 6, or 9 time periods. It can utilize the second precipitation datasets of multiple independent neighboring stations to construct the precipitation verification dataset corresponding to the time period to be tested. This allows the precipitation data of the time period to be tested in the first precipitation dataset of the target ground station to be compared with the precipitation data of several precipitation data in several precipitation verification datasets to conduct one-to-many verification, thereby avoiding the uncertainty caused by a single verification and improving the accuracy and efficiency of the verification.

[0039] S4: Extract the precipitation data of the time to be inspected from the first precipitation dataset, and multiply the precipitation data of the time to be inspected by a preset precipitation threshold coefficient to obtain the precipitation threshold data of the time to be inspected.

[0040] In this embodiment, the control device extracts the precipitation data of the time to be inspected from the first precipitation dataset, multiplies the precipitation data of the time to be inspected by a preset precipitation threshold coefficient, and obtains the precipitation threshold data of the time to be inspected.

[0041] S5: Compare several precipitation data points in the precipitation test dataset corresponding to the time to be tested with the precipitation threshold data of the time to be tested to obtain the number of stations.

[0042] The number of stations refers to the number of precipitation data points that are greater than the precipitation threshold data.

[0043] In this embodiment, the control device compares several precipitation data points in the precipitation test dataset corresponding to the time to be tested with the precipitation threshold data of the time to be tested, and records the number of precipitation data points that are greater than the precipitation threshold data as the number of stations, thereby obtaining the number of stations.

[0044] S6: Compare the number of stations with a preset threshold number of stations. If the number of stations meets the threshold number of stations, obtain the correct precipitation verification result for the precipitation data corresponding to the time to be inspected. If the number of stations does not meet the threshold number of stations, iteratively inspect the precipitation data of the time to be inspected according to a preset number of iterations until the correct precipitation verification result for the precipitation data of the time to be inspected is obtained. If the number of iterations is exceeded, obtain the precipitation verification error for the precipitation data of the time to be inspected.

[0045] In this embodiment, the control device compares the number of stations with a preset threshold number of stations. If the number of stations meets the threshold number, the precipitation data corresponding to the time period to be inspected is obtained as having a correct precipitation inspection result. If the number of stations does not meet the threshold number, the precipitation data of the time period to be inspected is iteratively inspected according to a preset number of iterations until a correct precipitation inspection result is obtained. If the number of iterations exceeds the preset number of iterations, the precipitation data of the time period to be inspected is found to have a precipitation inspection error.

[0046] Specifically, the condition can be that the number of stations is greater than the threshold number of stations, or the number of stations is equal to the threshold number of stations, to obtain the correct precipitation test result for the precipitation data corresponding to the time to be tested; otherwise, the precipitation test result for the precipitation data corresponding to the time to be tested is incorrect.

[0047] Please see Figure 3 , Figure 3 The flowchart of step S6 in the multi-temporal and spatial consistency hourly precipitation data quality control method provided in one embodiment of this application includes steps S61 to S63, as follows:

[0048] S61: Multiply the precipitation data of the time to be inspected by a preset precipitation threshold coefficient corresponding to the number of iterations to obtain the precipitation threshold data of the time to be inspected corresponding to the number of iterations.

[0049] S62: Compare several precipitation data points in the precipitation test dataset corresponding to the time to be tested with the precipitation threshold data of the time to be tested corresponding to the iteration number to obtain the number of stations corresponding to the iteration number.

[0050] S63: Compare the number of stations corresponding to the iteration number with a preset threshold for the number of stations corresponding to the iteration number until the precipitation data of the time to be inspected is obtained as correct. If the iteration number is exceeded, the precipitation data of the time to be inspected is obtained as incorrect.

[0051] In this embodiment, the control device performs the next iteration operation on the precipitation data of the time to be inspected, calculates the precipitation threshold data of the time to be inspected corresponding to the iteration number, and compares several precipitation data in the precipitation test dataset corresponding to the time to be inspected with the precipitation threshold data of the time to be inspected corresponding to the iteration number to obtain the number of stations corresponding to the iteration number.

[0052] The number of stations corresponding to the iteration number in this iteration operation is compared with a preset threshold for the number of stations corresponding to the iteration number to obtain the precipitation inspection result of the precipitation data of the time to be inspected in this iteration operation. If the precipitation inspection result of the precipitation data of the time to be inspected in this iteration operation is a correct precipitation inspection result, the process stops. If the precipitation inspection result of the precipitation data of the time to be inspected in this iteration operation is an incorrect precipitation inspection result, the next iteration is performed until a correct precipitation inspection result of the precipitation data of the time to be inspected is obtained. If the iteration number is exceeded, an incorrect precipitation inspection result of the precipitation data of the time to be inspected is obtained. This allows for rapid and accurate inspection of the precipitation data of the time to be inspected in the precipitation dataset of the ground stations corresponding to the target ground station identifier, achieving effective quality control of the precipitation data.

[0053] The precipitation threshold coefficient corresponding to the number of iterations includes several sub-precipitation threshold coefficients, which decrease as the number of iterations increases.

[0054] The threshold for the number of stations corresponding to the number of iterations includes several thresholds for the number of sub-stations, and the threshold for the number of sub-stations increases as the number of iterations increases.

[0055] In this embodiment, the control device sets the number of iterations to 5. The precipitation threshold coefficients corresponding to the number of iterations include a first sub-precipitation threshold coefficient, a second sub-precipitation threshold coefficient, a third sub-precipitation threshold coefficient, a fourth sub-precipitation threshold coefficient, and a fifth sub-precipitation threshold coefficient. The station number thresholds corresponding to the number of iterations include a first sub-station number threshold, a second sub-station number threshold, a third sub-station number threshold, a fourth sub-station number threshold, and a fifth sub-station number threshold.

[0056] In this embodiment, as the number of iterations increases, the value of the sub-precipitation threshold coefficient used in each iteration decreases, while the value of the sub-station number threshold used in each iteration increases. Through multiple iterations, the precipitation threshold data is gradually relaxed, and the number of precipitation comparisons that meet the station number threshold is increased accordingly. This improves the accuracy of precipitation data verification and enables better quality control of precipitation data.

[0057] This invention is not limited to the above-described embodiments. If any modifications or variations to this invention do not depart from the spirit and scope of this invention, and if such modifications and variations fall within the scope of the claims and equivalent technologies of this invention, then this invention also intends to include such modifications and variations.

Claims

1. A method for quality control of multi-temporal and spatial consistency hourly precipitation data, characterized in that, Includes the following steps: Construct a precipitation database for the target area, wherein the precipitation database includes precipitation datasets from several ground stations in the target area, and the precipitation datasets include precipitation data from several time periods; Obtain the target ground station identifier, and based on the target ground station identifier, obtain a first precipitation dataset and several second precipitation datasets from the precipitation database, wherein the first precipitation dataset is the precipitation dataset of the ground station corresponding to the target ground station identifier, and the second precipitation dataset is the precipitation dataset of neighboring ground stations of the ground station corresponding to the target ground station identifier. Traverse the several second precipitation datasets, and combine the precipitation data of the reference times before and after the time to be tested according to the preset reference times to construct the precipitation test dataset corresponding to the time to be tested. Extract the precipitation data of the time to be inspected from the first precipitation dataset, and multiply the precipitation data of the time to be inspected by a preset precipitation threshold coefficient to obtain the precipitation threshold data of the time to be inspected. Several precipitation data points in the precipitation test dataset corresponding to the time to be tested are compared with the precipitation threshold data of the time to be tested to obtain the number of stations, wherein the number of stations is the number of precipitation data points that are greater than the precipitation threshold data. The number of stations is compared with a preset threshold number of stations. If the number of stations meets the threshold number of stations, the precipitation verification result of the precipitation data corresponding to the time to be inspected is obtained. If the number of stations does not meet the threshold number of stations, the precipitation data of the time to be inspected is multiplied by a preset precipitation threshold coefficient corresponding to the iteration number according to a preset number of iterations to obtain the precipitation threshold data of the time to be inspected corresponding to the iteration number. Several precipitation data points in the precipitation test dataset corresponding to the time to be tested are compared with the precipitation threshold data of the time to be tested corresponding to the number of iterations to obtain the number of stations corresponding to the number of iterations. The precipitation threshold coefficient corresponding to the number of iterations includes several sub-precipitation threshold coefficients, and the sub-precipitation threshold coefficients decrease as the number of iterations increases. The number of stations corresponding to the iteration number is compared with a preset threshold for the number of stations corresponding to the iteration number until a correct precipitation verification result is obtained for the precipitation data of the time to be inspected. If the iteration number is exceeded, a precipitation verification error is obtained for the precipitation data of the time to be inspected. The threshold for the number of stations corresponding to the iteration number includes several sub-station number thresholds, and the sub-station number thresholds increase as the iteration number increases.

2. The method for quality control of multi-temporal and spatial consistency hourly precipitation data according to claim 1, characterized in that, The step of obtaining the target ground station identifier, and obtaining a first precipitation dataset and several second precipitation datasets from the precipitation database based on the target ground station identifier, includes the following steps: Taking each ground station as the center, based on the preset neighboring area extension data, the neighboring area of ​​each ground station is obtained, and other ground stations in the neighboring area are taken as the neighboring ground stations of the ground station, thus constructing a list of neighboring ground stations of the plurality of ground stations. Based on the target ground station identifier, obtain a list of neighboring ground stations corresponding to the target ground station, wherein the list of neighboring ground stations includes several neighboring ground stations; Based on the list of neighboring ground stations corresponding to the target ground station, obtain the precipitation dataset of neighboring ground stations corresponding to the target ground station identifier, and use it as the second precipitation dataset.

Images