Offshore multiband cloud and mist observation data quality marking control method and system

By setting the QC method control code and applying the quality control code in the sea multi-band cloud and fog observation data, and combining multiple observation data for comprehensive analysis, the problem of quality control of sea multi-band cloud and fog observation data is solved, and reliable identification and analysis of data quality is achieved. accuracy.

CN119003506AActive Publication Date: 2024-11-22CMA METEOROLOGICAL OBSERVATION CENT
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411092993.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-22
Estimated Expiration
2044-08-09

AI Technical Summary

Technical Problem

The prior art is difficult to effectively control the quality of maritime multi-band cloud observation data, resulting in the inability to determine data abnormalities or errors, affecting the accuracy of analysis and prediction.

Method used

The quality marking control method of the sea multi-band cloud fog observation data is adopted, and the QC method control code is set and the quality control code is applied, combined with laser fog measurement, millimeter wave cloud fog measurement, all-sky imaging and meteorological and hydrological observation data, comprehensive analysis is carried out to form the quality marking code. , ensure data quality.

Benefits of technology

It realizes effective quality control of multi-band cloud observation data at sea, provides the credibility and reliability of the data, and facilitates users to analyze and predict.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119003506A_ABST
    Figure CN119003506A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of cloud and mist observation, in particular to a marine multiband cloud and mist observation data quality marking control method and system. The scheme comprises the following steps: setting two quality control codes, namely a QC method control code and an application quality control code; setting a process for comprehensively analyzing the offshore cloud observation data by using multiple quality control methods, wherein the process of the comprehensive analysis is used for forming a final application quality control code according to multiple QC method quality control codes; forming an application quality control identification code according to the laser fog measurement quality control data; forming an application quality control identification code according to the millimeter wave cloud and mist measurement quality control data; obtaining an original observation image and extracting an all-sky application quality control identification code; and quality control identification codes of the weather and hydrological observation data. According to the scheme, through reasonable quality control, quality identification codes of quality and application are formed for multi-band cloud and mist observation data, and analysis and prediction by a user are facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of cloud and fog observation technology, and more specifically, to a method and system for quality marking control of marine multi-band cloud and fog observation data. Background Art

[0002] The importance of quality control of meteorological observation data has been recognized by all scientists who use meteorological data. Ground-based meteorological observation records must be representative, accurate, and comparable. Various observations can be considered as random variables in a statistical sense. When collecting observations, errors are usually generated in the true value. Depending on the nature of the error and the cause of the error, meteorological observation data may have three types of errors of completely different natures: random error, systematic error, and negligent error (accidental error). The purpose of quality control is to ensure that the data provided for application meets various requirements (including uncertainty, resolution, continuity, uniformity, representativeness, time limit, format, etc.). Good data does not need to be particularly outstanding. What is important is that its quality should be known and verifiable.

[0003] Prior to the technology of the present invention, it was difficult to effectively perform quality control on multi-band cloud and fog observation data, which resulted in the inability to effectively analyze multi-band clouds and fog at sea, and in particular, it was impossible to determine which data were abnormal and which might contain errors. Summary of the invention

[0004] In view of the above problems, the present invention proposes a quality marking control method and system for multi-band cloud and fog observation data at sea. Through reasonable quality control, quality and application quality identification codes are formed for multi-band cloud and fog observation data to facilitate users to analyze and predict.

[0005] According to a first aspect of an embodiment of the present invention, a method for controlling quality marking of multi-band cloud and fog observation data at sea is provided.

[0006] In one or more embodiments, preferably, the method for controlling the quality mark of marine multi-band cloud and fog observation data includes:

[0007] Set two quality control codes: QC method control code and application quality control code;

[0008] A process for comprehensively analyzing the marine cloud and fog observation data using a variety of quality control methods is set up, wherein the process for comprehensive analysis is used to form a final application quality control code based on the quality control codes of a variety of QC methods;

[0009] Form an application quality control identification code based on the laser fog measurement quality control data;

[0010] Generate application quality control identification code based on millimeter wave cloud and fog quality control data;

[0011] Obtain the original observation image to extract the quality control identification code for all-sky applications;

[0012] Quality control identification code for weather and hydrological observation data.

[0013] In one or more embodiments, preferably, the two quality control codes are respectively set as QC method control code and application quality control code, specifically including:

[0014] Set a 4-level QC method quality control code for each quality control method, wherein the QC method quality control code value range is 0 to 3, 0 means correct, 1 means suspicious, 2 means warning, and 3 means data error;

[0015] Determine the application quality control code for each data. The application quality control code value range is 0 to 9, where 0 means correct data, 1 means suspicious data, 2 means data warning, 3 means data error, 4 to 6 are spare, and 7 means no observation task. 8 means data missing, and 9 means format check failed.

[0016] In one or more embodiments, preferably, the setting uses a plurality of quality control methods to perform a comprehensive analysis process on the sea cloud and fog observation data, and the comprehensive analysis process is used to form a final application quality control code according to the quality control codes of the plurality of QC methods, specifically including:

[0017] Read the observation data before quality control and generate four types of quality control data: laser fog measurement, millimeter wave cloud and fog, meteorological and hydrological load, and all-sky imaging;

[0018] Calculate QC codes for four types of quality control data;

[0019] The QC quality control codes of the four types of quality control data are merged into the application quality control codes of a single type of equipment, and the observed data after quality control are output.

[0020] In one or more embodiments, preferably, forming an application quality control identification code according to the laser fog measurement quality control data specifically includes:

[0021] After the dead time correction process, the first laser fog measurement quality control identification code is added;

[0022] After the geometric overlap factor correction process, a second laser fog measurement quality control identification code is added;

[0023] After background noise subtraction, the third laser fog measurement quality control identification code is added;

[0024] After data smoothing, the fourth laser fog measurement quality control identification code is added;

[0025] Perform cloud and aerosol algorithm classification and data quality identification;

[0026] According to the first laser fog measurement quality control identification code, the second laser fog measurement quality control identification code, the third laser fog measurement quality control identification code and the fourth laser fog measurement quality control identification code, a laser fog measurement application quality control identification code is formed by using a first calculation formula in combination with the data quality identification;

[0027] The first calculation formula is:

[0028]

[0029] Among them, M1 is the laser fog measurement application quality control identification code, Cx1 is the number of times QC1, QC2, QC3 and QC4 are 1, Cx2 is the number of times QC1, QC2, QC3 and QC4 are 2, Cx3 is the number of times QC1, QC2, QC3 and QC4 are 3, QC1 is the first laser fog measurement quality control identification code, QC2 is the second laser fog measurement quality control identification code, QC3 is the third laser fog measurement quality control identification code, QC4 is the fourth laser fog measurement quality control identification code, L1 is the laser fog measurement data quality identifier, when there is cloud data, L1=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

[0030] In one or more embodiments, preferably, forming an application quality control identification code according to millimeter wave cloud and fog quality control data specifically includes:

[0031] After the spectrum quality control, the first millimeter wave cloud and fog quality control identification code is added;

[0032] After noise elimination, the second millimeter wave cloud and fog quality control identification code is added;

[0033] After the spectral moment extraction process, the third millimeter wave cloud and fog quality control identification code is added;

[0034] After isolated point echo processing, the fourth millimeter wave cloud and fog quality control identification code is added;

[0035] Perform velocity fuzzy processing to identify whether there is cloud data and mark it as the quality mark of millimeter wave cloud and fog data;

[0036] According to the first millimeter wave cloud and fog measurement quality control identification code, the second millimeter wave cloud and fog measurement quality control identification code, the third millimeter wave cloud and fog measurement quality control identification code and the fourth millimeter wave cloud and fog measurement quality control identification code, in combination with the millimeter wave cloud and fog measurement data quality identification, a millimeter wave cloud and fog measurement application quality control identification code is formed using a second calculation formula;

[0037] The second calculation formula is:

[0038]

[0039] Among them, M2 is the millimeter wave cloud and fog measurement application quality control identification code, Dx1 is the number of times QD1, QD2, QD3 and QD4 are 1, Dx2 is the number of times QD1, QD2, QD3 and QD4 are 2, Dx3 is the number of times QD1, QD2, QD3 and QD4 are 3, QD1 is the first laser fog measurement quality control identification code, QD2 is the second laser fog measurement quality control identification code, QD3 is the third laser fog measurement quality control identification code, QD4 is the fourth laser fog measurement quality control identification code, L2 is the laser fog measurement data quality identification, when there is cloud data, L2=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

[0040] In one or more embodiments, preferably, the obtaining of the original observation image to extract the all-sky application quality control identification code specifically includes:

[0041] Obtain the original observed image and determine whether it is visible light channel data. If it is visible light channel data, perform brightness balance correction and add the first full sky quality control identification code. On this basis, perform white balance correction and add the second full sky quality control identification code.

[0042] If it is not visible light channel data, it is considered to be infrared channel data, and the brightness temperature value is corrected, and the third all-sky quality control identification code is added;

[0043] Forming an all-sky application quality control identification code using a third calculation formula according to the first all-sky quality control identification code, the second all-sky quality control identification code, and the third all-sky quality control identification code;

[0044] The third calculation formula is:

[0045]

[0046] Wherein, M2 is the all-sky application quality control identification code, Ex1 is the number of times QE1, QE2, QE3 and QE4 are 1, Ex2 is the number of times QE1, QE2, QE3 and QE4 are 2, Ex3 is the number of times QE1, QE2, QE3 and QE4 are 3, QE1 is the first all-sky quality control identification code, QE2 is the second all-sky quality control identification code, QE3 is the third all-sky quality control identification code, f() is a fitting function, and the fitting function output is 0 when () is satisfied, otherwise, the fitting function output is 1.

[0047] In one or more embodiments, preferably, the quality control identification code of the weather and hydrological observation data specifically includes:

[0048] When the observation data fails the format check, the comprehensive quality control code is marked as 2;

[0049] If the missing test fails, no follow-up test will be conducted;

[0050] There is no observation task, and the application quality control code is marked as 7;

[0051] There is an observation task, and the application quality control code is 8;

[0052] If the limit value check fails, no further inspection will be conducted and the quality control code used will be 2;

[0053] For the observation data that have passed the limit value check, the variation range check, internal consistency check, time consistency check, spatial consistency check and comprehensive check are completed in sequence, and the corresponding application quality control code is marked.

[0054] According to a second aspect of an embodiment of the present invention, a quality marking control system for marine multi-band cloud and fog observation data is provided.

[0055] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality marking control system includes:

[0056] Application quality control code setting module, used to set two quality control codes, namely QC method control code and application quality control code;

[0057] A process quality control module is used to set a process for comprehensive analysis of marine cloud and fog observation data using a variety of quality control methods. The process of comprehensive analysis is used to form a final application quality control code based on a variety of QC method quality control codes;

[0058] Laser fog measurement module, used to form application quality control identification code based on laser fog measurement quality control data;

[0059] When the cloud cover identified by the original image of the all-sky imager is 0%, the current weather is considered to be clear. If the forward scatter visibility obtained by the laser fog measurement is less than 5km, the laser radar quality control mark is considered to be suspicious.

[0060] Millimeter wave cloud and fog measurement module, used to form an application quality control identification code based on millimeter wave cloud and fog measurement quality control data;

[0061] When the cloud cover identified by the original image of the all-sky imager is 10%, the current weather is considered to be cloudy. If the reflectivity factor obtained by the millimeter-wave cloud and fog measurement is empty, the quality control mark of the millimeter-wave cloud and fog measurement data is considered to be suspicious.

[0062] When the forward scattering identified by the laser fog measurement module is lower than 5km, if the reflectivity factor obtained by the millimeter-wave cloud and fog measurement is empty, the millimeter-wave cloud and fog measurement data quality control mark is considered suspicious.

[0063] All-sky imaging module, used to obtain original observation images and extract all-sky application quality control identification codes;

[0064] When a portrait or other foreign object is recognized based on the original image of the all-sky imager, it is considered that the original image has an error, and the data quality control mark of the all-sky imaging module is considered to be an error.

[0065] Meteorological and hydrological module, used for quality control identification codes of weather and hydrological observation data.

[0066] When the current navigation speed is greater than 3km / h, the meteorological and hydrological observation data are considered suspicious, and the data quality control mark of the all-sky imaging module is considered suspicious.

[0067] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.

[0068] According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, comprising a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement any one of the methods described in the first aspect of the embodiment of the present invention.

[0069] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0070] In the solution of the present invention, quality analysis is performed on a single type of equipment to form a quality control code.

[0071] In the solution of the present invention, an application quality control code is formed by jointly analyzing multiple types of quality control.

[0072] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0073] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0075] Figure 1 It is a flow chart of a method for quality marking control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.

[0076] Figure 2 It is a flowchart of setting two quality control codes, namely, QC method control code and application quality control code, in a quality marking control method for marine multi-band cloud and fog observation data in one embodiment of the present invention.

[0077] Figure 3 It is a flow chart of a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention, which uses a variety of quality control methods to conduct a comprehensive analysis of cloud and fog observation data at sea. The comprehensive analysis process is used to form a final application quality control code based on quality control codes of a variety of QC methods.

[0078] Figure 4 It is a flow chart of forming an application quality control identification code based on laser fog measurement quality control data in a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0079] Figure 5 It is a flow chart of forming an application quality control identification code based on millimeter wave cloud and fog quality control data in a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0080] Figure 6 It is a flowchart of obtaining original observation images and extracting quality control identification codes for all-sky applications in a quality marking control method for multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0081] Figure 7 It is a flow chart of the quality control identification code of weather and hydrological observation data in the quality marking control method of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.

[0082] Figure 8 It is a structural diagram of a quality marking control system for marine multi-band cloud and fog observation data according to an embodiment of the present invention.

[0083] Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. DETAILED DESCRIPTION

[0084] In some of the processes described in the specification and claims of the present invention and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0085] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0086] The importance of quality control of meteorological observation data has been recognized by all scientists who use meteorological data. Ground-based meteorological observation records must be representative, accurate, and comparable. Various observations can be considered as random variables in a statistical sense. When collecting observations, errors are usually generated in the true value. Depending on the nature of the error and the cause of the error, meteorological observation data may have three types of errors of completely different natures: random error, systematic error, and negligent error (accidental error). The purpose of quality control is to ensure that the data provided for application meets various requirements (including uncertainty, resolution, continuity, uniformity, representativeness, time limit, format, etc.). Good data does not need to be particularly outstanding. What is important is that its quality should be known and verifiable.

[0087] Prior to the technology of the present invention, it was difficult to effectively perform quality control on multi-band cloud and fog observation data, which resulted in the inability to effectively analyze multi-band clouds and fog at sea, and in particular, it was impossible to determine which data were abnormal and which might contain errors.

[0088] In an embodiment of the present invention, a method and system for quality labeling control of multi-band cloud and fog observation data at sea are provided. The solution forms a quality identification code for the multi-band cloud and fog observation data through reasonable quality control, which is convenient for users to analyze and predict.

[0089] According to a first aspect of an embodiment of the present invention, a method for controlling quality marking of multi-band cloud and fog observation data at sea is provided.

[0090] Figure 1It is a flow chart of a method for quality marking control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.

[0091] In one or more embodiments, preferably, the method for controlling the quality mark of marine multi-band cloud and fog observation data includes:

[0092] S101. Set two quality control codes, namely QC method control code and application quality control code;

[0093] S102, setting a process for comprehensively analyzing the marine cloud and fog observation data using a variety of quality control methods, wherein the comprehensive analysis process is used to form a final application quality control code based on the quality control codes of the various QC methods;

[0094] S103, forming an application quality control identification code according to the laser fog measurement quality control data;

[0095] S104, forming an application quality control identification code according to the millimeter wave cloud and fog quality control data;

[0096] S105, obtaining the original observation image to extract the all-sky application quality control identification code;

[0097] S106. Quality control identification code for weather and hydrological observation data.

[0098] In the embodiment of the present invention, the data quality and application quality are combined to achieve the validity of the observation data of the current cloud and fog observation system.

[0099] Figure 2 It is a flowchart of setting two quality control codes, namely, QC method control code and application quality control code, in a quality marking control method for marine multi-band cloud and fog observation data in one embodiment of the present invention.

[0100] like Figure 2 As shown, in one or more embodiments, preferably, the two quality control codes are respectively set as QC method control code and application quality control code, specifically including:

[0101] S201, setting 4 levels of QC method quality control codes for each quality control method, wherein the QC method quality control code value range is 0-3, 0 means correct, 1 means suspicious, 2 means warning, and 3 means data error;

[0102] S202, determine the application quality control code for each data, the application quality control code value range is 0-9, where 0 means correct data, 1 means suspicious data, 2 means data warning, 3 means data error, 4-6 means standby, 7 means no observation task, 8 means data missing, and 9 means format check failed.

[0103] In the embodiment of the present invention, QC method control code: This control code is usually used to indicate whether the adopted quality control method is appropriate or effective. Four levels of QC method quality control codes are set, and the value range is 0 to 3: 0 indicates that the QC method used is correct. 1 indicates that there may be problems with the QC method and the results are suspicious. 2 indicates that there is a warning, and the QC method may not be perfect or needs to be adjusted. 3 indicates that there is an error in the QC method and the quality check cannot be performed correctly. Application quality control code: The application quality control code is more specifically marked for the quality status of each data point. The value range is 0 to 9, and the specific meaning is as follows: 0 indicates that the data is completely correct. 1 indicates that there is a question about the data and further verification may be required. 2 is a data warning, indicating that there may be problems with the data but it has not been confirmed. 3 clearly indicates that there are errors in the data. 4 to 6 are reserved as spare codes and can be used for future expansion or other specific purposes. 7 indicates that there is no observation task, that is, there is no valid observation for this data point. 8 indicates that the data is missing, that is, there should be data at this moment but it has not been collected. 9 indicates that the data has not passed the format check, that is, the format of the data does not meet the predetermined standard.

[0104] Figure 3 It is a flow chart of a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention, which uses a variety of quality control methods to conduct a comprehensive analysis of cloud and fog observation data at sea. The comprehensive analysis process is used to form a final application quality control code based on quality control codes of a variety of QC methods.

[0105] like Figure 3 As shown, in one or more embodiments, preferably, the setting uses a plurality of quality control methods to perform a comprehensive analysis process on the sea cloud and fog observation data, and the comprehensive analysis process is used to form a final application quality control code according to the quality control codes of the plurality of QC methods, specifically including:

[0106] S301, read the observation data before quality control, and generate four types of quality control data: laser fog measurement, millimeter wave cloud and fog, meteorological and hydrological load, and all-sky imaging;

[0107] S302, calculating QC quality control codes for four types of quality control data;

[0108] S303, integrating the QC quality control codes of the four types of quality control data into application quality control codes for a single type of equipment, and outputting the observed data after quality control.

[0109] In the embodiment of the present invention, raw data is read: raw data needs to be read from the observation device first. Such data may include outputs of laser fog meters, millimeter wave cloud radars, meteorological and hydrological loads, and all-sky imagers. Such data are usually unprocessed raw signals, such as echo power values, backscattered light intensity, etc.

[0110] Generating quality control data: After obtaining the raw data, the data needs to be processed initially to generate quality control data for further analysis. This may include decoding the signal, unit conversion, time synchronization, etc. At this stage, some basic quality control methods may be applied, such as checking the integrity and consistency of the data.

[0111] Calculate QC code: For the four types of quality control data, the corresponding QC code needs to be calculated. This step involves evaluating the data quality and assigning a QC code to each data point according to a preset standard or algorithm. For example, if the echo power value of a data point is abnormally high, it may be marked as "suspicious" or "wrong".

[0112] Fusion of application quality control codes: Based on the calculated QC quality control codes, this information is merged into the application quality control codes of a single type of equipment. This step may require comprehensive consideration of the characteristics and observation targets of different equipment, as well as the specific meaning of the QC quality control codes. For example, if the data of the laser fog meter and the millimeter-wave cloud radar are both displayed as "correct", the final application quality control code may also be "correct".

[0113] Outputting quality-controlled data: After determining the application quality control code, the last step is to output the quality-controlled observation data. These data now contain information about their quality and can be used by researchers or business systems. In practical applications, these data may be stored in a database or directly used in real-time monitoring and early warning systems.

[0114] Figure 4 It is a flow chart of forming an application quality control identification code based on laser fog measurement quality control data in a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0115] like Figure 4 As shown, in one or more embodiments, preferably, forming an application quality control identification code according to the laser fog measurement quality control data specifically includes:

[0116] S401, after the dead time correction process, adding the first laser fog measurement quality control identification code;

[0117] S402, after the geometric overlap factor correction processing, adding a second laser fog measurement quality control identification code;

[0118] S403, after background noise subtraction processing, adding a third laser fog measurement quality control identification code;

[0119] S404, after data smoothing processing, adding a fourth laser fog measurement quality control identification code;

[0120] S405, perform cloud and aerosol algorithm classification and data quality identification;

[0121] S406, forming a laser fog measurement application quality control identification code using a first calculation formula according to the first laser fog measurement quality control identification code, the second laser fog measurement quality control identification code, the third laser fog measurement quality control identification code and the fourth laser fog measurement quality control identification code in combination with the data quality identification;

[0122] The first calculation formula is:

[0123]

[0124] Among them, M1 is the laser fog measurement application quality control identification code, Cx1 is the number of times QC1, QC2, QC3 and QC4 are 1, Cx2 is the number of times QC1, QC2, QC3 and QC4 are 2, Cx3 is the number of times QC1, QC2, QC3 and QC4 are 3, QC1 is the first laser fog measurement quality control identification code, QC2 is the second laser fog measurement quality control identification code, QC3 is the third laser fog measurement quality control identification code, QC4 is the fourth laser fog measurement quality control identification code, L1 is the laser fog measurement data quality identifier, when there is cloud data, L1=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

[0125] In an embodiment of the present invention, data distortion is avoided: dead time correction is necessary because it can prevent sensor data distortion under high count rate conditions. Add quality control identification code: After the dead time correction process is completed, the first laser fog measurement quality control identification code will be added, indicating that the data has been corrected for this. Improve data acquisition accuracy: Geometric overlap factor correction helps to improve the accuracy of data acquisition when laser beams overlap. Add quality control identification code: After the geometric overlap factor correction process, a second laser fog measurement quality control identification code will be added. Improve signal clarity: Subtracting background noise helps to improve signal clarity, thereby obtaining more accurate measurement results. Add quality control identification code: After the background noise subtraction process, a third laser fog measurement quality control identification code will be added. Reduce data fluctuations: Data smoothing helps to reduce data fluctuations and make trends more obvious. Add quality control identification code: After data smoothing, a fourth laser fog measurement quality control identification code will be added. Perform data classification: The cloud and aerosol algorithm classification is performed to better identify and distinguish the effects of different components on laser transmission. Data quality identification: Combined with the data quality identification, this helps with subsequent data analysis and interpretation. Calculation formula: The laser fog measurement application quality control identification code is calculated by combining the four laser fog measurement quality control identification codes and the data quality identification code through the first calculation formula. Identification code significance: This application quality control identification code represents the data quality status after a series of corrections and is crucial for subsequent data use and trust.

[0126] Figure 5It is a flow chart of forming an application quality control identification code based on millimeter wave cloud and fog quality control data in a method for quality marking control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0127] like Figure 5 As shown, in one or more embodiments, preferably, forming an application quality control identification code according to millimeter wave cloud and fog quality control data specifically includes:

[0128] S501. After spectrum quality control, add the first millimeter wave cloud and fog quality control identification code;

[0129] S502, after noise elimination processing, adding a second millimeter wave cloud and fog quality control identification code;

[0130] S503, after the spectral moment extraction processing, adding the third millimeter wave cloud and fog measurement quality control identification code;

[0131] S504, after isolated point echo processing, adding the fourth millimeter wave cloud and fog quality control identification code;

[0132] S505, perform velocity fuzzy processing to identify whether there is cloud data, and mark it as a millimeter wave cloud and fog data quality mark;

[0133] S506, forming a millimeter wave cloud and fog measurement application quality control identification code by using a second calculation formula according to the first millimeter wave cloud and fog measurement quality control identification code, the second millimeter wave cloud and fog measurement quality control identification code, the third millimeter wave cloud and fog measurement quality control identification code and the fourth millimeter wave cloud and fog measurement quality control identification code in combination with the millimeter wave cloud and fog measurement data quality identification;

[0134] The second calculation formula is:

[0135]

[0136] Among them, M2 is the millimeter wave cloud and fog measurement application quality control identification code, Dx1 is the number of times QD1, QD2, QD3 and QD4 are 1, Dx2 is the number of times QD1, QD2, QD3 and QD4 are 2, Dx3 is the number of times QD1, QD2, QD3 and QD4 are 3, QD1 is the first laser fog measurement quality control identification code, QD2 is the second laser fog measurement quality control identification code, QD3 is the third laser fog measurement quality control identification code, QD4 is the fourth laser fog measurement quality control identification code, L2 is the laser fog measurement data quality identification, when there is cloud data, L2=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

[0137] In an embodiment of the present invention, spectral quality control helps to ensure that the data obtained from the millimeter-wave cloud and fog radar accurately reflects the actual meteorological conditions. After completing the spectral quality control, the first millimeter-wave cloud and fog quality control identification code will be added, indicating that the data has been corrected for this item. Noise elimination helps to improve the overall clarity of the data and make the useful signal more prominent. After the noise elimination process, a second millimeter-wave cloud and fog quality control identification code will be added. Spectral moment extraction processing helps to enhance the interpretability of the data, making the information extracted from the data more reliable. After the spectral moment extraction process, a third millimeter-wave cloud and fog quality control identification code will be added. Isolated point echo processing helps to improve data coherence and reduce the impact caused by outliers. After the isolated point echo processing, a fourth millimeter-wave cloud and fog quality control identification code will be added. Velocity fuzzy processing helps to identify whether cloud data exists, which is particularly important for meteorological analysis. After the velocity fuzzy processing is performed, it will be identified as the millimeter-wave cloud and fog data quality identification, which is crucial for subsequent data analysis and interpretation. Through the second calculation formula, the millimeter-wave cloud and fog application quality control identification code is calculated by combining the four millimeter-wave cloud and fog quality control identification codes and the data quality identification.

[0138] Figure 6 It is a flowchart of obtaining original observation images and extracting quality control identification codes for all-sky applications in a quality marking control method for multi-band cloud and fog observation data at sea in one embodiment of the present invention.

[0139] like Figure 6 As shown, in one or more embodiments, preferably, the obtaining of the original observation image to extract the all-sky application quality control identification code specifically includes:

[0140] S601, obtaining an original observed image, determining whether it is visible light channel data, and if it is visible light channel data, performing brightness balance correction, and adding a first full-sky quality control identification code, and on this basis, performing white balance correction, and adding a second full-sky quality control identification code;

[0141] S602: If it is not visible light channel data, it is considered to be infrared channel data, brightness temperature correction is performed, and a third full sky quality control identification code is added;

[0142] S603, forming an all-sky application quality control identification code by using a third calculation formula according to the first all-sky quality control identification code, the second all-sky quality control identification code and the third all-sky quality control identification code;

[0143] The third calculation formula is:

[0144]

[0145] Wherein, M2 is the all-sky application quality control identification code, Ex1 is the number of times QE1, QE2, QE3 and QE4 are 1, Ex2 is the number of times QE1, QE2, QE3 and QE4 are 2, Ex3 is the number of times QE1, QE2, QE3 and QE4 are 3, QE1 is the first all-sky quality control identification code, QE2 is the second all-sky quality control identification code, QE3 is the third all-sky quality control identification code, f() is a fitting function, and the fitting function output is 0 when () is satisfied, otherwise, the fitting function output is 1.

[0146] In the embodiment of the present invention, it is first determined whether the acquired original observation image is visible light channel data. Visible light channel data usually requires brightness balance correction to adjust the overall brightness of the image to make it more natural and balanced. If it is not visible light channel data, it is considered to be infrared channel data. This type of data usually needs to be corrected for brightness temperature to accurately reflect the temperature distribution on the surface of the object. After brightness balance correction, a first full sky quality control identification code is added, indicating that the data has been corrected. On the basis of brightness balance correction, white balance correction is performed to further adjust the color balance of the image, and then a second full sky quality control identification code is added. For infrared channel data, after brightness temperature correction, a third full sky quality control identification code is added, indicating that the data has been corrected. According to the first full sky quality control identification code, the second full sky quality control identification code and the third full sky quality control identification code, a full sky application quality control identification code is formed using a third calculation formula. Fitting function: In the third calculation formula, f() is a fitting function, and when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1. The purpose of this function is to adjust the value of the application quality control identification code according to the number of occurrences of the quality control identification code.

[0147] Figure 7 It is a flow chart of the quality control identification code of weather and hydrological observation data in the quality marking control method of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.

[0148] like Figure 7 As shown, in one or more embodiments, preferably, the quality control identification code of the weather and hydrological observation data specifically includes:

[0149] S701: When the observation data fails the format check, the comprehensive quality control code is marked as 2;

[0150] S702: If the missing test fails, no subsequent inspection will be conducted;

[0151] S703, no observation task, marked application quality control code is 7;

[0152] S704, there is an observation task, and the application quality control code is 8;

[0153] S705, if the limit value check fails, no further inspection will be performed and the quality control code used is 2;

[0154] S706. For the observation data that have passed the limit value check, complete the variation range value check, internal consistency check, time consistency check, spatial consistency check and comprehensive check in sequence, and mark the corresponding application quality control code.

[0155] In an embodiment of the present invention, when the observation data fails the format check, no other checks are performed, and the comprehensive quality control code is marked as 2 (data error). When the missing measurement check fails, no subsequent checks are performed. If there is no observation task, the application quality control code is marked as 7; if there is an observation task, the application quality control code is 8. When the limit value check fails, no subsequent checks are performed, and the application quality control code is 2 (data error). For the observation data that passes the limit value check, the main variation range value check, internal consistency check, time consistency check, spatial consistency check and comprehensive check are completed in sequence, and the corresponding application quality control code is marked.

[0156] According to a second aspect of an embodiment of the present invention, a quality marking control system for marine multi-band cloud and fog observation data is provided.

[0157] Figure 8 It is a structural diagram of a quality marking control system for marine multi-band cloud and fog observation data according to an embodiment of the present invention.

[0158] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality marking control system includes:

[0159] Application quality control code setting module 801, used to set two quality control codes, namely QC method control code and application quality control code;

[0160] The process quality control module 802 is used to set a process for comprehensive analysis of marine cloud and fog observation data using multiple quality control methods, wherein the comprehensive analysis process is used to form a final application quality control code based on the quality control codes of multiple QC methods;

[0161] Laser fog measurement module 803, used to form an application quality control identification code based on laser fog measurement quality control data;

[0162] When the cloud cover identified by the original image of the all-sky imager is 0%, the current weather is considered to be clear. If the forward scatter visibility obtained by the laser fog measurement is less than 5km, the laser radar quality control mark is considered to be suspicious.

[0163] The millimeter wave cloud and fog measurement module 804 is used to form an application quality control identification code according to the millimeter wave cloud and fog measurement quality control data;

[0164] When the cloud cover identified by the original image of the all-sky imager is 10%, the current weather is considered to be cloudy. If the reflectivity factor obtained by the millimeter-wave cloud and fog measurement is empty, the quality control mark of the millimeter-wave cloud and fog measurement data is considered to be suspicious.

[0165] When the forward scattering identified by the laser fog measurement module is lower than 5km, if the reflectivity factor obtained by the millimeter-wave cloud and fog measurement is empty, the millimeter-wave cloud and fog measurement data quality control mark is considered suspicious.

[0166] The all-sky imaging module 805 is used to obtain the original observation image to extract the all-sky application quality control identification code;

[0167] When a portrait or other foreign object is recognized based on the original image of the all-sky imager, it is considered that the original image has an error, and the data quality control mark of the all-sky imaging module is considered to be an error.

[0168] Meteorological and hydrological module 806 is used for quality control identification codes of weather and hydrological observation data.

[0169] When the current navigation speed is greater than 3km / h, the meteorological and hydrological observation data are considered suspicious, and the data quality control mark of the all-sky imaging module is considered suspicious.

[0170] In an embodiment of the present invention, a system suitable for different structures is realized through a series of modular designs. The system can realize closed-loop, reliable and efficient execution through collection, analysis and control. When the missing measurement check fails, no subsequent inspection will be performed. If there is no observation task, the application quality control code is marked as 7; if there is an observation task, the application quality control code is 8. When the limit value check fails, no subsequent inspection will be performed, and the application quality control code is 2 (data error). For the observation data that passes the limit value check, the main change range value check, internal consistency check, time consistency check, spatial consistency check and comprehensive check are completed in sequence, and the corresponding application quality control code is marked.

[0171] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.

[0172] According to a fourth aspect of an embodiment of the present invention, an electronic device is provided. Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. Fig. 9The electronic device shown is a general-purpose marine multi-band cloud and fog observation data quality marking control device. The electronic device can be a smart phone, a tablet computer, or other device. As shown, the electronic device 900 includes a processor 901 and a memory 902. Among them, the processor 901 is electrically connected to the memory 902. The processor 901 is the control center of the terminal 900, which uses various interfaces and lines to connect various parts of the entire terminal, and executes various functions of the terminal and processes data by running or calling computer programs stored in the memory 902, and calling data stored in the memory 902, thereby monitoring the terminal as a whole.

[0173] In this embodiment, the processor 901 in the electronic device 900 will load the instructions corresponding to the processes of one or more computer programs into the memory 902 according to the following steps, and the processor 901 will run the computer program stored in the memory 902 to realize various functions: setting two quality control codes, namely the QC method control code and the application quality control code; setting a process for comprehensive analysis of marine cloud and fog observation data using multiple quality control methods, and the comprehensive analysis process is used to form a final application quality control code based on multiple QC method quality control codes; forming an application quality control identification code based on laser fog measurement quality control data; forming an application quality control identification code based on millimeter wave cloud and fog measurement quality control data; obtaining the original observation image to extract the full-sky application quality control identification code; quality control identification code of weather and hydrological observation data.

[0174] The memory 902 may be used to store computer programs and data. The computer programs stored in the memory 902 include instructions that can be executed in the processor. The computer programs may constitute various functional modules. The processor 901 executes various functional applications and data processing by calling the computer programs stored in the memory 902.

[0175] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0176] In the solution of the present invention, quality analysis is performed on a single type of equipment to form a quality control code.

[0177] In the solution of the present invention, an application quality control code is formed by jointly analyzing multiple types of quality control.

[0178] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0179] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0180] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0181] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0182] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for controlling the quality of marine multi-band cloud and fog observation data, characterized in that: The method includes: Set two quality control codes: QC method control code and application quality control code; A process for comprehensively analyzing the marine cloud and fog observation data using a variety of quality control methods is set up, wherein the process for comprehensive analysis is used to form a final application quality control code based on the quality control codes of a variety of QC methods; Form an application quality control identification code based on the laser fog measurement quality control data; Generate application quality control identification code based on millimeter wave cloud and fog quality control data; Obtain the original observation image to extract the quality control identification code for all-sky applications; Quality control identification code for weather and hydrological observation data.

2. The method for controlling the quality mark of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The two quality control codes are respectively QC method control code and application quality control code, specifically including: Set a 4-level QC method quality control code for each quality control method, wherein the QC method quality control code value range is 0 to 3, 0 means correct, 1 means suspicious, 2 means warning, and 3 means data error; Determine the application quality control code for each data. The application quality control code value range is 0 to 9, where 0 means correct data, 1 means suspicious data, 2 means data warning, 3 means data error, 4 to 6 are spare, and 7 means no observation task. 8 means data missing, and 9 means format check failed.

3. The method for controlling the quality of marine multi-band cloud and fog observation data according to claim 1, characterized in that: The setting is to use a plurality of quality control methods to conduct a comprehensive analysis of the sea cloud and fog observation data. The comprehensive analysis process is used to form a final application quality control code according to the quality control codes of the plurality of QC methods, and specifically includes: Read the observation data before quality control and generate four types of quality control data: laser fog measurement, millimeter wave cloud and fog, meteorological and hydrological load, and all-sky imaging; Calculate QC codes for four types of quality control data; The QC quality control codes of the four types of quality control data are merged into the application quality control codes of a single type of equipment, and the observed data after quality control are output.

4. The method for controlling the quality mark of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The forming of the application quality control identification code according to the laser fog measurement quality control data specifically includes: After the dead time correction process, the first laser fog measurement quality control identification code is added; After the geometric overlap factor correction process, a second laser fog measurement quality control identification code is added; After background noise subtraction, the third laser fog measurement quality control identification code is added; After data smoothing, the fourth laser fog measurement quality control identification code is added; Perform cloud and aerosol algorithm classification and data quality identification; According to the first laser fog measurement quality control identification code, the second laser fog measurement quality control identification code, the third laser fog measurement quality control identification code and the fourth laser fog measurement quality control identification code, a laser fog measurement application quality control identification code is formed by using a first calculation formula in combination with the data quality identification; The first calculation formula is: Among them, M1 is the laser fog measurement application quality control identification code, Cx1 is the number of times QC1, QC2, QC3 and QC4 are 1, Cx2 is the number of times QC1, QC2, QC3 and QC4 are 2, Cx3 is the number of times QC1, QC2, QC3 and QC4 are 3, QC1 is the first laser fog measurement quality control identification code, QC2 is the second laser fog measurement quality control identification code, QC3 is the third laser fog measurement quality control identification code, QC4 is the fourth laser fog measurement quality control identification code, L1 is the laser fog measurement data quality identifier, when there is cloud data, L1=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

5. The method for controlling the quality mark of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The forming of the application quality control identification code according to the millimeter wave cloud and fog quality control data specifically includes: After the spectrum quality control, the first millimeter wave cloud and fog quality control identification code is added; After noise elimination, the second millimeter wave cloud and fog quality control identification code is added; After the spectral moment extraction process, the third millimeter wave cloud and fog quality control identification code is added; After isolated point echo processing, the fourth millimeter wave cloud and fog quality control identification code is added; Perform velocity fuzzy processing to identify whether there is cloud data and mark it as the quality mark of millimeter wave cloud and fog data; According to the first millimeter wave cloud and fog measurement quality control identification code, the second millimeter wave cloud and fog measurement quality control identification code, the third millimeter wave cloud and fog measurement quality control identification code and the fourth millimeter wave cloud and fog measurement quality control identification code, in combination with the millimeter wave cloud and fog measurement data quality identification, a millimeter wave cloud and fog measurement application quality control identification code is formed using a second calculation formula; The second calculation formula is: Among them, M2 is the millimeter wave cloud and fog measurement application quality control identification code, Dx1 is the number of times QD1, QD2, QD3 and QD4 are 1, Dx2 is the number of times QD1, QD2, QD3 and QD4 are 2, Dx3 is the number of times QD1, QD2, QD3 and QD4 are 3, QD1 is the first laser fog measurement quality control identification code, QD2 is the second laser fog measurement quality control identification code, QD3 is the third laser fog measurement quality control identification code, QD4 is the fourth laser fog measurement quality control identification code, L2 is the laser fog measurement data quality identification, when there is cloud data, L2=1, f() is the fitting function, when () is satisfied, the fitting function output is 0, otherwise, the fitting function output is 1.

6. The method for controlling the quality mark of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The step of obtaining the original observation image to extract the all-sky application quality control identification code specifically includes: Obtain the original observed image and determine whether it is visible light channel data. If it is visible light channel data, perform brightness balance correction and add the first full sky quality control identification code. On this basis, perform white balance correction and add the second full sky quality control identification code. If it is not visible light channel data, it is considered to be infrared channel data, and the brightness temperature value is corrected, and the third full sky quality control identification code is added; Forming an all-sky application quality control identification code using a third calculation formula according to the first all-sky quality control identification code, the second all-sky quality control identification code, and the third all-sky quality control identification code; The third calculation formula is: Wherein, M2 is the all-sky application quality control identification code, Ex1 is the number of times QE1, QE2, QE3 and QE4 are 1, Ex2 is the number of times QE1, QE2, QE3 and QE4 are 2, Ex3 is the number of times QE1, QE2, QE3 and QE4 are 3, QE1 is the first all-sky quality control identification code, QE2 is the second all-sky quality control identification code, QE3 is the third all-sky quality control identification code, f() is a fitting function, and the fitting function output is 0 when () is satisfied, otherwise, the fitting function output is 1.

7. The method for controlling the quality mark of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The quality control identification code of the weather and hydrological observation data specifically includes: When the observation data fails the format check, the comprehensive quality control code is marked as 2; If the missing test fails, no follow-up test will be conducted; There is no observation task, and the application quality control code is marked as 7; There is an observation task, and the application quality control code is 8; If the limit value check fails, no further inspection will be conducted and the quality control code used will be 2; For the observation data that have passed the limit value check, the variation range check, internal consistency check, time consistency check, spatial consistency check and comprehensive check are completed in sequence, and the corresponding application quality control code is marked.

8. The quality marking control system for marine multi-band cloud and fog observation data is characterized by: The system is used to implement the method according to any one of claims 1 to 7, and the system comprises: Application quality control code setting module, used to set two quality control codes, namely QC method control code and application quality control code; A process quality control module is used to set a process for comprehensive analysis of marine cloud and fog observation data using a variety of quality control methods. The process of comprehensive analysis is used to form a final application quality control code based on a variety of QC method quality control codes; Laser fog measurement module, used to form application quality control identification code based on laser fog measurement quality control data; Millimeter wave cloud and fog measurement module, used to form an application quality control identification code based on millimeter wave cloud and fog measurement quality control data; All-sky imaging module, used to obtain original observation images and extract all-sky application quality control identification codes; Meteorological and hydrological module, used for quality control identification codes of weather and hydrological observation data.

9. A computer-readable storage medium storing computer program instructions, characterized in that: The computer program instructions implement the method according to any one of claims 1 to 7 when executed by a processor.

10. An electronic device comprising a memory and a processor, characterized in that: The memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to any one of claims 1-7.

Citation Information

Patent Citations

  • Agglomerate fog monitoring and forecasting method for motor vehicle highway

    CN110310501A

  • Method and system for checking site position information in meteorological observation data

    CN116955515A

  • Multi-source data collaborative 10-minute rainfall quality control method

    CN118050829A

  • System and method for determining an optimum QC strategy for immediate release results

    US20120330866A1

  • Information extraction using image data

    US20170154237A1