Offshore multiband cloud and mist observation data quality analysis control method and system
By screening and controlling the quality of the multi-band cloud and fog observation data at sea, the problem of uncontrollable data quality in the existing technology is solved, the stability and accuracy of the maritime cloud and fog observation data is achieved, and reliable data is provided for navigation safety and meteorological research. support.
Patent Information
- Application Number
- CN202411092995.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-11-22
AI Technical Summary
The existing laser fog measurement system is difficult to achieve standardized processing of various types of data, resulting in uncontrollable quality of maritime cloud fog observation data, which in turn affects navigation safety and the accuracy of meteorological research.
Quality screening and control is performed by setting laser fog measurement, millimeter-wave cloud fog, all-sky imager and meteorological hydrological load data, including dead time correction, signal overlap factor correction, background noise deduction, digital smoothing filtering, cloud and aerosol algorithm classification, Various quality control measures such as cloud height extreme value inspection, logic inspection, brightness uniformization and white balance correction have been formed to form stable and accurate data.
The quality identification and accuracy of multi-band cloud observation data at sea is realized, and stable data support is provided, which improves data quality and reliability for meteorological research and navigation safety.
Smart Images

Figure CN119003507A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of cloud and fog observation technology, and more specifically, to a method and system for quality analysis and control of marine multi-band cloud and fog observation data. Background Art
[0002] Marine fog observation technology has important scientific significance and practical value for ensuring the safety of marine activities and arranging transportation, industrial production and fishery production. Sea fog is one of the important factors affecting navigation safety. Reduced visibility will bring difficulties to ship navigation and increase the risk of collision and grounding. Through effective sea fog monitoring and forecasting, accurate information can be provided to ships to help crew members make correct navigation decisions. Sea fog not only affects maritime traffic, but also affects aviation and land transportation in coastal areas. Accurate sea fog forecasts can help relevant departments reasonably arrange traffic operation plans and reduce delays and accidents caused by weather reasons. The advancement of marine fog observation technology not only contributes to practical applications, but also provides important data support for meteorological research.
[0003] Prior to the technology of the present invention, it was difficult for existing laser fog measurement systems to effectively perform standardized processing of various types of data, which resulted in uncontrollable data quality and often inaccurate cloud and fog observations. Summary of the invention
[0004] In view of the above problems, the present invention proposes a method and system for quality analysis and control of multi-band cloud and fog observation data at sea. By inputting different data and performing specific quality screening and control on cloud and fog observation technology, data support is provided for meteorological research, achieving stable and accurate results.
[0005] According to a first aspect of an embodiment of the present invention, a method for quality analysis and control of multi-band cloud and fog observation data at sea is provided.
[0006] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality analysis control method includes:
[0007] Set all types of input data;
[0008] Obtain laser fog measurement data for quality control and form data quality verification;
[0009] Perform quality control on millimeter wave cloud and fog data;
[0010] Perform quality control on the all-sky imager data to form quality-controlled all-sky data;
[0011] Conduct quality control of meteorological and hydrological loads;
[0012] All data after quality control are stored in a unified manner.
[0013] In one or more embodiments, preferably, the setting of all types of input data specifically includes:
[0014] Use the laser fog radar data as part of the input data;
[0015] Use millimeter wave cloud and fog radar data as part of the input data;
[0016] Use the data from the All Sky Imager as part of the input data;
[0017] The data of meteorological and hydrological loads are included as part of the input data.
[0018] In one or more embodiments, preferably, the obtaining of laser fog measurement data for quality control to form data quality verification specifically includes:
[0019] Obtain laser fog measurement data for dead time correction;
[0020] Using the first calculation formula to correct the overlapping factor of the signal after the dead time correction;
[0021] Using the second calculation formula and the third calculation formula to perform background noise subtraction on the signal;
[0022] Digital smoothing filtering and cloud and aerosol algorithm classification of the signal;
[0023] The signal-to-noise ratio is calculated using the fourth calculation formula, and then the quality of all laser fog measurement data is marked;
[0024] The first calculation formula is:
[0025]
[0026] Wherein, P(R,λ) is the original echo signal; P'(R,λ) is the signal corrected by the geometric overlap factor; R is the height from the radar, in meters; λ is the laser emission wavelength, in nanometers; O(R) is the preset geometric overlap factor;
[0027] The second calculation formula is:
[0028]
[0029] Among them, P bg (R,λ) is the signal of background noise, R1,…,R N is the 1st,…,Nth background noise height;
[0030] The third calculation formula is:
[0031] P′'(R,λ)=P'(R,λ)-P bg (R,λ)
[0032] Among them, P′′(R,λ) is the signal after background noise subtraction;
[0033] The fourth calculation formula is:
[0034]
[0035] Here, SNR is the signal-to-noise ratio.
[0036] In one or more embodiments, preferably, the quality control of the millimeter wave cloud and fog data specifically includes:
[0037] Check the extreme values of cloud and fog height, including that data that exceeds the main variation range of elements within the specified geographical and temporal range is suspicious;
[0038] Precipitation attenuation identification is performed under precipitation conditions, specifically, when the millimeter-wave cloud radar echo is attenuated, the output cloud top height is lower than the actual cloud top height, and it is marked as suspicious; the cloud base height is lower than the actual cloud base height, and it is marked as suspicious;
[0039] Perform a logic check, specifically including that the bottom height is less than the top height; the top height of the next layer is less than the bottom height of the previous layer.
[0040] In one or more embodiments, preferably, performing quality control according to the all-sky imager data to form quality-controlled all-sky data specifically includes:
[0041] Obtain sky images with uniform brightness through high dynamic range imaging, reduce the number of overexposed pixels around the sun, and obtain the true sky color through white balance correction;
[0042] In the infrared band, the brightness temperature value is corrected to reduce the non-uniformity error of the brightness temperature data collected in the infrared band;
[0043] The fifth calculation formula is used to calculate the average gray value of the three channels;
[0044] The sixth calculation formula is used to calculate the same grayscale value K that the three channels tend to;
[0045] The new grayscale value of each pixel is used to calculate the three-channel gain value through the seventh calculation formula;
[0046] Update the grayscale value using the eighth calculation formula;
[0047] The fifth calculation formula is:
[0048]
[0049]
[0050]
[0051] Where M is the total number of pixels in the x-axis direction, N is the total number of pixels in the y-axis direction, and I r (x,y),I g (x,y),I b (x, y) represent the grayscale values of the red, green and blue channels of the image respectively, R aver , G aver and B aver are the average grayscale values of the red, green and blue channels respectively;
[0052] The sixth calculation formula is:
[0053]
[0054] Among them, K is the same gray value that the three channels tend to;
[0055] The seventh calculation formula is:
[0056] K=K / R
[0057] K r =K / R aver
[0058] K g =K / G aver
[0059] K b =K / B aver
[0060] Among them, Kr, Kg and Kb are the gain values of the red, green and blue channels;
[0061] The eighth calculation formula is:
[0062] I new_r (x,y)=I r (x,y)×K r
[0063] I new_g (x,y)=I g (x,y)×K g
[0064] I new_b (x,y)=I b (x,y)×K b
[0065] Among them, Inew_r, Inew_g and Inew_b are the new grayscales of the pixels.
[0066] In one or more embodiments, preferably, the quality control of meteorological and hydrological loads specifically includes:
[0067] Classify meteorological and hydrological loads according to time scale into minutes and hours;
[0068] Quality control is carried out according to the observation items for temperature, air pressure, relative humidity, wind direction, wind speed, sea temperature and salinity, and the anomalies in the format and data range limitations are extracted, and the meteorological and hydrological loads beyond the range are eliminated.
[0069] In one or more embodiments, preferably, the step of uniformly storing all quality-controlled data specifically includes:
[0070] Obtain meteorological and hydrological load data, all-sky data, millimeter-wave cloud and fog data, and laser fog measurement data;
[0071] The codes of all data with abnormal quality are stored.
[0072] According to a second aspect of an embodiment of the present invention, a system for quality analysis and control of marine multi-band cloud and fog observation data is provided.
[0073] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality analysis and control system includes:
[0074] Set up a data input module, which is used to set up all types of input data;
[0075] The quality control code setting module of laser fog measurement data is used to obtain laser fog measurement data for quality control and form data quality verification;
[0076] The quality control code setting module of millimeter wave cloud and fog data is used to perform quality control on millimeter wave cloud and fog data;
[0077] A quality control code setting module for all-sky imager data is used to perform quality control on the all-sky imager data to form quality-controlled all-sky data;
[0078] The quality control code setting module of meteorological and hydrological loads is used to perform quality control of meteorological and hydrological loads;
[0079] The quality control code storage module is used to uniformly store all data after quality control.
[0080] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.
[0081] According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, comprising a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement any one of the methods described in the first aspect of the embodiment of the present invention.
[0082] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:
[0083] In the scheme of the present invention, the quality identification of laser fog measurement data is achieved through abnormal screening and setting of data.
[0084] In the scheme of the present invention, the channel gain value of the skyscope is set by online screening and control, and the grayscale processed full skyscope data is formed.
[0085] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.
[0086] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0087] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0088] Figure 1 It is a flow chart of a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0089] Figure 2 It is a flowchart of setting all types of input data in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0090] Figure 3 The present invention is a flowchart of obtaining laser fog measurement data for quality control and forming data quality verification in a method for quality analysis and control of multi-band cloud and fog observation data at sea in an embodiment of the present invention.
[0091] Figure 4 It is a flow chart of quality control of millimeter-wave cloud and fog data in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0092] Figure 5 The present invention is a flowchart of performing quality control on all-sky imager data in a method for quality analysis and control of multi-band cloud and fog observation data at sea in one embodiment of the present invention to form quality-controlled all-sky data.
[0093] Figure 6 It is a flow chart of quality control of meteorological and hydrological loads in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0094] Figure 7 It is a flowchart of uniformly storing all data after quality control in a method for quality analysis and control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.
[0095] Figure 8 It is a structural diagram of a quality analysis and control system for marine multi-band cloud and fog observation data according to an embodiment of the present invention.
[0096] Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. DETAILED DESCRIPTION
[0097] In some of the processes described in the specification and claims of the present invention and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.
[0098] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0099] Marine fog observation technology has important scientific significance and practical value for ensuring the safety of marine activities and arranging transportation, industrial production and fishery production. Sea fog is one of the important factors affecting navigation safety. Reduced visibility will bring difficulties to ship navigation and increase the risk of collision and grounding. Through effective sea fog monitoring and forecasting, accurate information can be provided to ships to help crew members make correct navigation decisions. Sea fog not only affects maritime traffic, but also affects aviation and land transportation in coastal areas. Accurate sea fog forecasts can help relevant departments reasonably arrange traffic operation plans and reduce delays and accidents caused by weather reasons. The advancement of marine fog observation technology not only contributes to practical applications, but also provides important data support for meteorological research.
[0100] Prior to the technology of the present invention, it was difficult for existing laser fog measurement systems to effectively perform standardized processing of various types of data, which resulted in uncontrollable data quality and often inaccurate cloud and fog observations.
[0101] In the embodiment of the present invention, a method and system for quality analysis and control of multi-band cloud and fog observation data at sea are provided. The scheme provides data support for meteorological research by inputting different data and performing specific quality screening and control on cloud and fog observation technology, achieving stable and accurate results.
[0102] According to a first aspect of an embodiment of the present invention, a method for quality analysis and control of multi-band cloud and fog observation data at sea is provided.
[0103] Figure 1 It is a flow chart of a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0104] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality analysis control method includes:
[0105] S101, setting all types of input data;
[0106] S102, obtaining laser fog measurement data for quality control and forming data quality verification;
[0107] S103, perform quality control on millimeter wave cloud and fog data;
[0108] S104, performing quality control on the all-sky imager data to generate quality-controlled all-sky data;
[0109] S105. Conduct quality control of meteorological and hydrological loads;
[0110] S106. All data after quality control are stored uniformly.
[0111] In the embodiment of the present invention, cloud and fog observation technology is combined to input different data and perform specific quality screening and control, and combined to provide data support for meteorological research, so as to achieve stable and accurate results.
[0112] Figure 2 It is a flowchart of setting all types of input data in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0113] like Figure 2 As shown, in one or more embodiments, preferably, the setting of all types of input data specifically includes:
[0114] S201, using the laser fog radar data as part of the input data;
[0115] S202, taking the millimeter wave cloud and fog radar data as part of the input data;
[0116] S203, using the data of the all-sky imager as part of the input data;
[0117] S204. Take the meteorological and hydrological load data as part of the input data.
[0118] In an embodiment of the present invention, laser fog radar data: Input: Generally, laser fog radar data is obtained in the form of digital signals or files directly output by the device. Collection: Data is usually monitored and recorded in real time by a dedicated hardware device (such as a laser radar), and then transmitted to a data center or processing system through a wired or wireless network. Millimeter wave cloud radar data: Input: Similar to laser fog radar, the data of millimeter wave cloud radar is also obtained in the form of digital signals or files output by the device. Collection: These data are scanned by the millimeter wave radar device at a specific frequency, capturing cloud information and sending it to the data processing center through a communication interface. All-sky imager data: Input: All-sky imagers usually output high-resolution sky images or videos, which can be in digital file format. Collection: All-sky imagers take images of the entire visible sky area and transmit the image data to a computer system for storage and analysis. Meteorological and hydrological load data: Input: These data may include temperature, humidity, wind speed, rainfall, etc., and are usually recorded in the form of digital data or time series. Collection: The meteorological and hydrological sensor network measures various environmental parameters and sends the data to a central database or cloud platform in real time or periodically.
[0119] Figure 3 The present invention is a flowchart of obtaining laser fog measurement data for quality control and forming data quality verification in a method for quality analysis and control of multi-band cloud and fog observation data at sea in an embodiment of the present invention.
[0120] like Figure 3As shown, in one or more embodiments, preferably, the acquisition of laser fog measurement data is quality controlled to form data quality verification, specifically including:
[0121] S301, obtaining laser fog measurement data for dead time correction;
[0122] S302, using a first calculation formula to correct the overlapping factor of the signal after the dead time correction;
[0123] S303, using the second calculation formula and the third calculation formula to perform background noise subtraction on the signal;
[0124] S304, performing digital smoothing filtering and cloud and aerosol algorithm classification on the signal;
[0125] S305, calculating the signal-to-noise ratio using the fourth calculation formula, and then performing quality identification on all the laser fog measurement data;
[0126] The first calculation formula is:
[0127]
[0128] Wherein, P(R,λ) is the original echo signal; P'(R,λ) is the signal corrected by the geometric overlap factor; R is the height from the radar, in meters; λ is the laser emission wavelength, in nanometers; O(R) is the preset geometric overlap factor;
[0129] The second calculation formula is:
[0130]
[0131] Among them, P bg (R,λ) is the signal of background noise, r1,…,R N is the 1st,…,Nth background noise height;
[0132] The third calculation formula is:
[0133] P′'(R,λ)=P'(R,λ)-P bg (r,λ)
[0134] Among them, P′′(R,λ) is the signal after background noise subtraction;
[0135] The fourth calculation formula is:
[0136]
[0137] Here, SNR is the signal-to-noise ratio.
[0138] In an embodiment of the present invention, the original measurement data of the laser radar needs to be corrected for dead time, so as to correct the influence of the stacking effect of the echo photon signal on the detection result. The dead time of the photoelectric conversion detector is obtained by experimental measurement, and the dead time effect is corrected in combination with the extended detection principle hypothesis. The overlapping factor of the dead time-corrected signal is corrected to minimize the influence of the overlapping factor of the off-axis detection system on the near-field detection channel. The signal is then subjected to background noise subtraction and digital smoothing filtering to improve the signal-to-noise ratio. At the same time, in order to avoid the influence of clouds, rain, sea water, etc. on visibility inversion, cloud and aerosol algorithm classification and data quality identification are performed, signal sites close to saturation are marked, and waves and sea surface echoes caused by the floating of the detection platform are identified, thereby providing reliable data for surface visibility inversion.
[0139] The dead time correction process is as follows: The laser radar system consists of a laser emission system, an optical receiving system, a photoelectric conversion and data acquisition system, a signal processing system, etc. In the avalanche diode in the photoelectric conversion link, the upper limit of the photon counting mode count rate depends on the pulse pair resolution, that is, the minimum time interval at which each pulse can be separated. The reciprocal of the pulse pair resolution is the maximum count rate. However, since most events in the light counting area usually occur randomly, the counting pulses may overlap. Taking into account the possibility of pulse overlap, the actual maximum count rate is about one-tenth of the above calculated value. If we denote the true count rate as N, the measured count rate as M, and the time resolution as t, then the true count rate N can be expressed as:
[0140]
[0141] For example, the time resolution of a laser radar is 100ns, and the cumulative sampling times in one minute is 58400. Therefore, the measured count rate M1 = Data1 / (58400*100), the real count rate N1 = M1 / (1-M1·t), t is the dead time, generally provided by the manufacturer. After obtaining the real count rate, the real photon number Data1 = N1*100*58400 can be obtained. The original data of the radar is corrected according to this formula.
[0142] The specific process of geometric overlap factor correction is as follows: Generally speaking, in the blind area, the beam emitted by the laser is not in the receiving field of the telescope; in the transition area, the atmospheric echo signal cannot be completely received by the telescope, resulting in the received echo signal not matching the actual echo signal. The ratio of the number of photons received by the telescope to the actual number of photons is called the geometric overlap factor. This situation needs to be corrected during data processing, which is the geometric overlap factor correction.
[0143] The geometric overlap factor is a parameter that approaches 1 as the distance increases. It is generally provided by the manufacturer. If the geometric overlap factor is O(R), the corrected signal is:
[0144]
[0145] Where P(R,λ) is the original echo signal; P'(R,λ) is the signal corrected by the geometric overlap factor; R is the height from the radar, in meters; λ is the laser emission wavelength, in nanometers.
[0146] The process of background noise subtraction is as follows: Background noise is caused by stray light in the atmosphere. The data measured by the lidar contains not only signals such as aerosols and clouds, but also sky background noise signals.
[0147] According to the vertical distribution characteristics of the atmosphere, the high-altitude atmosphere is generally clean and contains almost no aerosols or clouds. Therefore, the high-altitude atmospheric echo signal is generally used to subtract background noise. The average value of the 1-2km high-altitude signal is selected as the background noise, and the real atmospheric echo signal is subtracted from the original echo. For example, if the range of the laser radar is 60km, the average value of the signal within any 2km between 50-60km can be selected as the background signal for subtraction.
[0148] The data smoothing process is as follows: Since the atmospheric state changes at any time and is affected by the random errors of the detection equipment, the original signal output by the lidar acquisition card has jitter. In this case, the echo signal can be smoothed to reduce signal jitter.
[0149] Data smoothing is to average the echo signals at several adjacent distance points, and the distance corresponding to the average echo value is also the average of these distances. The number of points for calculating the average value depends on the actual signal quality, such as 3-point smoothing, 5-point smoothing, etc. Data smoothing also changes the distance resolution of the echo signal. For example, if the distance resolution of a group of aerosol lidar echo signals is △r, after N-point smoothing, its distance resolution is N*△r.
[0150] Random noise is an influencing factor that cannot be ignored in the system. It is generally a crosstalk that cannot reflect the actual data of the radar. In order to reduce this influence, filtering processing is required at the algorithm inversion end. Through the combination of Fourier transform and spectrum windowing processing, it can be clearly seen that the noise level of the signal RCS curve is suppressed and the overall signal-to-noise ratio is improved. According to the detection distance and signal-to-noise ratio requirements stipulated by the meteorological regulations, the overall detection distance is significantly improved after algorithm quality control.
[0151] The specific process of cloud and aerosol classification is as follows: Clouds and aerosols have different optical properties. Choosing different aerosol lidar comparisons during data processing will have a significant impact on the inversion results, so cloud and aerosol data need to be distinguished.
[0152] Since the backscattering coefficient of clouds is much larger than that of aerosols, when the laser encounters clouds during transmission in the atmosphere, the range correction signal (RCS) will increase rapidly. The slope of the RCS curve is calculated, and the cloud layer or aerosol layer can be determined based on the positive and negative changes in the slope value.
[0153] If, starting from a certain height point, the slope of the RCS curve is continuously negative, then changes from negative to positive, and then continuously positive again, then this point is judged as the boundary between layers. After the entire curve is divided into layers according to the method, the interval range of each layer can be obtained, and then each layer is scored based on several parameters such as the maximum slope, minimum slope, and aspect ratio of each layer. If the score exceeds a certain threshold, it can be judged as a cloud layer, otherwise it is an aerosol layer or uncertain.
[0154] The data with clouds identified are marked and removed in the subsequent inversion of aerosol extinction coefficient and backscattering coefficient.
[0155] The specific process of data quality verification is as follows: comprehensively consider the RCS curve score, the signal-to-noise ratio of the original echo signal, and the consistency of fitting with the atmospheric molecular signal, and perform quality verification on the original echo data, and give the corresponding quality control identification code and quality control type code. Among them, the consistency of fitting with the atmospheric molecular signal means that above the boundary layer, in the area where the aerosol content in the atmosphere is almost zero, the echo signal can be assumed to be only related to the density of the molecules. Therefore, the molecular backscattering signal calculated according to the lidar equation and the curve after the real echo subtracts the background and is corrected by the distance square should be basically consistent after taking log, that is, they are consistent.
[0156] Figure 4 It is a flow chart of quality control of millimeter-wave cloud and fog data in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0157] like Figure 4 As shown, in one or more embodiments, preferably, the quality control of the millimeter wave cloud and fog data specifically includes:
[0158] S401. Check the extreme values of cloud and fog heights, including that data that exceeds the main variation range of elements within the specified geographical and temporal range is suspicious data;
[0159] S402, performing precipitation attenuation identification under precipitation conditions, specifically including: when the millimeter wave cloud radar echo is attenuated, the output cloud top height is lower than the actual cloud top height, and it is marked as suspicious; the cloud base height is lower than the actual cloud base height, and it is marked as suspicious;
[0160] S403, performing a logic check, specifically including that the logic check content includes that the bottom height is smaller than the top height; the top height of the next layer is smaller than the bottom height of the previous layer.
[0161] In the embodiment of the present invention, the millimeter wave cloud radar mainly carries out data quality control at three levels: power spectrum data, base data and product. Among them, the power spectrum data quality control mainly performs spectral moment extraction and velocity defuzzification processing, the base data quality control mainly eliminates isolated point echoes and clear sky echoes, and the product data quality control mainly checks the extreme value of cloud height, precipitation attenuation identification and logic inspection.
[0162] The process of spectral moment extraction is as follows: when the radar is working, it can receive the backscattered energy of signals such as clouds, fog, rain, and clutter, as well as the energy of spatial atmospheric background noise. Meteorological signals, atmospheric background noise, and equipment thermal noise are mixed together, which is mainly reflected in the power spectrum as the superposition of energy. In order to obtain pure cloud, fog, and rain echo images, it is necessary to eliminate the noise energy and clutter energy superimposed on the power spectrum and retain the meteorological signal. The noise signal is generally manifested as a multi-spectral peak signal on the power spectrum, and it is often manifested as the maximum point of the spectrum located in the middle of the power spectrum. When processing, the position of the non-meteorological echo is first determined, and the width of the spectrum is determined in combination with the noise threshold. The spectrum with a narrow spectral width and a position in the middle is generally a non-meteorological echo. The noise signal of the millimeter-wave cloud and fog radar is generally white noise, which is a broadband signal distributed at every frequency point on the spectrum, while the meteorological echo signal is a narrowband signal with relatively concentrated energy.
[0163] The premise of identifying meteorological signals is to determine the size of noise energy. The following three methods are often used to estimate noise: 1) Noise calibration: Noise calibration requires the radar to perform noise testing in standby mode. Advantages: more data can be statistically averaged, and the data consistency is better; Disadvantages: Noise testing requires observation time, and the noise test results are only the thermal noise of the equipment itself, excluding spatial atmospheric noise; 2) Long-distance signals are used as noise signals: During the real-time scanning process of the radar, it is assumed that the long distance is only noise and there is no meteorological echo. When there is a meteorological echo in the long distance, this method estimates the noise as the superposition of atmospheric noise, equipment noise, and meteorological echo power, and the noise estimate is too high; 3) Real-time extraction in each distance unit power spectrum: Use a single library power spectrum, sliding statistical average, and take the minimum value method.
[0164] The speed deambiguation process specifically includes: Due to the short wavelength of millimeter wave cloud radar, the speed ambiguity problem is particularly serious. The repetition frequency of W-band radar is 10kHz, and the maximum unambiguous speed is only 8m / s, so the speed ambiguity problem needs to be processed. The speed deambiguation methods mainly include the following methods: Signal processing speed deambiguation: A signal processing technology is provided to expand the unambiguous speed to 2, 3 or 4 times the original. This technology is called dual PRF speed deambiguation. The dual PRF mode contains alternating (N+M) pulse intervals, and the period of each interval is T l (low PRF) or T h (High PRF). Here, "N" represents T l The number of samples, "M" means T h The number of samples is used to obtain two average speeds V through each group of independent cycles T. l and V h , and then obtain additional correct speed information based on the correction algorithm.
[0165] Two trigger cycles T l and T h The ratio must be 3:2, 4:3 or 5:4. These ratios can be used to l The corresponding unambiguous speed is expanded by 3 times, 4 times and 5 times. The deambiguation algorithm uses the following algorithm. Assuming that the radar observes a target with a speed of V using two trigger cycles respectively, the phase angle corresponding to the autocorrelation R1 measured in these two PRFs is as follows: When the actual angle range exceeds the interval [-π,π], the angle is converted to the actual range by adding ±2π. Each angle corresponds to an ordinary single PRF Doppler velocity measurement value. When the velocity is ambiguous, the measured velocity value is actually a folded value of ±2π. Define φ to represent the difference between the two measured phases, then: It can be understood as: within the unambiguous velocity interval, the phase angle corresponding to the following unambiguous velocity:
[0166] If T l and T h The ratio is 3:2, then:
[0167] Therefore, V uunfold =3V ul =2V uh φ represents the velocity phase angle in [-π,π], but it corresponds to a larger unambiguous interval. Therefore, simply by calculating the difference between the folding angles of the lower and higher PRFs, an angle corresponding to a larger unambiguous velocity interval can be obtained. Similarly, it can be deduced that the ratio corresponding to 4:3 can convert the velocity Vul Increased to 4 times the original value, the ratio of 5:4 can increase the speed V ul Increased to 5 times the original.
[0168] The principle of data velocity defuzzification is mainly based on the continuity principle of wind field changes. The control threshold C is set. If |Vi-Va|≤C, Va is the reference speed, it can be considered that the change of the speed Vi of the processing point is within the continuous range and is confirmed as the correct point (non-fuzzy point); if |Vi-Va|>C, it is considered that Vi has an abnormal mutation and may be blurred. Select a suitable integer n and adjust Vi so that |Vi-Va|≤C. The velocity defuzzification formula is as follows:
[0169] V=|Vi|-2nV N When Vi>0
[0170] V=2nV N -Vi When Vi<0
[0171] The following two formulas are used for 2-order blurring:
[0172] V=|Vi|-2nV N When Vi<0
[0173] V=2nV N -Vi When Vi>0
[0174] The data processing method, expressed in the power spectrum, is the shifting and restoration of the spectrum.
[0175] Affected by the direct action of the boundary layer atmosphere and the underlying surface, the atmospheric movement in this layer has extremely strong turbulent characteristics and exhibits strong diurnal variation characteristics, which enables the radar to detect turbulent echoes even when there is no weather process.
[0176] Noise echoes are mainly divided into isolated echoes and clear sky echoes according to the causes of their formation. Among them, isolated echoes are mainly "bright spot" echoes caused by insects, birds, etc., also known as isolated noise points. Isolated echoes are distributed differently in different seasons, different regions, different time periods and different weather conditions, and are highly random. Their intensity and spatial distribution do not have obvious statistical characteristics, but their height is generally within 3000 meters, their reflectivity is -25±10dBZ, and their speed is ±1m / s. Since insects and birds are distributed in small numbers in the sampling space and their volume is large, generally one insect with a volume of about 1mm is contained in 1000m3, so there is generally only one or a few insect echoes within a radar beam width. For the identification and elimination of isolated echoes, the spatial scale area segmentation method is mainly used.
[0177] The identification and removal of clear sky echoes are mainly based on the law of clear sky echoes and their relationship with the temperature and humidity of the ground station. First, the ground temperature and humidity are input, the lifting condensation height is calculated, and a logical analysis is performed based on the millimeter wave cloud radar reflectivity factor and the lifting condensation height. If the reflectivity factor is grounded and the echo is strong, the reflectivity factor matrix is output, otherwise the echo data below the lifting condensation height is removed. Then the merged reflectivity factor matrix is calculated, and the reflectivity factor is corroded with a 3×1 filter to remove the data with a reflectivity factor less than a certain threshold. Then the entire image is divided into high altitude and near-ground layers, and different connected domain thresholds are used to remove areas with smaller connected domains; finally, the reflectivity factor matrix is output, and the thresholds in the entire process can be adjusted according to actual conditions.
[0178] Figure 5 The present invention is a flowchart of performing quality control on all-sky imager data in a method for quality analysis and control of multi-band cloud and fog observation data at sea in one embodiment of the present invention to form quality-controlled all-sky data.
[0179] like Figure 5 As shown, in one or more embodiments, preferably, performing quality control according to the all-sky imager data to form quality-controlled all-sky data specifically includes:
[0180] S501, obtain sky images with uniform brightness through high dynamic imaging, reduce the number of overexposed pixels around the sun, and obtain the true sky color through white balance correction;
[0181] S502, in the infrared band, by correcting the brightness temperature value, reducing the non-uniformity error of the brightness temperature data collected in the infrared band;
[0182] S503, using the fifth calculation formula to calculate the average grayscale value of the three channels;
[0183] S504, using the sixth calculation formula to calculate the same grayscale value K that the three channels tend to;
[0184] S505, the new gray value of each pixel is used to calculate the three-channel gain value through the seventh calculation formula;
[0185] S506, updating the gray value using the eighth calculation formula;
[0186] The fifth calculation formula is:
[0187]
[0188]
[0189]
[0190] Where M is the total number of pixels in the x-axis direction, N is the total number of pixels in the y-axis direction, and I r (x,y),I g (x,y),I b (x, y) represent the grayscale values of the red, green and blue channels of the image respectively, R aver , G aver and B aver are the average grayscale values of the red, green and blue channels respectively;
[0191] The sixth calculation formula is:
[0192]
[0193] Among them, K is the same gray value that the three channels tend to;
[0194] The seventh calculation formula is:
[0195] K=K / R
[0196] K r =K / R aver
[0197] K g =K / G aver
[0198] K b =K / B aver
[0199] Among them, Kr, Kg and Kb are the gain values of the red, green and blue channels;
[0200] The eighth calculation formula is:
[0201] I new_r (x,y)=I r (x,y)×K r
[0202] I new_g (x,y)=I g (x,y)×K g
[0203] I new_b (x,y)=I b (x,y)×K b
[0204] Among them, Inew_r, Inew_g and Inew_b are the new grayscales of the pixels.
[0205] In the embodiment of the present invention, the full sky imager can collect high-quality original sky images, which is an important prerequisite for accurately obtaining cloud parameters. In order to cope with the actual complex full sky conditions, in the visible light band, high dynamic imaging is first used to obtain sky images with uniform brightness, reduce the number of overexposed pixels around the sun, and obtain more sky texture information; then white balance correction is performed to obtain the true sky color. In the infrared band, the brightness temperature value correction is performed to reduce the non-uniformity error of the brightness temperature data collected in the infrared band.
[0206] When taking pictures, a visible light camera will obtain an adaptive exposure value in order to capture pictures with appropriate overall brightness. In daily environments, images with uniform brightness can be captured under this exposure value. When the camera is pointed directly at the sky to take pictures, the sky image captured under the adaptive exposure value will be overexposed due to the strong sunlight, and the sun and its surrounding pixels will be overexposed, causing some useful texture information to be submerged. Therefore, traditional all-sky imaging equipment is equipped with a sun tracking shielding device to prevent overexposure of the image due to direct sunlight, but this also causes part of the sky image to be blocked. When using cloud images in the later stage, image repair processing is required.
[0207] High Dynamic Range (HDR) technology is introduced in the all-sky imager. It uses short-time high dynamic continuous exposure to collect multiple sky images at different exposure values, and then synthesizes them to obtain a clear and unobstructed full-sky image with uniform brightness. Using high dynamic range image synthesis technology, the visible light imaging unit of the all-sky imager sets four gradient exposure times to collect sky images.
[0208] When the ambient lighting conditions are constantly changing, the human visual system can obtain the unchanged color characteristics of the object surface. This phenomenon is called color constancy, but the imaging equipment developed under the existing technical conditions does not have the function of adaptive color adjustment. Therefore, in different environments, when the lighting conditions are different, the collected image color will deviate from the true color of the object. According to the scattering effect of atmospheric molecules on light, the recognition basis of cloud point pixels in visible light cloud images is that the sky background is blue and the clouds are white. However, under special atmospheric conditions, color deviation occurs in visible light imaging, and the cloud image needs to be preprocessed to eliminate the influence of the lighting environment on the imaging color, obtain the most realistic sky color, and reduce the influence on the accuracy of cloud parameter inversion in the later stage. To solve this problem, the white balance correction algorithm is used to eliminate the color deviation of the cloud image. The commonly used white balance correction algorithm is called the gray world algorithm. The algorithm is based on the gray world assumption. Assuming a colorful image, the mean of the gray values of the three channels of the entire image RGB is calculated respectively. It is a gray value K approximating the mean of the gray values of the three channels. The premise of the gray world algorithm is that the reflected part of the light from the natural scene tends to a fixed value.
[0209] Assume that there is an M×N full sky image I(x,y), where x and y refer to the horizontal and vertical coordinates of the pixel in the image coordinate system. r (x,y),I g (x,y),I b (x, y) represent the grayscale values of the red, green and blue channels of the image respectively. The average grayscale value of the three channels is calculated according to the following formula:
[0210]
[0211]
[0212]
[0213] The same grayscale value K that the three channels tend to can be obtained by the following two methods:
[0214] (1) Directly set it to a fixed value, taking half of the maximum grayscale value of each channel of the image, that is, 127 or 128;
[0215] (2) Calculated by averaging the red, green, and blue channels:
[0216]
[0217] Then the gain values of the three channels are obtained as follows:
[0218] K=K / R
[0219] K r =K / R aver
[0220] K g =K / G aver
[0221] K b =K / B aver
[0222] After the white balance correction is performed on the image, the new gray value of each pixel can be calculated by the following formula:
[0223] I new_r (x,y)=I r (x,y)×K r
[0224] I new_g (x,y)=I g (x,y)×K g
[0225] I new_b (x,y)=I b (x,y)×Kb
[0226] In the above formula, I new_r (x,y),I new_g (x,y),I new_b (x, y) represent the new grayscale values of the red, green and blue channels after correction. According to the above calculation formula, the grayscale value of some pixels may exceed 255, so the pixels are directly set to 255.
[0227] As can be seen from the figure, the clouds in the corrected sky image are white and the sky background is blue. The corrected image is closer to the actual sky color. After white balance correction, the all-sky imager collects clearer and more realistic sky images, providing more accurate original images for later cloud image data analysis and providing a guarantee for later data processing.
[0228] The large-surface infrared camera used in the infrared band of the all-sky imager has high pixel resolution and prominent camera non-uniformity characteristics, so non-uniformity correction is required. The following figure shows the original brightness temperature data of the calibration part collected by the infrared camera. The temperature of the calibration part is uniform, but it can be seen from the figure that the collected data fluctuates greatly. This kind of situation is caused by the system error of the sensor itself on the one hand, and the temperature drift caused by the long-term operation of the camera on the other hand. The infrared camera has a built-in calibration blackbody, which is mainly used to provide two-point correction for the measurement results of the radiation sensor and correct the drift of the sensor's operating temperature effect and offset. The internal calibration blackbody adopts an unobstructed metal blackbody cavity with a diameter of 80mm, which is coated with high infrared radiance paint. The figure below shows the data after temperature correction, and its temperature fluctuation range is controlled within 0.3℃.
[0229] The two imaging units observe different bands. The different spectral characteristics of the visible light and infrared bands lead to differences in their ability to detect clouds. For example, the infrared camera is limited by the minimum observation temperature, and its detection ability for high clouds with lower temperatures is weak. However, the visible light band can accurately identify high clouds under good visibility conditions. In addition, under special weather conditions, such as fog, haze, and dust weather with poor visibility, the visible light image is scattered by aerosol particles and appears yellow. The contrast between the cloud and the sky background is reduced, resulting in errors in the identification of visible light cloud amount. At this time, the infrared cloud image is based on infrared radiation imaging, which is less affected by haze and dust, and can still accurately identify cloud point pixels. Therefore, the cloud amount data obtained by the two bands are fused to obtain the comprehensive cloud amount value and output it. When the difference between the cloud amount values of the two bands exceeds 50%, a large difference is judged and one of the band values is taken as the output true value.
[0230] Figure 6 It is a flow chart of quality control of meteorological and hydrological loads in a method for quality analysis and control of multi-band cloud and fog observation data at sea according to an embodiment of the present invention.
[0231] like Figure 6 As shown, in one or more embodiments, preferably, the quality control of meteorological and hydrological loads specifically includes:
[0232] S601, classify the meteorological and hydrological loads into minutes and hours according to the time scale;
[0233] S602. Quality control is performed on air temperature, air pressure, relative humidity, wind direction, wind speed, sea temperature and salinity according to the observation items, and the anomalies in the format and data range limitation are extracted, and the meteorological and hydrological loads beyond the range are eliminated.
[0234] S603. Meteorological and hydrological loads are quality controlled minute by minute. The quality control methods include format check, status check, equipment segment data quality control code check, climatological limit value check, major change range check, time consistency check, and internal consistency check.
[0235] A specific implementation is as follows:
[0236]
[0237]
[0238] Among them, the format check is carried out according to the meteorological and hydrological load data file (TXT). The specific inspection items are as follows:
[0239]
[0240] Among them, if the status check passes the quality control method, the quality control code is set to 0; otherwise, it will no longer be used as a subsequent quality control object or reference data, and the quality control process ends.
[0241]
[0242]
[0243] Among them, if the status check passes the quality control method, the quality control code is set to 0; otherwise, it will no longer be used as a subsequent quality control object or reference data, and the quality control process ends.
[0244]
[0245] Among them, if the limit value check passes the quality control method, the quality control code is set to 0; otherwise, it will no longer be used as a subsequent quality control object or reference data, and the quality control process ends.
[0246]
[0247]
[0248] Among them, the range value check is as follows:
[0249]
[0250]
[0251] Among them, the time consistency check performs quality control on the minute-by-minute data to determine the time changes of adjacent minute data.
[0252]
[0253] The following method only performs quality control on the 60th minute data, without checking the data minute by minute to determine the time changes of the adjacent 60th minute data.
[0254]
[0255] Among them, the internal consistency check is only performed on the 60th minute data, and no minute-by-minute data check is performed.
[0256]
[0257]
[0258] In an embodiment of the present invention, the quality control object is the ship meteorological and hydrological load observation data, which can be divided into minute data and hourly data according to the time scale, and can be divided into air temperature, air pressure, relative humidity, wind direction, wind speed, sea temperature and salinity according to the observation items.
[0259] Figure 7 It is a flowchart of uniformly storing all data after quality control in a method for quality analysis and control of multi-band cloud and fog observation data at sea in one embodiment of the present invention.
[0260] like Figure 7 As shown, in one or more embodiments, preferably, the unified storage of all quality-controlled data specifically includes:
[0261] S701, obtaining meteorological and hydrological load data, all-sky data, millimeter-wave cloud and fog data, and laser fog measurement data;
[0262] S702. Store the quality abnormality codes of all data.
[0263] In the embodiment of the present invention, the quality control codes generated during the process are uniformly stored and managed.
[0264] According to a second aspect of an embodiment of the present invention, a system for quality analysis and control of marine multi-band cloud and fog observation data is provided.
[0265] Figure 8 It is a structural diagram of a quality analysis and control system for marine multi-band cloud and fog observation data according to an embodiment of the present invention.
[0266] In one or more embodiments, preferably, the marine multi-band cloud and fog observation data quality analysis and control system includes:
[0267] Setting data input module 801, used to set all types of input data;
[0268] The laser fog measurement data quality control code setting module 802 is used to obtain the laser fog measurement data for quality control and form data quality verification;
[0269] The millimeter wave cloud and fog data quality control code setting module 803 is used to perform quality control on the millimeter wave cloud and fog data;
[0270] The quality control code setting module 804 of the all-sky imager data is used to perform quality control according to the all-sky imager data to form quality-controlled all-sky data;
[0271] The quality control code setting module 805 of the meteorological and hydrological load is used to perform quality control of the meteorological and hydrological load;
[0272] The quality control code storage module 806 is used to uniformly store all the data after quality control.
[0273] In the embodiment of the present invention, a system suitable for different structures is realized through a series of modular designs. The system can achieve closed-loop, reliable and efficient execution through collection, analysis and control.
[0274] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.
[0275] According to a fourth aspect of an embodiment of the present invention, an electronic device is provided. Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. Fig. 9The electronic device shown is a general-purpose marine multi-band cloud observation data quality analysis control device, which includes a general-purpose computer hardware structure, which at least includes a processor 901 and a memory 902. The processor 901 and the memory 902 are connected via a bus 903. The memory 902 is suitable for storing instructions or programs executable by the processor 901. The processor 901 can be an independent microprocessor or a collection of one or more microprocessors. Thus, the processor 901 executes the instructions stored in the memory 902, thereby executing the method flow of the embodiment of the present invention as described above to realize the processing of data and the control of other devices. The bus 903 connects the above-mentioned multiple components together, and at the same time connects the above-mentioned components to the display controller 904 and the display device and the input / output (I / O) device 905. The input / output (I / O) device 905 can be a mouse, a keyboard, a modem, a network interface, a touch input device, a somatosensory input device, a printer, and other devices known in the art. Typically, the input / output device 905 is connected to the system via an input / output (I / O) controller 906.
[0276] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:
[0277] In the scheme of the present invention, the quality identification of laser fog measurement data is achieved through abnormal screening and setting of data.
[0278] In the scheme of the present invention, the channel gain value of the skyscope is set by online screening and control, and the grayscale processed full skyscope data is formed.
[0279] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.
[0280] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0281] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0282] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0283] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for quality analysis and control of multi-band cloud and fog observation data at sea, characterized in that: The method includes: Set all types of input data; Obtain laser fog measurement data for quality control and form data quality verification; Perform quality control on millimeter wave cloud and fog data; Perform quality control on the all-sky imager data to form quality-controlled all-sky data; Conduct quality control of meteorological and hydrological loads; All data after quality control are stored in a unified manner.
2. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The setting of all types of input data specifically includes: Use the laser fog radar data as part of the input data; Use millimeter wave cloud and fog radar data as part of the input data; Use the data from the All Sky Imager as part of the input data; The data of meteorological and hydrological loads are included as part of the input data.
3. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The laser fog measurement data is obtained for quality control to form data quality verification, specifically including: Obtain laser fog measurement data for dead time correction; Using the first calculation formula to correct the overlapping factor of the signal after the dead time correction; Using the second calculation formula and the third calculation formula to perform background noise subtraction on the signal; Digital smoothing filtering and cloud and aerosol algorithm classification of the signal; The signal-to-noise ratio is calculated using the fourth calculation formula, and then the quality of all laser fog measurement data is marked; The first calculation formula is: Wherein, P(R,λ) is the original echo signal; P'(R,λ) is the signal corrected by the geometric overlap factor; R is the height from the radar, in meters; λ is the laser emission wavelength, in nanometers; O(R) is the preset geometric overlap factor; The second calculation formula is: Among them, P bg (R,λ) is the signal of background noise, R1,…,R N is the 1st,…,Nth background noise height; The third calculation formula is: P″(R,λ)=P'(R,λ)-P bg (R,λ) Where, P”(R,λ) is the signal after background noise subtraction; The fourth calculation formula is: Here, SNR is the signal-to-noise ratio.
4. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The quality control of the millimeter wave cloud and fog data specifically includes: Check the extreme values of cloud and fog height, including that data beyond the main variation range of elements within the specified geographical and temporal range is suspicious; Precipitation attenuation identification is performed under precipitation conditions, specifically, when the millimeter-wave cloud radar echo is attenuated, the output cloud top height is lower than the actual cloud top height, and it is marked as suspicious; the cloud base height is lower than the actual cloud base height, and it is marked as suspicious; Perform a logic check, specifically including that the bottom height is less than the top height; the top height of the next layer is less than the bottom height of the previous layer.
5. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The performing quality control according to the all-sky imager data to form quality-controlled all-sky data specifically includes: Obtain sky images with uniform brightness through high dynamic range imaging, reduce the number of overexposed pixels around the sun, and obtain the true sky color through white balance correction; In the infrared band, the brightness temperature value is corrected to reduce the non-uniformity error of the brightness temperature data collected in the infrared band; The fifth calculation formula is used to calculate the average grayscale value of the three channels; The sixth calculation formula is used to calculate the same grayscale value K that the three channels tend to; The new grayscale value of each pixel is used to calculate the three-channel gain value through the seventh calculation formula; Update the grayscale value using the eighth calculation formula; The fifth calculation formula is: Where M is the total number of pixels in the x-axis direction, N is the total number of pixels in the y-axis direction, and I r (x,y),I g (x,y),I b (x, y) represent the grayscale values of the red, green and blue channels of the image respectively, R aver , G aver and B aver are the average grayscale values of the red, green and blue channels respectively; The sixth calculation formula is: Among them, K is the same gray value that the three channels tend to; The seventh calculation formula is: K r =K / R aver K g =K / G aver K b =K / B aver Among them, Kr, Kg and Kb are the gain values of the red, green and blue channels; The eighth calculation formula is: I new_r (x,y)=I r (x,y)×K r I new_g (x,y)=I g (x,y)×K g I new_b (x,y)=I b (x,y)×K b Among them, Inew_r, Inew_g and Inew_b are the new grayscales of the pixels.
6. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The quality control of meteorological and hydrological loads specifically includes: Classify meteorological and hydrological loads according to time scale into minutes and hours; Quality control is carried out according to the observation items for temperature, air pressure, relative humidity, wind direction, wind speed, sea temperature and salinity, and the anomalies in the format and data range limitations are extracted, and the meteorological and hydrological loads beyond the range are eliminated.
7. The method for quality analysis and control of multi-band cloud and fog observation data at sea according to claim 1, characterized in that: The unified storage of all data after quality control specifically includes: Obtain meteorological and hydrological load data, all-sky data, millimeter-wave cloud and fog data, and laser fog measurement data; The codes of all data with abnormal quality are stored.
8. Marine multi-band cloud and fog observation data quality analysis and control system, characterized by: The system is used to implement the method according to any one of claims 1 to 7, and the system comprises: Set up a data input module, which is used to set up all types of input data; The quality control code setting module of laser fog measurement data is used to obtain laser fog measurement data for quality control and form data quality verification; The quality control code setting module of millimeter wave cloud and fog data is used to perform quality control on millimeter wave cloud and fog data; A quality control code setting module for all-sky imager data is used to perform quality control on the all-sky imager data to form quality-controlled all-sky data; The quality control code setting module of meteorological and hydrological loads is used to perform quality control of meteorological and hydrological loads; The quality control code storage module is used to uniformly store all data after quality control.
9. A computer-readable storage medium storing computer program instructions, characterized in that: The computer program instructions implement the method according to any one of claims 1 to 7 when executed by a processor.
10. An electronic device comprising a memory and a processor, characterized in that: The memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to any one of claims 1-7.
Citation Information
Patent Citations
Device and method for measuring two-waveband cloud height of foundation
CN102183237A
Sand and dust image sharpening method and system, medium, equipment and terminal
CN115272103A
Cloud base height estimation method and device based on ground-based microwave radiometer
CN115560727A
Millimeter wave radiation image fire point detection and identification method and system
CN115760749A
Satellite-borne synthetic aperture microwave radiometer sea and land pollution error correction method
CN116659684A
Cited By
Sea-land-air-space multi-source meteorological detection data fusion method and device and medium
CN119881902A
Sea fog detection method and device based on satellite-borne laser radar
CN119902230A
X-band weather radar data processing method and device
CN121721595A
