Intelligent weather image acquisition and weather image identification method and system

Abstract

The invention discloses an intelligent weather image acquisition and weather image recognition method and system, and particularly relates to the technical field of weather image recognition. The method comprises the following steps: performing continuous polarization imaging on a sky area, and synchronously acquiring space attitude and time information; carrying out preprocessing and Stokes parameter extraction on the polarized image data to obtain standardized sky polarized light field data; analyzing polarization degree distribution modes under different wavelengths by using a theoretical Rayleigh scattering model to obtain theoretical sky polarization mode characteristics; based on the polarized light field data, spatial distribution of actual clouds, aerosols and haze in the sky is identified, and actual atmospheric component distribution characteristics are formed; an abnormal polarization region is extracted through difference analysis of theoretical and actual characteristics, and halation polarization abnormity and scattering polarization abnormity are accurately classified based on geometric and spectral characteristics; generating a super local weather change early warning signal according to the classification result; the early warning accuracy and real-time performance of the super-local abnormal weather phenomenon are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of weather image recognition, and more particularly, to a method and system for intelligent weather image acquisition and weather image recognition. BACKGROUND

[0002] The existing sky weather image recognition method usually uses an ordinary visible light camera to capture and analyze sky images, and can only obtain basic visual information such as brightness and color of the sky region, and cannot obtain optical scattering characteristics and spatial distribution states of atmospheric components such as cloud layers, aerosols, and haze in the sky region. It is also impossible to distinguish the polarization characteristics of different abnormal weather phenomena (such as halos and scattering weather phenomena) in the sky, so that the actual weather abnormal region is difficult to be recognized and positioned, and accurate early warning of weather changes in the local region is difficult to achieve. SUMMARY

[0003] In order to overcome the above-mentioned defects of the prior art, embodiments of the present application provide a method and system for intelligent weather image acquisition and weather image recognition to solve the problems raised in the background art.

[0004] To achieve the above object, the present application provides the following technical scheme: A method for intelligent weather image acquisition and weather image recognition, comprising the following steps: S1: acquiring an original polarized image sequence of a target sky region by a multi-spectral polarized camera, and synchronously recording spatial attitude data and timestamp information of the camera, and outputting polarized image data; S2: preprocessing the polarized image data, and extracting Stokes parameters of each pixel, and outputting standardized sky polarized light field data; S3: based on the sky polarized light field data, analyzing the polarization degree distribution mode under different wavelengths, and combining the solar azimuth angle calculation theory Rayleigh scattering model, and outputting the theoretical sky polarization mode feature; S4: based on the sky polarized light field data, identifying the spatial distribution state of actual cloud layers, aerosols, and haze, and outputting the actual atmospheric component distribution feature; S5: comparing the theoretical sky polarization mode feature and the actual atmospheric component distribution feature, calculating the difference map in the polarization degree and polarization angle dimensions, and extracting the abnormal polarization region; S6: according to the geometric characteristics and spectral characteristics of the abnormal polarization region, distinguishing the halo polarization anomaly and the scattering polarization anomaly, and outputting the atmospheric optical anomaly classification result; S7: based on the atmospheric optical anomaly classification result, generating an ultra-local weather change early warning signal.

[0005] In a preferred embodiment, S1, in particular: The target sky region is continuously photographed by a multi-spectral polarization camera to obtain a raw polarization image sequence of different polarization directions of the target sky region under multiple spectral bands; The spatial attitude data of the multi-spectral polarization camera is collected in real time; The raw polarization image sequence and the corresponding spatial attitude data are respectively added with uniform timestamp information; The raw polarization image sequence data with uniform timestamp information is correspondingly matched with the corresponding spatial attitude data, and polarization image data is output.

[0006] In a preferred embodiment, S2, specifically: The polarization image data is subjected to image denoising to remove random noise and interference pixels in the polarization image data; The Stokes parameter data corresponding to each pixel point in the polarization image data is extracted from each frame of polarization image data after removal of random noise and interference pixels; The Stokes parameter data of all pixel points of each frame of polarization image data is subjected to data standardization conversion, and standardized sky polarization light field data is output.

[0007] In a preferred embodiment, S3, specifically: Based on the sky polarization light field data, the sky polarization degree distribution pattern corresponding to each spectral band is determined; The solar azimuth angle parameter under the corresponding spectral band is calculated for the sky polarization degree distribution pattern of each spectral band; Based on the solar azimuth angle parameter of each spectral band, the spatial distribution characteristics of ideal sky polarization degree and the spatial distribution characteristics of ideal polarization angle under each spectral band are calculated in combination with the Rayleigh scattering physical theory; According to the spatial distribution characteristics of ideal sky polarization degree and the spatial distribution characteristics of ideal polarization angle under each spectral band, theoretical sky polarization pattern characteristic data is output.

[0008] In a preferred embodiment, S4, specifically: Based on the sky polarization light field data, the sky region polarization feature change caused by the cloud layer is identified, and the spatial distribution region of the cloud layer is determined; Based on the sky polarization light field data, the sky polarization feature change region caused by aerosol particle scattering is identified, and the spatial distribution region of the aerosol particle is determined; Based on the sky polarization light field data, the polarization light feature change region caused by haze particle scattering is identified, and the spatial distribution region of the haze particle is determined; According to the cloud layer spatial distribution region, the aerosol particle spatial distribution region, and the haze particle spatial distribution region, actual atmospheric composition spatial distribution characteristic data is output.

[0009] In a preferred embodiment, S5, specifically: Calculate the polarization degree difference and polarization angle difference between the theoretical sky polarization pattern feature data and the actual atmospheric composition spatial distribution feature data under each spectral band; According to the polarization degree difference and the polarization angle difference, generate the sky polarization degree difference distribution map and the polarization angle difference distribution map of each spectral band; For the sky polarization degree difference distribution map and the polarization angle difference distribution map of each spectral band, extract the pixel area where the polarization degree difference and the polarization angle difference exceed the set threshold value, and determine the abnormal polarization area.

[0010] In a preferred embodiment, S6, specifically: For each abnormal polarization area, extract the boundary contour geometric parameters of the abnormal polarization area; For each abnormal polarization area, calculate the average polarization degree and the average polarization angle of the abnormal polarization area under each spectral band; Based on the boundary contour geometric parameters of the abnormal polarization area and the average polarization degree and the average polarization angle of the abnormal polarization area under each spectral band, determine the abnormal polarization type of each abnormal polarization area as a halo polarization abnormal type or a scattering polarization abnormal type; According to the abnormal polarization type determination result of the abnormal polarization area, output the atmospheric optical abnormal classification result In a preferred embodiment, S7, specifically: According to the atmospheric optical abnormal classification result, extract the spatial position parameters of each abnormal polarization area, including the center position coordinate data and the coverage range data of the abnormal polarization area; According to the spatial position parameters of each abnormal polarization area, calculate the offset of each abnormal polarization area relative to the center position of the target sky area; For the offset of each abnormal polarization area, according to the pre-set offset threshold value, determine the warning level of each abnormal polarization area; According to the warning level and the spatial position parameters of each abnormal polarization area, generate the super-local weather change warning signal corresponding to each abnormal polarization area.

[0011] On the other hand, the present application provides a kind of intelligent weather image acquisition and weather image identification system, comprising: Image acquisition module: the original polarization image sequence of target sky area is acquired by multispectral polarization camera, and the spatial attitude data and timestamp information of camera are recorded synchronously, and polarization image data is output; Data processing module: pre-process polarization image data, and extract the Stokes parameter of each pixel, output standardized sky polarization light field data; Theoretical feature module: based on the sky polarized light field data, analyze the polarization degree distribution pattern under different wavelengths, and calculate the theoretical Rayleigh scattering model combined with the solar azimuth angle, output the theoretical sky polarization pattern feature; Composition identification module: based on the sky polarized light field data, identify the spatial distribution state of actual cloud layer, aerosol and haze, output the actual atmospheric composition distribution feature; Abnormal extraction module: compare the theoretical sky polarization pattern feature and the actual atmospheric composition distribution feature, calculate the difference map in the polarization degree and polarization angle dimensions, and extract the abnormal polarization area; Abnormal classification module: according to the geometric characteristics and spectral characteristics of the abnormal polarization area, distinguish the halo polarization anomaly and scattering polarization anomaly, and output the atmospheric optical anomaly classification result; Early warning generation module: based on the atmospheric optical anomaly classification result, generate the super-local weather change early warning signal.

[0012] The technical effects and advantages of the intelligent weather image acquisition and weather image recognition method and system of the present application are as follows: By synchronously recording the polarization image, spatial attitude and time information through the multispectral polarization camera, the high space-time consistency of the sky observation data is realized; the image denoising and Stokes parameter extraction improve the reliability and accuracy of the polarization light field data; the Rayleigh scattering model is calculated combined with the multi-band polarization degree distribution and the solar azimuth angle, which provides an accurate theoretical benchmark; the cloud layer, aerosol and haze distribution are identified based on the polarization light field data, realizing the rapid and fine classification of atmospheric composition; the abnormal polarization area is accurately extracted through the difference analysis of the theoretical and actual polarization features, improving the abnormal detection sensitivity; the halo and scattering anomalies are distinguished by using the geometric and spectral characteristics of the abnormal area, enhancing the classification accuracy; the super-local early warning signal is generated based on the classification result, realizing the real-time and accurate early warning of local weather mutation. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 The present application is a kind of intelligent weather image acquisition and weather image recognition method schematic diagram; Figure 2 The present application is a kind of intelligent weather image acquisition and weather image recognition system structure schematic diagram. DETAILED DESCRIPTION

[0014] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application. Embodiment 1

[0015] Figure 1 A method for intelligent weather image acquisition and weather image recognition is given, which comprises the following steps: S1: acquiring the original polarization image sequence of the target sky area by a multispectral polarization camera, and synchronously recording the spatial attitude data and timestamp information of the camera, and outputting the polarization image data; S2: preprocessing the polarization image data, and extracting the Stokes parameters of each pixel, and outputting the standardized sky polarization light field data; S3: based on the sky polarization light field data, analyzing the polarization degree distribution mode under different wavelengths, and combining the solar azimuth angle calculation theory Rayleigh scattering model, and outputting the theoretical sky polarization mode characteristics; S4: based on the sky polarization light field data, identifying the spatial distribution state of actual cloud layer, aerosol and haze, and outputting the actual atmospheric composition distribution characteristics; S5: comparing the theoretical sky polarization mode characteristics and the actual atmospheric composition distribution characteristics, calculating the difference map in the polarization degree and polarization angle dimensions, and extracting the abnormal polarization area; S6: according to the geometric characteristics and spectral characteristics of the abnormal polarization area, distinguishing the halo polarization anomaly and the scattering polarization anomaly, and outputting the atmospheric optical anomaly classification result; S7: based on the atmospheric optical anomaly classification result, generating the super-local weather change warning signal.

[0016] S1: acquiring the original polarization image sequence of the target sky area by a multispectral polarization camera, and synchronously recording the spatial attitude data and timestamp information of the camera, and outputting the polarization image data, including: continuously photographing the target sky area by the multispectral polarization camera, and acquiring the original polarization image sequence of the target sky area in different polarization directions under multiple spectral bands; A multispectral polarimetric camera is a high-precision optical image acquisition device that simultaneously possesses both multispectral imaging and polarimetric imaging functions. The multispectral polarimetric camera is internally equipped with multiple independent spectral channels, each corresponding to a specific waveband range, such as the visible light waveband (e.g., wavelength range of 400 nanometers to 700 nanometers) and the near-infrared light waveband (e.g., wavelength range of 700 nanometers to 1100 nanometers). Each spectral channel is provided with a polarization-sensitive element (e.g., a linear polarizer or a polarization beam splitter prism) for simultaneously imaging in different polarization directions (e.g., horizontal polarization, vertical polarization, and positive and negative 45-degree polarization directions), thereby obtaining multi-directional polarization images in multiple spectral wavebands. The multispectral polarimetric camera is fixedly installed on a stable support platform or a gimbal device, with the lens of the multispectral polarimetric camera set to face the sky region to be measured, for example, the sky region at an elevation angle of 45 degrees in the azimuth direction above a specific geographic location. During continuous imaging, the camera shutter speed is set to a fixed parameter (e.g., exposure time of 10 milliseconds to 100 milliseconds), the imaging frame rate is set to 20 frames per second to 50 frames per second, and continuous imaging is performed for a relatively long period of time (e.g., 5 minutes to 30 minutes), thereby forming a series of continuous image sequences. Through continuous imaging by the multispectral polarimetric camera, a series of original polarization images with time continuity is generated, with each frame of the original polarization image sequence recording the polarization information of the sky region at a specific time, in multiple spectral wavebands, and in different polarization directions. For example, between 6:00 am and 9:00 am, 25 frames per second are continuously imaged, and a total of 45,000 frames of original polarization image sequence data are collected for the target sky region.

[0017] Real-time acquisition of spatial attitude data of the multispectral polarimetric camera; In order to ensure the reliability and accuracy of the original polarized image sequence data, it is necessary to record the real-time spatial attitude data during the shooting process of the multispectral polarization camera. By fixing high-precision attitude sensors and positioning devices such as micro-electromechanical system accelerometers, gyroscopes and global satellite navigation system receivers on the shell of the multispectral polarization camera, real-time acquisition of spatial attitude data of the multispectral polarization camera during shooting is realized, including rotation angle data of the multispectral polarization camera around three spatial axes (X axis, Y axis and Z axis) in the spatial coordinate system (such as pitch angle, roll angle and azimuth angle, with an angle measurement accuracy of 0.01 to 0.1 degrees) and real-time three-dimensional spatial coordinate data of the shooting point of the multispectral polarization camera (such as longitude and latitude and height coordinate information provided by the global satellite navigation system, with a longitude and latitude accuracy of ±0.5 to ±2 meters and a height accuracy of ±1 to ±3 meters). For example, when the multispectral polarization camera is installed on a ground observation platform, real-time recording of spatial attitude data during continuous shooting is realized, including spatial rotation angles (pitch angle 30.05 degrees, roll angle 0.02 degrees and azimuth angle 315.10 degrees) and spatial coordinate data (longitude 120.153576 degrees, latitude 30.287459 degrees and height 50 meters). Uniform timestamp information is added to the original polarized image sequence and the corresponding spatial attitude data. In order to ensure the correspondence between the polarized image data and the spatial attitude data, a unified high-precision synchronous clock source is set during continuous shooting and spatial attitude data acquisition, such as using the standard time signal provided by the global satellite navigation system as the reference and using a unified standard time counting method to add uniform timestamp information to each frame of original polarized image sequence and the simultaneously acquired spatial attitude data. For example, by using the internationally recognized coordinated universal time or Beijing time standard for timekeeping, it is ensured that each frame of original polarized image sequence data obtained by continuous shooting and each attitude data sample acquired in real time can be assigned uniform timestamp information. For example, the timestamp of a certain frame of polarized image sequence data is recorded as March 1, 2025, 08:35:15, 123 milliseconds, and at the same time, the corresponding recorded spatial attitude data is also marked with the timestamp March 1, 2025, 08:35:15, 123 milliseconds.

[0018] The original polarized image sequence data with uniform timestamp information is matched with the corresponding spatial attitude data, and the polarized image data is output. Each frame of the original polarization image sequence data with a unified timestamp is matched with each real-time recorded spatial attitude data with a unified timestamp, based on the same timestamp: the timestamp information of each frame of the original polarization image sequence data is compared with the timestamp information of each set of spatial attitude data acquired in real time. When the timestamp difference is less than 1 millisecond to 5 milliseconds, it is considered that the data was acquired at the same time, and the data matching is completed. Through matching, the data sets corresponding to all timestamps during continuous shooting are summarized and organized into a unified data structure, and the data matching result is output, that is, each frame of image data has an accurately matched spatial attitude data; for example, a total of 45,000 frames of polarization image data are obtained, and each frame of image data corresponds to a set of spatial attitude data, forming a total of 45,000 sets of matched polarization image data.

[0019] S2: Preprocess the polarization image data and extract the Stokes parameter for each pixel, outputting standardized sky polarization light field data, including: Image denoising is performed on polarization image data to remove random noise and interfering pixels from the polarization image data. Actual shooting processes are often affected by equipment noise and external environmental interference, such as electronic noise generated by the internal circuitry of the multispectral polarization camera, sensor response errors, or random interference from atmospheric turbulence. This results in the acquired polarization image data containing random noise and abnormal interfering pixels. Random noise manifests as random fluctuations in the grayscale or brightness values ​​of image pixels, while interfering pixels appear as abnormally prominent pixels with excessively large grayscale differences from adjacent pixels. To eliminate random noise and interfering pixels, image denoising needs to be performed frame-by-frame on the polarization image data. For example, if there are 45,000 frames of polarization image data, each frame is processed separately. Median filtering is applied to each pixel in each frame to remove random noise. In this process, a 3×3 or 5×5 pixel neighborhood window is established centered on each pixel to be processed. The median of the gray values ​​of all pixels within the neighborhood window is calculated, and the gray value of the pixel to be processed is replaced with the calculated median to effectively remove random noise pixels. For abnormally prominent interfering pixels in the image, a threshold method is used for identification and removal. For example, the pixel gray-level difference threshold is set to 50 gray levels. That is, when the gray value of a pixel differs from the gray value of its neighboring pixels by more than 50 gray levels, it is marked as an interfering pixel and replaced with the average gray value of its neighboring pixels to eliminate abnormal interfering pixels in the image. Through the above methods, random noise and interfering pixels are removed from each frame of polarized image data, generating polarized image data after removing random noise and interfering pixels.

[0020] For each frame of polarization image data after removing random noise and interfering pixels, extract the Stokes parameter data corresponding to each pixel in the polarization image data; Stokes parameter data are important parameters describing the state of polarized optical fields, including the first Stokes parameter, the second Stokes parameter, the third Stokes parameter, and the fourth Stokes parameter; To extract the above parameters, the polarization image data needs to be processed frame by frame and pixel by pixel. The position of each pixel in each frame of polarization image data needs to be determined. For example, if a frame of polarization image has a resolution of 1024×1024 pixels, all pixels are processed one by one. At each pixel position, the pixel grayscale value for different polarization directions (e.g., 0°, 45°, 90°, and 135° polarization) is read. The first Stokes parameter represents the total intensity of the incident light, which is a linear combination of the grayscale values ​​in the four polarization directions; that is, the first Stokes parameter is equal to the sum of the grayscale values ​​for 0° and 90° polarization. The second Stokes parameter... The Stokes parameter describes the difference in intensity between horizontally and vertically polarized light, which is the difference between the gray values ​​of 0 degrees and 90 degrees of polarization. The third Stokes parameter describes the difference in intensity between 45 degrees and 135 degrees of polarized light, which is the difference between the gray values ​​of 45 degrees and 135 degrees of polarization. The fourth Stokes parameter describes the circular polarization component, which is usually obtained through polarizer rotation and phase modulation measurements, for example, through the circular polarization element built into the camera. The Stokes parameter data for each frame of the image is extracted pixel by pixel. For example, the output of each frame of polarized image data is a data matrix containing all four Stokes parameter values.

[0021] The Stokes parameter data of all pixels in each frame of polarized image data are normalized and transformed to output normalized sky polarization light field data. After extracting the Stokes parameters, each frame of polarized image data corresponds to a complete Stokes parameter data matrix. Since the ranges of each parameter may vary significantly, data standardization is required. Standardization is performed on each Stokes parameter matrix in each frame of image data separately. The standardization process uses the max-min standardization method. Through standardization, all Stokes parameter matrix data in each frame of polarized image data are converted into standardized values ​​between 0 and 1, thereby obtaining standardized sky polarized light field data.

[0022] S3: Based on sky polarization field data, analyze the polarization degree distribution patterns at different wavelengths, and combine the solar azimuth angle to calculate the theoretical Rayleigh scattering model, outputting the theoretical sky polarization pattern characteristics, including: Based on sky polarization field data, determine the sky polarization degree distribution pattern for each spectral band; Sky polarization field data contains multiple spectral bands, each corresponding to a complete normalized Stokes parametric matrix. The data for each band is processed individually. Assuming the obtained sky polarization field data contains three bands, for example, with wavelength centers of 480 nm, 560 nm, and 670 nm, the data for each band is a two-dimensional matrix, where each element represents the normalized polarization characteristic value at the corresponding spatial location in the sky region. When determining the sky polarization degree distribution pattern corresponding to each spectral band, the polarization degree calculation formula is used to process the sky polarization field data for each spectral band. For any band (e.g., wavelength 480 nm), the normalized Stokes parametric matrix corresponding to that band is selected. The Stokes parameter matrix is ​​used to calculate the sky polarization degree pixel by pixel. The formula for calculating the sky polarization degree is: the polarization degree is equal to the ratio of the polarized light intensity to the total light intensity. The polarized light intensity is obtained by taking the square root of the sum of the squares of the second and third Stokes parameters, and the total light intensity is represented by the first Stokes parameter. The polarization degree is calculated for all pixels of the sky polarization field data in the 480 nm band, forming the spatial distribution matrix of the sky polarization degree of the band. Similarly, the same calculation operation is performed for other bands (560 nm, 670 nm), and the corresponding spatial distribution matrix of the sky polarization degree is obtained for each band. The calculated spatial distribution matrix is ​​defined as the sky polarization degree distribution pattern of the band.

[0023] For each spectral band, calculate the solar azimuth parameter in the corresponding spectral band based on the sky polarization distribution pattern. The solar azimuth parameter refers to the azimuth angle of the sun relative to the location of the observation equipment at the moment of sky observation. The calculation of the solar azimuth parameter is a spatial positioning operation of the sun's position, determined using the sky polarization degree distribution pattern. Based on the calculated sky polarization degree distribution pattern for each spectral band, the center position of the sky region where the polarization degree of the band reaches its minimum is found. For example, for the 480 nm wavelength band, the sky polarization degree distribution pattern is traversed to find the sky region with the polarization degree closest to zero, and the center coordinates of this region are recorded. According to Rayleigh scattering physics and sky polarization theory, the position of minimum polarization degree within the sky region usually corresponds to the actual direction of the sun; therefore, the coordinates of the position of minimum polarization degree are used as the estimated position of the sun. Starting from the spatial coordinates (such as latitude, longitude, and altitude) of the observation equipment's location, and ending at the sky coordinates of the position with the minimum polarization degree, a spatial position vector is established. The relative angle between the vector and the geographic reference coordinate system is calculated in the equipment coordinate system, and the calculated angle is defined as the solar azimuth parameter. Following the above method, the sky polarization degree distribution patterns at wavelengths of 560 nm and 670 nm are calculated respectively to obtain the corresponding solar azimuth parameters. For example, the solar azimuth angle for the 480 nm band is 135.25 degrees, the solar azimuth angle for the 560 nm band is 135.35 degrees, and the solar azimuth angle for the 670 nm band is 135.45 degrees. Finally, the solar azimuth parameter data corresponding to each spectral band is output.

[0024] Based on the solar azimuth angle parameters of each spectral band, and combined with Rayleigh scattering physics theory, the spatial distribution characteristics of the ideal sky polarization degree and the spatial distribution characteristics of the ideal polarization angle are calculated for each spectral band. Rayleigh scattering physics describes the physical mechanism by which sunlight is scattered by molecules in a clean atmosphere, resulting in sky polarization. According to Rayleigh scattering physics, once the solar azimuth angle parameter is determined, the ideal sky polarization state can be calculated using theoretical formulas: For each spectral band, the corresponding solar azimuth angle parameter is used as input, and ideal Rayleigh scattering atmospheric conditions are set, assuming that only air molecules exist in the atmosphere and neglecting the scattering effects of clouds, aerosols, etc. The calculation formula is the Rayleigh scattering polarization theory equation, using the solar azimuth angle and the angle between each pixel position in the sky and the sun's position as input, to calculate the theoretical polarization corresponding to each pixel position in the sky. The ideal sky polarization degree and theoretical polarization angle are obtained by traversing the position of each pixel in the sky and substituting the relative spatial angle value with the position of the sun into the Rayleigh scattering polarization theory equation. This yields the ideal sky polarization degree spatial distribution matrix and the ideal polarization angle spatial distribution matrix for all pixel positions in the 480 nm band. Similarly, the above calculations are performed on the 560 nm and 670 nm bands, and the corresponding ideal sky polarization degree spatial distribution matrix and ideal polarization angle spatial distribution matrix are obtained for each band. These constitute the ideal sky polarization characteristics of each spectral band, providing theoretical benchmark data for comparing the actual sky polarization state.

[0025] Based on the spatial distribution characteristics of the ideal sky polarization degree and the spatial distribution characteristics of the ideal polarization angle under each spectral band, theoretical sky polarization mode characteristic data are output. The spatial distribution matrix of ideal sky polarization degree and the spatial distribution matrix of ideal polarization angle are combined to output theoretical sky polarization mode feature data. The data structure is as follows: each spectral band corresponds to a combined data unit, which contains two matrices. One matrix records the ideal sky polarization degree at each pixel position in the sky, and the other matrix records the ideal polarization angle at the corresponding position. For example, the data unit of the 480 nm band contains the ideal sky polarization degree matrix and the ideal polarization angle matrix. Each element represents the theoretical value corresponding to a specific position in the sky region. The data units of all spectral bands are combined together to form complete theoretical sky polarization mode feature data.

[0026] S4: Based on sky polarization light field data, identify the spatial distribution of actual clouds, aerosols, and haze, and output the actual atmospheric composition distribution characteristics, including: Based on sky polarization field data, we can identify the changes in sky polarization characteristics caused by clouds and determine the spatial distribution area of ​​clouds. Sky polarization field data includes normalized Stokes parametric matrices for each spectral band. The presence of clouds in the sky alters the local polarization characteristics because clouds, composed of water droplets or ice crystals, have larger particles and scattering properties different from the Rayleigh scattering properties of air molecules. This causes the polarization characteristics of the sky to deviate from the theoretical sky polarization mode characteristics. The sky polarization field data for each spectral band is analyzed and compared pixel-by-pixel with the corresponding theoretical sky polarization mode characteristics. For example, comparing the 480 nm band data involves calculating the difference between the normalized actual polarization degree and the theoretical polarization degree at each sky pixel location, as well as the difference between the actual polarization angle and the theoretical polarization angle, forming polarization degree difference matrices and polarization angle difference matrices for each band. Based on the typical difference range of known cloud region polarization characteristics, polarization degree difference thresholds and polarization angle difference matrices are set. Cloud identification is performed using polarization angle difference thresholds. For example, the polarization degree difference threshold is set to the range of 0.2 to 0.5, and the polarization angle difference threshold is set to 10 to 20 degrees. The difference matrix of each band is traversed. If a pixel location satisfies both the polarization degree difference and polarization angle difference exceeding the set thresholds, the pixel location is determined to belong to the cloud region. To ensure that the determined cloud regions are continuous and spatially coherent, a spatial clustering algorithm is also required. For example, based on pixel connected component analysis, spatially coherent cloud regions are determined. For example, after calculation by the connected component algorithm, a region with more than 500 consecutive pixels in the 480 nm band is considered a cloud spatial distribution region. The cloud spatial distribution region results of each band are comprehensively superimposed to output a unified cloud spatial distribution region data matrix. Through the above methods, the location and range of cloud spatial distribution regions in the sky are determined.

[0027] Based on sky polarization light field data, we can identify regions of sky polarization characteristic changes caused by aerosol particle scattering and determine the spatial distribution region of aerosol particles. Aerosol particles mainly consist of tiny solid particles in the air (such as dust and soot), with particle sizes between those of air molecules and cloud particles. Therefore, the scattering characteristics of aerosol particles differ from Rayleigh scattering and cloud scattering. Aerosol particle regions cause a decrease in the degree of polarization in the sky region, while the polarization angle undergoes a specific, regular change. Analysis is performed based on the difference matrix between sky polarization field data and theoretical sky polarization mode characteristic data. The set polarization degree difference threshold and polarization angle difference threshold differ from those for cloud regions; for example, the polarization degree difference threshold is set to 0.1 to 0.2, and the polarization angle difference threshold is set to 5 to 10 degrees. The difference matrix is ​​analyzed pixel-by-pixel to find values ​​that satisfy these thresholds. The pixel locations within a certain range are identified and marked. Since aerosol particles are distributed in a relatively continuous and detailed manner and typically cover a wide area, a region growing algorithm is used to perform spatial clustering on the pixel locations marked as aerosol particle regions. For example, a continuous region with more than 1000 pixels in the 480 nm band determined by the region growing algorithm is considered a valid aerosol particle region. The spatial distribution region results of aerosols in different bands are then combined and superimposed to form a final unified aerosol particle spatial distribution region matrix. The aerosol particle spatial distribution region data obtained through the above methods fully discloses the spatial distribution information of aerosol particles.

[0028] Based on sky polarization light field data, identify the regions of polarization light characteristic changes caused by haze particle scattering and determine the spatial distribution area of ​​haze particles. Haze particles are fine and highly concentrated suspended particulate matter, typically smaller in size and higher in concentration than general aerosol particles. Their scattering characteristics show a significant reduction in sky polarization, even approaching zero, while the polarization angle exhibits highly consistent changes. A new threshold was set for the difference matrix between sky polarization field data and theoretical sky polarization mode characteristic data, specifically for haze particles. For example, the polarization degree difference threshold was set between 0.5 and 0.8 degrees, and the polarization angle difference threshold was set within a narrow range of 0 to 5 degrees. Then, the difference matrix was traversed pixel by pixel to mark the pixel positions that met the above threshold conditions. Due to the high spatial continuity of haze particle regions, a more stringent spatial clustering method was employed, such as morphological image analysis algorithms, to determine continuous spatial distribution regions. For example, a continuous region of haze particles in the 480 nm band, determined by morphological algorithms, must exceed 1500 pixels to be considered a valid haze particle region. The spatial distribution regions of haze particles in different bands were comprehensively superimposed to output a unified haze particle spatial distribution region data matrix. Through these methods, the spatial distribution regions of haze particles were determined.

[0029] Based on the spatial distribution areas of clouds, aerosol particles, and haze particles, output the spatial distribution characteristics data of actual atmospheric components. The obtained spatial distribution regions of clouds, aerosol particles, and haze particles are stored in matrix form. Each matrix data element marks whether the sky pixel location belongs to the corresponding atmospheric component region. The actual atmospheric component spatial distribution feature data is the final output result. The three matrices are merged pixel by pixel to form a comprehensive matrix. Each matrix element records the atmospheric component type of the corresponding pixel location using an encoding method. For example, a pixel location belonging to the cloud region is encoded as a value 1, belonging to the aerosol particle region is encoded as a value 2, belonging to the haze particle region is encoded as a value 3, and belonging to none of the above regions is encoded as a value 0. The merged matrix determines the actual atmospheric component classification of each pixel location in the sky region, which is the actual atmospheric component spatial distribution feature data, providing a complete data output result of the spatial distribution of atmospheric components in the sky region.

[0030] S5: Compare the theoretical sky polarization pattern characteristics with the actual atmospheric composition distribution characteristics, calculate the difference map in the dimensions of polarization degree and polarization angle, and extract anomalous polarization regions, including: Calculate the degree of polarization and the angle of polarization difference between the theoretical sky polarization mode characteristic data and the actual spatial distribution characteristic data of atmospheric composition for each spectral band; The theoretical sky polarization mode feature data includes spatial distribution matrices of ideal sky polarization degree and ideal polarization angle corresponding to multiple spectral bands. These matrices record the theoretical polarization degree and theoretical polarization angle of each pixel location in the sky under ideal cloudless, aerosol-free, and haze-free environments in different spectral bands. For example, the theoretical sky polarization mode feature data for the 480 nm band contains 1024×1024 elements. Each element records the theoretical polarization degree value between 0 and 1 and the theoretical polarization angle value between 0 and 180 degrees.

[0031] The actual spatial distribution characteristics of atmospheric components include a cloud spatial distribution region matrix, an aerosol particle spatial distribution region matrix, and a haze particle spatial distribution region matrix. Each element of each matrix marks whether each pixel position in the sky belongs to the corresponding atmospheric component region. For example, a pixel position belonging to the cloud region is marked as 1, belonging to the aerosol particle region is marked as 2, belonging to the haze particle region is marked as 3, and not belonging to the above regions is marked as 0.

[0032] When calculating the difference in polarization degree and polarization angle between the theoretical sky polarization mode feature data and the actual atmospheric composition spatial distribution feature data for each spectral band, the actual atmospheric composition spatial distribution feature data is first converted to correspond to the true polarization data of the actual sky region. For example, for pixel positions marked as cloud, aerosol, and haze regions, the actual polarization degree and actual polarization angle data matrix of the corresponding positions are extracted based on the actual sky polarization light field data.

[0033] For each spectral band, the difference between the theoretical polarization degree spatial distribution matrix and the actual polarization degree matrix is ​​calculated pixel by pixel. For example, in the 480 nm band, the theoretical polarization degree of each pixel position is subtracted from the actual polarization degree of the corresponding pixel position to obtain the polarization degree matrix of the 480 nm band. Each matrix element represents the difference between the theoretical polarization degree and the actual polarization degree of the corresponding sky position. Similarly, the same polarization degree difference calculation is performed on the 560 nm band and the 670 nm band to obtain the polarization degree difference matrix of each band.

[0034] The difference between the theoretical polarization angle spatial distribution matrix and the actual polarization angle matrix for each band is calculated pixel by pixel. For example, in the 480 nm band, the difference between the theoretical polarization angle and the actual polarization angle at each sky position is calculated to obtain the polarization angle difference matrix for the 480 nm band. The matrix elements represent the angle difference between the theoretical and actual polarization angles at the corresponding positions. The same polarization angle difference calculation is performed for the 560 nm band and the 670 nm band to obtain their respective polarization angle difference matrices.

[0035] Based on the difference in polarization degree and the difference in polarization angle, generate a sky polarization degree difference distribution map and a polarization angle difference distribution map for each spectral band; Based on the calculated polarization degree difference matrix and polarization angle difference matrix, a difference distribution map corresponding to each spectral band is generated to present the spatial distribution characteristics of the difference data in a visual form.

[0036] The method for generating the polarization degree difference distribution map is as follows: Select the polarization degree difference matrix of the 480 nm band and map the difference values ​​of the matrix elements to a visual color table; for example, using a heatmap mode, areas with large differences are mapped to red, areas with medium differences are mapped to yellow or green, and areas with small differences or close to zero are mapped to blue; after the above mapping process, the 480 nm band polarization degree difference matrix is ​​transformed into a visual sky polarization degree difference distribution map to intuitively display the location, shape, and area of ​​polarization degree anomalies in the sky; the same method is used to generate sky polarization degree difference distribution maps for the 560 nm and 670 nm bands respectively.

[0037] The polarization angle difference distribution map uses the same generation method. Taking the polarization angle difference matrix of the 480 nm band as an example, the difference range (e.g., 0 degrees to 45 degrees) is color-mapped. Large difference areas are represented by red, medium difference areas by yellow or green, and small difference areas close to zero by blue. Similarly, polarization angle difference distribution maps are generated for the 560 nm and 670 nm bands respectively.

[0038] The above methods transform complex difference data into visual images, showing the spatial distribution of the differences between theoretical and actual polarization characteristics within the sky region.

[0039] For each spectral band, the regions where the difference in polarization degree and the difference in polarization angle exceed a set threshold are extracted to identify abnormal polarization regions. If the difference in the polarization degree and polarization angle distribution map shows a region where the difference exceeds the range of the general natural background, it can be regarded as an abnormal polarization region. In order to identify the abnormal region, a threshold is set for region extraction.

[0040] For example, taking the polarization degree difference distribution map of the 480 nm band as an example, if the polarization degree difference threshold is set to 0.3, the area where the polarization degree difference of all pixel positions in the map exceeds 0.3 is defined as a polarization degree abnormal area; similarly, if the polarization angle difference distribution map of the 480 nm band is set to 15 degrees, the area where the polarization angle difference of all pixel positions in the map exceeds 15 degrees is defined as a polarization angle abnormal area.

[0041] Morphological image analysis methods are used to extract spatial regions of polarization degree anomalies and polarization angle anomalies, respectively. For example, a binarized threshold segmentation algorithm is used to mark the anomalies, and then a connected component detection algorithm is used to determine the region boundaries, extracting the spatial location and shape of the anomalies. For example, if more than 500 pixels are detected in a continuous region of polarization degree anomalies in the 480 nm band, it is defined as a valid anomalous polarization region. The same method is applied to the 560 nm and 670 nm bands to extract the valid anomalous polarization regions within each band.

[0042] By combining the effective abnormal polarization region extraction results of each band, the results of each band are spatially superimposed to determine the complete spatial location and range of the abnormal polarization region.

[0043] S6: Based on the geometric and spectral characteristics of the anomalous polarization region, distinguish between halo polarization anomalies and scattering polarization anomalies, and output the atmospheric optical anomaly classification results, including: For each abnormal polarization region, extract the boundary contour geometric parameters of the abnormal polarization region; The anomalous polarization region is located within the sky region, and each region records pixel position information in the form of a two-dimensional matrix. For example, in a 480 nm band image, an anomalous polarization region obtained through threshold segmentation and connected component detection is recorded as a two-dimensional binary matrix, where a pixel value of 1 represents a pixel inside the anomalous region, and a pixel value of 0 represents a pixel outside the anomalous region. In order to accurately describe the shape of the anomalous polarization region, it is necessary to extract geometric contour parameters from the anomalous polarization region, including area, perimeter, major axis, and minor axis length.

[0044] The area of ​​the anomalous polarization region is calculated by statistically counting the number of pixels marked as 1 in the binary matrix. For example, if the matrix data of the anomalous polarization region is 1024×1024 pixels, the total number of anomalous pixels marked within the region is 1500. The actual sky area corresponding to each pixel is calculated based on the field of view and pixel resolution of the camera. For example, assuming that the actual sky area corresponding to each pixel is 1 square meter, the area of ​​the region is accurately calculated to be 1500 square meters. If the sky areas corresponding to different pixels are different, the areas of each pixel can be summed to ensure the accuracy of the area calculation.

[0045] The perimeter of the anomalous polarization region is calculated using a boundary contour extraction algorithm. This includes performing an edge detection algorithm on the binary matrix, such as using the Sobel or Canny edge detection operator to determine the region boundary, resulting in a closed contour line. All boundary pixels on the closed contour line are then connected point-by-point for calculation, and the perimeter is obtained by summing the actual distances between every two consecutive adjacent pixels. For example, after boundary extraction, the anomalous polarization region has a total of 500 boundary pixels. Each pixel's side length corresponds to an actual sky field of view length of 1 meter. After pixel-by-pixel distance calculation, the perimeter of the region is found to be 500 meters.

[0046] The major and minor axis lengths of the anomalous polarization region are calculated using an ellipse fitting algorithm. The least squares ellipse fitting method is applied to the obtained closed contour line to fit an ellipse contour that is closest to the shape of the region boundary. The major axis of the fitted ellipse is defined as the major axis length of the anomalous region, and the minor axis is defined as the minor axis length of the anomalous region. For example, the major axis length of the fitted ellipse is calculated to be 70 meters and the minor axis length is 30 meters using the least squares fitting algorithm. For each anomalous polarization region, calculate the average degree of polarization and average polarization angle of the anomalous polarization region in each spectral band; Average degree of polarization and average angle of polarization are used to describe the overall polarization characteristics of an anomalous polarization region across different spectral bands. To calculate the average degree of polarization and average angle of polarization of the region in each spectral band, calculations based on sky polarization field data are required. First, based on the binary matrix corresponding to the anomalous polarization region in each spectral band, the positions of all pixels belonging to the anomalous region are determined; for example, in a 480 nm band image, the anomalous polarization region contains 1500 pixel positions, and each of the 1500 pixels corresponds to a specific degree of polarization and polarization angle in the standardized sky polarization field data. For each determined pixel location, the corresponding polarization degree is extracted. The sum of all extracted polarization degree values ​​is then divided by the total number of pixels to obtain the average polarization degree of the abnormal region in the 480 nm band. For example, if the sum of the polarization degree values ​​of 1500 pixels is 900, then the average polarization degree of the region in the 480 nm band is calculated as 900 divided by 1500, resulting in 0.6. The average polarization degree in the 560 nm and 670 nm bands is calculated using the same method. A similar method is used to extract the polarization angle corresponding to each pixel position in the abnormal region and perform statistical averaging. For example, the sum of the polarization angle values ​​of all pixels in the 480 nm band is 9000 degrees, so the average polarization angle is 9000 degrees divided by 1500 pixels, resulting in an average polarization angle of 6 degrees. The same calculation method is used for the 560 nm and 670 nm bands to determine the average polarization angle of each band.

[0047] Based on the boundary contour geometric parameters of the abnormal polarization region and the average degree of polarization and average polarization angle of the abnormal polarization region in each spectral band, the abnormal polarization type of each abnormal polarization region is determined to be either halo polarization abnormality type or scattering polarization abnormality type. Halo polarization anomalies and scattering polarization anomalies have different geometric contours and polarization characteristics. Halo polarization anomalies are usually elliptical or nearly circular, with the ratio of the major axis to the minor axis being close to 1, and the average degree of polarization is low, with the average polarization angle varying little within the region. Scattering polarization anomalies generally have more irregular shapes, with the ratio of the major axis to the minor axis being significantly greater than 1, the average degree of polarization being high, and the polarization angle varying significantly.

[0048] The geometric parameters of the boundary contour of the anomalous region and the average degree of polarization and average polarization angle values ​​of each band are calculated comprehensively. For example, the threshold for the ratio of the major and minor axes of halo polarization anomalies is set to 1 to 1.2, the threshold for the average degree of polarization is less than 0.4, and the change in polarization angle is less than 5 degrees. If a certain anomalous polarization region has a major axis of 70 meters and a minor axis of 68 meters, the ratio is 1.03, the average degree of polarization is 0.35, and the change in average polarization angle is 2 degrees, which meets the definition of halo polarization anomaly type. Another anomalous region has a major axis of 70 meters and a minor axis of 30 meters, with a ratio of 2.3, an average degree of polarization of 0.65, and an average polarization angle variation of 20 degrees, thus satisfying the definition of a scattering polarization anomaly type. Using the above determination method, each anomalous region can be classified as either a halo polarization anomaly type or a scattering polarization anomaly type.

[0049] Based on the determination of the abnormal polarization type in the abnormal polarization region, the atmospheric optical anomaly classification result is output; Output the results of abnormal polarization region type determination in the form of a data matrix or list; for example, create an abnormal region classification result matrix to record the serial number of each abnormal region, spatial location parameters, boundary contour geometric parameters, average degree of polarization and average polarization angle of each spectral band, and the corresponding abnormal polarization type. For example, the first anomalous area is recorded as: "Area 1, center coordinates (100, 200), area 1500 square meters, major axis 70 meters, minor axis 68 meters, average polarization degree of 480 nm 0.35, average polarization degree of 560 nm 0.33, average polarization degree of 670 nm 0.34, polarization type: halo polarization anomaly type"; the second anomalous area is recorded as: "Area 2, center coordinates (300, 400), area 2000 square meters, major axis 70 meters, minor axis 30 meters, average polarization degree of 480 nm 0.65, average polarization degree of 560 nm 0.62, average polarization degree of 670 nm 0.60, polarization type: scattering polarization anomaly type".

[0050] S7: Based on atmospheric optical anomaly classification results, generate ultra-local weather change early warning signals, including: Based on the atmospheric optical anomaly classification results, the spatial location parameters of each anomalous polarization region are extracted, including the center coordinate data and coverage data of the anomalous polarization region. The atmospheric optical anomaly classification results are anomaly region classification datasets composed of halo polarization anomaly types or scattering polarization anomaly types. These datasets record the sequence number, boundary geometry parameters, and polarization characteristics of each anomalous polarization region across different wavelengths. For example, in the 480 nm band, the area of ​​the anomalous polarization region is determined to be 1500 square meters, with a major axis of 70 meters, a minor axis of 68 meters, an average degree of polarization of 0.35, and an average polarization angle of 6 degrees. To provide weather change warnings for anomalous polarization regions, it is necessary to extract the spatial location parameters of each region, including center coordinates and coverage area data.

[0051] The center position coordinate data of an anomalous polarization region refers to the centroid of the spatial region surrounded by the outline boundary of each anomalous region in a two-dimensional coordinate system of the sky region. The calculation process of the center position coordinate data is as follows: A weighted average is calculated using the horizontal and vertical coordinates of all pixels marked as anomalous within the sky region; the horizontal coordinates of each pixel within the anomalous region in the two-dimensional binary matrix are summed, and the sum is divided by the total number of pixels within the anomalous region; for example, an anomalous polarization region contains 1500 pixels in the 480 nm band. For each pixel location marked as abnormal, if the sum of the horizontal coordinates is 150,000, then the horizontal center coordinate is calculated as 150,000 divided by 1500, which equals a horizontal coordinate value of 100. The vertical coordinates are calculated similarly by dividing the sum of the vertical coordinates by the total number of pixels. For example, if the sum of the vertical coordinates is 300,000, then the vertical center coordinate is calculated as 300,000 divided by 1500, which equals a vertical coordinate value of 200. Using this method, the center coordinates of the abnormal polarization region can be extracted, for example, (100, 200), in pixel coordinates.

[0052] Coverage data refers to the spatial area and range of an anomalous polarization region in the sky. Coverage data is based on the boundary contour coordinates of the anomalous polarization region. The coverage range of the anomalous polarization region is determined using the boundary pixel coordinates of the anomalous region. For example, if an anomalous polarization region in the 480 nm band has a boundary composed of 500 boundary pixels, the coordinates of each boundary pixel are recorded to form a closed boundary contour coordinate set. This closed boundary contour coordinate set defines the spatial coverage range of the anomalous polarization region. Coverage data can also be represented using a bounding rectangle, i.e., finding the smallest bounding rectangle that completely covers the anomalous region and recording the coordinates of its upper left and lower right corners. For example, the upper left corner coordinates are (70, 170), and the lower right corner coordinates are (130, 230). All of these methods can be used to obtain the coverage data of the anomalous polarization region.

[0053] Based on the spatial position parameters of each anomalous polarization region, calculate the offset of each anomalous polarization region relative to the center position of the target sky region; The center position of the target sky region is the reference point set by the observation equipment when photographing the target sky region. It is usually the coordinates of the center of the sky region corresponding to the center point of the camera's field of view. For example, if the camera image resolution is 1024×1024 pixels, the center position of the target sky region is the coordinates of the image center point (512,512). The offset of the anomalous polarization region relative to the center of the target sky region represents the spatial distance between the coordinates of the center of the anomalous polarization region and the center of the target sky region. A two-dimensional coordinate calculation formula is used: subtract the center coordinates of the target sky region from the center coordinates of the anomalous region, and then calculate the absolute value or take the square root of the result to obtain the offset. For example, the horizontal offset of the anomalous region's center coordinates (100, 200) from the target sky region's center coordinates (512, 512) is 512 minus 100, resulting in 412; the vertical offset is 512 minus 200, resulting in 312. The Euclidean distance between the horizontal and vertical offsets is then calculated as the square root of (412² + 312²). Through calculation, the offset of the anomalous polarization region relative to the center of the target sky region is approximately 516.3 pixels.

[0054] For the offset of each abnormal polarization region, the warning level of each abnormal polarization region is determined according to the preset offset threshold. The warning level is a classification standard indicating the severity of weather changes caused by abnormal polarization regions. Pre-set offset thresholds are the basis for dividing the offset values ​​of abnormal regions. For example, the offset threshold can be set into multiple threshold ranges. The setting method is as follows: an offset of less than 200 pixels is defined as a Level 1 warning, indicating that the abnormal region is close to the center of the sky and may cause direct impact; an offset between 200 and 500 pixels is defined as a Level 2 warning, indicating that the abnormal region is far from the center of the sky and may cause indirect or secondary impact; an offset exceeding 500 pixels is defined as a Level 3 warning, indicating that the abnormal region is far from the center and the resulting weather changes are relatively weak. For example, if the offset of the abnormal area is 516.3 pixels, then the abnormal area belongs to the level three warning level according to the offset threshold.

[0055] Based on the warning level and spatial location parameters of each anomalous polarization region, a hyperlocal weather change warning signal corresponding to each anomalous polarization region is generated; Ultra-local weather change warning signals provide local weather anomaly alerts based on the spatial location parameters of abnormal polarization regions and warning levels. The generation method involves encoding the center coordinates, coverage area, and warning level information of each abnormal area to form a digital and visualized weather change warning signal. For example, a level 1 warning area is marked with a red area, level 2 with a yellow area, and level 3 with a blue area. The center coordinates are displayed on the weather monitoring screen. For example, if the center coordinates of an abnormal area are (100, 200), the offset is 516.3 pixels, and the warning level is 3, then the warning signal will be marked in blue and the relevant location and warning information will be clearly displayed. Ultra-local weather change warning signals can be sent to the meteorological service system via electronic warning messages, displaying the location of the abnormal area and warning information, so as to realize the functions of real-time weather monitoring and local weather change warning. Example 2

[0056] The difference between Embodiment 2 and Embodiment 1 is that this embodiment introduces a system for intelligent weather image acquisition and weather image recognition.

[0057] Figure 2 A schematic diagram of the structure of an intelligent weather image acquisition and weather image recognition system according to the present invention is provided. The intelligent weather image acquisition and weather image recognition system includes: Image acquisition module: Acquires raw polarization image sequences of the target sky region through a multispectral polarization camera, and simultaneously records the camera's spatial attitude data and timestamp information, and outputs polarization image data; Data processing module: preprocesses polarization image data, extracts Stokes parameters for each pixel, and outputs standardized sky polarization light field data; Theoretical Feature Module: Based on sky polarization field data, analyze the polarization degree distribution pattern under different wavelengths, and calculate the theoretical Rayleigh scattering model by combining the solar azimuth angle, and output the theoretical sky polarization pattern characteristics; Composition identification module: Based on sky polarization light field data, it identifies the spatial distribution of actual clouds, aerosols and haze, and outputs the actual atmospheric composition distribution characteristics; Anomaly Extraction Module: By comparing the characteristics of theoretical sky polarization patterns with the actual atmospheric composition distribution characteristics, the module calculates the difference map in the dimensions of polarization degree and polarization angle, and extracts anomalous polarization regions. Anomaly Classification Module: Based on the geometric and spectral characteristics of the anomalous polarization region, it distinguishes between halo polarization anomalies and scattering polarization anomalies, and outputs atmospheric optical anomaly classification results; Early warning generation module: Based on the atmospheric optical anomaly classification results, it generates ultra-local weather change early warning signals.

[0058] The above formulas are all dimensionless calculations. The formulas are derived from software simulations based on a large amount of collected data to obtain the most recent real-world results. The preset parameters and thresholds in the formulas are set by those skilled in the art according to the actual situation.

[0059] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium can be a solid-state drive.

[0060] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0061] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and modules described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0062] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0063] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0064] In addition, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.

[0065] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0066] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0067] In conclusion, the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method of intelligent weather image acquisition and weather image recognition, characterized in that, The method comprises the following steps: S1: acquiring a raw polarization image sequence of a target sky area by a multi-spectral polarization camera, and synchronously recording spatial pose data and timestamp information of the camera, and outputting polarization image data; S2: preprocessing the polarization image data, and extracting Stokes parameters of each pixel, and outputting standardized sky polarization light field data; S3: based on the sky polarization light field data, analyzing polarization degree distribution patterns under different wavelengths, and combining a solar azimuth angle calculation theory Rayleigh scattering model, and outputting a theoretical sky polarization pattern feature; S4: based on the sky polarization light field data, identifying spatial distribution states of actual cloud layers, aerosols and haze, and outputting actual atmospheric composition distribution features; S5: comparing the theoretical sky polarization pattern feature and the actual atmospheric composition distribution feature, calculating a difference map in the polarization degree and polarization angle dimensions, and extracting an abnormal polarization region; S6: according to geometric characteristics and spectral characteristics of the abnormal polarization region, distinguishing a halo polarization anomaly and a scattering polarization anomaly, and outputting an atmospheric optical anomaly classification result; S7: based on the atmospheric optical anomaly classification result, generating a super-local weather change early warning signal. 2.The method of claim 1, wherein, S1, specifically: a multi-spectral polarization camera is used to continuously shoot a target sky area, so as to obtain a raw polarization image sequence of the target sky area under different polarization directions in multiple spectral bands; spatial pose data of the multi-spectral polarization camera is collected in real time; uniform timestamp information is added to the raw polarization image sequence and the corresponding spatial pose data respectively; the raw polarization image sequence data with the uniform timestamp information is correspondingly matched with the corresponding spatial pose data, and polarization image data is outputted.

3. The method of claim 2, wherein, S2, specifically: image denoising is performed on the polarization image data, so as to remove random noise and interference pixels in the polarization image data; Stokes parameter data corresponding to each pixel point in the polarization image data is extracted from each frame of polarization image data after the random noise and the interference pixels are removed; data standardization conversion is performed on the Stokes parameter data of all pixel points of each frame of polarization image data, and standardized sky polarization light field data is outputted.

4. The method for intelligent weather image acquisition and weather image recognition according to claim 3, characterized in that, S3, specifically: based on the sky polarization light field data, a sky polarization degree distribution pattern corresponding to each spectral band is determined; a solar azimuth angle parameter under a corresponding spectral band is calculated for the sky polarization degree distribution pattern of each spectral band; based on the solar azimuth angle parameter of each spectral band, a spatial distribution feature of an ideal sky polarization degree and a spatial distribution feature of an ideal polarization angle under each spectral band are calculated in combination with a Rayleigh scattering physical theory; theoretical sky polarization pattern feature data is outputted according to the spatial distribution feature of the ideal sky polarization degree and the spatial distribution feature of the ideal polarization angle under each spectral band.

5. The method of claim 4, wherein, S4, specifically: based on the sky polarization light field data, a sky area polarization feature change caused by a cloud layer is identified, and a cloud layer spatial distribution region is determined; based on the sky polarization light field data, a sky polarization feature change region caused by aerosol particle scattering is identified, and an aerosol particle spatial distribution region is determined; based on the sky polarization light field data, a polarization light feature change region caused by haze particle scattering is identified, and a haze particle spatial distribution region is determined; According to the cloud layer spatial distribution area, the aerosol particle spatial distribution area and the haze particle spatial distribution area, actual atmospheric composition spatial distribution characteristic data is output.

6. The method for intelligent weather image acquisition and weather image recognition according to claim 5, characterized in that, S5, specifically: Calculate the polarization degree difference and polarization angle difference between the theoretical sky polarization mode characteristic data and the actual atmospheric composition spatial distribution characteristic data under each spectral band; According to the polarization degree difference and the polarization angle difference, generate the sky polarization degree difference distribution map and the polarization angle difference distribution map of each spectral band; For the polarization degree difference and the polarization angle difference in the sky polarization degree difference distribution map and the polarization angle difference distribution map of each spectral band, the pixel area extraction is performed on the area where the polarization degree difference and the polarization angle difference exceed the set threshold value, and the abnormal polarization area is determined.

7. The method of claim 6, wherein the method further comprises: S6, specifically: For each abnormal polarization area, the boundary contour geometric parameters of the abnormal polarization area are extracted; For each abnormal polarization area, the average polarization degree and the average polarization angle of the abnormal polarization area under each spectral band are calculated; Based on the boundary contour geometric parameters of the abnormal polarization area and the average polarization degree and the average polarization angle of the abnormal polarization area under each spectral band, the abnormal polarization type of each abnormal polarization area is determined to be a halo polarization abnormal type or a scattering polarization abnormal type; According to the abnormal polarization type determination result of the abnormal polarization area, the atmospheric optical abnormal classification result is output.

8. The method of claim 7, wherein, S7, specifically: According to the atmospheric optical abnormal classification result, the spatial position parameters of each abnormal polarization area are extracted, including the center position coordinate data and the coverage range data of the abnormal polarization area; According to the spatial position parameters of each abnormal polarization area, the offset amount of each abnormal polarization area relative to the center position of the target sky area is calculated; According to the pre-set offset amount threshold value, the warning level of each abnormal polarization area is determined according to the offset amount of each abnormal polarization area; According to the warning level and the spatial position parameters of each abnormal polarization area, the super-local weather change warning signal corresponding to each abnormal polarization area is generated.

9. A system for intelligent weather image acquisition and weather image recognition, for implementing the method of any one of claims 1-8, characterized in that, It includes: Image acquisition module: the original polarization image sequence of the target sky area is collected by the multispectral polarization camera, and the spatial attitude data and timestamp information of the camera are recorded synchronously, and the polarization image data is output; Data processing module: the polarization image data is preprocessed, and the Stokes parameters of each pixel are extracted, and the standardized sky polarization light field data is output; Theoretical feature module: based on the sky polarization light field data, the polarization degree distribution pattern under different wavelengths is analyzed, and the theoretical Rayleigh scattering model is calculated combined with the solar azimuth angle, and the theoretical sky polarization mode feature is output; Composition identification module: based on the sky polarization light field data, the spatial distribution state of actual cloud layer, aerosol and haze is identified, and the actual atmospheric composition distribution feature is output; Abnormal extraction module: compare the theoretical sky polarization mode feature and the actual atmospheric composition distribution feature, calculate the difference map in the polarization degree and polarization angle dimensions, and extract the abnormal polarization area; Abnormal classification module: according to the geometric characteristics and spectral characteristics of the abnormal polarization area, the halo polarization abnormality and the scattering polarization abnormality are distinguished, and the atmospheric optical abnormal classification result is output; Warning generation module: based on the atmospheric optical abnormal classification result, the super-local weather change warning signal is generated.

Images