Satellite cloud picture marine weather system identification method, device, equipment and medium

Abstract

The invention discloses a satellite cloud picture marine weather system identification method, device and equipment and a medium, and relates to the technical field of marine weather system identification, and the method comprises the steps: taking a historical satellite cloud picture as an input in advance, taking the position information of a marine weather system in the historical satellite cloud picture as a label, training a deep learning network model, and obtaining a deep learning network model; in practical application, a satellite cloud picture of an analysis area is obtained, the analysis area comprises an ocean area, the satellite cloud picture is used as input, the trained maritime weather system recognition model is used for marking a maritime weather system in the satellite cloud picture, and the maritime weather system recognition model is used for recognizing the maritime weather system. According to the method and the device, the marine weather system in the satellite cloud picture can be quickly, accurately and automatically identified.

Description

Technical Field

[0001] The present application relates to the technical field of marine weather system identification, and in particular to a method, device, equipment and medium for identifying marine weather systems using satellite cloud images. Background Art

[0002] With the development of meteorological satellite technology, satellite cloud images have become an indispensable reference for weather forecasting today. In particular, geostationary meteorological satellites have the characteristics of high observation frequency and wide observation range, making satellite cloud images the main basis for ocean and meteorological departments to understand the development and changes of marine weather when there are few sources of observation data and information at sea. However, at present, my country's application of meteorological satellite data is still mainly focused on auxiliary judgment of marine weather systems, especially auxiliary judgment of marine weather systems in land and nearshore areas, and auxiliary judgment of marine weather systems at sea, especially in open sea areas, is far from enough.

[0003] The most obvious manifestation of the lack of application of satellite cloud images is that in the process of weather map analysis and drawing, some professionals mark the range and location of land weather systems more accurately because they have more observation data to assist, but the marking of marine weather systems often has large errors. On the one hand, it is due to the lack of other observation data to assist, and on the other hand, there is a lack of knowledge and in-depth understanding of the performance characteristics of marine weather systems in satellite cloud images. In addition, in the use of satellite cloud images and weather maps, the two are two separate reference materials. Although the meteorological department now superimposes infrared cloud images on weather maps for display, the weather systems that satellite cloud images can show are relatively single and cannot fully reflect the effects of satellite observations, especially the marine weather systems are often ignored.

[0004] Because the understanding of satellite cloud images by my country's meteorological forecast professionals varies, and meteorological satellite professionals rarely participate in meteorological forecasting work, in the absence of other observation data to assist in the judgment of marine weather systems, the marine weather systems mapped manually and automatically by meteorological mapping software have large errors and often omissions. At present, there is no comprehensive analysis product for the mapping of marine weather systems based on satellite cloud images. Therefore, most professionals are unable to accurately identify some important marine weather systems when using satellite cloud images, which prevents the full utilization of the functions of satellite cloud images. Summary of the invention

[0005] The purpose of this application is to provide a method, device, equipment and medium for identifying marine weather systems in satellite cloud images, which can quickly, accurately and automatically identify marine weather systems in satellite cloud images.

[0006] To achieve the above objectives, this application provides the following solutions.

[0007] In a first aspect, the present application provides a method for identifying marine weather systems using satellite cloud images, and the method for identifying marine weather systems using satellite cloud images includes the following steps.

[0008] Obtain a satellite cloud image of an analysis area; the analysis area includes an ocean area.

[0009] Taking the satellite cloud map as input, the marine weather system in the satellite cloud map is labeled using the trained marine weather system identification model to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model using historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

[0010] Optionally, the satellite cloud image includes a visible light cloud image and an infrared cloud image.

[0011] Optionally, the marine weather system includes a high pressure center, a low pressure center, a subtropical high pressure area, a low pressure trough line, a high pressure ridge line and an equatorial convergence zone.

[0012] Optionally, the deep learning network model adopts an improved RT-DETR model, which is a model obtained by improving the RT-DETR model, and the improvement includes: replacing the convolutional layer in the backbone network of the RT-DETR model with a spatial and channel reconstruction convolutional layer, making the neck network of the RT-DETR model use a feature pyramid network, and replacing the convolutional layer in the feature pyramid network with a spatial and channel reconstruction convolutional layer.

[0013] Optionally, before taking the satellite cloud map as input and using a trained marine weather system identification model to label the marine weather system in the satellite cloud map, the satellite cloud map marine weather system identification method also includes: training to obtain a trained marine weather system identification model, specifically including the following steps.

[0014] Acquire multiple samples; the samples include historical satellite cloud images, historical ground weather analysis images and historical 500hPa potential height images corresponding to the time of the analysis area.

[0015] The marine weather systems in the historical ground weather analysis map and the historical 500hPa potential height map are marked to generate a historical marine weather system distribution map; the historical marine weather system distribution map contains the location information of the marine weather systems in the historical satellite cloud map.

[0016] The historical satellite cloud image is used as input and the historical marine weather system distribution map is used as a label to train the deep learning network model to obtain a trained marine weather system recognition model.

[0017] Optionally, obtaining multiple samples specifically includes the following steps.

[0018] For historical satellite cloud images, historical satellite cloud images of the analysis area are obtained; or, L1 level full disk data of the analysis area are obtained, and the historical satellite cloud images are drawn based on the L1 level full disk data.

[0019] For historical surface weather analysis maps and historical 500hPa potential height maps, historical surface weather analysis maps and global meteorological reanalysis data of the analysis area are obtained, and historical 500hPa potential height maps are drawn based on the global meteorological reanalysis data; or, global meteorological reanalysis data of the analysis area are obtained, and historical surface weather analysis maps and historical 500hPa potential height maps are drawn based on the global meteorological reanalysis data.

[0020] Among them, the time of the historical satellite cloud map, the historical ground weather analysis map and the historical 500hPa potential height map corresponds to each other, and the map projections are all Mercator projections.

[0021] Optionally, when training the deep learning network model, the loss functions used include a classification loss function and a bounding box regression loss function, the classification loss function adopts a cross entropy function, and the bounding box regression loss function adopts a Smooth L1 function.

[0022] In a second aspect, the present application provides a satellite cloud image marine weather system identification device, and the satellite cloud image marine weather system identification device includes the following modules.

[0023] The acquisition module is used to acquire a satellite cloud image of an analysis area; the analysis area includes an ocean area.

[0024] The identification module is used to use the satellite cloud map as input and use the trained marine weather system identification model to mark the marine weather system in the satellite cloud map to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model using historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

[0025] In a third aspect, the present application provides a computer device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-mentioned method for identifying marine weather systems using satellite cloud images.

[0026] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned method for identifying marine weather systems using satellite cloud images.

[0027] According to the specific embodiments provided in this application, this application has the following technical effects.

[0028] The present application provides a method, device, equipment and medium for identifying marine weather systems from satellite cloud images. Historical satellite cloud images are used as input in advance, and the location information of marine weather systems in historical satellite cloud images is used as labels to train a deep learning network model to obtain a trained marine weather system identification model. In practical applications, a satellite cloud image of an analysis area is obtained, and the analysis area includes an ocean area. The satellite cloud image is used as input, and the trained marine weather system identification model is used to annotate the marine weather system in the satellite cloud image to identify the marine weather system in the satellite cloud image, so that the marine weather system in the satellite cloud image can be quickly, accurately and automatically identified through model recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 This is an application environment diagram of a method for identifying marine weather systems using satellite cloud images provided in Example 1 of the present application.

[0031] Figure 2 A flowchart of a method for identifying marine weather systems using satellite cloud images provided in Example 1 of the present application.

[0032] Figure 3 A schematic diagram of the network structure of the trained marine weather system identification model provided in Example 1 of the present application.

[0033] Figure 4 A schematic diagram of the fusion of multi-scale feature maps provided in Example 1 of the present application.

[0034] Figure 5 A schematic diagram of the functional modules of a satellite cloud image marine weather system identification device provided in Example 2 of the present application.

[0035] Figure 6 A schematic diagram of the structure of a computer device provided in Example 3 of the present application. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0037] Example 1.

[0038] The satellite cloud image marine weather system identification method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal communicates with the server through the network. The data storage system can store the data that the server needs to process. The data storage system can be set up separately, integrated on the server, or placed on the cloud or other servers. The terminal can send the satellite cloud image to be processed to the server. After the server receives the satellite cloud image to be processed, for the satellite cloud image to be processed, the server uses the satellite cloud image as input and uses the trained marine weather system identification model to mark the marine weather system in the satellite cloud image to identify the marine weather system in the satellite cloud image. The server can feed back the marine weather system identification result obtained for the satellite cloud image to the terminal.

[0039] In addition, in some embodiments, the satellite cloud image marine weather system identification method can also be implemented independently by a server or a terminal. For example, the terminal can directly process the satellite cloud image to be processed, or the server can obtain the satellite cloud image to be processed from the data storage system and process the satellite cloud image to be processed.

[0040] The terminals may be, but are not limited to, various desktop computers, laptops, smart phones, tablet computers, IoT devices and portable wearable devices. IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. The server may be implemented as an independent server or a server cluster consisting of multiple servers, or a cloud server.

[0041] In an exemplary embodiment, Figure 2 As shown, a method for identifying marine weather systems in satellite cloud images is provided. The method is executed by a computer device, and can be executed by a computer device such as a terminal or a server alone, or can be executed by a terminal and a server together. In the embodiment of the present application, the method is applied to Figure 1 The following steps are used to illustrate the server in the example.

[0042] Step S1, obtaining a satellite cloud image of an analysis area; the analysis area includes an ocean area.

[0043] Step S2, taking the satellite cloud map as input, and using the trained marine weather system identification model to label the marine weather system in the satellite cloud map to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model using historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

[0044] By implementing the above-mentioned steps S1 to S2, this embodiment provides a method for identifying marine weather systems in satellite cloud images based on deep learning. The deep learning network model is trained in advance using historical satellite cloud images as input and the location information of marine weather systems in the historical satellite cloud images as labels to obtain a trained marine weather system identification model. In actual application, it only needs to use the satellite cloud image of the analysis area as input, and the trained marine weather system identification model can be used to mark the marine weather systems in the satellite cloud images to identify the marine weather systems in the satellite cloud images, thereby quickly, accurately and automatically completing the identification of marine weather systems in the satellite cloud images.

[0045] In this embodiment, the satellite cloud map is an image of the cloud cover and surface features of the earth observed from top to bottom by a geostationary meteorological satellite, which may include visible light cloud maps and infrared cloud maps. The marine weather system refers to various weather systems occurring over the ocean, which may include high pressure centers, low pressure centers, subtropical high pressure areas, low pressure troughs, high pressure ridges and equatorial convergence zones.

[0046] This embodiment is based on a deep learning method, combining ground weather analysis maps, 500hPa (hectopascal) potential height maps and corresponding satellite cloud maps obtained by geostationary meteorological satellites, to learn the characteristics of marine weather systems such as high-pressure centers, low-pressure centers, subtropical high-pressure areas, low-pressure troughs, high-pressure ridges, and equatorial convergence zones in satellite cloud maps, and realize automatic recognition and labeling of corresponding marine weather systems in satellite cloud maps obtained by geostationary meteorological satellites.

[0047] In this embodiment, before taking the satellite cloud image as input and using the trained marine weather system identification model to mark the marine weather system in the satellite cloud image, the satellite cloud image marine weather system identification method of this embodiment also includes: training to obtain the trained marine weather system identification model, which specifically includes the following steps.

[0048] (1) Obtain multiple samples, including historical satellite cloud images, historical surface weather analysis images, and historical 500 hPa potential height images corresponding to the time of the analysis area.

[0049] This embodiment directly obtains historical ground weather analysis maps, or uses global meteorological reanalysis data (such as ERA5 data) to draw historical ground weather analysis maps, and then uses global meteorological reanalysis data to draw historical 500hPa potential height maps, analyzes and annotates major marine weather systems in historical ground weather analysis maps and historical 500hPa potential height maps, establishes a historical weather analysis map library, and simultaneously establishes a geostationary meteorological satellite cloud map library that matches the time series and spatial position of the historical weather analysis map library. The geostationary meteorological satellite cloud map library includes historical satellite cloud maps corresponding to the time and space of the historical ground weather analysis maps and the historical 500hPa potential height maps, thereby constructing a data set.

[0050] At this time, in this embodiment, multiple samples are obtained, specifically including: for historical satellite cloud images, historical satellite cloud images of the analysis area are obtained; or, L1 level full disk data of the analysis area is obtained, and historical satellite cloud images are obtained based on L1 level full disk data. For historical ground weather analysis maps and historical 500hPa potential height maps, historical ground weather analysis maps and global meteorological reanalysis data of the analysis area are obtained, and historical 500hPa potential height maps are obtained based on global meteorological reanalysis data; or, global meteorological reanalysis data of the analysis area is obtained, and historical ground weather analysis maps and historical 500hPa potential height maps are obtained based on global meteorological reanalysis data.

[0051] Among them, the time of historical satellite cloud images, historical ground weather analysis images and historical 500hPa potential height images corresponds to each other, and the map projections are all Mercator projections.

[0052] Specifically, if the historical surface weather analysis map can be directly obtained, the historical surface weather analysis map of the North Pacific region published by the National Oceanic and Atmospheric Administration of the United States on the Internet is obtained. The historical surface weather analysis map covers most of the North Pacific Ocean, with a longitude and latitude range of 0-60°N (north latitude), 110°E (east longitude)-150°W (west longitude), and the map projection is the Mercator projection. The high-pressure center, low-pressure center, low-pressure trough line, high-pressure ridge line, equatorial convergence zone and other marine weather systems are manually marked in the historical surface weather analysis map. At the same time, the historical 500hPa potential height map is drawn using global meteorological reanalysis data. The map projection selects the Mercator projection, and the drawing range is 0-60°N, 110°E-150°W. The coverage range of the 588hPa isohyper lines in the historical 500hPa potential height map is the subtropical high pressure area. When drawing the historical 500hPa potential height map, the 588hPa isohyper lines can be boldly marked to mark the subtropical high pressure area.

[0053] If the historical surface weather analysis map cannot be obtained directly, the global meteorological reanalysis data will be used to draw the historical surface weather analysis map and the historical 500hPa potential height map. The Mercator projection is selected as the map projection, and the drawing range is 0-60°N, 110°E-150°W. The high-pressure center and the low-pressure center can be automatically marked during the drawing process of the historical surface weather analysis map, and the low-pressure trough line, high-pressure ridge line and equatorial convergence zone can be manually marked. The coverage of the 588hPa isohyet line in the historical 500hPa potential height map is the subtropical high-pressure area. When drawing the historical 500hPa potential height map, the 588hPa isohyet line can be marked in bold to mark the subtropical high-pressure area.

[0054] If it is possible to directly obtain historical satellite cloud images, the historical visible light cloud images and historical infrared cloud images of the Himawari-8 geostationary meteorological satellite (of course, it can also be replaced by other geostationary meteorological satellites) can be obtained from the official website of the Japan Meteorological Agency. The historical visible light cloud images and historical infrared cloud images constitute the historical satellite cloud images. The cloud map range is 0-60°N, 110°E-150°W, and the map projection of the cloud image is the Mercator projection.

[0055] If the historical satellite cloud images cannot be obtained directly, the L1 full-disk data of the Himawari-8 geostationary meteorological satellite can be obtained from the official website of the Japan Meteorological Agency. The data file format is NetCDF (Network Common Data Format), and the file name is NC_H08_YYYYMDD_hhmm_Rbb_FLDK.xxxxx_yyyyy.nc, where YYYYMDD_hhmm is UTC (Coordinated Universal Time) world time, bb represents the satellite channel, and the time of the L1 full-disk data can be matched with the time of the historical ground weather analysis chart and the historical 500hPa potential height chart in the historical weather analysis chart library. After obtaining the L1 full-disk data, data from any channel from 1 to 3 can be selected to draw the historical visible light cloud map, and data from any channel from 10 to 13 can be selected to draw the historical infrared cloud map. The map projection for drawing the cloud map is set to Mercator projection.

[0056] (2) Label the marine weather systems in the historical surface weather analysis map and the historical 500 hPa potential height map to generate a historical marine weather system distribution map, which contains the location information of the marine weather systems in the historical satellite cloud map.

[0057] The historical surface weather analysis map includes the location information of marine weather systems such as high pressure center, low pressure center, low pressure trough line, high pressure ridge line and equatorial convergence zone. The historical 500hPa potential height map includes the location information of marine weather systems such as subtropical high pressure area. The marine weather systems in the historical surface weather analysis map and the historical 500hPa potential height map are further labeled based on the location information of the marine weather systems to generate a historical marine weather system distribution map to make a label file. The LabelImg tool is used for labeling according to the location information of the marine weather system. The LabelImg tool supports rectangular box labeling and can create label files in XML (eXtensible Markup Language) or JSON (JavaScript Object Notation) format.

[0058] Taking the low-pressure trough line as an example, the specific labeling steps are: collect the weather system distribution map of the low-pressure trough line category (that is, the historical ground weather analysis map with the location information of the low-pressure trough line as a marine weather system), start the LabelImg tool, open the folder containing the weather system distribution map of the low-pressure trough line category, and in the image preview window, select an image (that is, the weather system distribution map of the low-pressure trough line category) for labeling. Use the rectangular frame tool to drag the mouse on the image to draw a labeling frame around the low-pressure trough line, and enter "trough_line (that is, low-pressure trough line)" as the label in the label input box. If there are multiple low-pressure trough lines in the image, repeat the above steps to create a labeling frame and label for each low-pressure trough line. After completing the labeling, save the labeling information as an XML file to obtain the historical marine weather system distribution map. Other categories can be labeled by referring to the same steps.

[0059] (3) Using historical satellite cloud images as input and historical marine weather system distribution maps as labels, the deep learning network model is trained to obtain a trained marine weather system recognition model.

[0060] Among them, the deep learning network model adopts the improved RT-DETR (Real-Time Detection Transformer) model. The improved RT-DETR model is a model obtained by improving the RT-DETR model. The improvements include: replacing the convolutional layers in the backbone network of the RT-DETR model with spatial and channel reconstruction convolutional layers, making the neck network of the RT-DETR model use a feature pyramid network, and replacing the convolutional layers in the feature pyramid network with spatial and channel reconstruction convolutional layers.

[0061] Specifically, Figure 3As shown in the figure, the deep learning network model adopts the improved RT-DETR model. The improved RT-DETR model is a model obtained by improving the RT-DETR model. The RT-DETR model includes a backbone network (Backbone), a neck network (Neck), an efficient hybrid encoder (Efficient Hybrid Encoder, including a Transformer encoder), an IOU (Intersection over Union)-aware query selection and a decoder and a prediction head (Detection&Head) connected in sequence. The backbone network is the HGNetV2 (High Performance GPU Net V2) model. The HGNetV2 model is mainly composed of multiple HG-Blocks (Hierarchical Graph-Blocks). The hierarchical blocks are composed of a series of 3 3 traditional convolutional layers stacked, that is, in the RT-DETR model, the backbone network contains a large number of traditional convolutional layers. In order to improve the efficiency of feature extraction and network performance, this embodiment uses spatial and channel reconstruction convolution layers (Spatial and Channel reconstruction Convolution, SCConv) to replace these traditional convolutional layers in the backbone network, thereby optimizing the feature extraction process and reducing the consumption of computing resources. In addition, in the neck network part, this embodiment introduces the Feature Pyramid Networks (FPN) enhanced by SCConv. The Feature Pyramid Networks enhanced by SCConv refers to replacing the convolutional layers in the Feature Pyramid Networks with spatial and channel reconstruction convolution layers. This Feature Pyramid Networks enhanced by SCConv can generate feature representations rich in multi-scale information, significantly enhancing the model's ability to represent image features, thereby improving the overall network performance.

[0062] At this point, the workflow of the deep learning network model is as follows: first, use the backbone network of the improved RT-DETR model to generate multi-scale feature maps. The backbone network uses HGNetV2 as the basic structure and replaces all traditional convolutional layers with SCConv to enhance feature extraction capabilities; the multi-scale feature maps generated by the backbone network are input into the FPN (i.e., the neck network) enhanced by SCConv, and further reconstructed using spatial and channel information to improve the feature expression capability and output multi-scale features; using an efficient hybrid encoder, by decoupling the attention-based intra-scale feature interaction (AIFI) and cross-scale feature fusion (Cross-scale The feature fusion map output by CCFF enters the query selection based on IOU perception, and finally the decoder and prediction head process the position embedding information, image feature information and target query information to determine the category, position and bounding box size of the target prediction box, that is, the target prediction box is used to select the marine weather system, so as to realize the learning of the cloud map features corresponding to the marine weather system and the accurate identification of the marine weather system.

[0063] After the deep learning network model is constructed, the historical satellite cloud images can be used as input and the historical marine weather system distribution map can be used as labels to train the deep learning network model to obtain a trained marine weather system identification model. It should be noted that when training the deep learning network model, a corresponding trained marine weather system identification model is obtained for each marine weather system, that is, a trained marine weather system identification model corresponding to each marine weather system is obtained.

[0064] During training, the input data is static satellite images, specifically historical satellite cloud images, namely historical visible light cloud images and historical infrared cloud images. Both historical visible light cloud images and historical infrared cloud images are single-channel images. Therefore, different images are selected as different channels of input data, so the input data is a two-channel image, and the label data is a historical marine weather system distribution map. The data set consisting of multiple samples is divided into a training set, a validation set, and a test set. The ratio of the three is roughly maintained at 8:1:1. This division aims to train the model through a training set containing sufficient training data, while using the validation set to tune the model parameters, and finally evaluate the generalization ability of the model through the test set to ensure the stability and reliability of the model in practical applications. During the training process, there are two parts of the loss function: the classification loss function and the bounding box regression loss function, which together constitute a total loss function. Among them, the classification loss function can be implemented by the cross entropy function, and the bounding box regression loss function can be implemented by the Smooth L1 function.

[0065] When training a model, the usual practice is to perform a weighted summation of the classification loss function and the bounding box regression loss function to form a total loss function. This approach allows the model to consider both the accuracy of object classification and the accuracy of bounding box positioning during the optimization process. Specifically, the total loss It can be calculated by the following formula (1).

[0066] (1).

[0067] In formula (1), is the total loss; is a hyperparameter used to balance the weight of classification loss and bounding box regression loss; is the classification loss; is the bounding box regression loss.

[0068] The calculation formula of classification loss is as follows (2).

[0069] (2).

[0070] In formula (2), is the number of samples; is the number of categories; is an indicator variable, if the sample The true category is ,but ,otherwise, ; Predict samples for the model Belongs to category probability.

[0071] The calculation formula of the bounding box regression loss is as follows (3).

[0072] (3).

[0073] In formula (3), is the number of samples; The bounding box parameters predicted by the model (usually the center point coordinates ,width ,high ); are the actual bounding box parameters.

[0074] is the Smooth L1 function, which is defined as the following formula (4).

[0075] (4).

[0076] In formula (4), For input.

[0077] At this time, in this embodiment, when training the deep learning network model, the loss functions used include a classification loss function and a bounding box regression loss function. The classification loss function adopts a cross entropy function, and the bounding box regression loss function adopts a Smooth L1 function.

[0078] The processing process of the deep learning network model on the historical satellite cloud images is as follows: Feature extraction: The historical satellite cloud images in the data set are input into the backbone network of the improved RT-DETR model. The backbone network outputs a feature map with three dimensions [C, H, W], where C represents the number of channels, H represents the height of the feature map, and W represents the width of the feature map; taking the third, fourth, and fifth layers of feature maps output by the backbone network as an example (here the backbone network can generate five layers of feature maps as an example), they are recorded as FP3, FP4, and FP5 respectively, as shown in Figure 4As shown in the figure, first, the number of channels of these feature maps is uniformly adjusted to 256 to obtain FP3_Later, FP4_Later, and FP5_Later. Then, FP5_Later is upsampled by the nearest neighbor interpolation method to obtain upsampled_FP5, and is horizontally connected with FP4_Later, that is, the corresponding element values ​​are added to obtain the fused merged_FP4. The merged_FP4 is upsampled and horizontally connected with FP3_Later to obtain the fused merged_FP3. Finally, these fused multi-scale feature maps are passed to the next processing stage, that is, the multi-scale feature maps are output; Multi-scale feature map fusion: In FPN, the semantic information of the high-level feature map is fused with the spatial information of the low-level feature map to generate a feature representation with rich multi-scale information and output multi-scale features; Capture global context information: The output multi-scale The degree features are input into the Transformer encoder of the model. In this process, the position encoding, query selection, self-attention mechanism, multi-head attention, and multiple calculation steps of the encoder and decoder are combined to generate a feature vector with stronger global context information capture ability, and output a feature fusion map; Detection head processing: IOU-aware query selection receives the feature fusion map from the Transformer encoder, and after further processing, it is passed to the decoder and prediction head. First, the decoder and prediction head perform linear transformation on these feature vectors to generate class classification logits (referring to the original prediction value of the network output layer), and apply the Softmax activation function to predict the probability of each category. Then, another linear transformation is performed on the feature vector to predict the regression value of the bounding box. According to the classification results of the marine weather system, the position and size of the target prediction box are adjusted to realize the inspection and recognition of cloud map features.

[0079] After obtaining the trained marine weather system identification model, obtain the satellite cloud images of the geostationary meteorological satellite in the same area as the historical satellite cloud images in the data set, input the satellite cloud images into the trained marine weather system identification model, annotate the marine weather system in the satellite cloud images, output the new cloud image product, and complete the identification of the marine weather system.

[0080] At this time, obtain the satellite cloud image of the analysis area, which includes the ocean area. Take the satellite cloud image as input, use the trained marine weather system recognition model to annotate the marine weather system in the satellite cloud image, so as to identify the marine weather system in the satellite cloud image, and output a new cloud image product. In the new cloud image product, use the annotation box to select the marine weather system in the satellite cloud image.

[0081] At present, the purpose of satellite cloud images of geostationary meteorological satellites is mainly to assist in judging the intensity and location of disastrous weather systems or processes such as tropical cyclones, severe convection, and sea fog. These disastrous weather systems are only part of the marine weather system displayed in the satellite cloud images. On the one hand, they must be manually interpreted in combination with the weather maps. On the other hand, these application scenarios also have certain limitations and fail to give full play to the functions of satellite cloud images. In order to solve this problem, this embodiment provides a method for identifying marine weather systems in satellite cloud images based on deep learning, which can correspond and learn the characteristics of marine weather systems such as high-pressure centers, low-pressure centers, subtropical high-pressure areas, low-pressure troughs, high-pressure ridges, and equatorial convergence zones in weather maps and satellite cloud images of corresponding geostationary meteorological satellites, realize automatic identification and annotation of corresponding marine weather systems in satellite cloud images, replace manual judgment, and provide a reference basis for weather system analysis and mapping in marine areas.

[0082] The present application also provides an application scenario, which applies the above-mentioned method for identifying marine weather systems in satellite cloud images. Specifically, the method for identifying marine weather systems in satellite cloud images provided in this embodiment can be applied in marine weather system identification scenarios. The marine weather system identification scenario includes an identification link and a display link. The identification link is used to use a trained marine weather system identification model to mark the marine weather system in the satellite cloud image to identify the marine weather system in the satellite cloud image, and the display link is used to display the marine weather system in the satellite cloud image. The method for identifying marine weather systems in satellite cloud images provided in this embodiment belongs to the identification link.

[0083] Example 2.

[0084] Based on the same inventive concept, the embodiment of the present application also provides a satellite cloud image marine weather system identification device for implementing the satellite cloud image marine weather system identification method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more satellite cloud image marine weather system identification device embodiments provided below can refer to the limitations of the satellite cloud image marine weather system identification method above, and will not be repeated here.

[0085] In an exemplary embodiment, Figure 5 As shown, a satellite cloud image marine weather system identification device is provided, and the satellite cloud image marine weather system identification device includes the following modules.

[0086] The acquisition module M1 is used to acquire a satellite cloud image of an analysis area; the analysis area includes an ocean area.

[0087] The identification module M2 is used to take the satellite cloud map as input, and use the trained marine weather system identification model to mark the marine weather system in the satellite cloud map to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model with historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

[0088] Example 3.

[0089] In an exemplary embodiment, a computer device is provided. The computer device may be a server or a terminal. The internal structure diagram thereof may be as follows: Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for identifying marine weather systems in satellite cloud images is implemented.

[0090] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0091] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method for identifying marine weather systems based on satellite cloud images in Example 1 is implemented.

[0092] Example 4.

[0093] In an exemplary embodiment, a computer-readable storage medium is provided, storing a computer program, which, when executed by a processor, implements the method for identifying marine weather systems using satellite cloud images in Example 1.

[0094] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0095] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0096] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A method for identifying marine weather systems from satellite cloud images, characterized in that: The satellite cloud image marine weather system identification method comprises: Obtaining a satellite cloud image of an analysis area; the analysis area includes an ocean area; Taking the satellite cloud map as input, the marine weather system in the satellite cloud map is labeled using the trained marine weather system identification model to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model using historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

2. The method for identifying marine weather systems from satellite cloud images according to claim 1, characterized in that: The satellite cloud images include visible light cloud images and infrared cloud images.

3. The method for identifying marine weather systems from satellite cloud images according to claim 1, characterized in that: The marine weather system includes high pressure center, low pressure center, subtropical high pressure area, low pressure trough line, high pressure ridge line and equatorial convergence zone.

4. The method for identifying marine weather systems from satellite cloud images according to claim 1, characterized in that: The deep learning network model adopts an improved RT-DETR model, which is a model obtained by improving the RT-DETR model, and the improvements include: replacing the convolutional layers in the backbone network of the RT-DETR model with space and channel reconstruction convolutional layers, making the neck network of the RT-DETR model use a feature pyramid network, and replacing the convolutional layers in the feature pyramid network with space and channel reconstruction convolutional layers.

5. The method for identifying marine weather systems from satellite cloud images according to claim 1, characterized in that: Before labeling the marine weather system in the satellite cloud image using the trained marine weather system recognition model using the satellite cloud image as input, the satellite cloud image marine weather system recognition method further includes: training to obtain the trained marine weather system recognition model, specifically including: Acquire multiple samples; the samples include historical satellite cloud images, historical ground weather analysis images and historical 500hPa potential height images corresponding to the time of the analysis area; Annotating the marine weather systems in the historical ground weather analysis map and the historical 500hPa potential height map to generate a historical marine weather system distribution map; the historical marine weather system distribution map contains the location information of the marine weather systems in the historical satellite cloud map; The historical satellite cloud image is used as input and the historical marine weather system distribution map is used as a label to train the deep learning network model to obtain a trained marine weather system recognition model.

6. The method for identifying marine weather systems from satellite cloud images according to claim 5, characterized in that: Get multiple samples, including: For historical satellite cloud images, obtain historical satellite cloud images of the analysis area; or obtain L1 level full disk data of the analysis area, and draw the historical satellite cloud images based on the L1 level full disk data; For the historical surface weather analysis map and the historical 500 hPa potential height map, the historical surface weather analysis map and the global meteorological reanalysis data of the analysis area are obtained, and the historical 500 hPa potential height map is obtained based on the global meteorological reanalysis data; or, the global meteorological reanalysis data of the analysis area is obtained, and the historical surface weather analysis map and the historical 500 hPa potential height map are obtained based on the global meteorological reanalysis data; Among them, the time of the historical satellite cloud map, the historical ground weather analysis map and the historical 500hPa potential height map corresponds to each other, and the map projections are all Mercator projections.

7. The method for identifying marine weather systems from satellite cloud images according to claim 5, characterized in that: When training the deep learning network model, the loss functions used include a classification loss function and a bounding box regression loss function. The classification loss function adopts a cross entropy function, and the bounding box regression loss function adopts a Smooth L1 function.

8. A satellite cloud image marine weather system identification device, characterized in that: The satellite cloud image marine weather system identification device comprises: An acquisition module, used to acquire a satellite cloud image of an analysis area; the analysis area includes an ocean area; The identification module is used to use the satellite cloud map as input and use the trained marine weather system identification model to mark the marine weather system in the satellite cloud map to identify the marine weather system in the satellite cloud map; wherein the trained marine weather system identification model is a model obtained by training a deep learning network model using historical satellite cloud maps as input and the location information of the marine weather systems in the historical satellite cloud maps as labels.

9. A computer device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the satellite cloud image marine weather system identification method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for identifying marine weather systems in satellite cloud images described in any one of claims 1 to 7 is implemented.

Images