On-satellite SAR image ocean internal wave detection method and related equipment thereof

By using edge detection and hierarchical clustering methods of SAR images on the star, combined with sliding window and bandpass filtering, the timeliness and effectiveness of intraocular wave detection is solved, and efficient detection of intraocular waves in the star Shanghai and intraocular waves is realized. analyze.

CN118968273AActive Publication Date: 2024-11-15QINGDAO COLLABORATIVE INNOVATION RES INST

Patent Information

Application Number
CN202410974895.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-15
Estimated Expiration
2044-07-19

AI Technical Summary

Technical Problem

The existing intraocular wave detection methods cannot be processed on the satellite, resulting in poor timeliness and effectiveness of monitoring data.

Method used

Through the edge detection operator and hierarchical clustering method based on SAR images, the edge feature lines and morphological features of the wave region in the ocean are extracted, and combined with sliding window and bandpass filtering processing, real-time detection and analysis of waves in the ocean are realized.

Benefits of technology

Real-time and effectiveness of satellite in-ocean wave detection is realized, data transmission time and resource usage are reduced, detection accuracy is improved and false alarm rate is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118968273A_ABST
    Figure CN118968273A_ABST
Patent Text Reader

Abstract

The invention relates to an on-satellite SAR image ocean internal wave detection method and related equipment thereof. The method comprises the following steps: generating an ocean region image based on a target region in an SAR image; determining an edge feature line set of the ocean internal wave region based on an edge detection operator method; determining a target edge feature line in a plurality of edge feature lines in the edge feature line set so as to determine spatial distribution features of the ocean internal waves; determining direction information corresponding to the target edge feature lines, and classifying the target edge feature lines to determine direction distribution features of the ocean internal waves; and based on the morphological characteristics, the spatial distribution characteristics and the direction distribution characteristics, processing the ocean internal wave region image corresponding to the ocean internal wave region to determine the centroid position of the ocean internal wave, and determining the wavelength information of the ocean internal wave based on the centroid position. Based on the above method, the resource occupation of the SAR image ocean internal wave detection can be reduced, the on-satellite processing is realized, and the real-time performance and the response speed are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of ocean remote sensing information processing, and in particular to a method for detecting ocean internal waves in satellite SAR images and related equipment. Background Art

[0002] Ocean internal waves are an important phenomenon in the ocean, and their formation is caused by the combined effects of seawater density stratification and disturbance sources. Usually, internal waves have a short period and a large amplitude, which have an important impact on the marine ecological environment and human marine activities. Synthetic Aperture Radar (SAR), as an efficient microwave remote sensing technology, has the characteristics of all-day, all-weather, and high resolution, and has been widely used in the observation and research of ocean internal waves.

[0003] At present, the monitoring of ocean internal waves is generally achieved based on off-satellite images, using high-cost hardware and neural network models. However, SAR images themselves have a large amount of data, a long data transmission time, and serious lags in off-satellite processing, resulting in poor timeliness and effectiveness of monitoring data. Due to the simple on-satellite hardware logic and limited computing resources, the existing ocean internal wave detection methods cannot be applied to on-satellite processing. Summary of the invention

[0004] An onboard SAR image ocean internal wave detection method provided by an embodiment of the present invention at least solves the problem that the existing ocean internal wave detection method cannot be applied to onboard processing and the timeliness and effectiveness of monitoring data are poor.

[0005] According to a first aspect of an embodiment of the present invention, a method for detecting ocean internal waves in a satellite SAR image is provided, comprising:

[0006] Generate an ocean region image based on the target region in the SAR image, wherein the ocean region image includes an ocean internal wave region;

[0007] Determine a set of edge feature lines of the ocean internal wave region based on an edge detection operator, so as to determine the morphological features of the ocean internal wave region based on the set of edge feature lines, wherein the set of edge feature lines includes a plurality of edge feature lines;

[0008] Determine a target edge feature line that meets multiple threshold ranges among the plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line;

[0009] Determine the direction information corresponding to the target edge characteristic line, classify the target edge characteristic line, so as to determine the direction distribution characteristics of the ocean internal wave, wherein the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction;

[0010] Based on the morphological characteristics, the spatial distribution characteristics and the directional distribution characteristics, the ocean internal wave area image corresponding to the ocean internal wave area is processed by a hierarchical clustering method to determine the centroid position of the ocean internal wave, and the wavelength information of the ocean internal wave is determined based on the centroid position.

[0011] According to an embodiment of the present invention, after generating an ocean area image based on the target area in the SAR image, the method further includes:

[0012] Dividing the image portion corresponding to the ocean internal wave area into a plurality of image blocks, so as to generate an ocean area image based on a target image block among the plurality of image blocks that meets a preset image quality condition;

[0013] Determine the position information of the ocean internal wave area relative to the ocean area image based on a sliding window method, wherein the size of the sliding window is determined based on a preset wavelength of the ocean internal wave;

[0014] Extracting feature information in an image area corresponding to the ocean internal wave area using the position information determined based on the sliding window, wherein the feature information is used to describe interference features in the image;

[0015] Based on the characteristic information, a bandpass filtering process is performed on the image area corresponding to the ocean internal wave area to remove the interference characteristics and generate a processed image of the ocean area.

[0016] According to an embodiment of the present invention, dividing the image portion corresponding to the ocean internal wave region into a plurality of image blocks so as to generate an ocean region image based on a target image block among the plurality of image blocks that meets a preset image quality condition includes:

[0017] Performing histogram statistics and normalization processing on the multiple image blocks respectively to generate normalized histogram curves corresponding to the multiple image blocks respectively;

[0018] Respectively determining the maximum peak positions of a plurality of the normalized histogram curves and the grayscale values ​​corresponding to the maximum peak positions;

[0019] A target grayscale value within a preset grayscale range is determined from the plurality of grayscale values, so that an image block corresponding to the target grayscale value is determined as a target image block that meets the preset image quality condition.

[0020] According to an embodiment of the present invention, generating an ocean area image based on a target area in a SAR image includes:

[0021] Performing geo-registration on the SAR image to determine geographical location information corresponding to the SAR image;

[0022] Combining the geo-referenced SAR image with a land mask corresponding to the geographic location information to mask the land data in the SAR image and determine the ocean area in the SAR image;

[0023] An ocean area whose ocean depth meets a preset depth threshold is determined as the target area.

[0024] According to an embodiment of the present invention, the method based on the edge detection operator determines the edge feature line set of the ocean internal wave region, so as to determine the morphological features of the ocean internal wave region based on the edge feature line set, including:

[0025] Calculate the first gradient value in the horizontal direction and the second gradient value in the vertical direction of each pixel point in the ocean area image respectively based on the Sobel operator method;

[0026] Determine a gradient modulus and a gradient direction of each of the pixel points based on the first gradient value and the second gradient value, so as to determine a target pixel point among the pixel points, wherein the gradient modulus of the target pixel point is a maximum value of a local gradient modulus;

[0027] Determine an initial edge feature line according to the gradient modulus corresponding to the target pixel point;

[0028] Based on the gradient direction, adjacent initial edge feature lines are connected by a morphological closing operation method to generate the edge feature line.

[0029] According to an embodiment of the present invention, the threshold range includes a curvature range, an entropy value range, a total length range of edge feature lines, a length range and a number range of the initial edge feature lines;

[0030] Among them, the curvature range includes 0.98 to 0.999, the entropy value range includes below 3.97, the total length range of the edge feature line includes more than 300, and the length range and number range of the initial edge feature lines include at least 4 initial edge feature lines with a length greater than 30.

[0031] According to an embodiment of the present invention, the determining the direction information corresponding to the target edge characteristic line and classifying the target edge characteristic line to determine the directional distribution characteristics of the ocean internal wave includes:

[0032] Determine the circumscribed ellipse of the target edge feature line based on the least square method to determine the direction information corresponding to each of the target edge feature lines;

[0033] Classify the target edge feature lines according to the angle range intervals corresponding to the direction information to determine the total length of the target edge feature lines in each angle range interval, wherein the angle range intervals include -90 degrees to -45 degrees, -45 degrees to 0 degrees, 0 degrees to 45 degrees, and 45 degrees to 90 degrees;

[0034] Based on the total length of the target edge feature line in each of the angle range intervals, determining the length standard deviation corresponding to each of the angle range intervals;

[0035] The direction information of the target edge characteristic line within the angle range interval whose length standard deviation meets the standard deviation threshold is obtained to determine the directional distribution characteristics of the ocean internal wave.

[0036] According to a second aspect of an embodiment of the present invention, a SAR image ocean internal wave detection device is provided, comprising:

[0037] A generating module, used for generating an ocean region image based on a target region in a SAR image, wherein the ocean region image includes an ocean internal wave region;

[0038] A determination module, configured to determine a set of edge feature lines of the ocean internal wave region based on an edge detection operator, so as to determine the morphological features of the ocean internal wave region based on the set of edge feature lines, wherein the set of edge feature lines includes a plurality of edge feature lines;

[0039] The determination module is further configured to determine a target edge feature line that meets multiple threshold ranges among the plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line;

[0040] A classification module, used to determine the direction information corresponding to the target edge characteristic line, classify the target edge characteristic line, so as to determine the direction distribution characteristics of the ocean internal wave, wherein the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction;

[0041] The determination module is also used to process the ocean internal wave area image corresponding to the ocean internal wave area through a hierarchical clustering method based on the morphological characteristics, the spatial distribution characteristics and the directional distribution characteristics to determine the centroid position of the ocean internal wave, and determine the wavelength information of the ocean internal wave based on the centroid position.

[0042] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor, and a memory storing a program, wherein the program comprises instructions, which, when executed by the processor, cause the processor to execute the method according to the first aspect.

[0043] According to a fourth aspect of an embodiment of the present invention, a non-transitory machine-readable medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method according to the first aspect.

[0044] The method for detecting ocean internal waves in satellite SAR images provided by the embodiment of the present invention requires a small amount of hardware and software resources, can realize real-time processing on the satellite, and improve the timeliness and effectiveness of monitoring data. Specifically, first, an ocean area image is generated based on the target area in the SAR image, wherein the ocean area image includes an ocean internal wave area. By extracting the ocean area image containing the ocean internal wave area in the SAR image and performing subsequent processing on the ocean area image, the amount of data processing can be reduced, resource occupation can be reduced, and the data processing speed can be improved. Then, a method based on an edge detection operator is used to determine the edge feature line set of the ocean internal wave area, so as to determine the morphological characteristics of the ocean internal wave area based on the edge feature line set, wherein the edge feature line set includes multiple edge feature lines. Finally, the target edge feature line that meets multiple threshold ranges is determined from the multiple edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line; the directional information corresponding to the target edge feature line is determined, and the target edge feature line is classified to determine the directional distribution characteristics of the ocean internal wave, and the directional information includes the angle between the major axis of the circumscribed ellipse of the target edge feature line and the horizontal direction; and based on the morphological characteristics, spatial distribution characteristics and directional distribution characteristics, the ocean internal wave area image corresponding to the ocean internal wave area is processed by the hierarchical clustering method to determine the centroid position of the ocean internal wave, and the wavelength information of the ocean internal wave is determined based on the centroid position. Based on the above method, the resource occupation of the ocean internal wave detection of SAR images can be reduced, and on-board processing can be realized. Compared with the traditional off-board processing method, the data transmission time is reduced, and the real-time performance and response speed are significantly improved; at the same time, the accuracy of internal wave detection can be improved and the false alarm rate can be reduced.

[0045] The details of one or more embodiments of the invention are set forth in the following drawings and description so that other features, objects, and advantages of the invention are more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other embodiments can be obtained based on these drawings without creative work.

[0047] Figure 1A flow chart of a method for detecting ocean internal waves in satellite SAR images is provided as an exemplary embodiment of the present invention.

[0048] Figure 2 A schematic diagram of a SAR image of a target sea area provided by an exemplary embodiment of the present invention.

[0049] Figure 3 A schematic diagram of an image after geo-registration and land mask processing of a SAR image of a target sea area is provided as an exemplary embodiment of the present invention.

[0050] Figure 4 A schematic diagram of an image after sliding window processing is performed on an ocean area image provided by an exemplary embodiment of the present invention.

[0051] Figure 5 A schematic diagram of a window 2-6 image provided by an exemplary embodiment of the present invention.

[0052] Figure 6 A schematic diagram of an image after bandpass filtering provided by an exemplary embodiment of the present invention.

[0053] Figure 7 A schematic diagram of an edge image provided by an exemplary embodiment of the present invention.

[0054] Figure 8 A schematic diagram of an actual edge image provided by an exemplary embodiment of the present invention.

[0055] Fig. 9 A schematic diagram of an image obtained after hierarchical clustering processing is provided according to an exemplary embodiment of the present invention.

[0056] Fig.10 A schematic diagram of an internal wave geographic location window image corresponding to a SAR image provided by an exemplary embodiment of the present invention.

[0057] Fig.11 A flow chart of an onboard SAR image ocean internal wave detection device provided as an exemplary embodiment of the present invention.

[0058] Fig.12 The present invention provides a schematic structural diagram of an electronic device according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0059] Embodiments of the present embodiment will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present embodiment are shown in the accompanying drawings, it should be understood that the present embodiment can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein, which are instead provided for a more thorough and complete understanding of the present embodiment. It should be understood that the drawings and embodiments of the present embodiment are only for exemplary purposes and are not intended to limit the scope of protection of the present embodiment.

[0060] Ocean internal waves are an important wave phenomenon in the ocean. They are usually generated by the combined effects of seawater density stratification and disturbance sources. They have short periods and large amplitudes, and have significant impacts on marine ecology and human activities. Synthetic aperture radar (SAR), as an advanced microwave remote sensing technology, has become an important tool for monitoring ocean internal waves due to its advantages of all-day, all-weather, and high resolution. However, most existing ocean internal wave detection methods rely on high-cost off-satellite hardware and complex deep learning models, which not only increases costs, but also faces problems such as long data transmission time and processing lag.

[0061] To solve the above problems, an embodiment of the present invention provides a method for detecting ocean internal waves in satellite SAR images. The technical solutions provided by the embodiments of the present invention are described in detail below in conjunction with the accompanying drawings.

[0062] Figure 1 The following is a flow chart of a method for detecting ocean internal waves in satellite SAR images provided by an exemplary embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0063] Step S101, generating an ocean region image based on a target region in a SAR image, wherein the ocean region image includes an ocean internal wave region.

[0064] Step S102, determining an edge feature line set of the ocean internal wave region based on an edge detection operator method, so as to determine the morphological features of the ocean internal wave region based on the edge feature line set, wherein the edge feature line set includes a plurality of edge feature lines.

[0065] Step S103, determining a target edge feature line that meets multiple threshold ranges from a plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal waves based on the target edge feature line.

[0066] Step S104, determining the direction information corresponding to the target edge characteristic line, classifying the target edge characteristic line to determine the direction distribution characteristics of the ocean internal wave, the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction.

[0067] Step S105, based on the morphological characteristics, spatial distribution characteristics and directional distribution characteristics, the ocean internal wave area image corresponding to the ocean internal wave area is processed by a hierarchical clustering method to determine the centroid position of the ocean internal wave, and the wavelength information of the ocean internal wave is determined based on the centroid position.

[0068] First, an ocean region image is generated based on the target region in the SAR image. In this embodiment, the ocean region image includes an ocean internal wave region.

[0069] SAR (Synthetic Aperture Radar) images are remote sensing images acquired through synthetic aperture radar. SAR is an active imaging system that generates images by emitting microwave signals and receiving signals reflected from the ground. Since microwaves have the ability to penetrate clouds and rain, SAR images can obtain surface information around the clock under various meteorological conditions. SAR images can be used in application scenarios such as geographical research, environmental monitoring, and ocean observation.

[0070] The ocean internal wave region refers to a specific area in the ocean region image that contains ocean internal waves. Ocean internal waves are fluctuations in the ocean caused by density differences, usually manifested as fluctuations between different density layers inside the water body.

[0071] In this embodiment, in order to realize the ocean internal wave detection of SAR images, it is necessary to first determine the target area in the SAR image. The target area refers to a specific geographical area extracted from the SAR image. By reasonably selecting the target area, effective detection and analysis of ocean internal waves can be achieved, which determines the accuracy and effectiveness of subsequent processing steps.

[0072] The ocean area image is an image extracted from the SAR image that contains only the ocean part. This step involves further extracting the pure ocean area from the target area and removing any unwanted land areas and interference.

[0073] In an optional embodiment, when generating an ocean area image based on a target area in a SAR image, in order to further reduce the amount of computation for processing the entire SAR image and the interference of irrelevant information, first, the SAR image can be georeferenced to determine the geographical location information corresponding to the SAR image. Then, the georeferenced SAR image is combined with a land mask corresponding to the geographical location information to mask the land data in the SAR image and determine the ocean area in the SAR image. Finally, the ocean area whose ocean depth meets a preset depth threshold is determined as the target area.

[0074] First, the SAR image is geo-referenced to ensure that the SAR image accurately corresponds to the real geographic coordinate system. Specifically, this step includes: determining the geographic reference system of the SAR image, and matching the SAR image pixels with known geographic coordinate points. Use a transformation model (such as affine transformation, projection transformation) to transform the SAR image into a geographic coordinate system. Specifically, it can include operations such as rotation, scaling, and translation. Minimize the error between the geographic reference point and the SAR image point through a geo-referenced algorithm (such as the least squares method). The registered SAR image has clear geographic location information, and each pixel can be mapped to a specific geographic coordinate.

[0075] In this embodiment, the geographical location information corresponding to the SAR image can be represented by geographical coordinates (such as longitude and latitude). Specifically, when performing geographic registration, the SAR image can be registered with the geographic reference data through a registration algorithm. Optionally, the registration algorithm can include scale-invariant feature transform (SIFT), accelerated robust features (SURF), etc. Based on the above registration algorithm, the registration parameters (such as translation, rotation, scaling, etc.) are determined by matching the feature points in the SAR image with the feature points in the geographic reference data. Then the determined registration parameters are applied to the SAR image to align it with the geographic reference data to generate a geo-registered SAR image.

[0076] After georeferencing, the SAR image is combined with a land mask corresponding to the geographic location information to perform land data masking. The specific steps include: using existing geographic data (such as coastline vector data or geographic information system (GIS) data) to generate a land mask image. The land mask image is combined with the georeferenced SAR image. The mask acts on the land areas in the SAR image, shielding the data in these areas and retaining only the data in the ocean area. The masking process can be achieved by replacing pixel values ​​(for example, setting the pixel values ​​of the land area to 0 or other specific values).

[0077] After obtaining a SAR image containing only the ocean area, it is necessary to further determine the target ocean area that meets the preset depth threshold. The specific steps are as follows: obtain the ocean depth data corresponding to the SAR image, and you can use the ocean bathymetric map or ocean geographic information system data. Then set an ocean depth threshold according to the specific application requirements. For example, in order to detect ocean internal waves within a specific depth range, you can set the depth threshold to 50 meters, 100 meters, etc. The ocean area whose ocean depth meets the preset depth threshold is determined as the target area. Optionally, when determining the ocean area whose ocean depth meets the preset depth threshold as the target area, you can first perform a threshold judgment on the ocean depth data to generate a binary mask (the area that meets the depth threshold is 1, and the rest of the area is 0). Then combine the binary mask with the SAR image containing only the ocean area, and only retain the ocean area that meets the depth requirements.

[0078] In an optional embodiment, in order to improve the image quality of the ocean internal wave region in the SAR image and remove interference features, after the ocean region image is generated based on the target region in the SAR image, further image processing may be performed on the ocean region image. Specifically, the following steps are included:

[0079] The image portion corresponding to the ocean internal wave area is divided into a plurality of image blocks, so as to generate an ocean area image based on a target image block among the plurality of image blocks that meets a preset image quality condition.

[0080] In this embodiment, after generating the ocean area image, it is necessary to divide the image portion corresponding to the ocean internal wave area into a plurality of image blocks. The purpose of doing so is to generate a higher quality ocean area image based on the target image blocks among these image blocks that meet the preset image quality conditions. Specifically, the ocean area image is equally divided into a plurality of small blocks, usually square or rectangular small blocks, referred to as image blocks. The size of each image block can be set according to specific requirements, such as 64x64 pixels, 128x128 pixels, etc.

[0081] In order to ensure the quality of the generated ocean area image, these image blocks are further screened, and target image blocks that meet the preset image quality conditions can be selected. Specifically, the image quality of each image block can be evaluated by histogram statistics, normalization processing and other methods to generate normalized histogram curves corresponding to multiple image blocks. The maximum peak position of multiple normalized histogram curves and the grayscale value corresponding to the maximum peak position are determined respectively; the target grayscale value within the preset grayscale range is determined among the multiple grayscale values, so that the image block corresponding to the target grayscale value is determined as the target image block that meets the preset image quality conditions.

[0082] Optionally, when selecting a target image block that meets a preset image quality condition, the selection may be performed based on the following steps.

[0083] The ocean region image is divided into a plurality of smaller image blocks. The division method may include dividing the image equally according to a certain size (eg, 64x64 pixels or 128x128 pixels), and dividing the entire ocean region image into a plurality of small blocks.

[0084] Image quality assessment. Image quality assessment is performed on each image block, which can be done through methods such as histogram statistics and normalization processing. Specifically, the following steps are included:

[0085] Step 1: Histogram statistics.

[0086] Histogram generation: For each image block, calculate its grayscale histogram, which counts the number of pixels at each grayscale level (e.g. 0 to 255).

[0087] Grayscale values ​​are the brightness values ​​of pixels in an image, usually ranging from 0 (black) to 255 (white).

[0088] Normalization: The histogram of each image block is normalized so that the total area of ​​the histogram is 1. This is achieved by dividing the number of pixels at each gray level by the total number of pixels in the image block.

[0089] The normalized histogram curve represents the relative frequency of each gray level.

[0090] Step 2: Generate a normalized histogram curve.

[0091] Normalized histogram curve: Generate a normalized histogram curve corresponding to each image block. This curve represents the relative frequency distribution of different grayscale values ​​in the image block.

[0092] The horizontal axis of the curve is the grayscale value (0 to 255), and the vertical axis is the normalized relative frequency.

[0093] Step 3: Determine the maximum peak position and grayscale value.

[0094] The maximum peak position of each normalized histogram curve and the grayscale value corresponding to the maximum peak position are determined respectively.

[0095] Maximum peak position: The maximum peak position of the histogram curve represents the grayscale value with the highest frequency in the image block.

[0096] Grayscale value determination: Find the maximum peak position on the normalized histogram curve of each image block and record the corresponding grayscale value.

[0097] Step 4: Filter the target image blocks.

[0098] Among the maximum peak grayscale values ​​of the plurality of image blocks, a target grayscale value that meets a preset grayscale range is screened out to determine a target image block that meets a preset image quality condition.

[0099] Preset grayscale range: Set a grayscale value range according to actual application requirements. For example, the preset range can be a grayscale value between 100 and 150.

[0100] Step 5: Target image block screening.

[0101] Check whether the maximum peak grayscale value of each image block is within the preset grayscale range.

[0102] If the maximum peak grayscale value of an image block is within a preset range, the image block is determined as a target image block that meets the preset image quality condition.

[0103] Step 6: Generate high-quality ocean area images.

[0104] Through the above steps, all target image blocks that meet the preset image quality conditions are screened out to generate the final high-quality ocean area image.

[0105] Synthesis processing: All the filtered target image blocks are synthesized to form a complete ocean area image.

[0106] By performing histogram statistics and normalization on each image block and generating a normalized histogram curve, the maximum peak position of each image block and its corresponding grayscale value are found, and the target image blocks that meet the preset grayscale range are further screened out, and finally a high-quality ocean area image is generated. This process ensures the quality of the image, especially in complex ocean environments, and helps to improve the accuracy and reliability of subsequent ocean internal wave detection.

[0107] The position information of the ocean internal wave area relative to the ocean area image is determined based on a sliding window method, and the size of the sliding window is determined based on the wavelength of the preset ocean internal wave.

[0108] In this embodiment, the position information of the ocean internal wave region relative to the ocean region image is determined based on a sliding window method. The size of the sliding window is determined based on a preset ocean internal wave wavelength.

[0109] Set the size of the sliding window to match the wavelength of the ocean internal waves. For example, if the wavelength of the ocean internal waves is 100 meters, the size of the sliding window should correspond to this. The sliding window moves across the image, each time moving a step size, which is usually a fraction of the window size (such as half or one-third of the window size). At each position, the statistical characteristics of the image data within the window, such as the mean, variance, etc., are calculated to determine the location of the ocean internal wave area.

[0110] The feature information in the image area corresponding to the ocean internal wave area is extracted using the position information determined based on the sliding window, and the feature information is used to describe the interference features in the image.

[0111] In this embodiment, the position information determined by the sliding window is used to extract feature information from the image area corresponding to the ocean internal wave area. The feature information is used to describe the interference features in the image.

[0112] In the determined ocean internal wave area, feature information is extracted, such as edge features, texture features, etc. These feature information helps to identify and describe interference features in the image, such as noise, clutter, etc.

[0113] Based on the feature information, the image area corresponding to the ocean internal wave area is subjected to bandpass filtering to remove interference features and generate a processed ocean area image.

[0114] In this embodiment, based on the extracted feature information, a bandpass filtering process is performed on the image area corresponding to the ocean internal wave area to remove interference features and generate a processed ocean area image.

[0115] A bandpass filter is a filter that can pass signals within a specific frequency range and block signals of other frequencies. According to the feature information, the parameters of the bandpass filter are set to effectively remove the interference features. Bandpass filtering is performed on the image area to eliminate noise and interference and retain useful internal wave information.

[0116] After the above processing steps, the generated ocean area image has higher image quality and can show the ocean internal wave information more clearly, which is convenient for subsequent detection and analysis.

[0117] After generating an ocean area image based on the target area in the SAR image, an edge feature line set of the ocean internal wave area can be determined based on an edge detection operator method to determine the morphological features of the ocean internal wave area based on the edge feature line set, wherein the edge feature line set includes multiple edge feature lines.

[0118] The edge detection operator is an image processing technique used to identify areas in an image where the grayscale changes significantly, which usually correspond to the edges in the image. Commonly used edge detection operators include the Sobel operator, the Canny operator, the Laplace operator, etc. In this embodiment, the Sobel operator is used as the edge detection operator for calculation.

[0119] Specifically, firstly, the first gradient value in the horizontal direction and the second gradient value in the vertical direction of each pixel in the ocean area image can be calculated based on the Sobel operator method. The gradient modulus and gradient direction of each pixel are determined based on the first gradient value and the second gradient value to determine the target pixel among the pixels, and the gradient modulus of the target pixel is the maximum value of the local gradient modulus; the initial edge feature line is determined according to the gradient modulus corresponding to the target pixel; based on the gradient direction, adjacent initial edge feature lines are connected by the morphological closing operation method to generate edge feature lines.

[0120] In this embodiment, for each pixel point of the ocean area image, its gradient value in the horizontal direction and the vertical direction is calculated respectively. The Sobel operator uses two 3x3 convolution kernels to calculate the gradients in these two directions. Among them:

[0121] The horizontal convolution kernel (K x ) is shown in the following formula (1):

[0122]

[0123] The horizontal convolution kernel (K y ) is shown in the following formula (2):

[0124]

[0125] According to the gradient values ​​in the horizontal and vertical directions, the gradient magnitude (G) and gradient direction (θ) of each pixel are calculated. The gradient magnitude (G) of each pixel can be calculated according to the following formula (3), and the gradient direction (θ) can be calculated according to the following formula (4).

[0126]

[0127] θ=arctan(G y / G x ) (4)

[0128] Among them, G x Represents the horizontal gradient value, G t Indicates the vertical gradient value.

[0129] After obtaining the gradient magnitude (G) and gradient direction (θ) of each pixel, non-maximum suppression is performed to accurately locate the edge. That is, only the gradient magnitude of the local maximum is retained, and the gradient values ​​of other non-edge points are suppressed.

[0130] Then, the gradient amplitude is binarized and a threshold is set. Only pixels with a gradient amplitude greater than the threshold are considered edge points. The detected edge points are connected to form a complete edge feature line. Optionally, morphological processing methods such as dilation and erosion can be used to connect discontinuous edge points to form a continuous edge feature line. Further, a square structure element with a window size of 5*5 can be selected to perform a morphological closing operation.

[0131] After edge detection and feature line generation, a set of edge feature lines of the ocean internal wave region is obtained. The set contains multiple edge feature lines. Each edge feature line corresponds to a closed or non-closed curve, representing the edge of the ocean internal wave.

[0132] In an optional embodiment, each line in the feature line set has attribute information such as position, length, direction, etc. By analyzing the edge feature line set, the morphological characteristics of the ocean internal wave area can be determined.

[0133] Morphological feature analysis: Length: Calculate the length of each edge feature line to determine the scale of the ocean internal wave. Direction: Statistically calculate the direction distribution of each edge feature line to analyze the propagation direction of the ocean internal wave. Curvature: Calculate the curvature of each edge feature line to analyze the waveform characteristics of the ocean internal wave.

[0134] Different types of ocean internal waves can be further identified and classified through the morphological characteristics of edge feature lines. These morphological characteristics can also provide important basis for subsequent ocean internal wave detection and analysis.

[0135] By using edge detection operators, we can extract edge feature lines of the ocean internal wave region from SAR images. These edge feature lines provide key data for determining the morphological characteristics of the ocean internal wave region, including the length, direction, and curvature of the internal waves. Through these features, we can more accurately identify and analyze the spatial distribution and dynamic changes of ocean internal waves.

[0136] A target edge feature line that meets multiple threshold ranges is determined from a plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line.

[0137] In this embodiment, the threshold range may include a curvature range, an entropy value range, a total length range of edge feature lines, a length range and a number range of initial edge feature lines;

[0138] Among them, the curvature range includes 0.98 to 0.999, the entropy value range includes below 3.97, the total length range of edge feature lines includes more than 300, and the length range and number range of initial edge feature lines include at least 4 initial edge feature lines with a length greater than 30.

[0139] Specifically, to determine the spatial distribution characteristics of ocean internal waves based on the target edge characteristic line, the following steps may be performed.

[0140] Step 1: Set the curvature threshold range.

[0141] Statistical edge line curvature: Calculate the curvature of each edge feature line. Curvature is a parameter that describes the degree of curvature of the curve.

[0142] Curvature threshold range: only retain edge feature lines with curvature between 0.98 and 0.999.

[0143] In this embodiment, the curvature range is set based on the fact that the characteristic line of the ocean internal wave is locally approximate to a straight line, that is, the curvature value is close to 1. The characteristic line with a curvature less than 0.98 generally represents other ocean phenomena, while the characteristic line with a curvature greater than 0.999 may be linear noise in the image.

[0144] Preserve edge feature lines that meet curvature requirements.

[0145] Step 2: Set the feature line length threshold range.

[0146] Count feature line length: Calculate the length of each edge feature line, that is, the number of pixels on the feature line.

[0147] Feature line length threshold range: retain feature lines with a length of more than 20 pixels.

[0148] In this embodiment, feature lines with less than 20 points are generally regarded as small wave texture noise rather than internal ocean waves.

[0149] Step 3: Set the entropy value, the total length of feature lines, and the number range of initial edge feature lines.

[0150] Entropy range: Calculate the entropy of the binary image and retain feature lines with entropy values ​​less than 3.97.

[0151] In this embodiment, the entropy value indicates the disorder degree of the image, and the larger the entropy value, the more disordered the image is. Internal waves usually gather on one side of the image, and the entropy value is small.

[0152] Total length range of feature lines: retain the set of feature lines with a total length greater than 300.

[0153] In this embodiment, this range ensures that the total length of the selected characteristic lines is sufficient to describe the spatial distribution characteristics of the internal waves.

[0154] The length and number range of initial edge feature lines:

[0155] In this embodiment, the number of characteristic lines with a single internal wave length greater than 30 should be at least 4. This condition ensures the stability and reliability of the detected internal wave edge characteristic lines.

[0156] Step 4: Comprehensive judgment of multi-parameter thresholds.

[0157] Internal wave binary image U: a binary image formed by the set of feature lines screened through the above steps.

[0158] Threshold condition: Set the threshold of image U. The image part that meets the following conditions is judged as internal wave:

[0159] The curvature is between 0.98 and 0.999, the entropy value is less than 3.97, the total length of the feature lines is greater than 300, and the length of at least 4 initial edge feature lines is greater than 30.

[0160] The comprehensive application of these screening conditions ensures that the target edge characteristic lines finally screened out can accurately describe the spatial distribution characteristics of ocean internal waves.

[0161] In this embodiment, the threshold U can be set based on the initially obtained internal wave binary image U. T , the pixels in the image are divided into two categories: those that meet certain conditions are identified as internal wave areas, while those that do not meet the conditions are filtered out and regarded as non-internal wave signals. Specifically:

[0162] Internal wave binary image U: A binary image obtained through preliminary processing and screening, where the value of each pixel (x, y) is 1 or 0.

[0163] Threshold U T : is a set value, which is the key criterion for judging whether each pixel point (x, y) belongs to the internal wave area.

[0164] Internal wave area judgment: If the value of the pixel point (x, y) U(x, y) ≥ U T , it is identified as an internal wave area, and its corresponding f(x,y) value is 1; if the value U(x,y) of the pixel point (x,y) T , it is identified as a non-internal wave area, and the corresponding f(x,y) value is 0.

[0165] This method uses a threshold to classify the binary image and regards the qualified part as the internal wave area, thereby achieving a preliminary extraction and analysis of the spatial distribution characteristics of ocean internal waves.

[0166] After determining the spatial distribution characteristics of the ocean internal waves based on the target edge characteristic lines, the directional information corresponding to the target edge characteristic lines can be determined, and the target edge characteristic lines can be classified to determine the directional distribution characteristics of the ocean internal waves. The directional information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic lines and the horizontal direction.

[0167] ​By analyzing and processing the target edge feature lines, the spatial distribution characteristics of the ocean internal waves are determined. Then, the circumscribed ellipse fitting technique is used to obtain the main direction of each target edge feature line, that is, the angle between the major axis of the ellipse and the horizontal direction. Further, these directional information are classified according to a certain angle range, thereby revealing and describing the directional distribution characteristics of the ocean internal waves in the entire image.

[0168] In an optional embodiment, when determining the direction information corresponding to the target edge characteristic line and classifying the target edge characteristic line to determine the directional distribution characteristics of the ocean internal wave, the following steps may be performed:

[0169] The circumscribed ellipse of the target edge feature line is determined based on the least square method to determine the direction information corresponding to each of the target edge feature lines.

[0170] In this embodiment, a mathematical model can be used to fit a circumscribed ellipse to each target edge feature line. The angle between the major axis of the circumscribed ellipse and the horizontal direction is the main direction information of the feature line.

[0171] The target edge feature lines are classified according to the angle range intervals of the direction information corresponding to each of the target edge feature lines to determine the total length of the target edge feature lines in each angle range interval. The angle range intervals include -90 degrees to -45 degrees, -45 degrees to 0 degrees, 0 degrees to 45 degrees, and 45 degrees to 90 degrees.

[0172] In this embodiment, each characteristic line is allocated to four predefined angle ranges according to the main direction angle of its circumscribed ellipse, and the total length of the characteristic lines in each angle range is counted.

[0173] Based on the total length of the target edge feature line in each angle range interval, the length standard deviation corresponding to each angle range interval is determined.

[0174] The direction information of the target edge characteristic line within the angle range interval whose length standard deviation meets the standard deviation threshold is obtained to determine the directional distribution characteristics of the ocean internal waves. In this embodiment, the standard deviation threshold can be 2.

[0175] In an optional embodiment, the feature line set can be expressed based on the following formula (5):

[0176] N i ={n s,i}, i=1,2,3,4 (5)

[0177] Among them, N i represents the set of characteristic lines within the i-th angle range, i=1,2,3,4 respectively correspond to the angle range (-90° to -45°),

[0178] The total length of the target edge feature line can be expressed based on the following formula (6):

[0179]

[0180] in, N i The total length of the target edge feature line in Represents the length of the sth characteristic line within the i-th angle range.

[0181] Furthermore, the directional distribution characteristics of the ocean internal waves can be determined based on the following formula (7) according to the standard deviation of the sum of the lengths of the characteristic lines in different angle ranges.

[0182]

[0183] in, It refers to the sum of the lengths of the characteristic lines within the angle range i The standard deviation of .

[0184] Finally, based on the morphological characteristics, spatial distribution characteristics and directional distribution characteristics, the ocean internal wave area image corresponding to the ocean internal wave area is processed by a hierarchical clustering method to determine the centroid position of the ocean internal wave, and the wavelength information of the ocean internal wave is determined based on the centroid position.

[0185] In this embodiment, based on morphological features, spatial distribution features and directional distribution features, the ocean internal wave area image is processed by a hierarchical clustering method to determine the centroid position of the ocean internal waves, and then the wavelength information of the ocean internal waves is determined based on the centroid position.

[0186] Determination of centroid position: Using the hierarchical clustering method, the internal wave region images with similar morphology, spatial distribution and directional distribution characteristics are clustered. The centroid position of each cluster represents the central position of the internal wave in the cluster.

[0187] Setting the Euclidean distance threshold of clustering results: According to the description in content 1, a certain minimum Euclidean distance threshold (such as 30) can be set to determine the separation results between different internal wave clusters. This threshold is usually obtained through experiments and analysis to ensure that the internal wave clusters can be effectively distinguished.

[0188] Determine the wavelength information of ocean internal waves based on the centroid position:

[0189] Calculation of wavelength information: Once the centroid position of each internal wave cluster is determined, the wavelength of the ocean internal wave can be inferred or measured by calculating the shortest distance between these centroids. Wavelength is one of the important characteristics of internal waves and reflects the spatial periodicity of waves or vortices in the ocean.

[0190] The following describes in detail the method for detecting ocean internal waves in satellite SAR images provided by an embodiment of the present invention in conjunction with the accompanying drawings.

[0191] Assume that Figure 2 Taking the SAR image shown in FIG. 1 as an example, ocean internal waves are detected on the SAR image based on the following method.

[0192] Step 1: SAR image acquisition and preprocessing.

[0193] 1.1. SAR image acquisition.

[0194] Use spaceborne SAR satellites (such as Sentinel-1 or RADARSAT) to obtain SAR images covering the target sea area. Specifically, SAR images containing multiple time points can be collected for dynamic analysis. Figure 2 shown.

[0195] 1.2 Image Preprocessing

[0196] Geo-reference: Use known geographic reference points in a geographic information system (GIS) to match pixels in SAR images. Align SAR images to a geographic coordinate system through an affine transformation to ensure the geographic accuracy of the image.

[0197] Radiometric correction: Corrects the radiometric error in SAR images and eliminates reflectivity deviations caused by sensor noise and other external factors.

[0198] Land area masking: The land mask is generated using the coastline vector data to mark and remove the land area in the SAR image to ensure that only the data of the ocean area is retained.

[0199] The SAR image of the target sea area is georeferenced and the land mask is processed as follows: Figure 3 shown.

[0200] Step 2: Generate ocean area images.

[0201] After preprocessing, SAR images containing only the ocean area are generated. These images accurately reflect the microwave reflection signals on the ocean surface and serve as the basic data for subsequent ocean internal wave detection and analysis.

[0202] Step 3: Image block division and sliding window processing of ocean area images.

[0203] 3.1、Image block division.

[0204] The image portion corresponding to the ocean internal wave area is divided into a plurality of image blocks, so as to generate an ocean area image based on a target image block among the plurality of image blocks that meets a preset image quality condition.

[0205] The size of each image block is fixed, and the target image block is screened according to preset image quality conditions (such as signal-to-noise ratio, contrast, etc.).

[0206] 3.2. Sliding window processing.

[0207] The position information of the ocean internal wave area relative to the ocean area image is determined based on a sliding window method, and the size of the sliding window is determined based on a preset wavelength of the ocean internal wave.

[0208] The size of the sliding window can be adjusted based on the wavelength of typical ocean internal waves, such as the common 10-100 km range.

[0209] The sliding window moves step by step on the image, each time by a window size, and the internal wave characteristics within the window are recorded.

[0210] The image after sliding window processing of the ocean area image is as follows Figure 4 As shown, there are 30 sliding windows, including window 1-1 to window 1-6, window 2-1 to window 2-6, window 3-1 to window 3-6, window 4-1 to window 4-6, and window 5-1 to window 6-6.

[0211] The following steps are explained using window 2-6 as an example. The image corresponding to window 2-6 is as follows Figure 5 shown.

[0212] 3.3. Feature information extraction.

[0213] The position information determined based on the sliding window is used to extract feature information in the image area corresponding to the ocean internal wave area, and the feature information is used to describe interference features in the image.

[0214] Feature information includes but is not limited to gradient, direction, texture, etc.

[0215] Use feature extraction algorithms (such as Gabor filter, HOG feature, etc.) to extract feature information within the window.

[0216] 3.4. Bandpass filtering.

[0217] Based on the characteristic information, a bandpass filtering process is performed on the image area corresponding to the ocean internal wave area to remove the interference characteristics and generate a processed image of the ocean area.

[0218] The frequency range of the bandpass filter should match the characteristic frequency of ocean internal waves to enhance the internal wave signal and suppress other interference.

[0219] The image after bandpass filtering of windows 2-6 is as follows Figure 6 shown.

[0220] 4. Edge detection and feature extraction of ocean internal wave areas.

[0221] 4.1. Edge detection.

[0222] Use the Sobel operator for edge detection. The Sobel operator calculates the gradient value of each pixel in the horizontal and vertical directions, and obtains the edge image through non-maximum suppression and thresholding. The edge image obtained after edge detection is as follows: Figure 7 shown.

[0223] 4.2. Feature extraction.

[0224] Multiple edge feature lines are extracted from the edge image. These feature lines represent the morphology and distribution characteristics of the ocean internal waves. Non-maximum suppression and double threshold processing are applied to refine the edge lines to ensure that the extracted feature lines accurately reflect the actual edges of the internal waves. The actual edge image obtained after feature extraction is shown in Figure 2. Figure 8 shown.

[0225] 5. Analysis of spatial distribution characteristics of ocean internal waves.

[0226] 5.1. Spatial distribution analysis.

[0227] The extracted edge feature lines are clustered using a hierarchical clustering method. Hierarchical clustering gradually merges or splits data points to form a tree structure that represents the grouping of feature lines at different clustering levels. The image obtained after hierarchical clustering is shown in Figure 1. Fig. 9 shown.

[0228] Method: An agglomerative hierarchical clustering algorithm was used to calculate the Euclidean distance between feature lines and gradually merge the feature lines according to the distance.

[0229] Result: Multiple feature line clusters are formed, each cluster represents an ocean internal wave region.

[0230] 5.2. Directional distribution characteristics.

[0231] Direction analysis is performed on each characteristic line cluster, and the main direction of the internal wave is determined by the circumscribed ellipse method.

[0232] Circumscribed ellipse: Perform least squares fitting on the point set of each cluster to obtain the major and minor axes of the ellipse.

[0233] Propagation direction: The angle between the major axis of the ellipse and the horizontal direction is the propagation direction of the internal wave.

[0234] 6. The centroid position and wavelength information of ocean internal waves are determined.

[0235] 6.1. Determine the center of mass position.

[0236] For each feature line cluster, the centroid location is calculated.

[0237] 6.2. Calculation of wavelength information.

[0238] Based on the distance of the centroid position, the wavelength of the ocean internal waves is calculated. The wavelength of the internal waves is determined by the average distance between the characteristic line clusters.

[0239] 7. Analysis and presentation of results.

[0240] 7.1. Result visualization.

[0241] The detection results are displayed visually, including the morphological characteristics, spatial distribution and directional characteristics of the internal waves.

[0242] Use visualization tools (such as MATLAB software visualization, etc.) to generate a result image containing an internal wave geographic location window and overlay it on the geographic information map to intuitively display the distribution of ocean internal waves. The internal wave geographic location window image corresponding to the SAR image is shown in the figure below. Fig.10 shown.

[0243] 7.2. Result analysis

[0244] Statistical analysis is performed on the morphological characteristics, propagation direction and wavelength of internal waves.

[0245] Through time series analysis, the dynamic changes and periodic characteristics of internal waves are studied to provide effective data support for marine environmental monitoring and scientific research.

[0246] Through the above detailed steps, the automated detection and analysis of ocean internal waves can be realized, providing accurate internal wave characteristic information, which is helpful for marine environment monitoring and resource management.

[0247] Based on the above-mentioned on-board SAR image ocean internal wave detection method provided by the embodiment of the present invention, the embodiment of the present invention also provides a SAR image ocean internal wave detection device, such as Fig.11 As shown, the SAR image ocean internal wave detection device includes a generation module 1101 , a determination module 1102 and a classification module 1103 .

[0248] A generating module 1101 is used to generate an ocean region image based on a target region in a SAR image, wherein the ocean region image includes an ocean internal wave region;

[0249] A determination module 1102 is used to determine an edge feature line set of the ocean internal wave region based on an edge detection operator method, so as to determine the morphological features of the ocean internal wave region based on the edge feature line set, wherein the edge feature line set includes a plurality of edge feature lines;

[0250] The determination module 1102 is further configured to determine a target edge feature line that meets multiple threshold ranges among the plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line;

[0251] A classification module 1103 is used to determine the direction information corresponding to the target edge characteristic line, classify the target edge characteristic line, so as to determine the direction distribution characteristics of the ocean internal wave, wherein the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction;

[0252] The determination module 1102 is also used to process the ocean internal wave area image corresponding to the ocean internal wave area through a hierarchical clustering method based on the morphological characteristics, the spatial distribution characteristics and the directional distribution characteristics to determine the centroid position of the ocean internal wave, and determine the wavelength information of the ocean internal wave based on the centroid position.

[0253] Optionally, the generating module 1101 is further configured to divide the image portion corresponding to the ocean internal wave region into a plurality of image blocks, so as to generate an ocean region image based on a target image block among the plurality of image blocks that meets a preset image quality condition.

[0254] Accordingly, the determination module 1102 is further used to determine the position information of the ocean internal wave region relative to the ocean region image based on a sliding window method, and the size of the sliding window is determined based on the wavelength of the preset ocean internal wave. The feature information in the image region corresponding to the ocean internal wave region is extracted using the position information determined based on the sliding window, and the feature information is used to describe the interference features in the image. Bandpass filtering is performed on the image region corresponding to the ocean internal wave region based on the feature information to remove the interference features and generate a processed ocean region image.

[0255] Optionally, the generation module 1101 is specifically used to perform histogram statistics and normalization processing on multiple image blocks respectively, and generate normalized histogram curves corresponding to the multiple image blocks respectively; determine the maximum peak positions of the multiple normalized histogram curves and the grayscale values ​​corresponding to the maximum peak positions respectively; determine the target grayscale value within a preset grayscale range among the multiple grayscale values, so as to determine the image block corresponding to the target grayscale value as the target image block that meets the preset image quality conditions.

[0256] Optionally, the generation module 1101 is specifically used to perform geo-referencing on the SAR image to determine the geographical location information corresponding to the SAR image; combine the geo-referenced SAR image with a land mask corresponding to the geographical location information to shield the land data in the SAR image and determine the ocean area in the SAR image; and determine the ocean area whose ocean depth meets a preset depth threshold as the target area.

[0257] Optionally, the determination module 1102 is specifically used to calculate the first gradient value in the horizontal direction and the second gradient value in the vertical direction of each pixel in the ocean area image based on the Sobel operator method; determine the gradient modulus and gradient direction of each pixel based on the first gradient value and the second gradient value to determine the target pixel among the pixels, and the gradient modulus of the target pixel is the maximum value of the local gradient modulus; determine the initial edge feature line according to the gradient modulus corresponding to the target pixel;

[0258] Accordingly, the generating module 1101 is specifically configured to connect adjacent initial edge feature lines based on the gradient direction by a morphological closing operation method to generate edge feature lines.

[0259] Optionally, the threshold range includes a curvature range, an entropy value range, a total length range of edge feature lines, a length range and a number range of initial edge feature lines;

[0260] Among them, the curvature range includes 0.98 to 0.999, the entropy value range includes below 3.97, the total length range of edge feature lines includes more than 300, and the length range and number range of initial edge feature lines include at least 4 initial edge feature lines with a length greater than 30.

[0261] Optionally, the determination module 1102 is specifically used to determine the circumscribed ellipse of the target edge characteristic lines based on the least squares method to determine the directional information corresponding to each target edge characteristic line; classify the directional information corresponding to each target edge characteristic line according to the angular range interval to determine the total length of the target edge characteristic lines in each angular range interval, the angular range intervals include -90 degrees to -45 degrees, -45 degrees to 0 degrees, 0 degrees to 45 degrees, and 45 degrees to 90 degrees; based on the total length of the target edge characteristic lines in each angular range interval, determine the length standard deviation corresponding to each angular range interval; obtain the directional information of the target edge characteristic lines in the angular range interval whose length standard deviation meets the standard deviation threshold, and determine the directional distribution characteristics of the ocean internal waves.

[0262] An embodiment of the present invention further provides an electronic device, comprising: at least one processor and a memory in communication with the at least one processor. The memory stores a computer program executable by the at least one processor, and when the at least one processor executes the computer program, the electronic device executes the method of the embodiment of the present invention.

[0263] An embodiment of the present invention further provides a non-transitory machine-readable medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is used to cause the computer to execute the method of the embodiment of the present invention.

[0264] An embodiment of the present invention further provides a computer program product, including a computer program, wherein the computer program, when executed by a processor of a computer, is used to enable the computer to execute the method of the embodiment of the present invention.

[0265] refer to Fig.12 , a block diagram of an electronic device that can be used as a server or client of an embodiment of the present invention will now be described, which is an example of a hardware device that can be applied to various aspects of the present invention. Electronic devices are intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0266] like Fig.12 As shown, the electronic device includes a computing unit 1201, which can store data stored in a read-only memory (ROM)

[0267] The computer program in the computing unit 1201, the ROM 1202 or the computer program loaded from the storage unit 1208 into the random access memory (RAM) 1203 is used to perform various appropriate actions and processes. In the RAM 1203, various programs and data required for the operation of the electronic device can also be stored. The computing unit 1201, the ROM 1202 and the RAM 1203 are connected to each other via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0268] Multiple components in the electronic device are connected to the I / O interface 1205, including: an input unit 1206, an output unit 1207, a storage unit 1208, and a communication unit 1209. The input unit 1206 can be any type of device that can input information to the electronic device, and the input unit 1206 can receive input digital or character information, and generate key signal input related to user settings and / or function control of the electronic device. The output unit 1207 can be any type of device that can present information, and can include but is not limited to a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 1208 can include but is not limited to a disk, an optical disk. The communication unit 1209 allows the electronic device to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and can include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0269] The computing unit 1201 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1201 include, but are not limited to, a CPU, a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1201 performs the various methods and processes described above. For example, in some embodiments, the method embodiments of the present invention may be implemented as a computer program, which is tangibly contained in a machine-readable medium, such as a storage unit 1208. In some embodiments, part or all of the computer program may be loaded and / or installed on an electronic device via ROM 1202 and / or communication unit 1209. In some embodiments, the computing unit 1201 may be configured to perform the above-described method in any other appropriate manner (e.g., by means of firmware).

[0270] The computer programs for implementing the methods of the embodiments of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer programs are executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer programs may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0271] In the context of an embodiment of the present invention, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable signal medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0272] It should be noted that the term "including" and its variations used in the embodiments of the present invention are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". The modifications of "one" and "multiple" mentioned in the embodiments of the present invention are illustrative rather than restrictive. Those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more".

[0273] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present invention are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0274] The various steps described in the method implementation methods provided in the embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method implementation methods may include additional steps and / or omit the steps shown. The scope of protection of the present invention is not limited in this respect.

[0275] The term "embodiment" in this specification refers to specific features, structures or characteristics described in conjunction with the embodiment that can be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. The various embodiments in this specification are described in a related manner, and the same or similar parts between the various embodiments refer to each other. In particular, for the device, equipment, and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts refer to the partial description of the method embodiment.

[0276] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of patent protection. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the attached claims.

Claims

1. A method for detecting ocean internal waves from satellite SAR images, characterized in that: include: Generate an ocean region image based on the target region in the SAR image, wherein the ocean region image includes an ocean internal wave region; Determine a set of edge feature lines of the ocean internal wave region based on an edge detection operator, so as to determine the morphological features of the ocean internal wave region based on the set of edge feature lines, wherein the set of edge feature lines includes a plurality of edge feature lines; Determine a target edge feature line that meets multiple threshold ranges among the plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line; Determine the direction information corresponding to the target edge characteristic line, classify the target edge characteristic line, so as to determine the direction distribution characteristics of the ocean internal wave, wherein the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction; Based on the morphological characteristics, the spatial distribution characteristics and the directional distribution characteristics, the ocean internal wave area image corresponding to the ocean internal wave area is processed by a hierarchical clustering method to determine the centroid position of the ocean internal wave, and the wavelength information of the ocean internal wave is determined based on the centroid position.

2. The method according to claim 1, characterized in that After generating an ocean area image based on the target area in the SAR image, it also includes: Dividing the image portion corresponding to the ocean internal wave area into a plurality of image blocks, so as to generate an ocean area image based on a target image block among the plurality of image blocks that meets a preset image quality condition; Determine the position information of the ocean internal wave area relative to the ocean area image based on a sliding window method, wherein the size of the sliding window is determined based on a preset wavelength of the ocean internal wave; Extracting feature information in an image area corresponding to the ocean internal wave area using the position information determined based on the sliding window, wherein the feature information is used to describe interference features in the image; Based on the characteristic information, a bandpass filtering process is performed on the image area corresponding to the ocean internal wave area to remove the interference characteristics and generate a processed image of the ocean area.

3. The method according to claim 2, characterized in that The step of dividing the image portion corresponding to the ocean internal wave region into a plurality of image blocks so as to generate an ocean region image based on a target image block among the plurality of image blocks that meets a preset image quality condition comprises: Performing histogram statistics and normalization processing on the multiple image blocks respectively to generate normalized histogram curves corresponding to the multiple image blocks respectively; Respectively determining the maximum peak positions of a plurality of the normalized histogram curves and the grayscale values ​​corresponding to the maximum peak positions; A target grayscale value within a preset grayscale range is determined from the plurality of grayscale values, so that an image block corresponding to the target grayscale value is determined as a target image block that meets the preset image quality condition.

4. The method according to claim 1, characterized in that: The generating of the ocean area image based on the target area in the SAR image comprises: Performing geo-registration on the SAR image to determine geographical location information corresponding to the SAR image; Combining the geo-referenced SAR image with a land mask corresponding to the geographic location information to mask the land data in the SAR image and determine the ocean area in the SAR image; An ocean area whose ocean depth meets a preset depth threshold is determined as the target area.

5. The method according to claim 1, characterized in that: The method based on the edge detection operator determines the edge feature line set of the ocean internal wave region, so as to determine the morphological features of the ocean internal wave region based on the edge feature line set, including: Calculate the first gradient value in the horizontal direction and the second gradient value in the vertical direction of each pixel point in the ocean area image respectively based on the Sobel operator method; Determine a gradient modulus and a gradient direction of each of the pixel points based on the first gradient value and the second gradient value, so as to determine a target pixel point among the pixel points, wherein the gradient modulus of the target pixel point is a maximum value of a local gradient modulus; Determine an initial edge feature line according to the gradient modulus corresponding to the target pixel point; Based on the gradient direction, adjacent initial edge feature lines are connected by a morphological closing operation method to generate the edge feature line.

6. The method according to claim 1, characterized in that The threshold range includes a curvature range, an entropy value range, a total length range of edge feature lines, a length range and a number range of the initial edge feature lines; Among them, the curvature range includes 0.98 to 0.999, the entropy value range includes below 3.97, the total length range of the edge feature line includes more than 300, and the length range and number range of the initial edge feature lines include at least 4 initial edge feature lines with a length greater than 30.

7. The method according to claim 1, characterized in that The determining of the direction information corresponding to the target edge characteristic line and classifying the target edge characteristic line to determine the directional distribution characteristics of the ocean internal wave includes: Determine the circumscribed ellipse of the target edge feature line based on the least square method to determine the direction information corresponding to each of the target edge feature lines; Classify the target edge feature lines according to the angle range intervals corresponding to the direction information to determine the total length of the target edge feature lines in each angle range interval, wherein the angle range intervals include -90 degrees to -45 degrees, -45 degrees to 0 degrees, 0 degrees to 45 degrees, and 45 degrees to 90 degrees; Based on the total length of the target edge feature line in each of the angle range intervals, determining the length standard deviation corresponding to each of the angle range intervals; The direction information of the target edge characteristic line within the angle range interval whose length standard deviation meets the standard deviation threshold is obtained to determine the directional distribution characteristics of the ocean internal wave.

8. A SAR image ocean internal wave detection device, characterized in that: include: A generating module, used for generating an ocean region image based on a target region in a SAR image, wherein the ocean region image includes an ocean internal wave region; A determination module, configured to determine a set of edge feature lines of the ocean internal wave region based on an edge detection operator, so as to determine the morphological features of the ocean internal wave region based on the set of edge feature lines, wherein the set of edge feature lines includes a plurality of edge feature lines; The determination module is further configured to determine a target edge feature line that meets multiple threshold ranges among the plurality of edge feature lines in the edge feature line set, so as to determine the spatial distribution characteristics of the ocean internal wave based on the target edge feature line; A classification module, used to determine the direction information corresponding to the target edge characteristic line, classify the target edge characteristic line, so as to determine the direction distribution characteristics of the ocean internal wave, wherein the direction information includes the angle between the major axis of the circumscribed ellipse of the target edge characteristic line and the horizontal direction; The determination module is also used to process the ocean internal wave area image corresponding to the ocean internal wave area through a hierarchical clustering method based on the morphological characteristics, the spatial distribution characteristics and the directional distribution characteristics to determine the centroid position of the ocean internal wave, and determine the wavelength information of the ocean internal wave based on the centroid position.

9. An electronic device, comprising: A processor, and a memory storing a program, wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 7.

10. A non-transitory machine-readable medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Ocean internal wave forecast method based on synthetic aperture radar image and internal wave model

    CN102253385A

  • SAR image airport target detection method based on edge features

    CN106251332A

  • Marine internal wave detection algorithm based on multi-scale mathematical morphological feature fusion

    CN109410228A

  • Automatic detection method for internal wave area of satellite SAR image

    CN112991309A

  • Apparatus and method for measuring internal waves using radar

    KR1020150045285A

Cited By

  • SAR image-based internal wave stripe positioning method, system and device

    CN120198509A

  • Internal wave fringe positioning method, system and device based on SAR image

    CN120198509B